There's quite a garden in Madison Square, where Broadway meets Madison. This is not Madison Square Garden, which isn't on Madison, is a circle and has no garden.
Edit for clarity: Madison Square Garden Arena is fairly well-known among sports and music fans, as well as millions who remember the opening scene of the original Highlander movie. It's on 7th Ave (not Madison); it's a circle (not a Square); and there's not so much as a blade of astroturf (no Garden). This is the basis for what some (mainly New Yorkers) see as a stupid question: Why is it called Madison Square Garden? The answer, of course, is that it's the fourth venue with that name, the first of which was located in the area pictured (say it with me): Madison Square. Where there's a garden.