That's not how I remember it.

Here's a decent map I found:
http://www.clubvacationkeywest.com/map-keywestmap.htm

According to Sloppy Joe's website, it's at the corner of Greene and Duval, right in the thick of it.

Wendy
------
Booked: Uniworld Egypt, 2015
Tauck Amsterdam to Budapest, 2016
Paul Gauguin, Societies & Tuamotus 2016