I suggest doing the Hop On Hop Off bus route . Several stops were interesting. Here is the brochure:

HoHo Bus Reykjavik

We enjoyed:
Whales of Iceland Museum
Laugavegur Shopping Street
Hallgrímskirkja church