This itinerary includes all the hot springs, public pools and bathing places that I've visited and liked.
Most local pools in the country are very nice, there is always a pool and a hot tub. Many also offer a sauna, steam room, cold pot and water slides. So don't be afraid to try one! They're the cheapest way to bathe in Iceland.