This is the only real laundromat you'll find in Iceland. You may also try The Laundromat Cafe in Reykjavik.

Here, detergent is provided.