Just outside of Selfoss, there's this wool shop. You'll find a lot of local products (but also some standard souvenirs). So if you are looking for something more unique, you will find it here.

They also sell a lot of Icelandic sweaters (lopapeysa) in many different colors and sizes.