Café Bryggjan is a great, local seafood joint with a lovely view of the harbor. Downstairs is the cafe with coffee, pastries, and soup. Upstairs is an open dining hall with heartier meals where you may catch a net maker at work in the net making shop.
Both are open everyday but close fairly early.