One of your first stops should be Hammerfest Tourist Information. Here, you'll be able to orient yourself and get some great tips before you start exploring.
When you've finished up at this tourist information center in Hammerfest, why not check out Royal and Ancient Polar Bear Society, St Michaels Catholic Church, and Fuglenes? They're not very far from Hammerfest Tourist Information and also popular with many tourists.