One of your first stops should be Fiordland National Park Visitor Centre. Here, you'll be able to find your bearings and pick up some great ideas before you start exploring.
This tourist information center in Te Anau comes recommended by many travelers, so make sure it features on your must-see list. Don't think that's all there is to do here, though. There are a lot more spots waiting for you to explore after Fiordland National Park Visitor Centre. Kepler Track, Te Anau Wildlife Centre, and Te Anau Golf Course are nearby.