Among your first stops should be Canberra and Region Visitors Centre. Here, you'll be able to orient yourself and get some great ideas before you set out exploring.
To explore this tourist information center, find your way to Parkes. There are plenty of other things to see and do in the area, like Parliament House, Australian War Memorial, and National Museum of Australia.