Among your first stops should be The Willows & Wetlands Visitor Centre. Here, you'll be able to orient yourself and pick up some great ideas before you begin exploring.
This tourist information center is located in Taunton, a place that has plenty of things going for it! Muchelney Abbey, and Somerset Towpath are other interesting sightseeing opportunities nearby when you've finished up at The Willows & Wetlands Visitor Centre.