Among your first stops should be World of James Herriot. Here, you'll be able to orient yourself and get some great ideas before you set out exploring.
When you've spent a bit of time at this Thirsk tourist information center, why not make your way to Thirsk Museum, Thirsk Birds of Prey Centre, and Rural Arts? They're not very far from World of James Herriot and also popular with tourists.