You don't have to be of strong faith to enjoy the peaceful atmosphere of St. Martin Cathedral. Check when the next mass starts or when it's open for general viewing.
To explore this principal church, find your way to Thetford. You'll find plenty of other interesting attractions in the area, like Richmond Park Golf Club, Wayland Wood, and Melsop Farm Park.