Check if you can join a group tour at Hotel de Sallegourde. If not, this grand building is still worth seeing from the outside.
You'll be spoiled for sightseeing choice when visiting Old Town. Hotel de Sallegourde is a good place to start here, but there are numerous other fine places to explore. Cathedrale St-Front, Perigueux Golf Club, and Museum of Art and Archeology of Perigord are near the historic landmark and and will cap off your day nicely.