You'll probably see Cathedrale St-Front in the skyline before you actually find this amazing building. Take a seat inside if it's open or just appreciate the facade from outside.
To explore this principal church, find your way to Old Town. There are plenty of other worthwhile attractions in this area, like Perigueux Golf Club, Museum of Art and Archeology of Perigord, and Place de la Clautre.