You may spot Roman Catholic Cathedral across town before you actually find this grand building. Take a seat inside if the doors are open or just admire the facade from the street.
When you've finished exploring this principal church in Old Town Naxos, why not check out Plaka Beach, Agios Georgios Beach, and Agios Prokopios Beach? They're not too far from Roman Catholic Cathedral and also popular with many tourists.