Stop by Tourism Office for some useful tips before you set out exploring. It's an one-stop shop for travel information.
You'll find this tourist information center in Auxerre. Once you've done everything you want to at Tourism Office, consider visiting nearby Stade de l'Abbe-Deschamps, Auxerre Cathedral, and Auxerre Clock Tower.