See if you can attend a service at Green Synagogue. You'll learn about some of the customs and practices of the Jewish religion.
When you've spent some time at this Jewish house of worship in Rezekne, why not make your way to Art House, St. Nicholas Old-Believers Church, and Our Lady of Sorrows Roman Catholic Church? They're near Green Synagogue and also popular with many travelers.