Kasuga Shrine is a holy site where the spiritually minded meet to pray. You can do the same, or respectfully observe others in worship.
When you've spent a bit of time at this Himeji sacred place, why not make your way to Himeji Central Park, Himeji Castle, and Taiyo Park? They're close to Kasuga Shrine and also a hit with many tourists.