If your idea of a great vacation means being near the water, head to Oak Island. Whatever you choose to do here, you're unlikely to tire of those pretty views.
Oak Island is a water-surrounded land mass in Babylon. If you're searching for other places to explore around the area, you can't beat Robert Moses Beach.