If you’re a New Yorker, the idea of spending the weekend in Connecticut is probably not top of mind. But, as it turns out, it should be. This waterfront town might be best known for its castle-like estates, hedge fund-owner residents and high-end, designer-lined main drag (which goes by the name “the Ave”), but there’s far more culture and charm than meets the eye. And at just 30 miles outside the city—an easy 45 minute train ride from Grand Central—it might be the easiest weekend getaway ever.