East Coast travel destinations

I'm from Massachusetts, and my boyfriend and I are looking for good trips to go on probably between 3-5 days long. Nothing too crazy expensive and no big cities preferably. We haven't taken any trip outside of New England (most gone to Cape Cod, Vermont, Rhode Island, Connecticut and Lake George New York). We enjoy walkable towns, beaches or lakes to walk, hiking trails, winery's and enjoy exploring local hole in the wall restaurants or bars. Any advice on places to check out would be greatly appreciated.