New England is a high-cost part of the country. Have you priced housing lately?
How stony is your soil? The thing about a pole barn is you have to be able to place the poles exactly where they need to go. Around here you could dig down two feet and hit a rock the size of a house, the only way to place a post would be with dynamite. Pole barns aren't very popular.