A lot of what you are hearing from people who talk down about your lifestyle is fear. They know one way of doing something. If you move them out of their comfort zone they have a visceral reaction. When they talk to you about where you live and what you are doing they apply that situation to themselves and they have to shoot it full of holes to validate themselves. They fear change. fear making a mistake. fear living away from people.
I work in the city in an office. Everyone I work with knows that on the weekend I am in the mountains, working on my farm. They ask what I did each Monday because they are interested. It isn't something they want to do but it is different and interesting. They says it sounds like a lot of work....they are right. It is nonstop work. And the most gratifying thing I have ever done. I flew my drone last weekend and got pictures of my homesite, after it had the footings put in for my house. I made that the background for my work computer......and had a coworker stop by to see the picture....a mountainside with a clearing and a house. While shaking his head, he said "You are in the middle of nowhere."
I just smile. I did the city living for years. Then I "escaped" to the suburbs, only to slowly discover that I was in a carefully crafted prison.
When I am in "the middle of nowhere" I feel free.