It depends on which model and if it's designed to withstand the elements. I have a 13kW Northstar from Northern Sales and I would not run it without having some sort of cover for protection. You can see in the photo that water can get in and cause problems. This model isn't that well built to begin with and I wouldn't want to give it any excuse to fail.