With 4' spans, it's common around here to put up metal. There's metal siding sold for interior applications that's cheaper than the stuff on the outside of the barn. Price it out. You'll have a better finished product anyway.
Rigid foam insulation is hard to beat for the walls, but it can get pricey. Fiberglass insulation @ 24" for 6" walls (R19) isn't exactly cheap either. A lot of folks will have closed-cell insulation sprayed on, as they can just leave it exposed. It's about the most expensive of products, but by the time you're done, you may find that an 1" of closed-cell foam will give you what you need better and cheaper than the other options, especially from the perspective of not having to finish the walls.
Metal ceiling with blown-in cellulose along with closed-cell foam on the walls will give you a pretty functional, economical outcome for the occasionally used barn.