Thinking about this a lilttle more, be sure to consider what it would cost to just build a house on it's own and a barn on it's own. I'm all for an apartment in a barn, but that would be a very small, simple place to stay short term. Putting anything extra into it to make it nice and comfortable seems like a waste if your long term goal is to have a stand alone house.
Eddie