I thought about it for a second. Glad the inspection is done. Part of the problem is in your question.
A barn or out building is not a sub panel but rather its own service, even if served from your house. So don't remove the neutral to ground strap (jumper). Because the barn is its own service you need another ground source. Here that would mean a ground plate or two driven ground rods, this can be different in different jurisdictions.
For clarity, a sub panel would be in the same building. In a sub panel is where you remove the neutral to ground jumper as you only ground your neutral once per service.
I realize it's a play in n words but it's similar to ground and bond, totally different but still
the same.