John, In my Harper and Row's field guide it looks like a Woodland Jumping Mouse. Head and body 3-4". Tail 4.5-6" Sides bright orange, Dorsal band dark.
tail with white tip. Habits -Dives into water when frightened. climbs vines and bushes for berries. Range- New England and Canada s. through PA and Appalachians.