I've read articles, but not recently, that hummingbirds have been known to mistake the brightly colored plastic insulators used on tee posts for flowers. They hover and stick their beaks and tongues into the center of the insulator, if they hit the post at the same time the fence charger has the wire hot....
But that doesnt seem to be the case here.