Another idea.
Build a rock dam uphill from it or possibly in it. Put maybe a foot of sand in the bottom of it, then dirt. Then put in plants that'll tolerate both wet and dry, like Joe Pye Weed and trees that like wet like River Birch. This is a rain garden, designed to capture rain water runoff before it goes downstream and creates problems.
I did this upstream of much of the gully that I filled. Have the dam and have filled behind it. Haven't gotten around to putting in plants yet, mainly cuz the sawdust I used mostly for fill isn't decomposed enough for plants yet. Getting close. It hasn't washed away.
Ralph