This is more of a one liner than a saying.....
The population never changes in the town where I grew up, every time a baby is born a father leaves town!
I believe that quotation should be attributed to the old Hoosier himself, Herb Shriner, my favorite humorist of old:
herb shriner reel - YouTube
I first heard it from Rodney Dangerfield.