Good grief.... you have an earthen dam and earthen spillway. You NEVER want water flowing over the dam OR a spillway. The spillway is for EMERGENCY overflow only to try and prevent the dam from washing out if its topped. That's why the spillway is supposed to be very, very wide and completely level, and a much longer, gentler slope than the dam. Your main device for controlling the level of the water behind the dam is your pipe. You can build a box with a drainpipe in it, and control the level of the pond with boards on the box. Or you can add spacer rings to the top of the pipe. But you want that pipe to be able to handle any and all water that comes into that pond so it leaves the pond fast, and the level of the pond never ever approaches the spillway. You do not want water on the spillway ever. It's for emergencies and a last-ditch device before dam breech.
From the looks of your topo map, and the size of the pond indicated, you have a HUGE, steep, watershed above your pond. Just 1" of rain on one acre of land that drains entirely into that 1/4 acre pond has the potential to raise the water level 4". How many acres drain into that pond? Let's guess at 5 acres for an example.
A 1" rain on 5 acres will give you 5 inch acres of water.
Compress that to a 1/4 acre pond, and you have 20" of potential water level rise in an hour (assuming the ground is saturated and nothing soaks in).
Now let's assume you have no drainpipe.
And your spillway is 10' wide.
You're going to try and drain 20" of water from 1/4 acre through a 10' wide path in an hour without washing out any dirt...... think about that.
You want that drainpipe sized to control the pond level, and you want it large enough to handle a 100 year rain in your area, whatever that may be, on the watershed above your pond, however many acres that may be, and then size the pipe larger than that plus a 10% fudge factor for safe measure. The spillway is to safeguard against anything more than a 100 year rain that the drainpipe won't normally handle.
Now that is not scientific, I have no idea if its correct. And I have no idea if that's what you should actually do. I know my father always planned our yard drainage around 100 year rains, and we had 2 of them when I was a kid, and our yard didn't flood and the neighbors almost lost their houses to washouts. Our town just had a 500 year flood a few weeks ago, and everything was planned on 100 year floods. Many folks lost a lot.
Plan ahead and you most likely won't have problems. Good luck in your project. Get some professional advice.