I don't know what the laws are in your area, or if you're concerned about leaving things as you found. Regardless, here's how we get water at our hunting camp.
We did some water-witching (don't start guys) and found a spring. We dug down about 8 feet and sunk two 45 gallon pickle barrels into the hole. We cut the top off the first and screwed the second to it. We also drilled holes in the first around the sides and bottom. We filled the bottom of the sunken assembly with about a foot of gravel. We had made another hole in the side of the second barrel to run the waterline. We passed the line through and on the inside installed a 90 degree elbow pointing down and to that added enough line to have it (with a foot valve) submerged in water. The pickle barrels are nice because they come with lids that you can screw on to prevent debris from falling in.
You could do the same close to this creek - but again, I don't know if you have concerns. We did this way up in the middle of knowhere.