The higher something has to fall, the higher 'gravitational' potential energy it has. Gravity is the force that keeps us on the ground, why when you jump up, you come down and not float or stay in the air longer. The higher up, the more of this force there is.
I hope this helped you!
