Paulton are out of the Somerset Premier Cup missing a penalty and losing out to the only goal despite far greater possesion.
Keynsham went ahead as ben harris cut in from the right and hit a low shot into the far corner of the Rovers net.
They had chances as Nathan Legge headed over and Elliott Gibbons fired over.
Legge then had a great run only for Ashley Whitten in the home goal to tip over the crossbar.
As half time approached Legge was tripped in the area. However Jordan Ricketts penalty drive was hit straight at Whitten to save easily.
In the second half Kailan Gould brought a save from the keeper. He then looked to have been fouled in the area only for the referee to turn down Paulton's appeals.
With minutes left Sol Wheatley hit a speculative shot from distance clipping the bar with the keeper beaten.