A couple of possible fixes I can recommend.
Check the position of the rotation center. Do ensure it is at the very center of your propeller assembly.
Try disabling the “Initialize with potential flow” under simulation control and see if that helps stop the increase in lift.
You can reduce the Relaxation factor for field p, Relaxation factor for equation U, Relaxation factor for equation k and Relaxation factor for equation omega by 0.2 each to try to improve simulation stability at the cost of increased simulation time.
Do keep the gradient schemes under numerics and numerical solver to guass linear as leastsquares may cause simulation instability. Generally we should aim to get the simulation running with first order schemes first before moving on to higher order schemes.
Try changing the solver for velocity, Turbulent kinetic energy solver, Specific turbulence dissipation solver to smooth solver if all the above fixes do not work.
Ensure you implement these changes individually as if we do identify the problem, you would want to know which setting is causing the problem.