Statistics for Reinforcement learning for telescope optimisation