If the ball is just an interference fit on the shaft, then if it was me doing the job, then I would slit the ball on both sides with a disc cutter but only cutting to the outer edge of the shaft . Then a sharp chisel would relieve the pressure on the joint and ball should come off.
Mike.