Maybe rig up a bolt to pass thru the bushing while pressing to hopefully keep it from popping out to the side? I'm thinking a bolt thru a flat plate to keep it aligned with the press axis. Effectively making it act like the pin on your press could pass thru the bushing.