The command is
ssh-keygen -e -f PRIVATE_KEY_FILE > PUBLIC_KEY
You can now append this to your .ssh/authorized_keys file on your openssh server machine.