I think there should be a way to use the ssh key provided with 'coder gitssh' with the normal ssh command. A possible solution would be to add the private key to the ssh agent on workspace creation.