Typically, your private (id_rsa) and public (id_rsa.pub) keys will be stored under ~/.ssh
From what you wrote, my assumption is that you will have to copy your id_rsa.pub key to their server as password authentication over SSH is not allowed.
Did they provide you with instructions how to...