Many time you will find something like this to put into your ssh/config file,
Host myshortname realname.example.com
HostName realname.example.com
IdentityFile ~/.ssh/realname_rsa # private key for realname
User remoteusername
Host myother realname2.example.org
HostName realname2.example.org
IdentityFile ~/.ssh/realname2_rsa # different private key for realname2
User remoteusername
but there is simpler solution, you can just add identity files and they will be tried one by one and you don't have to worry much about config.
$ cat ~/.ssh/config
IdentityFile ~/.ssh/id_rsa
IdentityFile ~/.ssh/some_key
IdentityFile ~/.ssh/other_key