Configure Rails app to use certain gem version

Hi all,

I use a shared host (Dreamhost) and have installed my own RMagick gem.
I understood that I need to configure rails that it uses my gem and
not the version on the server.

Can I somehow configure a global configuration file to force my rails
app to use that version of the gem or do I have to change the code?