Freezing Architecture-Dependent Gems such as Rmagick, Ferret

A lot has been made recently about the need to freeze your gems for
production deployment on a shared server so your application can depend
on
it’s own gem version instead of being subjected to whatever gem is
installed
on the server, but does this rule of thumb come with an exception?
Architecture dependent gems such as RMagick, Ferret and Unicode have
dependencies that cannot be included as a frozen gem, and with these
types
of gems you still are left depending on the one installed the server?

Yes or no?

Thanks,

Tim C.
[email protected]