I will soon be using the Amazon S3 interface on a RoR web app that is
about 50% complete at this point. I grabbed the S3 interface from
Amazon and began looking through the code and I found this:
uses Net::HTTP to interface with S3. note that this interface
be used for smaller objects, as it does not stream the data. if you
to download a 1gb file, it would require 1gb of memory. also, this
creates a new http connection each time. it would be greatly
some connection pooling.
My jaw kinda dropped open at this point as my web app uploads large
files (up to 200 meg in some cases). Has anyone ran into this issue,
and if so how did you go about getting around this? I’m not sure what
they mean by connection pooling to be honest. I thought that referred
to the database connections.