What distributed storage are you using?

Hey all,

I’ve been using NFS for some months now to share user-uploaded files on
a Rails-based music community site. The files are mainly MP3 and images.

I’m currently investigating alternative systems to share the files
between the systems, because of poor performance of NFS in our setup and
to better scale in the future.

MogileFS seems interesting, scales well and is heavily used on some Web
sites. I also want to test some distributed file systems (at the
OS-level) as it would be less intrusive.

What are your experiences? Do you have any hints?

Thanks,

Philippe

You might also want to look at Amazon’s S3. Inexpensive, and by default
it
is replicated.

On 5/11/07, Philippe J. [email protected] wrote:


Posted via http://www.ruby-forum.com/.


Chris B.
[email protected]

On May 11, 2007, at 4:22 AM, Philippe J. wrote:

setup and

Philippe

Hi Philippe-

Your best bet for a shared posix compliant clustering filesystem
that will not require you to change your code to use it is GFS

We use this heavily as a shared filesystem between app server nodes.
It holds the rails app code as well as all the page and fragment
caches. So any one node in the cluster can generate or expire a cache
and its instantly mirrored to all nodes.

GFS is in every way superior to NFS. But it does require SAN.

Cheers-
– Ezra Z.
– Lead Rails Evangelist
[email protected]
– Engine Y., Serious Rails Hosting
– (866) 518-YARD (9273)

Hi,

GFS seems very interesting but unfortunately I’m not sure shared
storage is a possibility for now. I hope it would. Ezra, your setup
looks amazing :slight_smile:

Right now were using GPFS and evaluating lustre. The admins haven’t
really come to a conclusion as to which direction were going. The
permissions required to run GPFS have a bad smell in my opinion.

GPFS is not free, I’ll try the other alternatives before evaluating
it. Lustre seems a very good option. What do you think?

Ezra, do you have any experience with options not requiring shared
storage?

Thanks all for your feedback,

Philippe

Right now were using GPFS and evaluating lustre. The admins haven’t
really come to a conclusion as to which direction were going. The
permissions required to run GPFS have a bad smell in my opinion.

–R