Ways to compare the performance of different Ruby implementations

Greetings,

I have recently become interested in Ruby and I was curious what the
correct approach was in measuring the performance of the various VM
against one another. I.e. YARV, JRuby, MRI etc. What kind of
applications or benchmarks are good for this purpose.

Thanks in advance,

Carter.

The best benchmark is your own application. Synthetic benchmarks are
good at one thing: giving synthetic perf comparisons.

Thanks for the reply. I guess perhaps my original post might not have
been too clear. I am actually not interested in running applications
per se but in understanding the strengths and weaknesses of each of
the respective platforms. I am trying to figure out what runs
fast/slow on each platform and what each of them are good at
performance wise. In terms of techniques I am curious how to proceed.

Thank in advance,

Carter.

Carter C. wrote:

Thanks for the reply. I guess perhaps my original post might not have
been too clear. I am actually not interested in running applications
per se but in understanding the strengths and weaknesses of each of
the respective platforms. I am trying to figure out what runs
fast/slow on each platform and what each of them are good at
performance wise. In terms of techniques I am curious how to proceed.

There’s the ruby benchmark suite:

I believe Antonio is about to do another blog post on the various
implementations on various platforms.

GL!
-rp

Thanks Roger. I will check it out.

On 05/13/2010 12:51 AM, Carter C. wrote:

… I am actually not interested in running applications
per se but in understanding the strengths and weaknesses of each of
the respective platforms. I am trying to figure out what runs
fast/slow on each platform and what each of them are good at
performance wise. In terms of techniques I am curious how to proceed.

I suggest you look at, and understand the qualitative differences
between the implementations before getting into benchmarking.

ruby 1.8 only supports green threads
ruby 1.9 supports native threads with a GIL Global Interpreter Lock
jruby supports native threads

There are obviously other differences and other implementations.

Edward

I have been looking at the source code. Are there other ways of
getting into the differences between the implementations?

On Thu, May 13, 2010 at 9:54 AM, Edward Middleton

Ask the implementers? :slight_smile: