# Performance: system() vs. Garbage Collection or Thread Count **URL:** \ **Category:** Ruby\ **Created:** [October 30, 2007, 5:38pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754 "2007-10-30T17:38:21Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![jazcyk](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/e56c9b/32.png) [@jazcyk](https://www.ruby-forum.com/u/jazcyk)\ **Post date:** [October 30, 2007, 5:38pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754/1 "2007-10-30T17:38:21Z")
Hi, I have a performance problem with the following setup: I use a Ruby script to run a Java stress-test tool (JMeter) using Kernel.system(). The Ruby part is responsible for building configuration files for JMeter, looking at the response from the test, and building a new test configuration for JMeter before it launches the test again. Essentially: 1. Create Initial XML configuration for JMeter (~1sec) 2. Run JMeter using system() for this configuration (~2 mins) 3. system() returns, JMeter ends run, the script is read (~20 secs) 4. A new XML configuration is created for JMeter, goto ‘2’ (~1sec) The JMeter task spawns 400 threads very quickly, and stresses a remote server for about 2 minutes. I am seeing performance and reproducability problems. For example, I set the script to generate the exact same configuration for JMeter every time, and I get wildly different results back from the test. Interestingly, the first test run gives me back the exact results I expected, however, the second test always reports dramatically poorer performance for exactly the same test. I have checked on the server side (I am stressing an Apache setup) and the logs show no problems - the problem is to do with my test setup of Ruby + JMeter. Here are some things that I think are giving anomalous results for the second reading (these anomalie are reproducable and always happen on the second reading): a. JMeter spawns 400 threads per test. The overhead of cleaning up after these threads lasts until the second run is active, slowing it down. Or perhaps the OS hasn’t cleaned up the first 400 threads by the time the second JMeter instance is launched. b. Ruby is garbage collecting in the middle of the second run, causing a dramatic slowdown on the client side. c. JMeter, being Java, is garbage collecting for some reason (although JMeter is started anew with system() for each run, so should be virgin?) d. Some strange interaction between Ruby and Java? If anyone has any advice, particularly on preventing Ruby GC for a certain time, that would be fantastic. I’ve run a lot of tests, and added some sleep() calls for ~20 seconds between runs to try and let things settle wrt threads and memory being cleaned up etc. and this **appears** to have some effect, but still the results are far from stable across runs when they should be. Thanks for reading this far, I appreciate this is a messy request with no clear answer, ---
**Author:** ![jazcyk](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/e56c9b/32.png) [@jazcyk](https://www.ruby-forum.com/u/jazcyk)\ **Post date:** [October 30, 2007, 9:31pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754/2 "2007-10-30T21:31:33Z")
Peter L. wrote: > If anyone has any advice, particularly on preventing Ruby GC for a > certain time, that would be fantastic. I can’t help you with your actual problem, but you should take a look at the GC core module. mortee ---
**Author:** ![jazcyk](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/e56c9b/32.png) [@jazcyk](https://www.ruby-forum.com/u/jazcyk)\ **Post date:** [October 30, 2007, 10:16pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754/3 "2007-10-30T22:16:13Z")
> … you should take a look at > the GC core module. Thanks - I disabled the GC for the duration of the system() task (the JMeter invocation). The issue remained, so I can discount Ruby’s GC as the culprit. My current thinking is leaning to some kind of threads issue, perhaps also something to do with OS X thread limits. ---
**Author:** ![jazcyk](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/e56c9b/32.png) [@jazcyk](https://www.ruby-forum.com/u/jazcyk)\ **Post date:** [October 30, 2007, 10:34pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754/4 "2007-10-30T22:34:12Z")
On Oct 30, 2007, at 5:16 PM, Peter L. wrote: > > … you should take a look at > > the GC core module. > > ## Thanks - I disabled the GC for the duration of the system() task (the JMeter invocation). The issue remained, so I can discount Ruby’s GC as the culprit. My current thinking is leaning to some kind of threads issue, perhaps also something to do with OS X thread limits. Kernel.system forks and execs a new process for the command (via the C library version of system()) so I don’t see how threads in the jmeter process could be affected at all by anything Ruby is doing. In fact Ruby isn’t really ‘doing’ anything other then waiting for the child process to complete. ---
**Author:** ![jazcyk](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/e56c9b/32.png) [@jazcyk](https://www.ruby-forum.com/u/jazcyk)\ **Post date:** [October 30, 2007, 10:35pm UTC](https://www.ruby-forum.com/t/performance-system-vs-garbage-collection-or-thread-count/118754/5 "2007-10-30T22:35:54Z")
> Kernel.system forks and execs a new process for the command (via the > C library version of system()) so I don’t see how threads in the > jmeter process could be affected at all by anything Ruby is doing. > In fact Ruby isn’t really ‘doing’ anything other then waiting for > the child process to complete. That’s excellent info, thankyou. It will help a lot in what I choose to focus on in terms of debugging efforts.