Code coverage of ironruby code

barby · September 23, 2009, 11:25am

Hi
Is there a way to get the code coverage when running RSpec or Test::Unit
stuff with ironruby? It would help me a lot to set build tresholds etc.

Because I guess the C# tools won’t be able to do it and the ruby tools
neither.

Is it in the cards? What would it take to implement something like that
for
IronRuby?

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C.
Blog: http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)

barby · September 23, 2009, 6:10pm

If you want to get coverage numbers for C# code you should be able to
do:

set PERF_TOOLS=%VSINSTALLDIR%\Team Tools\Performance Tools
set DSTDIR=an empty directory to store dlls you want to instrument to
(the tests must load them from here)

instrument each dll for which you want to get the coverage numbers

“%PERF_TOOLS%\vsinstr.exe” /coverage /outputpath:%DSTDIR% your.dll

start code coverage service:

“%PERF_TOOLS%\vsperfcmd.exe” /start:coverage /OUTPUT:report_file

run your unit tests here

stop code coverage service

“%PERF_TOOLS%\vsperfcmd.exe” /shutdown

Open report_file.coverage in VS.

Tomas

From: [email protected]
[mailto:[email protected]] On Behalf Of Ivan Porto
Carrero
Sent: Wednesday, September 23, 2009 2:19 AM
To: ironruby-core
Subject: [Ironruby-core] code coverage of ironruby code

Hi

Is there a way to get the code coverage when running RSpec or Test::Unit
stuff with ironruby? It would help me a lot to set build tresholds etc.

Because I guess the C# tools won’t be able to do it and the ruby tools
neither.

Is it in the cards? What would it take to implement something like that
for IronRuby?

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C.
Blog: http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)

barby · September 23, 2009, 6:46pm

rcov can spit out junit xmlI’m sure it can spit out the xml we want.

Ideally rcov would be ported and usable for both C# and ruby code when
executing tests. Seeing how many people are trying cucumber on ironruby
it
could be a good thing to have early on.

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C.
GSM: +32.486.787.582
Blog: http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)

On Wed, Sep 23, 2009 at 6:15 PM, Thibaut BarrÃ¨re

barby · September 23, 2009, 6:16pm

Maybe we’d have to mix tools to munge the profiling data and provide a
uniformised set in return.
Like:

vsinstr + a port of rcov for windows
mono profiler + port of rcov again on mac / linux

just a thought, but from a user perspective I am definitely interested
to
see a mix of C# and Ruby stacks into one view.

That’s a project on its own though

– Thibaut

On Wed, Sep 23, 2009 at 6:09 PM, Tomas M. <

barby · September 23, 2009, 6:57pm

Anyone out there interested in tackling this? I know Ivanâ€™s busy, but
someone out there might have time â˜º

From: [email protected]
[mailto:[email protected]] On Behalf Of Ivan Porto
Carrero
Sent: Wednesday, September 23, 2009 9:45 AM
To: [email protected]
Subject: Re: [Ironruby-core] code coverage of ironruby code

rcov can spit out junit xml
I’m sure it can spit out the xml we want.

Ideally rcov would be ported and usable for both C# and ruby code when
executing tests. Seeing how many people are trying cucumber on ironruby
it could be a good thing to have early on.

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C.
GSM: +32.486.787.582
Blog: http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)

On Wed, Sep 23, 2009 at 6:15 PM, Thibaut BarrÃ¨re
<[email protected]mailto:[email protected]> wrote:
Maybe we’d have to mix tools to munge the profiling data and provide a
uniformised set in return.

Like:

vsinstr + a port of rcov for windows
mono profiler + port of rcov again on mac / linux

just a thought, but from a user perspective I am definitely interested
to see a mix of C# and Ruby stacks into one view.

That’s a project on its own though

– Thibaut

On Wed, Sep 23, 2009 at 6:09 PM, Tomas M.
<[email protected]mailto:[email protected]>
wrote:

If you want to get coverage numbers for C# code you should be able to
do:

set PERF_TOOLS=%VSINSTALLDIR%\Team Tools\Performance Tools

set DSTDIR=an empty directory to store dlls you want to instrument to
(the tests must load them from here)

instrument each dll for which you want to get the coverage numbers

“%PERF_TOOLS%\vsinstr.exe” /coverage /outputpath:%DSTDIR% your.dll

start code coverage service:

“%PERF_TOOLS%\vsperfcmd.exe” /start:coverage /OUTPUT:report_file

run your unit tests here

stop code coverage service

“%PERF_TOOLS%\vsperfcmd.exe” /shutdown

Open report_file.coverage in VS.

Tomas

From:
[email protected]mailto:[email protected]
[mailto:[email protected]mailto:[email protected]]
On Behalf Of Ivan Porto C.
Sent: Wednesday, September 23, 2009 2:19 AM
To: ironruby-core

Subject: [Ironruby-core] code coverage of ironruby code

Hi

Is there a way to get the code coverage when running RSpec or Test::Unit
stuff with ironruby? It would help me a lot to set build tresholds etc.

Because I guess the C# tools won’t be able to do it and the ruby tools
neither.

Is it in the cards? What would it take to implement something like that
for IronRuby?

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C.
Blog: http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)

Ironruby-core mailing list
[email protected]mailto:[email protected]
http://rubyforge.org/mailman/listinfo/ironruby-core