Expectations for runs of irtests

Zac_Brown · April 5, 2010, 8:22am

Hi all,

I’ve run irtests and I know failures expected. I am however unclear on
how to determine whether or not I’ve got the expected results for my
current build of IronRuby. Could someone shed some light on what I’m to
expect? I presently get somewhere in the realm of ~22 failures from a
quick skim of the irtest log I saved.

Any light shed would be appreciated :).

-Zac

Zac_Brown · April 5, 2010, 8:26am

There should be no failures. Could you send us the results? Could you
reproduce the failures consistently?

Tomas

Zac_Brown · April 5, 2010, 8:30am

I can

http://hudson.colliertech.org that’s a windows build machine with
en-us
culture

Met vriendelijke groeten - Best regards - Salutations
Ivan Porto C. - Mob: +32.486.787.582
Web: http://whiterabbitconsulting.eu - http://flanders.co.nz
Twitter: http://twitter.com/casualjim
Author of IronRuby in Action (http://manning.com/carrero)
Microsoft IronRuby/C# MVP

On Mon, Apr 5, 2010 at 8:25 AM, Tomas M.
<[email protected]

Zac_Brown · April 5, 2010, 7:02pm

For the 6k failures in netinterop, please try the following:

Setup the environment (dev.bat or dev.ps1 or whatever :))
rbt
cd interop
…\Scripts\csc

This should recompile the fixtures so that they are linked against the
the unsigned Git binaries instead of the delay-signed Merlin binaries.
I’ll be fixing this during our cleanup period next month.

For the ARGF failures… What is the output of “git config
core.autocrlf”? It should be true, but irtests should also be checking
that. I’ll look into it and let you know. I’m not sure why you are
getting the other errors.

JD

Zac_Brown · April 5, 2010, 4:51pm

Hi,

This first link is irtests run with the latest github changes:
http://dl.dropbox.com/u/3527783/irtests-04042010-ruby18.log

This link is after I made a couple changes in Builtins\FileOps.cs,
Builtins\KernelOps.cs and the associated MSpec tests:
http://dl.dropbox.com/u/3527783/irtests-04052010-ruby18.log

This is a patch for the changes I made, in case its relevant to you
guys:
http://dl.dropbox.com/u/3527783/0001-Add-support-for-A-atime-in-Kernel-test-and-appropria.patch

-Zac

Zac_Brown · April 5, 2010, 8:20pm

Yes and no. It is expected that some of the tests will have issues on
CLR4, but I thought Tomas had fixed most of them. Either way, pull the
latest from the v1.0 branch, and those binaries should work.

JD

Zac_Brown · April 7, 2010, 4:08am

So I pulled the latest changes from v1.0 HEAD and still get the compile
errors in Tests\Interop. Going to run irtests again tonight and see what
I get.

-Zac

Zac_Brown · April 7, 2010, 7:23am

In this case, Zac is not trying to run the tests using .NET 4 (which can
be done using “irtests.bat --clr4”). And so the .NET 3.5 C# compiler
should be used. However, dev.bat calls vsvars32.bat which seems to add
all versions of .NET to the path, with .NET 4
(C:\Windows\Microsoft.NET\Framework\v4.0.30128) before .NET 3.5
(C:\Windows\Microsoft.NET\Framework\v3.5) if you have .NET 4 installed.
As a result, the C# 4 compiler is being invoked.

Zac, for now, you could try adding
C:\Windows\Microsoft.NET\Framework\v3.5 to the start of the path.

Zac_Brown · April 5, 2010, 7:29pm

Hi,

Just fyi, it doesn’t appear that ‘rbt’ is an alias setup by dev.bat yet.
I figured it out though that you meant Ruby\Tests.

When I run the “…\Scripts\csc” in Ruby\Tests\Interop I get the
following:

method\fixtures\classes.rb(1040,43): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func’ and
‘Microsoft.Scripting.Utils.Func’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1076,71): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1080,74): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1115,46): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1120,45): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1229,36): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func’ and
‘Microsoft.Scripting.Utils.Func’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1265,64): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1269,67): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1304,39): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
method\fixtures\classes.rb(1309,38): error CS0104: ‘Func’ is an
ambiguous reference between ‘System.Func<T,bool>’ and
‘Microsoft.Scripting.Utils.Func<T,bool>’
c:\Windows\Microsoft.NET\Framework\v4.0.30128\mscorlib.dll: (Location of
symbol related to previous error)
e:\code\ironruby.git\Merlin\Main\bin\Debug\Microsoft.Scripting.Core.dll:
(Location of symbol related to previous error)
E:\code\ironruby.git\Merlin\Main\Languages\Ruby\Tests\Interop>

Is that the expected output?

Setting the irtests to run again now.

-Zac