Testsuites and Test Results

Tue Jun 10 18:24:00 GMT 2003

> Ranjit> 3. For some weird reason that is not immediately
> Ranjit> obvious to me by looking at the testsuite/Makefile,
> Ranjit> my DejaGNU "runtest" is not picked up by make.
> Ranjit> "runtest" is in "/usr/local/bin" and it definitely
> Ranjit> is in my PATH.
>> I haven't had this problem. I usually run make check from the
> libjava build directory though.

After digging around a bit, I finally found out that for
some reason, my runtest from DejaGNU does not accept
"runtest TCLVAR=VALUE" style invocations and that's what's
causing these problems!
FYI, I have DejaGNU 1.4.2, expect 5.34.1 and Tcl 8.3.
The testsuite Makefile ultimately sets RUNTEST to 
"runtest INTERPRETER=yes" and since this command fails,
the Makefile reports that runtest was not found.
So the fix was to remove "INTERPRETER=yes" from the
command line and move it to the generated "site.exp"
as a "set INTERPRETER yes" and sure enough, everything
ran fine after this. 
> Ranjit> 4. Even after this, only about 85 tests are actually
> Ranjit> run (all PASS-es).
>> Which ones appear to be missing?

After the fix, all the libjava tests run for me with
the following results (3.3 for i686-pc-linux-gnu):
		=== libjava Summary ===
# of expected passes		2987
# of unexpected failures	2
# of expected failures		16
# of untested testcases		14
...
FAIL: SyncTest execution - gij test
FAIL: SyncTest execution - gij test
...
UNTESTED: Where execution from source compiled test
UNTESTED: Where output from source compiled test
UNTESTED: Where -O execution from source compiled test
UNTESTED: Where -O output from source compiled test
UNTESTED: inner_1 execution from source compiled test
UNTESTED: inner_1 output from source compiled test
UNTESTED: inner_1 -O execution from source compiled test
UNTESTED: inner_1 -O output from source compiled test
UNTESTED: SyncTest output - gij test
UNTESTED: SyncTest output - gij test
UNTESTED: pr8823 execution from bytecode->native test
UNTESTED: pr8823 output from bytecode->native test
UNTESTED: pr8823 -O execution from bytecode->native test
UNTESTED: pr8823 -O output from bytecode->native test
Ranjit.
-- 
Ranjit Mathew Email: rmathew AT hotmail DOT com
Bangalore, 
INDIA. Web: http://ranjitmathew.tripod.com/