Yeah, gcj won't work without extra arguments if libgcj isn't installed. Instead you can do this, from the libjava build directory: make check RUNTESTFLAGS="lang.exp=err6" That worked. And more importantly, the fix I mentioned did deal with this test case.