GCC 2.95 regression test strategy

Regression Testing

One of the critical steps in making releases is regression testing. For GCC 2.95 regression tests have been performed against EGCS 1.1.2.

Since it is impossible to test every platform, several popular platforms were selected for regression testing. The goal is for GCC 2.95 to have zero regressions relative to EGCS 1.1.2 for gcc, g++, g77, objc, libstdc++, libio, and libg++.

Regression Testing Status

Platform	build	regressions	libg++ tests	fast-fixinc
alpha-dec-osf4.0	OK	OK	OK	OK
alphaev5-unknown-linux-gnu	OK	OK	OK	N/A
hppa1.1-hp-hpux10.20	OK	OK	OK	OK
i386-pc-freebsd2.2.6	OK	OK	OK	OK
i386-pc-freebsd3.0	OK	OK	OK	OK
i586-pc-linux-gnu	OK	OK	OK	N/A
i686-pc-linux-gnulibc1	OK	OK	UNTESTED	N/A
i686-pc-linux-gnu	OK	OK	OK	N/A
i686-pc-sco3.2v5.0.5	OK	libstdc++ typename8.C sig13.C new3.C	OK	N/A
m68k-hp-bsd4.4	OK	OK	OK	OK
mips-sgi-irix6.5	OK	OK	OK	OK
{rs6000,powerpc}-ibm-aix4.2	OK	OK	OK	OK
powerpc-ibm-linux-gnu	OK	OK	OK	N/A
sparc-sun-solaris2.5	OK	OK	OK	OK
sparc-sun-solaris2.7	OK	OK	OK	OK
sparc-sun-sunos4.1	OK	OK	OK	OK
sparc-sun-linux-gnu	OK	OK	OK	N/A

Package/Feature Testing

Platform	linux-2.2.10	glibc-2.1.1	redhat-6.0	lapack
alphaev6-unknown-linux-gnu	OK	FAILS
hppa1.1-hp-hpux10.20	N/A	N/A	N/A	-O2 OK -O3 -funroll-loops fails
i586-unknown-linux-gnu	OK	OK
i686-unknown-linux-gnu	OK	OK	compat-binutils compat-egcs kdelibs korganizer python sgml-tools	OK
powerpc-unknown-linux-gnu	2.2.6 OK	OK	OK
sparc-sun-solaris2.5	N/A	N/A	N/A	-O2 OK
sparc-unknown-linux-gnu	OK

Package testing notes

Note the linux kernel, modules and related code must be compiled with -fno-strict-aliasing as the linux kernel violates ANSI/ISO C standards used to perform type based alias analysis

.

In addition to performing regression testing we want to test major software packages with GCC 2.95. This list is not complete (I would like to add at least one major C++ and Fortran package).

• C++ package(s)
• Fortran package(s)