homepage

Hi,
Running test_distutils as a non root user fails for me. Running it as a
root user works.
System information:
uname -a
Linux Matrix 2.6.22.5-31-default #1 SMP 2007年09月21日 22:29:00 UTC i686
i686 i386 GNU/Linux
./python --version
Python 3.1a2+
======================================================================
ERROR: test_no_optimize_flag
(distutils.tests.test_bdist_rpm.BuildRpmTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
 File
"/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/tests/test_bdist_rpm.py",
line 114, in test_no_optimize_flag
 cmd.run()
 File
"/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/command/bdist_rpm.py",
line 363, in run
 self.spawn(rpm_cmd)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/cmd.py", line
368, in spawn
 spawn(cmd, search_path, dry_run=self.dry_run)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/spawn.py", line
31, in spawn
 _spawn_posix(cmd, search_path, dry_run=dry_run)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/spawn.py", line
139, in _spawn_posix
 % (cmd[0], exit_status))
distutils.errors.DistutilsExecError: command 'rpmbuild' failed with exit
status 1
======================================================================
ERROR: test_quiet (distutils.tests.test_bdist_rpm.BuildRpmTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
 File
"/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/tests/test_bdist_rpm.py",
line 74, in test_quiet
 cmd.run()
 File
"/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/command/bdist_rpm.py",
line 363, in run
 self.spawn(rpm_cmd)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/cmd.py", line
368, in spawn
 spawn(cmd, search_path, dry_run=self.dry_run)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/spawn.py", line
31, in spawn
 _spawn_posix(cmd, search_path, dry_run=dry_run)
 File "/home/shuaib/Tools/GSoC2009/py3k/Lib/distutils/spawn.py", line
139, in _spawn_posix
 % (cmd[0], exit_status))
distutils.errors.DistutilsExecError: command 'rpmbuild' failed with exit
status 1
----------------------------------------------------------------------

can you try to remove all /var/tmp/rpm-tmp.* directories and relaunch
the tests as a simple user ?
I would like to see if this problem doesn't occur because this temp
directory was previously created by root.

Tried. Same failure.

can you tell me the owner and permission setttings for:
- /var/tmp/rpm-tmp.*
- /var/tmp
(and if /var/tmp is a symklink, if it points to /tmp, 
 and in that case the same info for /tmp)

drwxrwxrwt 5 root root 4096 2009年04月29日 15:46 tmp
And after a number of failed test runs...
-rw-r--r-- 1 shuaib users 893 2009年04月29日 16:01 rpm-tmp.11523
-rw-r--r-- 1 shuaib users 893 2009年04月29日 16:01 rpm-tmp.11524
-rw-r--r-- 1 shuaib users 893 2009年04月29日 15:46 rpm-tmp.13270

Can you remove 
/var/tmp/foo-0.1-1-buildroot
and try again ?
if it fails, can you look at the permissions of
/var/tmp/foo-0.1-1-buildroot/dev/null/lib

I've already tried the removal of foo... directory. Failed.
I think the following might be interesing...
drw-rw-rw- 3 shuaib users 4096 2009年04月29日 15:46 null
Permissions for null/lib are as follows:
drwxr-xr-x 3 shuaib users 4096 2009年04月29日 15:46 lib

I temporarily changed the Fedora bot to run Fedora-14-i386. The
same failures can be observed:
======================================================================
ERROR: test_no_optimize_flag (distutils.tests.test_bdist_rpm.BuildRpmTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/tests/test_bdist_rpm.py", line 121, in test_no_optimize_flag
 cmd.run()
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/command/bdist_rpm.py", line 365, in run
 self.spawn(rpm_cmd)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/cmd.py", line 366, in spawn
 spawn(cmd, search_path, dry_run=self.dry_run)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/spawn.py", line 32, in spawn
 _spawn_posix(cmd, search_path, dry_run=dry_run)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/spawn.py", line 163, in _spawn_posix
 % (cmd[0], exit_status))
distutils.errors.DistutilsExecError: command 'rpmbuild' failed with exit status 1
======================================================================
ERROR: test_quiet (distutils.tests.test_bdist_rpm.BuildRpmTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/tests/test_bdist_rpm.py", line 81, in test_quiet
 cmd.run()
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/command/bdist_rpm.py", line 365, in run
 self.spawn(rpm_cmd)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/cmd.py", line 366, in spawn
 spawn(cmd, search_path, dry_run=self.dry_run)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/spawn.py", line 32, in spawn
 _spawn_posix(cmd, search_path, dry_run=dry_run)
 File "/home/buildbot/buildarea/3.x.krah-fedora/build/Lib/distutils/spawn.py", line 163, in _spawn_posix
 % (cmd[0], exit_status))
distutils.errors.DistutilsExecError: command 'rpmbuild' failed with exit status 1
----------------------------------------------------------------------
Ran 177 tests in 2.967s

The patch from #11599 should let us get the full error message, for a start.

May be last report is not related to initial two years old . It seems to me it is introduced recently after some optimization related to creation of pyc files and this is not OpenSUSE related.

Here's the error message:
"""
error: File not found: /tmp/tmpsga9lh/foo/build/bdist.linux-i686/rpm/BUILDROOT/foo-0.1-1.i386/usr/local/lib/python3.3/site-packages/foo.pyc
error: File not found: /tmp/tmpsga9lh/foo/build/bdist.linux-i686/rpm/BUILDROOT/foo-0.1-1.i386/usr/local/lib/python3.3/site-packages/foo.pyo
 File not found: /tmp/tmpsga9lh/foo/build/bdist.linux-i686/rpm/BUILDROOT/foo-0.1-1.i386/usr/local/lib/python3.3/site-packages/foo.pyc
 File not found: /tmp/tmpsga9lh/foo/build/bdist.linux-i686/rpm/BUILDROOT/foo-0.1-1.i386/usr/local/lib/python3.3/site-packages/foo.pyo
"""
http://python.org/dev/buildbot/all/builders/AMD64%20Fedora%20without%20threads%203.x/builds/934/steps/test/logs/stdio 

> Here's the error message:
> error: File not found: /tmp/tmpsga9lh/foo/build/bdist.linux-i686/rpm/BUILDROOT/foo-0.1-1.i386/usr/local/lib/python3.3/site-packages/foo.pyc
Thanks. Some rpm tool is looking for byte-compiled files in the old location, but I’ve fixed sdist (used under the cover by bdist_rpm) recently to use __pycache__ directories. There must be some other code path that reports wrong locations for byte-compiled files, similar to the get_outputs methods that I fixed in another commit, but I’m unable to find it right now. I’ll try to install Fedora in a VM when I get more time.

For the buildbot failures see #13307. I think that it's indeed a
different issue, since AFAIK __pycache__ didn't exist when this one
was opened.

Buildbot passes, certainly thanks to the fix for #13307.

Hm, did I close this too hastily? The original report was not about the buildbot; does the buildbot run as a non-root user with the same version that was reported in the first message? If no, can someone try to reproduce the issue in the same conditions as the OP?

The buildbot runs as non-root, so it should reproduce this
issue (but it's green).
The original report was for 2.6/3.1, so I think closing this as
out-of-date is reasonable.