matplotlib-devel Mailing List for matplotlib

John Hunter wrote:
>This is probably failing on the tex/latex temporary files. I spent
>some time initially trying to figure out how to get these to go into
>~/.tex.cache but didn't succeed. If anyone knows how to direct
>tex/latex to put the various *.aux, *.log, etc, files in a specified
>directory, pass it my way.
> 
>
 From "man tex" on FC3, the section on environment variables:
 TEXMFOUTPUT
 Normally, TeX puts its output files in the current 
directory.
 If any output file cannot be opened there, it tries to 
open it
 in the directory specified in the environment variable 
TEXM-
 FOUTPUT. There is no default value for that 
variable. For
 example, if you say tex paper and the current directory 
is not
 writable, if TEXMFOUTPUT has the value /tmp, TeX 
attempts to
 create /tmp/paper.log (and /tmp/paper.dvi, if any 
output is
 produced.)

John Hunter wrote:
>>>>>>"Fernando" == Fernando Perez <Fer...@co...> writes:
> 
> 
> Fernando> This was in a long-running session with very large
> Fernando> memory allocations, but it dawned on me that
> Fernando> get_dvipng_version(self) should cache its return value.
> Fernando> There's no point in forcing a popen() call every single
> Fernando> time, is there?
> 
> It already does cache the version
> 
> def get_dvipng_version(self):
> if self.dvipngVersion is not None: return self.dvipngVersion
> sin, sout = os.popen2('dvipng --version')
> ...snip...
> 
> I think the reason it is failing in your case is that is each renderer
> creation creates a new TexManager instance. The cache should be on a
> class basis and not on a per instance basis (slaps self on head).
> Moving
> 
> self.dvipngVersion = None
> 
> to the class level and out of __init__ should suffice. I made this
> change, and similar changes in texmanager and backend_agg, so that
> caching is shared between instances. Update from CVS and let me know
> if everything still works :-)
swamped at the moment, but I'll let you know if I see problems when I 
get a chance.
> Fernando> I also just saw pylab crash when a user was trying to
> Fernando> run with $PWD being something he didn't have write
> Fernando> access to. Are there any checks in the code to fall
> Fernando> back to /tmp or something sensible if texmanager can't
> Fernando> write the temp files it needs? Sorry for not giving a
> Fernando> traceback, but I only saw this on someone else's screen
> Fernando> while helping them, and for some odd reason it's not
> Fernando> happening on my box.
> 
> This is probably failing on the tex/latex temporary files. I spent
> some time initially trying to figure out how to get these to go into
> ~/.tex.cache but didn't succeed. If anyone knows how to direct
> tex/latex to put the various *.aux, *.log, etc, files in a specified
> directory, pass it my way.
I don't really know, sorry. My texpertise is pretty limited, as you know :)
Thanks for the fixes!
f

>>>>> "Fernando" == Fernando Perez <Fer...@co...> writes:
 Fernando> This was in a long-running session with very large
 Fernando> memory allocations, but it dawned on me that
 Fernando> get_dvipng_version(self) should cache its return value.
 Fernando> There's no point in forcing a popen() call every single
 Fernando> time, is there?
It already does cache the version
 def get_dvipng_version(self):
 if self.dvipngVersion is not None: return self.dvipngVersion
 sin, sout = os.popen2('dvipng --version')
 ...snip...
I think the reason it is failing in your case is that is each renderer
creation creates a new TexManager instance. The cache should be on a
class basis and not on a per instance basis (slaps self on head).
Moving
 self.dvipngVersion = None
to the class level and out of __init__ should suffice. I made this
change, and similar changes in texmanager and backend_agg, so that
caching is shared between instances. Update from CVS and let me know
if everything still works :-)
 Fernando> I also just saw pylab crash when a user was trying to
 Fernando> run with $PWD being something he didn't have write
 Fernando> access to. Are there any checks in the code to fall
 Fernando> back to /tmp or something sensible if texmanager can't
 Fernando> write the temp files it needs? Sorry for not giving a
 Fernando> traceback, but I only saw this on someone else's screen
 Fernando> while helping them, and for some odd reason it's not
 Fernando> happening on my box.
This is probably failing on the tex/latex temporary files. I spent
some time initially trying to figure out how to get these to go into
~/.tex.cache but didn't succeed. If anyone knows how to direct
tex/latex to put the various *.aux, *.log, etc, files in a specified
directory, pass it my way.
Thanks,
JDH

Hi all,
I just had this crash in mpl:
/usr/lib/python2.3/site-packages/matplotlib/texmanager.py in 
get_dvipng_version(self)
 299 def get_dvipng_version(self):
 300 if self.dvipngVersion is not None: return 
self.dvipngVersion
--> 301 sin, sout = os.popen2('dvipng --version')
 302 for line in sout.readlines():
 303 if line.startswith('dvipng '):
/usr/lib/python2.3/os.py in popen2(cmd, mode, bufsize)
 614 def popen2(cmd, mode="t", bufsize=-1):
 615 import popen2
--> 616 stdout, stdin = popen2.popen2(cmd, bufsize)
 617 return stdin, stdout
 618 __all__.append("popen2")
/usr/lib/python2.3/popen2.py in popen2(cmd, bufsize, mode)
 145 specified, it sets the buffer size for the I/O pipes. 
The file objects
 146 (child_stdout, child_stdin) are returned."""
--> 147 inst = Popen3(cmd, False, bufsize)
 148 return inst.fromchild, inst.tochild
 149
/usr/lib/python2.3/popen2.py in __init__(self, cmd, capturestderr, bufsize)
 40 if capturestderr:
 41 errout, errin = os.pipe()
---> 42 self.pid = os.fork()
 43 if self.pid == 0:
 44 # Child
OSError: [Errno 12] Cannot allocate memory
This was in a long-running session with very large memory allocations, 
but it dawned on me that get_dvipng_version(self) should cache its 
return value. There's no point in forcing a popen() call every single 
time, is there?
I don't know the texmanager code, so I don't want to touch it myself. 
But if the idea is OK, a simple property tag is enough to cache:
In [3]: def cached():
 ...: try:
 ...: return cached.cachedvalue
 ...: except AttributeError:
 ...: cached.cachedvalue=42
 ...: return cached.cachedvalue
 ...:
In [4]: cached()
Out[4]: 42
I also just saw pylab crash when a user was trying to run with $PWD 
being something he didn't have write access to. Are there any checks in 
the code to fall back to /tmp or something sensible if texmanager can't 
write the temp files it needs? Sorry for not giving a traceback, but I 
only saw this on someone else's screen while helping them, and for some 
odd reason it's not happening on my box.
Cheers,
f