matplotlib-devel Mailing List for matplotlib

On Tue, Jan 25, 2011 at 6:12 PM, Darren Dale <dsd...@gm...> wrote:
> There is still an outstanding issue that must be taken care of before
> we migrate. The conversion routines create a basemap repository out of
> trunk/toolkits/basemap, and matplotlib repository out of
> trunk/matplotlib. Still, the matplotlib repo (at
> github.com/darrendale/matplotlib) is over 200 MB. One can search the
> objects in the large packfile, and find that there are still
> references to basemap data in the matplotlib repo. I don't know how it
> got in there, nor how to remove it.
I went through the exercise of identifying the largest blob, as
described near the end of http://progit.org/book/ch9-7.html :
$ git verify-pack -v
objects/pack/pack-fa44ca56d7ec3964e562494f2fe08203143074bd.idx | sort
-k 3 -n | tail -3
3b8b6c010f8ce59afac1e811b1bbc3efc21b770a blob 9154481 9089827 62749144
6328b70e665b58ed7f5aa1e110418cbb3facc07a blob 9331200 94297 156884507
f784efc1518b10dff33673ad9a7a1ac3a7d107d5 blob 51399604 14333430 162328624
$ git rev-list --objects --all | grep f784efc1518b10dff
f784efc1518b10dff33673ad9a7a1ac3a7d107d5 toolkits/basemap/data/gshhs_h.txt
This shell script is supposed to identify which commits have that blob
in their tree (http://stackoverflow.com/questions/223678/git-which-commit-has-this-blob):
---
#!/bin/sh
obj_name="1ドル"
shift
git log "$@" --pretty=format:'%T %h %s' \
| while read tree commit subject ; do
 if git ls-tree -r $tree | grep -q "$obj_name" ; then
 echo $commit "$subject"
 fi
done
---
but it comes up empty, so now I'm stuck. Any ideas would be greatly appreciated.

On Tue, Jan 25, 2011 at 3:06 PM, Darren Dale <dsd...@gm...> wrote:
> On Tue, Jan 25, 2011 at 1:31 PM, Pauli Virtanen <pa...@ik...> wrote:
>> 2011年1月25日 12:19:37 -0500, Darren Dale wrote:
>>> There is a potential problem converting the entire basemap history to
>>> git. In svn commit 4418, trunk/toolkits had basemap and basemap-testing
>>> directories. In commit 4419, basemap was renamed basemap-0.9.6.1, so
>>> there was only basemap-0.9.6.1 and basemap-testing. In commit 4420,
>>> basemap-testing is renamed basemap. The git history only goes back as
>>> far as svn4420, it looks like the conversion routines get confused by
>>> the temporary absence of the basemap directory.
>>>
>>> I'm trying to find a workaround, but if I can't... ?
>>
>> You can maybe do it like this:
>>
>> 1) Write matplotlib.rules so that all of the directories where basemap
>> stuff has been ends in the basemap repository. (I'm assuming this does
>> not error out...)
>
> Aha! I thought I had tried that. Thanks.
>
>> 2) This will create a number of separate heads in the basemap repo that
>> do not share common history.
>>
>> 3) Add graft rules in matplotlib.grafts to stitch the disconnected
>> history graphs together.
>
> Mercifully, the latest checkout of svn2git seems to take care of that.
> I've developed a wicked headache.
>
> Jeff, the repository is temporarily available at
> https://github.com/darrendale/basemap . It would be really helpful if
> you would have a look at the network graph at
> https://github.com/darrendale/basemap/network to make sure there are
> no surprises, maybe clone the repository and check that the working
> directory is identical to your svn checkout.
There is still an outstanding issue that must be taken care of before
we migrate. The conversion routines create a basemap repository out of
trunk/toolkits/basemap, and matplotlib repository out of
trunk/matplotlib. Still, the matplotlib repo (at
github.com/darrendale/matplotlib) is over 200 MB. One can search the
objects in the large packfile, and find that there are still
references to basemap data in the matplotlib repo. I don't know how it
got in there, nor how to remove it.
Jeff: was there ever any basemap data committed directly to trunk/matplotlib?
Pauli: could I trouble you to have a look at my rules file, maybe you
will notice something I overlooked?
(https://github.com/darrendale/mpl2git/blob/master/matplotlib.rules)
Any other ideas?
Thanks
Darren

On Tue, Jan 25, 2011 at 1:31 PM, Pauli Virtanen <pa...@ik...> wrote:
> 2011年1月25日 12:19:37 -0500, Darren Dale wrote:
>> There is a potential problem converting the entire basemap history to
>> git. In svn commit 4418, trunk/toolkits had basemap and basemap-testing
>> directories. In commit 4419, basemap was renamed basemap-0.9.6.1, so
>> there was only basemap-0.9.6.1 and basemap-testing. In commit 4420,
>> basemap-testing is renamed basemap. The git history only goes back as
>> far as svn4420, it looks like the conversion routines get confused by
>> the temporary absence of the basemap directory.
>>
>> I'm trying to find a workaround, but if I can't... ?
>
> You can maybe do it like this:
>
> 1) Write matplotlib.rules so that all of the directories where basemap
> stuff has been ends in the basemap repository. (I'm assuming this does
> not error out...)
Aha! I thought I had tried that. Thanks.
> 2) This will create a number of separate heads in the basemap repo that
> do not share common history.
>
> 3) Add graft rules in matplotlib.grafts to stitch the disconnected
> history graphs together.
Mercifully, the latest checkout of svn2git seems to take care of that.
I've developed a wicked headache.
Jeff, the repository is temporarily available at
https://github.com/darrendale/basemap . It would be really helpful if
you would have a look at the network graph at
https://github.com/darrendale/basemap/network to make sure there are
no surprises, maybe clone the repository and check that the working
directory is identical to your svn checkout.
Darren

2011年1月25日 12:19:37 -0500, Darren Dale wrote:
> There is a potential problem converting the entire basemap history to
> git. In svn commit 4418, trunk/toolkits had basemap and basemap-testing
> directories. In commit 4419, basemap was renamed basemap-0.9.6.1, so
> there was only basemap-0.9.6.1 and basemap-testing. In commit 4420,
> basemap-testing is renamed basemap. The git history only goes back as
> far as svn4420, it looks like the conversion routines get confused by
> the temporary absence of the basemap directory.
> 
> I'm trying to find a workaround, but if I can't... ?
You can maybe do it like this:
1) Write matplotlib.rules so that all of the directories where basemap 
stuff has been ends in the basemap repository. (I'm assuming this does 
not error out...)
2) This will create a number of separate heads in the basemap repo that 
do not share common history.
3) Add graft rules in matplotlib.grafts to stitch the disconnected 
history graphs together.
This happened also with Numpy: part of the old history had a this sort of 
a rename and so part of the history was not connected to the main graph. 
So I just stitched the graphs together manually.
-- 
Pauli Virtanen

There is a potential problem converting the entire basemap history to
git. In svn commit 4418, trunk/toolkits had basemap and
basemap-testing directories. In commit 4419, basemap was renamed
basemap-0.9.6.1, so there was only basemap-0.9.6.1 and
basemap-testing. In commit 4420, basemap-testing is renamed basemap.
The git history only goes back as far as svn4420, it looks like the
conversion routines get confused by the temporary absence of the
basemap directory.
I'm trying to find a workaround, but if I can't... ?

Sorry it was my fault: /dev/shm was not mounted in the chroot where I
built the package so multiprocessing wasn't able to create semaphores.
It's building fine now.
On Thu, Jan 20, 2011 at 22:58, Sandro Tosi <mo...@de...> wrote:
> Hi all,
> I'm fighting against this weirdness since some days: if I build mpl
> debian package on my system, it builds normally, but if I build the
> package in a clean chroot it fails, and I only noticed because I want
> to create a link in doc/build/html/_static dir, that's missing. and
> I'm wondering why! I can't seem to find a clear answer to that, so I'm
> asking for any advice yo might have.
>
> The full log of the package build in the chroot is at [1] (it's quite
> large expanded); at the end of the file there are some ls -lR to try
> to identify what's going wrong.
>
> [1] http://people.debian.org/~morph/matplotlib_1.0.1-1_amd64.build.bz2
>
> Thanks in advance,
> --
> Sandro Tosi (aka morph, morpheus, matrixhasu)
> My website: http://matrixhasu.altervista.org/
> Me at Debian: http://wiki.debian.org/SandroTosi
>
-- 
Sandro Tosi (aka morph, morpheus, matrixhasu)
My website: http://matrixhasu.altervista.org/
Me at Debian: http://wiki.debian.org/SandroTosi