Message 137692 - Python tracker

➜

This issue tracker has been migrated to GitHub , and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

In-reply-to
Author	pitrou
Recipients	bquinlan, pitrou, tbrink
Date	2011年06月05日.13:14:44
SpamBayes Score	2.3376783e-06
Marked as misclassified	No
Message-id	<1307279744.72.0.238869941318.issue11271@psf.upfronthosting.co.za>

Content
Using your test script fixed (on Python 3.3), I get the following numbers: Starting multiproc...done in 2.1014609336853027 s. Starting futures...done in 20.209479093551636 s. Starting futures "fixed"...done in 2.026125907897949 s. So there's a 0.2ms overhead per remote function call here (20/(100100000-100000000)). Can't your chunks() function use itertools.islice()? Also, the chunksize can't be anything else than 1 by default, since your approach is increasing latency of returning results.

Content

Using your test script fixed (on Python 3.3), I get the following numbers:
Starting multiproc...done in 2.1014609336853027 s.
Starting futures...done in 20.209479093551636 s.
Starting futures "fixed"...done in 2.026125907897949 s.
So there's a 0.2ms overhead per remote function call here (20/(100100000-100000000)).
Can't your chunks() function use itertools.islice()?
Also, the chunksize can't be anything else than 1 by default, since your approach is increasing latency of returning results.

History
Date	User	Action	Args
2011年06月05日 13:15:44	pitrou	set	recipients: + pitrou, bquinlan, tbrink
2011年06月05日 13:15:44	pitrou	set	messageid: <1307279744.72.0.238869941318.issue11271@psf.upfronthosting.co.za>
2011年06月05日 13:14:44	pitrou	link	issue11271 messages
2011年06月05日 13:14:44	pitrou	create

homepage