Python multiprocessing

Question

I have a "master" process that needs to spawn some child processes.

How can I manage these child processes? (for example, restart if the process is dead)

Thanks!

Answer 1

Have a look at celery.

• Jordan: You are a god among men. Thanks for saving me a weekend.
• mikerobi: @Jordan, that is the best comment ever posted to Stack Overflow.

Answer 2

If you use the multiprocessing package, every child process has is_alive method you can check. So one option to to hold a list of all running processes and periodically check is_alive and re-spawn dead processes.

If you're on POSIX system, you can also catch SIGCHLD (using signal) and get notified when a child process dies.

Answer 3

This will help http://docs.python.org/library/multiprocessing.html

edit : a good tutorial http://www.ibm.com/developerworks/aix/library/au-multiprocessing/