Message queue IPC implementation on Linux

Question

I have a multi-processed perl system that picks up a lot of files ( may be in 10 Millions ) and works on the them one by one

Since each process must pick up exclusive files I need to have one seperate process that does the file-listing and sends the filenames to a message queue

Each worker-process will query the message-queue , get 10 jobs at a time and execute the 10 jobs until the message-queue is empty

What is the best way of implementing a message queue

• daxim: Gearman, TheSchwartz, Qudo

Answer 1

You could give Queue::Beanstalk a try.

Answer 2

I'd vote for Net::RabbitMQ and rabbitmq