Re: [Boost-users] General design question about threading/concurrency

Subject: Re: [Boost-users] General design question about threading/concurrency
From: Matthias Troyer (troyer_at_[hidden])
Date: 2010-10-24 16:57:06

On 24 Oct 2010, at 22:44, Julien Martin wrote:

> Hello,
> I am writing a program that needs to run N simulations with N >10 000.
> Obviously, I cannot instantiate N threads at the same time but I cannot run the simulations sequentially either.
> Can anyone please advise me how to design my program using the boost threading library and concepts please?

Hi Julien,

if you have an 8-core machine you could, e.g. create 8 threads and always run 8 simulations to an end. If the simulations are independent I would rather suggest that you use Boost.MPI  and distribute it on a cluster. A 10000-core cluster can then allow you to run all 10000 simulations simultaneously. We are routinely doing that with several thousand simulations.

Matthias