Subject: [boost] C++ MapReduce performance - compared to C Phoenix
From: Jose (jmalv04_at_[hidden])
Date: 2009-08-31 16:13:57
I wanted to share some performance numbers to encourage others to
write examples or applications using the C++ multi-core mapreduce
library being developed by Craig H.
I ran some tests comparing the C++ version to the C version, for the
word_count example. The tests are run on a X86_64 linux Fedora 10 with
The results below show that the C++ MapReduce (mr) has very similar
performance to the C version (mr-c).
The tests start running phoenix first. Run 3 and 4 show that c++ mr is
slightly faster. When using 1MB MR_L1CACHESIZE (which should be the
best comparison) shows that mr-c is a little bit faster but not much.
Note: The C++ version uses a chunk size of 1MB while the C version
uses by default a chunk size of 64KB (which can be changed with the
Boost list run by bdawes at acm.org, gregod at cs.rpi.edu, cpdaniel at pacbell.net, john at johnmaddock.co.uk