parallel processing fine balance

1 view (last 30 days)
I am running a fairly straightforward loop on a single machine, and want to take advantage of parallel processing (parfor on heaps).
Each iteration of the loop is supposed to take about the same time.
I am splitting between each worker equally, but I am unsure on how to treat the remainer, and am unsure whether this even makes a diffence.
Let's assume I have 3 workers and 19 iterations. I could do 7,7,5 or 7,6,6. Theoretically, they are both limited by the slower worker (on average either one with 7 iterations), so it wouldn't seem like it makes much of a difference.
Any insight on this would be helpful - namely which approach should I use.

Accepted Answer

Edric Ellis
Edric Ellis on 17 Apr 2020
Edited: Edric Ellis on 17 Apr 2020
You're quite right that in this case, you're always inevitably going to be held up by the slowest worker. It's almost impossible to predict which of your two approaches would be faster - I'd suggest simply measuring the execution time for each case.
  1 Comment
Raphael Alhadef
Raphael Alhadef on 17 Apr 2020
Thanks, I did some preliminary testing but got mixed results, and was wondering if there are best practices that could be applied to my case.

Sign in to comment.

More Answers (0)




Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!