alternative to log?

I am multiplying a lot of small numbers (probabilities). in order to avoid underflow, i use the log transformation. this is rather time consuming, so i was wondering whether there is a faster alternative

4 Comments

Maybe you could post some code, to get some hints? If taking the log of many numbers is your bottleneck, there is probably something that can be done to speed it up, but it is impossible to help without seeing code.
bym
bym on 2 Sep 2011
can I ask why you are multiplying a lot of small probabilities? perhaps there is another way to formulate your problem
Have you profiled your code to know this is the bottleneck? Is it possible to distrbute the log and multiplication to across a cluster?
Maybe you could use complementary events?

Sign in to comment.

Answers (2)

Walter Roberson
Walter Roberson on 3 Sep 2011

0 votes

There is a possibility that the fixed-point toolbox might be faster (you would define a fixed point format with a large enough exponent field to take care of your final value), but I suspect that the cost of converting the values into fixed point and doing the software multiplications would be higher than the cost of taking the log.
The symbolic toolbox can handle very small numbers, but again there is the cost of the conversion and software multiplication (but the software multiplication library would at be a fairly well-tuned and robust one in this case.)
Derek O'Connor
Derek O'Connor on 4 Sep 2011

0 votes

No matter what transformation you use, the result, prod(pi, i=1:n) --> 0, so eventually you will get underflow in fixed precision or run out of memory in variable precision or rational arithmetic.
You need to give us more information.

Categories

Tags

Asked:

on 2 Sep 2011

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!