How to limit rounding in matrix division

6 views (last 30 days)
Maine MacConville
Maine MacConville on 15 Mar 2016
Answered: Chris Turnes on 15 Mar 2016
I've a 2D matrix with values ranging from about 40 to 100. I'm dividing each entry value by 98 and for some reason, it's rounding my answers to 0 and 1. How can I limit this and get more decimal places? Or even better, how can I store each entry as a fraction? The matrix dimensions are 3456x5184 uint8.

Answers (1)

Chris Turnes
Chris Turnes on 15 Mar 2016
Your last sentence has the answer: your data type is uint8. Dividing a uint8 by a uint8 is going to give you another integer, so you won't get any decimal places.
Your options are to convert to either double or single and do the operation, or as you said you can store each entry as a fraction. Since they are uint8, every entry of the matrix will contain the numerator, and every denominator is 98 -- so you already have all of the information.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!