Is inexact subtraction expected?
Show older comments
In Matlab R2018a, I just typed "32885.6-32760" and got back 125.599999999999. Is this type of inexact subtraction expected? If I then type "ans - 125" I get 0.599999999998545, so it's not just a bunch of 9's. Removing the leading 3 or the leading 32 does not give this incorrect answer (i.e. it gives the exact decimal value .6)
Answers (1)
Image Analyst
on 18 Jun 2020
0 votes
It's expected. See the FAQ:
Categories
Find more on Introduction to Installation and Licensing in Help Center and File Exchange
Products
on 18 Jun 2020
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
