primary school question!

8 views (last 30 days)
Wenjuan
Wenjuan on 28 Nov 2020
Answered: Image Analyst on 28 Nov 2020
well, a silly question
why 0.07*400 is not equal to 28?
see screenshot;

Sign in to answer this question.

Answers (1)

Image Analyst
Image Analyst on 28 Nov 2020
Truncation error due to double's only using 64 bits instead of an infinite number of bits. It will be off a very small amount, eps(28). See the FAQ for a thorough discussion:
https://matlab.fandom.com/wiki/FAQ#Why_is_0.3_-_0.2_-_0.1_.28or_similar.29_not_equal_to_zero.3F

Categories

Find more on MATLAB in Help Center and File Exchange

Tags

Products


Release

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!