what does the "percentage of occurrences along the Y-axis" mean in fixed point converter app?

1. i want to know the the relation between histogram and the simulation value. Does it mean the probability of 1 of specific bit position?
2. why the histogram will shift to the right for 1 bit when I clearing Signed option?

Answer 1

[Andy Bartlett]

Hi,

The histograms in quantization workflows put each value observed in simulation in a power of two bin.

For example, the values 1.25, 1.51234, and 1.75 are all in the power of two bin from 2 to 4.

The values -4.7, -5.9, and -7.8765432 are all in the power of two bin from -8 to -4.

This documentation page does a very nice job of explaining histogram bins in quantization workflows.

Andy

[lai chengxuan]

Thank you!