HD6432670 Hitachi, HD6432670 Datasheet - Page 771

• Manufacturer Part Number: HD6432670
• Description: (HD64F267x Series) 16-Bit Microcomputer
• Manufacturer: Hitachi

The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from B'1111111110 (H'3FE) to B'1111111111 (H'3FF) (see
figure 16.5).
Nonlinearity error
The error with respect to the ideal A/D conversion characteristic between the zero voltage and
the full-scale voltage. Does not include the offset error, full-scale error, or quantization error
(see figure 16.5).
Absolute precision
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.
Figure 16.4 A/D Conversion Accuracy Definitions
Digital output
111
110
101
100
011
010
001
000
1024
1
1024
2
Ideal A/D conversion
characteristic
Quantization error
1022
1024
1023
1024
Analog
input voltage
FS
Rev. 2.0, 04/02, page 725 of 906