HD6412240 RENESAS [Renesas Technology Corp], HD6412240 Datasheet - Page 564

• Manufacturer Part Number: HD6412240
• Description: Renesas 16-Bit Single-Chip Microcomputer H8S Family / H8S/2200 Series
• Manufacturer: RENESAS [Renesas Technology Corp]

Section 14 A/D Converter
A/D Conversion Precision Definitions
H8S/2245 Group A/D conversion precision definitions are given below.
Rev.3.00 Mar. 26, 2007 Page 522 of 772
REJ09B0355-0300
Resolution
The number of A/D converter digital output codes
Offset error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from the minimum voltage value B'0000000000 (H'000) to
B'0000000001 (H'001) (see figure 14.10).
Full-scale error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from B'1111111110 (H'3FE) to B'1111111111 (H'3FF) (see
figure 14.10).
Quantization error
The deviation inherent in the A/D converter, given by 1/2 LSB (see figure 14.9).
Nonlinearity error
The error with respect to the ideal A/D conversion characteristic between the zero voltage and
the full-scale voltage. Does not include the offset error, full-scale error, or quantization error.
Absolute precision
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.