h8s-2646 Renesas Electronics Corporation., h8s-2646 Datasheet - Page 645

• Manufacturer Part Number: h8s-2646
• Description: Renesas 16-bit Single-chip Microcomputer H8s Family/h8s/2600 Series
• Manufacturer: Renesas Electronics Corporation.

A/D Conversion Precision Definitions: H8S/2646 Group A/D conversion precision definitions
are given below.
• Resolution
• Offset error
• Full-scale error
• Quantization error
• Nonlinearity error
• Absolute precision
The number of A/D converter digital output codes
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from the minimum voltage value B'0000000000 (H'00) to
B'0000000001 (H'01) (see figure 16.10).
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from B'1111111110 (H'3E) to B'1111111111 (H'3F) (see
figure 16.10).
The deviation inherent in the A/D converter, given by 1/2 LSB (see figure 16.9).
The error with respect to the ideal A/D conversion characteristic between the zero voltage and
the full-scale voltage. Does not include the offset error, full-scale error, or quantization error.
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.
Rev. 5.00 Sep 22, 2005 page 619 of 1136
Section 16 A/D Converter
REJ09B0257-0500