High-precision arithmetic
- Category
- STANDARD MATHEMATICS
- Definition
- Arithmetic carried out with substantially more digits than standard machine floating-point calculations.
- Math Level
- TECHNICAL
- Index Excerpt
- arbitrary precision; multiprecision
High-precision arithmetic carries calculations with substantially more numerical digits than ordinary machine floating-point arithmetic.
It is useful when values are extremely small, cancellation is severe, or a sign must be checked against rounding error. More digits can strengthen a numerical calculation, but they do not by themselves prove that the formula, truncation or method is correct.
See also: numerical precision, numerical stability, interval arithmetic, convergence.