TheWorksheets.com

INTRODUCTION TO COMPUTATIONAL MATHEMATICS

However, a computer can only represent finite precision, so we are not guaranteed to retain all digits from the initial number. Let’s consider a hypothetical “decimal” computer with at most 5 digits in the mantissa. The floating-point representation of x obtained on this computer, after rounding, is given by xˆ = fl(x) = 0.12346×10− ...