"Single Precision occupies 32 bits (4 bytes) and has a significand precision of 24 bits. This gives it an accuracy of about 7 decimal digits.
Double precision occupies 64 bits (8 bytes) and has a significand precision of 53 bits. This gives it an accuracy of about 16 decimal digits."
Monday, April 02, 2007
Double Precision Accuracy
via random google search result:
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment