From: BRYAN@SU-SIERRA.ARPA (Doug Bryan)
Subject: floating point number radix
Date: Fri, 18-Oct-85 22:39:57 EDT [thread overview]
Date: Fri Oct 18 22:39:57 1985
Message-ID: <8510190642.AA26485@UCB-VAX> (raw)
We have a question for all you model number gurus out there:
[3.5.7(6)]
The reference manual states that the minimum number of binary digits, B,
required after the point in the binary mantissa of a floating point
number is...
ceiling (D * ln(10)/ln(2) + 1.0)
where D is the minimal number of decimal digits in the decimal mantissa.
Consider D = 3...
ceiling (3 * ln(10)/ln(2) + 1.0) = ceiling (10.9657) = 11
But... is not 10 binary digits sufficient to represent 3 decimal digits?
2**(-10) < 10**(-3)
We think the "+ 1.0" in the above expression can be removed.
doug bryan and geoff mendal
-------
next reply other threads:[~1985-10-19 2:39 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
1985-10-19 2:39 Doug Bryan [this message]
-- strict thread matches above, loose matches on Subject: below --
1985-10-19 2:39 floating point number radix Doug Bryan
1985-10-20 20:17 ` dik
1985-10-19 17:50 "Keith F. Lynch"
replies disabled
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox