From: Henrique <henriquemagalhaes@gmail.com>
Subject: Re: Float conversion
Date: Thu, 29 Jul 2010 11:21:52 -0700 (PDT)
Date: 2010-07-29T11:21:52-07:00 [thread overview]
Message-ID: <cb7a898b-fe3b-424e-adfa-9dcc22ea570c@l20g2000yqm.googlegroups.com> (raw)
In-Reply-To: 1d1txn4x3r5xn.1trm4gx9n87gm$.dlg@40tude.net
On Jul 29, 12:35 pm, "Dmitry A. Kazakov" <mail...@dmitry-kazakov.de>
wrote:
> ------------------------
> var1 9.99900024414063E+02
> var4 9.99900085449219E+02
>
> When rounded to 6 decimal digits both are same. But the underlying base
> binary type is longer than 6 digits.
>
> P.S. It is always useful to think of floating point numbers as intervals
> (which they are) rather than numbers.
>
> --
> Regards,
> Dmitry A. Kazakovhttp://www.dmitry-kazakov.de
As I declared the type with 6 digits, I expected that it would make
the comparison only for these digits (this would gave var4 = var1).
Do I always need to manually truncate the float number to the number
of desired digits before making a comparison of them?? So what is the
advantage of declaring it as "digits 6"?
Thanks
next prev parent reply other threads:[~2010-07-29 18:21 UTC|newest]
Thread overview: 35+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-07-29 12:23 Float conversion Henrique
2010-07-29 12:44 ` Jacob Sparre Andersen
2010-07-29 12:46 ` Dmitry A. Kazakov
2010-07-29 15:08 ` Georg Bauhaus
2010-07-29 15:10 ` Georg Bauhaus
2010-07-29 15:35 ` Dmitry A. Kazakov
2010-07-29 18:21 ` Henrique [this message]
2010-07-29 19:08 ` Jeffrey R. Carter
2010-07-29 19:15 ` Dmitry A. Kazakov
2010-07-30 1:30 ` Phil Clayton
2010-07-30 8:43 ` Dmitry A. Kazakov
2010-07-30 13:14 ` Phil Clayton
2010-07-30 14:34 ` Dmitry A. Kazakov
2010-07-31 15:12 ` Stephen Leake
2010-08-03 1:07 ` Phil Clayton
2010-08-03 3:31 ` Shark8
2010-08-03 10:38 ` Georg Bauhaus
2010-08-04 7:27 ` Stephen Leake
2010-08-04 16:15 ` Georg Bauhaus
2010-08-04 16:32 ` Phil Clayton
2010-08-04 7:26 ` Stephen Leake
2010-08-04 12:52 ` Robert A Duff
2010-08-04 14:32 ` Dmitry A. Kazakov
2010-08-04 19:36 ` Simon Wright
2010-08-04 19:46 ` Dmitry A. Kazakov
2010-08-04 20:29 ` Georg Bauhaus
2010-08-05 12:05 ` Stephen Leake
2010-08-07 5:54 ` Shark8
2010-08-07 8:56 ` Georg Bauhaus
2010-08-07 13:49 ` Shark8
2010-08-05 10:20 ` Phil Clayton
2010-07-30 13:16 ` Henrique
2010-07-29 15:37 ` Warren
2010-07-29 14:56 ` Georg Bauhaus
2010-07-29 17:56 ` Jeffrey R. Carter
replies disabled
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox