From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me X-Spam-Level: X-Spam-Status: No, score=-1.3 required=5.0 tests=BAYES_00,INVALID_MSGID autolearn=no autolearn_force=no version=3.4.4 X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 103376,c7637cfdf68e766 X-Google-Attributes: gid103376,public X-Google-Thread: f8362,c7637cfdf68e766 X-Google-Attributes: gidf8362,public X-Google-Thread: 107079,c7637cfdf68e766 X-Google-Attributes: gid107079,public X-Google-Thread: 109d8a,c7637cfdf68e766 X-Google-Attributes: gid109d8a,public X-Google-Thread: f43e6,c7637cfdf68e766 X-Google-Attributes: gidf43e6,public From: dewar@merv.cs.nyu.edu (Robert Dewar) Subject: Re: floating point comparison Date: 1997/08/09 Message-ID: #1/1 X-Deja-AN: 263384149 References: <33E61497.33E2@pseserv3.fw.hac.com> <33E6D359.3EF4@imbi.uni-freiburg.de> <33E74A62.53E2@pseserv3.fw.hac.com> <5sar4r$t7m$1@cnn.nas.nasa.gov> <33EAD17D.3E91@imbi.uni-freiburg.de> Distribution: inet Organization: New York University Newsgroups: comp.lang.ada,sci.math.num-analysis,comp.software-eng,comp.theory,sci.math Date: 1997-08-09T00:00:00+00:00 List-Id: Dave Sparks wrote: > But I've seen a program where one of the inputs was a temperature > in degrees Centigrade, in the range 10 to 50 with no fractional > part. The calculated results were displayed to six decimal places - > very misleading. This output may or may not be misleading. The question is whether or not a one degree difference in the input could affect the result to the extent of one part in 100,000 or not, if not, then six decimal places may be quite reasonable -- careful analysis is needed in all such cases.