From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham autolearn_force=no version=3.4.4 X-Google-Thread: 103376,703c4f68db81387d X-Google-Thread: 115aec,703c4f68db81387d X-Google-Thread: f43e6,703c4f68db81387d X-Google-Thread: 108717,a7c8692cac750b5e X-Google-Attributes: gid103376,gid115aec,gidf43e6,gid108717,public X-Google-Language: ENGLISH,ASCII-7-bit Path: g2news1.google.com!news4.google.com!news.glorb.com!newshub.sdsu.edu!tethys.csu.net!nntp.csufresno.edu!sn-xit-02!sn-xit-01!sn-post-01!supernews.com!corp.supernews.com!not-for-mail From: CTips Newsgroups: comp.lang.ada,comp.realtime,comp.software-eng,comp.programming Subject: Re: 10 rules for benchmarking (was Re: Teaching new tricks to an old dog (C++ -->Ada)) Date: Mon, 14 Mar 2005 11:19:06 -0500 Organization: Posted via Supernews, http://www.supernews.com Message-ID: <113bebt2e0u6835@corp.supernews.com> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20041217 X-Accept-Language: en-us, en MIME-Version: 1.0 References: <4229bad9$0$1019$afc38c87@news.optusnet.com.au> <112t3de6fu04f38@corp.supernews.com> <1110396477.596174.285520@o13g2000cwo.googlegroups.com> <112vb2t8eonuhed@corp.supernews.com> <1110422108.925127.54110@o13g2000cwo.googlegroups.com> <11329cb96h2p19f@corp.supernews.com> <113394jjvppao64@corp.supernews.com> <1133s3qnmqmbjfb@corp.supernews.com> <17cd177c.0503140735.2f59ff8f@posting.google.com> In-Reply-To: <17cd177c.0503140735.2f59ff8f@posting.google.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: abuse@supernews.com Xref: g2news1.google.com comp.lang.ada:9369 comp.realtime:1452 comp.software-eng:5018 comp.programming:17943 Date: 2005-03-14T11:19:06-05:00 List-Id: Gautier wrote: > CTips: > > >>He's done it right: >> - he's running them on a Linux machine, which is more accurate than >>cygwin for measuring performance (and where sys/user really mean something). >> - he's using the improved times() which gives better resolution >> - he's controlling for the startup overhead. >> - he's using best of 4 runs. >> - he's picked data sizes that will not blow the cache >> - he's picked data sizes that will give decent run-times. >> >>Like I said, if one knows what one is doing (which he does) then one can >>disregard the rules. If one does not know what one is doing (which you >>don't) then one should follow the rules. > > > He just forgot (and you forgot he forgot!) the main thing: to set the > right (indeed: any) compilation options for the Ada code... The site maintainer doesn't set the compile flags... the person who submits the code fragment gives him the compile & run script. I'm not surprised that the submitter neglected to set up any flags for performance.