From mboxrd@z Thu Jan  1 00:00:00 1970
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM
	autolearn=ham autolearn_force=no version=3.4.4
X-Google-Thread: 103376,703c4f68db81387d
X-Google-Thread: 115aec,703c4f68db81387d
X-Google-Thread: f43e6,703c4f68db81387d
X-Google-Thread: 108717,a7c8692cac750b5e
X-Google-Attributes: gid103376,gid115aec,gidf43e6,gid108717,public
X-Google-Language: ENGLISH,ASCII-7-bit
Path: g2news1.google.com!postnews.google.com!not-for-mail
From: gautier_niouzes@hotmail.com (Gautier)
Newsgroups: comp.lang.ada,comp.realtime,comp.software-eng,comp.programming
Subject: Re: 10 rules for benchmarking (was Re: Teaching new tricks to an old
 dog (C++ -->Ada))
Date: 14 Mar 2005 07:35:51 -0800
Organization: http://groups.google.com
Message-ID: <17cd177c.0503140735.2f59ff8f@posting.google.com>
References: <4229bad9$0$1019$afc38c87@news.optusnet.com.au>
 <E1vXd.352556$w62.20389@bgtnsc05-news.ops.worldnet.att.net>
 <112t3de6fu04f38@corp.supernews.com>
 <1110396477.596174.285520@o13g2000cwo.googlegroups.com>
 <112vb2t8eonuhed@corp.supernews.com>
 <1110422108.925127.54110@o13g2000cwo.googlegroups.com>
 <11329cb96h2p19f@corp.supernews.com> <c92s0d.vgk.ln@hunter.axlog.fr>
 <113394jjvppao64@corp.supernews.com> <uk6oeaua9.fsf@obry.org>
 <1133s3qnmqmbjfb@corp.supernews.com>
NNTP-Posting-Host: 213.173.163.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Trace: posting.google.com 1110814552 13474 127.0.0.1 (14 Mar 2005 15:35:52
 GMT)
X-Complaints-To: groups-abuse@google.com
NNTP-Posting-Date: Mon, 14 Mar 2005 15:35:52 +0000 (UTC)
Xref: g2news1.google.com comp.lang.ada:9364 comp.realtime:1448
 comp.software-eng:5013 comp.programming:17941
Date: 2005-03-14T07:35:51-08:00
List-Id: <comp.lang.ada>

CTips:

> He's done it right:
>   - he's running them on a Linux machine, which is more accurate than 
> cygwin for measuring performance (and where sys/user really mean something).
>    - he's using the improved times() which gives better resolution
>    - he's controlling for the startup overhead.
>    - he's using best of 4 runs.
>    - he's picked data sizes that will not blow the cache
>    - he's picked data sizes that will give decent run-times.
> 
> Like I said, if one knows what one is doing (which he does) then one can 
> disregard the rules. If one does not know what one is doing (which you 
> don't) then one should follow the rules.

He just forgot (and you forgot he forgot!) the main thing: to set the
right (indeed: any) compilation options for the Ada code...
______________________________________________________________
Gautier     --     http://www.mysunrise.ch/users/gdm/index.htm
Ada programming -- http://www.mysunrise.ch/users/gdm/gsoft.htm

NB: For a direct answer, e-mail address on the Web site!