From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me X-Spam-Level: X-Spam-Status: No, score=-1.3 required=5.0 tests=BAYES_00,INVALID_MSGID autolearn=no autolearn_force=no version=3.4.4 X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 103376,42427d0d1bf647b1 X-Google-Attributes: gid103376,public From: dewar@cs.nyu.edu (Robert Dewar) Subject: Re: Ada Core Technologies and Ada95 Standards Date: 1996/04/16 Message-ID: #1/1 X-Deja-AN: 148088781 references: <00001a73+00002c20@msn.com> <4kf739$f00@cliffy.lfwc.lockheed.com> <3172903D.1926@lfwc.lockheed.com> <31735CE2.1B94@lmtas.lmco.com> organization: Courant Institute of Mathematical Sciences newsgroups: comp.lang.ada Date: 1996-04-16T00:00:00+00:00 List-Id: Ken said "Believe it or not, Robert Dewar wrote these two sentences in the same post: > ...the point is that Brian's test generator does not test any > features not tested pretty thoroughly in the ACVC suite. > We certainly plan to use this tool in testing GNAT. Sounds like either (1) a waste of money, given that the ACVC tests these features thoroughly, or (2) a good idea for all compiler vendors to do." You should definitely believe it because I certainly wrote those two sentences, and they are not at all inconsistent. The fact that you think they are shows you are still missing some important points. There is a big difference between feature coverage and stress testing. The ACVC has pretty complete feature coverage, for example, you will find cases of all possible operators applied to all classes of types. But that is very differnt from seeing if a compiler will fall apart if you give it a complex expression containing thousands of tokens (which is waht the NPL stress testing tool can do). I use feature in the sense of "feature in the language", not a general use applying to any possible characteristic of the language. The ACVC test suite measures conformance, not capacity or performance. For capacity and performance tests, you should look at the ACES test suite which concentrates on these areas. Note that the development of the ACES has been funded by the DoD, and use of this test suite is considered to be of critical importance by many projects.