From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=unavailable autolearn_force=no version=3.4.4 Path: eternal-september.org!reader01.eternal-september.org!reader02.eternal-september.org!.POSTED!not-for-mail From: Simon Wright Newsgroups: comp.lang.ada Subject: Re: Formal Subprogram Access Date: Thu, 15 Feb 2018 16:38:43 +0000 Organization: A noiseless patient Spider Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain Injection-Info: reader02.eternal-september.org; posting-host="a67a9dc89aff97d2b3dcf6ea27c3ab3c"; logging-data="4064"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19s6PgcQJs+s5J3OJvxW4LlhrTnl/oNKYQ=" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (darwin) Cancel-Lock: sha1:+xWBzqT11ftLmbBkB0YpqfKb1w0= sha1:hR/3LKpQADjZLzwJ2fhXim+h6Gg= Xref: reader02.eternal-september.org comp.lang.ada:50457 Date: 2018-02-15T16:38:43+00:00 List-Id: Simon Clubley writes: > On 2018-02-14, Randy Brukardt wrote: >> >> "Simon Wright" wrote in message >> news:lymv0bk59g.fsf@pushface.org... >>> >>> Good news! >>> >>> For info, my current 8.0.1 20180207 results, vs 4.1f, are >>> >>> # of expected passes 2500 >>> # of unexpected failures 9 >>> # of expected failures 1451 >>> # of unresolved testcases 11 >>> # of unsupported tests 121 >>> *** FAILURES: c250002 cxd1003 cxd1004 cxd1005 cxd4007 cxd2006 cxd3001 >>> cxd3002 c611a04 >> >> This is similar to the list of C-Tests that the ACATS tools report as >> failed. >> > > Does the testsuite also report the number of unexpected passes ? It would if there were any. > I don't see a line for that above, and if the number is zero, I would > expect to see a line of output confirming that. So far as I can tell, this behaviour is consistent with other GCC tests. Certainly with "make check-gnat". The GCC ACATS tests are run by a shell script, unlike all (?) the other tests which are run via dejagnu, and the current script in GCC reports PASSes and FAILs unconditionally and UNSUPPORTED if non-zero (it doesn't check XPASS, because it doesn't run B or L tests which are the ones expected to fail).