From mboxrd@z Thu Jan  1 00:00:00 1970
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00
	autolearn=unavailable autolearn_force=no version=3.4.4
Path: 
 eternal-september.org!reader01.eternal-september.org!.POSTED!not-for-mail
From: Simon Wright <simon@pushface.org>
Newsgroups: comp.lang.ada
Subject: Re: Ann: Gcc/GNAT 9.1 released - Test Results
Date: Wed, 08 May 2019 18:09:10 +0100
Organization: A noiseless patient Spider
Message-ID: <lyef58yitl.fsf@pushface.org>
References: <7d10dac8-f871-4cf9-b57f-aa9a114d2650@googlegroups.com>
Mime-Version: 1.0
Content-Type: text/plain
Injection-Info: reader02.eternal-september.org;
 posting-host="3b0d401f4dd351c2a149fe0533afc5f6";
	logging-data="23899"; mail-complaints-to="abuse@eternal-september.org";
	posting-account="U2FsdGVkX18a7/9XzAiMQgKCtyWf/WAdLw/MxQGqbAA="
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (darwin)
Cancel-Lock: sha1:8DgCXYLs0bfsKA4OgryqhrztAUM=
	sha1:e9gVA1g+u9ZSUlUQFyiL9RKM0ns=
Xref: reader01.eternal-september.org comp.lang.ada:56257
Date: 2019-05-08T18:09:10+01:00
List-Id: <comp.lang.ada>

alby.gamper@gmail.com writes:

> GCC 9.1 has been released, and below are the test results for GNAT (I
> will try and run the ACATS version 4.1 using Simon Wright's GitHub
> repo at a later stage)

With release GCCs, c452003 will hang during compilation (the test suite
checks for overruns of executions, but not of builds). Killing the hung
gnat1 process lets ACATS proceed.

With non-release GCCs, which have many more checks enabled, you get a
bug box: see https://gcc.gnu.org/bugzilla/show_bug.cgi?id=88610

For info, the GCC 9.1.0 x86_64-apple-darwin official results are:

		=== gnat Summary ===

# of expected passes		2964
# of expected failures		23
# of unsupported tests		10

		=== acats Summary ===
# of expected passes		2320
# of unexpected failures	0

The 4.1L results are

		=== acats Summary ===
# of expected passes		2505
# of unexpected failures	11
# of expected failures		1463
# of unresolved testcases	11
# of unsupported tests		124
*** FAILURES: c250002 c452003 c611a04 c650b04 cxd1003 cxd1004 cxd1005 cxd2006 cxd3001 cxd3002 cxd8002 

There are expected failures because I included the whole test suite.

c250002: UTF-8 case conversion issue
c452003: see above
c6*:     hairy tests
cxd*:    Bob Duff says full Annex D compliance not to be expected on
         desktop OS