From: "Randy Brukardt" <randy@rrsoftware.com>
Subject: Re: Ann: Gcc/GNAT 9.1 released - Test Results
Date: Fri, 10 May 2019 17:32:21 -0500
Date: 2019-05-10T17:32:21-05:00 [thread overview]
Message-ID: <qb4u5l$40k$1@franka.jacob-sparre.dk> (raw)
In-Reply-To: lyk1f0vw11.fsf@pushface.org
"Simon Wright" <simon@pushface.org> wrote in message
news:lyk1f0vw11.fsf@pushface.org...
...
> Quite a few of the unsupported tests are so because they deal with the
> consequences of changing the source code and rebuilding. The ACATS
> source for those tests contains multiple copies of some units, which
> results in a gnatchop failure. It'd require a lot of work to fix, and
> for what is essentially an IVP (installation verification procedure)
> seems like overkill.
Note that the (relatively new) ACATS grading tool checks process failures,
and the GNAT scripting tool available in the submitted tests area handles
most of these tests properly.
I note that my experience is that there are a lot of B-Tests (on *every*
compiler that I've checked) that are either in a grey area as to whether
they have passed or are outright failing. I suspect that's because errors
creep into supposedly "known good results", and also because without any
formal verifications it is really easy to decide not to worry about a
dubious result. (It's also possible that my test procedure didn't exactly
match the one typically used by the vendor, so some results might differ).
Randy.
next prev parent reply other threads:[~2019-05-10 22:32 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-05-04 6:12 Ann: Gcc/GNAT 9.1 released - Test Results alby.gamper
2019-05-08 17:09 ` Simon Wright
2019-05-08 17:30 ` Optikos
2019-05-09 9:04 ` Simon Wright
2019-05-10 22:32 ` Randy Brukardt [this message]
2019-05-09 10:57 ` alby.gamper
2019-05-09 11:18 ` Simon Wright
replies disabled
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox