From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham autolearn_force=no version=3.4.4 X-Google-Language: ENGLISH,ASCII Path: g2news2.google.com!postnews.google.com!l12g2000yqo.googlegroups.com!not-for-mail From: info@midoan.com Newsgroups: comp.lang.ada Subject: Re: ANNOUNCE Mika by Midoan New Release : Automated Test Data Generation for Ada Date: Tue, 26 May 2009 01:55:06 -0700 (PDT) Organization: http://groups.google.com Message-ID: <46048ef9-5071-4593-9ab5-f1dcd6cdaedf@l12g2000yqo.googlegroups.com> References: <9f6229a1-e95d-4453-8dca-eb0e893e603d@g1g2000yqh.googlegroups.com> <84be79ff-121e-4202-8f1c-97b9da34efa6@m19g2000yqk.googlegroups.com> <96e6bbd8-8c66-4405-9389-a7dd9c8ac919@a36g2000yqc.googlegroups.com> NNTP-Posting-Host: 89.101.123.118 Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Trace: posting.google.com 1243328106 18441 127.0.0.1 (26 May 2009 08:55:06 GMT) X-Complaints-To: groups-abuse@google.com NNTP-Posting-Date: Tue, 26 May 2009 08:55:06 +0000 (UTC) Complaints-To: groups-abuse@google.com Injection-Info: l12g2000yqo.googlegroups.com; posting-host=89.101.123.118; posting-account=X24XNwoAAACSn_ecescZSCM9-2ONsCM_ User-Agent: G2/1.0 X-HTTP-UserAgent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 GTB5 (.NET CLR 3.5.30729),gzip(gfe),gzip(gfe) Xref: g2news2.google.com comp.lang.ada:6015 Date: 2009-05-26T01:55:06-07:00 List-Id: On May 26, 9:18=A0am, Maciej Sobczak wrote: > On 25 Maj, 22:26, i...@midoan.com wrote: > > > Mika [...] has no knowledge of the intended > > behaviour of the code. It only automatises the generation of tests. > > These two sentences above seem to be conflicting to me, or at least > they provoke a justified question on the actual value of such > generated tests. > Can you provide some examples? > > -- > Maciej Sobczak *www.msobczak.com*www.inspirel.com > > Database Access Library for Ada:www.inspirel.com/soci-ada The most simple typical example is : procedure swap(x, y : in out Integer) is t : Integer; begin t :=3D y; --should be t :=3D x; x :=3D y; y :=3D t; end swap; For this Mika generates the following test: TEST NUMBER 1 CONSTRUCTED TEST x =3D -3411276 y =3D -2256887 PREDICTED RESULTS x =3D -2256887 y =3D -2256887 100% branch coverage predicted. 1 tests generated (paths followed) 0 paths fully attempted but for which tests could not be generated Mika generates tests, and can compile and run the tests but it cannot answer the question: "did the tests pass or fail?". The fact that the intended behaviour was a swap of the two arguments is obviously completely unknown to Mika. But if an oracle is available (e.g. during regression testing, or from previous test runs) it is possible to perform back to back test runs automatically using the tests generated: thus answering the question did the test pass or fail... But of course the answer is completely dependent on the integrity of the oracle. More complex examples are available at http://www.midoan.com/mika.html Hoping this clarify things a little. Regards, Midoan.