From mboxrd@z Thu Jan  1 00:00:00 1970
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me
X-Spam-Level: 
X-Spam-Status: No, score=-2.9 required=5.0 tests=BAYES_00,MAILING_LIST_MULTI
	autolearn=unavailable autolearn_force=no version=3.4.4
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 103376,6d9eb594a33cb947
X-Google-Attributes: gid103376,public
X-Google-ArrivalTime: 2001-01-29 09:48:20 PST
Path: 
 supernews.google.com!sn-xit-02!supernews.com!isdnet!grolier!fr.usenet-edu.net!usenet-edu.net!enst!enst.fr!not-for-mail
From: Mario Amado Alves <maa@di.fct.unl.pt>
Newsgroups: comp.lang.ada
Subject: RE: very specific question on Ada syntax
Date: Mon, 29 Jan 2001 17:52:15 +0000 (WET)
Organization: ENST, France
Sender: comp.lang.ada-admin@ada.eu.org
Message-ID: <mailman.980790498.4176.comp.lang.ada@ada.eu.org>
Reply-To: comp.lang.ada@ada.eu.org
NNTP-Posting-Host: marvin.enst.fr
Mime-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
X-Trace: avanie.enst.fr 980790499 95870 137.194.161.2 (29 Jan 2001 17:48:19
 GMT)
X-Complaints-To: usenet@enst.fr
NNTP-Posting-Date: Mon, 29 Jan 2001 17:48:19 +0000 (UTC)
To: comp.lang.ada@ada.eu.org
Return-Path: <maa@di.fct.unl.pt>
X-Authentication-Warning: lexis.di.fct.unl.pt: maa owned process doing -bs
In-Reply-To: <9543p4$u4u$1@nnrp1.deja.com>
Errors-To: comp.lang.ada-admin@ada.eu.org
X-BeenThere: comp.lang.ada@ada.eu.org
X-Mailman-Version: 2.0
Precedence: bulk
List-Help: <mailto:comp.lang.ada-request@ada.eu.org?subject=help>
List-Post: <mailto:comp.lang.ada@ada.eu.org>
List-Subscribe: <http://ada.eu.org/mailman/listinfo/comp.lang.ada>,
	<mailto: comp.lang.ada-request@ada.eu.org?subject=subscribe>
List-Id: comp.lang.ada mail<->news gateway <comp.lang.ada.ada.eu.org>
List-Unsubscribe: <http://ada.eu.org/mailman/listinfo/comp.lang.ada>,
	<mailto: comp.lang.ada-request@ada.eu.org?subject=unsubscribe>
List-Archive: <http://ada.eu.org/pipermail/comp.lang.ada/>
Errors-To: comp.lang.ada-admin@ada.eu.org
X-BeenThere: comp.lang.ada@ada.eu.org
Xref: supernews.google.com comp.lang.ada:4669
Date: 2001-01-29T17:52:15+00:00

> I just tried the test_ada_lexer from the OpenToken examples directory on
> the following input:
> 
> A'L;
> 
> and got the output
> 
> Found IDENTIFIER_T A
> Found TICK_T '
> Found IDENTIFIER_T L
> Found SEMICOLON_T ;
> Found END_OF_FILE_T *
> 
> That looks like the right output to me. Am I missing some parameter of
> the problem?

It is the right output. The problem is tokenisation of character literals
relying on inexistence of one-character attribute designator. Someone said
OpenToken did that. Try input

  A'B'C

(attribute C of attribute B of something A) on the OpenToken lexer. If what
that someone said is true, the output will ressemble

  Identifier_T         A
  Character_Literal_T  B
  Identifier_T         C

(which is incorrect).

Thanks.

| |,| | | |RuaFranciscoTaborda24RcD 2815-249CharnecaCaparica 351+939354005
|M|A|R|I|O|
|A|M|A|D|O|DepartmentoDeInformaticaFCT/UNL 2825-114 Caparica 351+212958536
|A|L|V|E|S|                                                  fax 212948541
| | | | | |                 maa@di.fct.unl.pt                FCT 212948300