Re: lexical ambiguity

[Georg Bauhaus <bauhaus@futureapps.de>]

On Tue, 2006-06-06 at 18:56 +0000, Peter C. Chapin wrote:
> Georg Bauhaus <bauhaus@futureapps.de> wrote in 
> news:1149590366.8521.5.camel@localhost:
> 
> >  if'('="-"("="('='=',',','=','))
> 
> Now *that* is evil. :-)

;)

When it came to the tick mark in ASnip's tokenizer,
I had to consider the case when there isn't a token at
which to look back (a source snippet might well
start with 'x'). So the solution isn't perfect.

I should add another piece of history, for better
classing of tokens where possible.


-- Georg