From mboxrd@z Thu Jan  1 00:00:00 1970
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on polar.synack.me
X-Spam-Level: 
X-Spam-Status: No, score=-0.3 required=5.0 tests=BAYES_00,
	REPLYTO_WITHOUT_TO_CC autolearn=no autolearn_force=no version=3.4.4
Path: 
 eternal-september.org!reader01.eternal-september.org!reader02.eternal-september.org!news.eternal-september.org!mx02.eternal-september.org!.POSTED!not-for-mail
From: Georg Bauhaus <bauhaus@futureapps.invalid>
Newsgroups: comp.lang.ada
Subject: Re: OpenToken: Parsing Ada (subset)?
Date: Fri, 05 Jun 2015 11:23:40 +0200
Organization: A noiseless patient Spider
Message-ID: <mkrpoh$cmm$1@dont-email.me>
References: <878uc3r2y6.fsf@adaheads.sparre-andersen.dk>
 	<85twupvjxo.fsf@stephe-leake.org>
 	<81ceb070-16fe-4578-a09a-eb11a2bbb664@googlegroups.com>
 	<162zj7c2l0ykp$.1rxias18vby83.dlg@40tude.net>
 <856172bk80.fsf@stephe-leake.org>
Reply-To: nonlegitur@futureapps.de
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Fri, 5 Jun 2015 09:22:25 +0000 (UTC)
Injection-Info: mx02.eternal-september.org;
 posting-host="b96887e80893c84a90c3007226ca0d1c";
	logging-data="13014"; mail-complaints-to="abuse@eternal-september.org";
	posting-account="U2FsdGVkX19vzJgZ7yM/B8+ShkFlNincRzAp0rBzEgM="
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:31.0) Gecko/20100101 Thunderbird/31.7.0
In-Reply-To: <856172bk80.fsf@stephe-leake.org>
Cancel-Lock: sha1:eoSar4payJ82bV6bZRxfZZX4Tn4=
Xref: news.eternal-september.org comp.lang.ada:26190
Date: 2015-06-05T11:23:40+02:00
List-Id: <comp.lang.ada>

On 05.06.15 11:03, Stephen Leake wrote:
> Aflex compiles all the regular expressions for all of the tokens into
> one state machine, that visits each character in the input stream once.
> You can't get faster than that.

You can get faster than that if the OS supports
line-oriented I/O of text:

NotInString -> '-' ... -> '-' -> SKIPThisLine :)