Re: Text parsing package

["Dmitry A. Kazakov" <mailbox@dmitry-kazakov.de>]

On Tue, 22 Mar 2011 16:34:48 -0700 (PDT), Syntax Issues wrote:

> I have just finished a simple text parsing package.

Congratulations. What are you parsing? CSV?

> If anyone is interested I can post the code (only about 160~ lines).

Some notes to parsing techniques:

1. Don't use unbounded strings. That is an unnecessary overhead.

2. When parsing something you should have a kind of syntax error handling.
Exceptions with error location information is IMO the best choice.

3. As others have mentioned, it is a good idea to abstract the source
formats in order to be able to parse files, strings, streams etc.

4. Encoding issues is a related issue to the above. If you have that source
abstraction layer, you can deal everything Unicode, transcoding things
there and keeping the parser agnostic to encoding.

5. The state of the parser should be encapsulated in an object. Otherwise
you won't be able to reenter the parser or to make a recursively descent
one.

6. You should decide what drives the parser. In your case it is the caller.
That is not a good idea in most cases, because the caller rarely knows what
to expect next. A better choice is semantic call-backs from the parser to
the caller. Abstract primitive operations is IMO the best implementation of
such callbacks.

7. Usually parser is a middleman. It means that you should consider how to
shape the intermediate results of parsing, e.g. the AST. Ada pools are very
nice to keep that stuff in an arena.

-- 
Regards,
Dmitry A. Kazakov
http://www.dmitry-kazakov.de