Re: KC normalization form for text

["Hibou57 (Yannick Duchêne)" <yannick_duchene@yahoo.fr>]

> Yes, of course it applies. The reason for the wording is that some Unicode
> documents insist that programs that are not normalized are dangerous, and
> strongly recommend that everything be normalized.
I know about it : some characters and they historically compatible
forms may bring the reader into confusion. For this reason I first
that this was to applied on identifiers only.

> Initially, we required
> that the program be converted by the compiler into a normalized form before
> processing. But such a conversion has its own problems
Yes, they will be :
1) string concatenation will most of times not behave as expected.
2) character literals may not be valid character literal, beceause a
compatibility decomposition may create two characters instead of one,
and this stay even after canonical recomposition.

> I would suspect that most compilers simply don't care about unnormalized
> programs, and everything will work fine (without any normalization being
> applied, nor any rejection). But the rule allows a compilers especially
> worried about security to do normalization and/or code rejection.
I think the best is to reject any text which contains unormalized
identifier.

For literal, this depend on the end usage of those literals. Well,
when I think about it, this is true that a unormalized string literal
may be usafe as well, if it is to be used in system command (as an
exemple). But the restriction is heavy if strings are to be used for
display or else (but for identifiers, this should be always rejected I
think, beceause a convertion will be any way confusing for the user).

> P.S. If you want a more definitive answer, you have to ask the ARG by
> sending a formal question to ---@---.
Ok, I will ask the question there.

Thanks for these comments

Yannick