[Grammatica-users] question about tokens

[Wieger Wesselink]

Hello,

I have the following grammar that parses the string "x2" successfully
as two different tokens:

----
%tokens%
OPERATOR         = "x"
NUMBER           = <<[0-9]*>>
WHITESPACE       = <<[ \t\n\r]+>> %ignore%

%productions%
Value            = OPERATOR NUMBER ;
---

When I add the token definition IDENTIFIER = <<[a-zA-Z][a-zA-Z0-9-_]*>>
,
the string "x2" results in a parse error, since it is parsed as a single
IDENTIFIER token. Is there something that I can do to prevent this?

Best regards,

Wieger

-- 
http://www.fastmail.fm - mmm... Fastmail...