Add lexer test runner and whitespace characters tests
Whitespace characters for the tests are U+000B, U+000C, U+000D, U+0085, U+2028, U+2029
This commit is contained in:
@@ -0,0 +1,17 @@
|
||||
val ('val')
|
||||
WHITE_SPACE (' ')
|
||||
IDENTIFIER ('x')
|
||||
WHITE_SPACE (' ')
|
||||
EQ ('=')
|
||||
WHITE_SPACE (' ')
|
||||
INTEGER_LITERAL ('1')
|
||||
WHITE_SPACE ('\n')
|
||||
BAD_CHARACTER ('
')
|
||||
WHITE_SPACE ('\n\n')
|
||||
val ('val')
|
||||
WHITE_SPACE (' ')
|
||||
IDENTIFIER ('y')
|
||||
WHITE_SPACE (' ')
|
||||
EQ ('=')
|
||||
WHITE_SPACE (' ')
|
||||
INTEGER_LITERAL ('2')
|
||||
Reference in New Issue
Block a user