Add lexer test runner and whitespace characters tests

Whitespace characters for the tests are U+000B, U+000C, U+000D, U+0085, U+2028, U+2029
This commit is contained in:
victor.petukhov
2018-10-25 18:58:43 +03:00
parent fe072e3366
commit 9a61998fca
47 changed files with 1306 additions and 65 deletions
@@ -0,0 +1,19 @@
EOL_COMMENT ('// some…comment')
WHITE_SPACE ('\n')
EOL_COMMENT ('//…some comment')
WHITE_SPACE ('\n\n')
BLOCK_COMMENT ('/*…*/')
WHITE_SPACE ('\n')
BLOCK_COMMENT ('/* some…comment */')
WHITE_SPACE ('\n')
BLOCK_COMMENT ('/*…some comment */')
WHITE_SPACE ('\n')
BLOCK_COMMENT ('/* some comment…*/')
WHITE_SPACE ('\n\n')
KDoc ('/** */')
WHITE_SPACE ('\n')
KDoc ('/** some…doc */')
WHITE_SPACE ('\n')
KDoc ('/**…some doc */')
WHITE_SPACE ('\n')
KDoc ('/** some doc…*/')