Dmitriy Novozhilov
dea3c954f1
[Test] Add ability to stop test pipeline if there was an exception in handler
2021-02-02 17:54:59 +03:00
Dmitriy Novozhilov
3a0eee64b8
[Test] Migrate all jvm tests runners for boxInline tests
2021-02-02 17:53:50 +03:00
Dmitriy Novozhilov
e3ab3d6be3
[Test] Align lines in TestFile with lines in real testdata file
2021-02-02 17:50:07 +03:00
Dmitriy Novozhilov
13a778fd9c
[Test] Add ability to freely transform module structure which was parsed from directive
...
Service ModuleStructureExtractor may break readabilty of test so it
should be used very carefully
Originally it is created for box inline test where we have different
runners on same testdata where one runner assumes that all files
in test in same module and other that they in different ones
2021-02-02 17:50:06 +03:00
Dmitriy Novozhilov
9ba41c5b88
[Test] Improve error reporting if there are too many values passed to directive
2021-02-02 17:50:05 +03:00
Dmitriy Novozhilov
7d4adaba21
[Test] Add ability to simply declaring mapping between directives and configuration keys
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
5490689fea
[Test] Add ability to disable specific handler if there was an error from previous one
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
42f9442728
[Test] Handle any Throwable from test instead of AssertionError
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
5ae5f660f6
[Test] Add ability to explicitly declare default binary kind for test
2021-01-22 13:51:22 +03:00
Dmitriy Novozhilov
acb6d2e196
[Test] Allow facades to return null which indicates that facade can't complete it's job
...
This is needed for cases when test pipeline assumes that some part of
pipeline may be unavailable because of errors on previous stage.
For example, this may occur in some test which check something on IR
but contains backend facade for compiling binary dependencies. In
this case testdata with frontend errors is allowed if test has only
one module which should not be compiled
2021-01-22 13:51:20 +03:00
Dmitriy Novozhilov
6a7cd0c811
[Test] Add ability to specify applicability of diagnostic to module or file
2021-01-22 13:51:19 +03:00
Dmitriy Novozhilov
28cff22cd0
[Test] Add ability to specify directive for test file
...
Rules of directives resolving:
- If no `MODULE` or `FILE` was declared in test then all directives
belongs to module
- If `FILE` is declared, then all directives after it will belong to
file until next `FILE` or `MODULE` directive will be declared
- All directives between `MODULE` and `FILE` directives belongs to module
- All directives before first `MODULE` are global and belongs to each
declared module
2021-01-22 13:51:17 +03:00
Alexander Udalov
221f44da5f
Fix warnings in stdlib/compiler/plugins/test code
2021-01-13 19:18:20 +01:00
Dmitriy Novozhilov
065255adbe
[Test] Support friend modules in new test infrastructure
2021-01-12 18:35:24 +03:00
Dmitriy Novozhilov
d547ce7c42
[Test] Save TargetBackend instead of BackendKind in TestModule
2021-01-12 18:35:17 +03:00
Dmitriy Novozhilov
3c2079c926
[Test] Compute target backend in test generator automatically using reflection
2021-01-12 18:35:16 +03:00
Dmitriy Novozhilov
5382e68180
[Test] Properly delete temporary directories after test run
2021-01-12 16:51:33 +03:00
Dmitriy Novozhilov
ce44a2a7e4
[Test] Inject info about test (class and method names, tags) to TestServices
2021-01-12 16:51:32 +03:00
Dmitriy Novozhilov
009add2b41
[Test] Report difference in test data file in a first place
2020-12-29 16:06:48 +03:00
Dmitriy Novozhilov
e287742842
[Test] Add ability to provide additional analysis flags in EnvironmentConfigurator
2020-12-24 14:57:58 +03:00
Dmitriy Novozhilov
a9f913a97f
[Test] Migrate AbstractDiagnosticsWithJdk15Test to new infrastructure
2020-12-24 14:57:56 +03:00
Dmitriy Novozhilov
02fb11a2cd
[Test] Fix double reading of module directives
2020-12-24 14:57:55 +03:00
Dmitriy Novozhilov
70ae756083
Revert "[Test] Save TargetBackend instead of BackendKind in TestModule"
...
This reverts commit 29d923d5
2020-12-24 13:57:02 +03:00
Dmitriy Novozhilov
29d923d50d
[Test] Save TargetBackend instead of BackendKind in TestModule
2020-12-24 13:44:05 +03:00
Dmitriy Novozhilov
019cb1485e
[TEST] Extract language feature regex pattern to :test-infrastructure-utils
2020-12-16 19:52:31 +03:00
Dmitriy Novozhilov
49d9b85950
[TEST] Migrate AbstractFirDiagnosticsWithLightTreeTest to new test runners
...
Also this commit adds AbstractTwoAttributesMetaInfoProcessor which can
be used for reporting diagnostics with two attributes (OI/NI, PSI/Light tree)
2020-12-16 19:52:30 +03:00
Dmitriy Novozhilov
1fe5148f0d
[TEST] Extract compiler-specific test utils from :tests-common to new module
2020-12-16 19:52:29 +03:00
Dmitriy Novozhilov
23e704f361
[TEST] Migrate AbstractDiagnosticsWithExplicitApi to new test runners
2020-12-16 19:52:26 +03:00
Dmitriy Novozhilov
dd402b16d9
[TEST] Add core of new tests infrastructure
...
It contains different abstractions which represents parts of compiler
pipeline and artifacts produced by them, service structure, handlers
for analysis of artifacts
2020-12-16 19:52:23 +03:00