Dmitriy Novozhilov
73a63359df
[Test] Add new directive for specifying target platform for module
2021-05-19 00:52:28 +03:00
Dmitriy Novozhilov
06b2efe65f
[Test] Introduce new syntax for dependsOn dependencies
2021-05-19 00:52:27 +03:00
Dmitriy Novozhilov
27f0d938c9
[Test] Add wrapping of failures from different parts of test pipeline
2021-05-19 00:52:22 +03:00
Victor Petukhov
1f0616439c
Introduce special common directives for tests based on foreign annotation tests
2021-04-30 14:43:26 +03:00
Dmitriy Novozhilov
e3b5cc491d
[Test] Throw exception from compiler at a first place
2021-04-19 14:32:37 +03:00
Dmitriy Novozhilov
69ff45971f
Suppress HIDDEN diagnostics from FIR to fix FIR bootstrap compilation
2021-04-14 18:30:56 +03:00
Ivan Kylchik
dbf1f54c3f
Add possibility to run callback lambda before dispose test project
2021-03-29 18:11:22 +03:00
Ilmir Usmanov
b838ba8c62
Check whether backend is IR instead of distinct ones
2021-03-22 15:08:59 +00:00
Dmitriy Novozhilov
34f8c7a68b
[TEST] Add ability to register compiler extensions in EnvironmentConfigurator
2021-03-18 14:00:38 +03:00
Ilmir Usmanov
a90a5f6dd4
Check for backend when checking for suspend in fun interfaces
2021-03-16 22:37:44 +01:00
Alexander Udalov
aaecb87d1b
Tests: compute runtime classpath for JVM box tests manually
...
Taking just the `jvmClasspathRoots` is not correct because it also
contains stuff needed for resolve to work correctly, such as JDK (full
or mock), stdlib (full or mock), reflect. JDK is obviously not needed in
the classpath, and stdlib/reflect are available via the parent class
loader, which is specifically reused across all tests to make them run
faster.
Also, don't try to create class loader for Java-only modules in
`JvmBoxRunner.processModule`. This happens, for example, for all tests
which were moved from `boxAgainstJava`.
2021-02-17 14:41:07 +01:00
Dmitriy Novozhilov
1216b33593
[Test] Move extracting JVM_TARGET to provideConfigurationKeys
2021-02-10 13:02:07 +03:00
Dmitriy Novozhilov
606ae45f5f
[Test] Replace remaining KOTLIN_CONFIGURATION_FLAGS directives with specific ones
2021-02-10 13:02:06 +03:00
Dmitriy Novozhilov
a932f69b8a
[Test] Don't pass MockProject to environment configurators
2021-02-10 13:02:00 +03:00
Dmitriy Novozhilov
dea3c954f1
[Test] Add ability to stop test pipeline if there was an exception in handler
2021-02-02 17:54:59 +03:00
Dmitriy Novozhilov
3a0eee64b8
[Test] Migrate all jvm tests runners for boxInline tests
2021-02-02 17:53:50 +03:00
Dmitriy Novozhilov
e3ab3d6be3
[Test] Align lines in TestFile with lines in real testdata file
2021-02-02 17:50:07 +03:00
Dmitriy Novozhilov
13a778fd9c
[Test] Add ability to freely transform module structure which was parsed from directive
...
Service ModuleStructureExtractor may break readabilty of test so it
should be used very carefully
Originally it is created for box inline test where we have different
runners on same testdata where one runner assumes that all files
in test in same module and other that they in different ones
2021-02-02 17:50:06 +03:00
Dmitriy Novozhilov
9ba41c5b88
[Test] Improve error reporting if there are too many values passed to directive
2021-02-02 17:50:05 +03:00
Dmitriy Novozhilov
7d4adaba21
[Test] Add ability to simply declaring mapping between directives and configuration keys
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
5490689fea
[Test] Add ability to disable specific handler if there was an error from previous one
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
42f9442728
[Test] Handle any Throwable from test instead of AssertionError
2021-01-25 17:08:31 +03:00
Dmitriy Novozhilov
5ae5f660f6
[Test] Add ability to explicitly declare default binary kind for test
2021-01-22 13:51:22 +03:00
Dmitriy Novozhilov
acb6d2e196
[Test] Allow facades to return null which indicates that facade can't complete it's job
...
This is needed for cases when test pipeline assumes that some part of
pipeline may be unavailable because of errors on previous stage.
For example, this may occur in some test which check something on IR
but contains backend facade for compiling binary dependencies. In
this case testdata with frontend errors is allowed if test has only
one module which should not be compiled
2021-01-22 13:51:20 +03:00
Dmitriy Novozhilov
6a7cd0c811
[Test] Add ability to specify applicability of diagnostic to module or file
2021-01-22 13:51:19 +03:00
Dmitriy Novozhilov
28cff22cd0
[Test] Add ability to specify directive for test file
...
Rules of directives resolving:
- If no `MODULE` or `FILE` was declared in test then all directives
belongs to module
- If `FILE` is declared, then all directives after it will belong to
file until next `FILE` or `MODULE` directive will be declared
- All directives between `MODULE` and `FILE` directives belongs to module
- All directives before first `MODULE` are global and belongs to each
declared module
2021-01-22 13:51:17 +03:00
Alexander Udalov
221f44da5f
Fix warnings in stdlib/compiler/plugins/test code
2021-01-13 19:18:20 +01:00
Dmitriy Novozhilov
065255adbe
[Test] Support friend modules in new test infrastructure
2021-01-12 18:35:24 +03:00
Dmitriy Novozhilov
d547ce7c42
[Test] Save TargetBackend instead of BackendKind in TestModule
2021-01-12 18:35:17 +03:00
Dmitriy Novozhilov
3c2079c926
[Test] Compute target backend in test generator automatically using reflection
2021-01-12 18:35:16 +03:00
Dmitriy Novozhilov
5382e68180
[Test] Properly delete temporary directories after test run
2021-01-12 16:51:33 +03:00
Dmitriy Novozhilov
ce44a2a7e4
[Test] Inject info about test (class and method names, tags) to TestServices
2021-01-12 16:51:32 +03:00
Dmitriy Novozhilov
009add2b41
[Test] Report difference in test data file in a first place
2020-12-29 16:06:48 +03:00
Dmitriy Novozhilov
e287742842
[Test] Add ability to provide additional analysis flags in EnvironmentConfigurator
2020-12-24 14:57:58 +03:00
Dmitriy Novozhilov
a9f913a97f
[Test] Migrate AbstractDiagnosticsWithJdk15Test to new infrastructure
2020-12-24 14:57:56 +03:00
Dmitriy Novozhilov
02fb11a2cd
[Test] Fix double reading of module directives
2020-12-24 14:57:55 +03:00
Dmitriy Novozhilov
70ae756083
Revert "[Test] Save TargetBackend instead of BackendKind in TestModule"
...
This reverts commit 29d923d5
2020-12-24 13:57:02 +03:00
Dmitriy Novozhilov
29d923d50d
[Test] Save TargetBackend instead of BackendKind in TestModule
2020-12-24 13:44:05 +03:00
Dmitriy Novozhilov
019cb1485e
[TEST] Extract language feature regex pattern to :test-infrastructure-utils
2020-12-16 19:52:31 +03:00
Dmitriy Novozhilov
49d9b85950
[TEST] Migrate AbstractFirDiagnosticsWithLightTreeTest to new test runners
...
Also this commit adds AbstractTwoAttributesMetaInfoProcessor which can
be used for reporting diagnostics with two attributes (OI/NI, PSI/Light tree)
2020-12-16 19:52:30 +03:00
Dmitriy Novozhilov
1fe5148f0d
[TEST] Extract compiler-specific test utils from :tests-common to new module
2020-12-16 19:52:29 +03:00
Dmitriy Novozhilov
23e704f361
[TEST] Migrate AbstractDiagnosticsWithExplicitApi to new test runners
2020-12-16 19:52:26 +03:00
Dmitriy Novozhilov
dd402b16d9
[TEST] Add core of new tests infrastructure
...
It contains different abstractions which represents parts of compiler
pipeline and artifacts produced by them, service structure, handlers
for analysis of artifacts
2020-12-16 19:52:23 +03:00