671aa68ad6
*Enable JPS tests for K2 *Exclude compiler messages from the comparison of output logs, as they can vary depending on the compiler *Mute failing tests: 1) Sam conversions - Unmute after updating IntelliJ core up to 212, as they should pass after updating IntelliJ JPS dependency 2) Failing IC tests with Java-interop, that are needed to be fixed during KT-55696 3) Failing IC tests with recording different sets of lookups by the compiler, that are needed to be fixed during KT-55195 4) Failing AllConstants, will be changed in KT-54991 *Fix test data: 1) Add cleaned outputs for JPS, because Gradle skips error messages at all 2) Rename gradle-fir-build.log to fir-build.log, because JPS also can use it and there is no need to duplicate files 3) Add some k2-specific logs, that changed the set of files in different rounds in comparison with the old compiler, but the scope stays the same 4) Remove useless logs and obsolete directives.txt files as they have no impact on test results 5) Replace fir-build.log files with gradle-fir-build.log because Gradle build with FIR is correct, but not optimal. JPS with K2 is now tested with fir-build.log files 6) Remove useless fir-log, as it duplicates the main build log, and Remove empty directives file #KT-54991 In Progress Merge-request: KT-MR-8174 Merged-by: Aleksei Cherepanov <aleksei.cherepanov@jetbrains.com>
15 KiB
15 KiB
| 1 | Test key | Issue | State (optional: MUTE or FAIL) | Status (optional: FLAKY) |
|---|---|---|---|---|
| 2 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerTestGenerated.JavaAgainstKotlin.testExtendingMutableInterfaces | KT-34105 | ||
| 3 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerTestGenerated.JavaAgainstKotlin.testExtendingReadOnlyInterfaces | KT-34105 | ||
| 4 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerTestGenerated.JavaAgainstKotlin.testUsingMutableInterfaces | ERROR: Incompatible types. Found: 'E' required: 'E' | FLAKY | |
| 5 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerTestGenerated.JavaAgainstKotlin.testUsingReadOnlyInterfaces | Incompatible types. Found: 'java.util.Set<K>' required: 'java.util.Set<E>' | FLAKY | |
| 6 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerWithoutUltraLightTestGenerated.JavaAgainstKotlin.testExtendingMutableInterfaces | KT-34105 | ||
| 7 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerWithoutUltraLightTestGenerated.JavaAgainstKotlin.testUsingMutableInterfaces | FLAKY | ||
| 8 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinSourceCheckerWithoutUltraLightTestGenerated.JavaAgainstKotlin.testUsingReadOnlyInterfaces | FLAKY | ||
| 9 | org.jetbrains.kotlin.gradle.NewMultiplatformProjectImportingTest.testSingleAndroidTarget[1: Gradle-4.9, KotlinGradlePlugin-latest stable] | Stable on windows | FLAKY | |
| 10 | org.jetbrains.kotlin.gradle.NewMultiplatformProjectImportingTest.testSingleAndroidTarget[4: Gradle-5.6.4, KotlinGradlePlugin-latest stable] | Stable on windows | FLAKY | |
| 11 | org.jetbrains.kotlin.gradle.NewMultiplatformProjectImportingTest.testSingleAndroidTarget[7: Gradle-6.5.1, KotlinGradlePlugin-latest stable] | Stable on windows | FLAKY | |
| 12 | org.jetbrains.kotlin.gradle.NewMultiplatformProjectImportingTest.testSingleAndroidTarget[8: Gradle-6.5.1, KotlinGradlePlugin-master] | Stable on windows | FLAKY | |
| 13 | org.jetbrains.kotlin.idea.caches.resolve.MultiPlatformHighlightingTestGenerated.testJvmKotlinReferencesCommonKotlinThroughJavaDifferentJvmImpls | Always red | ||
| 14 | org.jetbrains.kotlin.idea.codeInsight.gradle.GradleBuildFileHighlightingTest.testKtsInJsProject[1: with Gradle-5.6.4] | ERROR: Diagnostic's list should be empty | ||
| 15 | org.jetbrains.kotlin.idea.codeInsight.gradle.GradleBuildFileHighlightingTest.testKtsInJsProject[0: with Gradle-4.9] | ERROR: Diagnostic's list should be empty | ||
| 16 | org.jetbrains.kotlin.idea.codeInsight.gradle.GradleBuildFileHighlightingTest.testKtsInJsProject | ERROR: Diagnostic's list should be empty | ||
| 17 | org.jetbrains.kotlin.idea.configuration.ConfigureKotlinInTempDirTest.testKotlincExistsNoSettingsLatestRuntimeNoVersionAutoAdvance | FLAKY | ||
| 18 | org.jetbrains.kotlin.idea.configuration.ConfigureKotlinInTempDirTest.testNoKotlincExistsNoSettingsRuntime10 | FLAKY | ||
| 19 | org.jetbrains.kotlin.idea.configuration.ConfigureKotlinTest.testJava9WithModuleInfo | ERROR: Require directive for kotlin.stdlib is expected | ||
| 20 | org.jetbrains.kotlin.idea.configuration.GradleConfigureProjectByChangingFileTestGenerated.Gradle.testWithJava9ModuleInfo | Probably test data should be updated | ||
| 21 | org.jetbrains.kotlin.idea.debugger.test.CoroutineDumpTestGenerated.testNoCoroutines | Stable on windows | FLAKY | |
| 22 | org.jetbrains.kotlin.idea.debugger.test.CoroutineDumpTestGenerated.testThreeCoroutines | Stable on windows | FLAKY | |
| 23 | org.jetbrains.kotlin.idea.debugger.test.CoroutineDumpTestGenerated.testTwoDumps | Stable on windows | FLAKY | |
| 24 | org.jetbrains.kotlin.idea.decompiler.stubBuilder.BuiltInDecompilerConsistencyTest.testSameAsClsDecompilerForCompiledBuiltInClasses | No classes with this name found: kotlin.ArithmeticException | FLAKY | |
| 25 | org.jetbrains.kotlin.idea.decompiler.stubBuilder.BuiltInDecompilerTest.testBuiltInStubTreeEqualToStubTreeFromDecompiledText | No classes with this name found: kotlin.ArithmeticException | FLAKY | |
| 26 | org.jetbrains.kotlin.idea.highlighter.HighlightingTestGenerated.testSuspend | Always red | ||
| 27 | org.jetbrains.kotlin.idea.highlighter.NoErrorsInStdlibTest.testNoErrors | Always red | ||
| 28 | org.jetbrains.kotlin.idea.maven.KotlinMavenInspectionTestGenerated.testWrongPhaseExecution | Always red | ||
| 29 | org.jetbrains.kotlin.idea.maven.MavenMigrateTest.testMigrateApiAndLanguageVersions | flaky on windows | FLAKY | |
| 30 | org.jetbrains.kotlin.idea.maven.configuration.MavenConfigureProjectByChangingFileTestGenerated.Jvm.testWithJava9ModuleInfo | Probably test data should be updated | ||
| 31 | org.jetbrains.kotlin.idea.quickfix.DeprecatedSymbolUsageFixSpecialTest.testDefaultParameterValuesFromLibrary | Always red because of additional import | FLAKY | |
| 32 | org.jetbrains.kotlin.idea.quickfix.QuickFixMultiModuleTestGenerated.CreateActual.testWithTestDummy | Very flaky on teamcity | FLAKY | |
| 33 | org.jetbrains.kotlin.idea.quickfix.QuickFixTestGenerated.Libraries.testJunit | ERROR: Couldn't find the following libraries | ||
| 34 | org.jetbrains.kotlin.idea.quickfix.QuickFixTestGenerated.Libraries.testTestNG | ERROR: Couldn't find the following libraries | ||
| 35 | org.jetbrains.kotlin.idea.quickfix.QuickFixTestGenerated.ObsoleteKotlinJsPackages.testKotlinDomAndBrowserImport | Always red because UAST does not work with JS | ||
| 36 | org.jetbrains.kotlin.idea.refactoring.move.MultiModuleMoveTestGenerated.testMoveFromJvmModuleToJsModule_MoveFromJvmModuleToJsModule | KT-34106 | ||
| 37 | org.jetbrains.kotlin.idea.refactoring.move.MultiModuleMoveTestGenerated.testMoveJdkDependentToJsModule_MoveJdkDependentToJsModule | KT-34106 | ||
| 38 | org.jetbrains.kotlin.idea.resolve.PartialBodyResolveTestGenerated.testSmartCastInTheSameStatement | KT-35922 | ||
| 39 | org.jetbrains.kotlin.idea.run.RunConfigurationTest.testWithModuleForJdk9 | Always red | ||
| 40 | org.jetbrains.kotlin.idea.spring.tests.references.SpringReferenceNavigationTestGenerated.testPackageReferenceInComponentScan | Always red because of test data | ||
| 41 | org.jetbrains.kotlin.idea.stubs.MultiFileHighlightingTestGenerated.testTopLevelMembersReference | Always red | ||
| 42 | org.jetbrains.kotlin.j2k.JavaToKotlinConverterSingleFileTestGenerated.AnonymousClass.testKt_13146 | |||
| 43 | org.jetbrains.kotlin.j2k.JavaToKotlinConverterSingleFileTestGenerated.Issues.testKt_807 | |||
| 44 | org.jetbrains.kotlin.psi.injection.StringInterpolationInjectionTest.testInterpolationSimpleName | Stable failure during run may work in debug | ||
| 45 | org.jetbrains.kotlin.shortenRefs.ShortenRefsTestGenerated.testExtensionForObject2 | Always red | ||
| 46 | org.jetbrains.kotlin.idea.debugger.test.AsyncStackTraceTestGenerated.testAsyncLambdas | redesign test AsyncStackTraces | ||
| 47 | org.jetbrains.kotlin.idea.quickfix.QuickFixTestGenerated.ConvertToAnonymousObject.testHasConcreateMember2 | Unprocessed | ||
| 48 | org.jetbrains.uast.test.kotlin.KotlinUastTypesTest.testEa101715 | Unprocessed | ||
| 49 | org.jetbrains.kotlin.idea.quickfix.QuickFixTestGenerated.CreateFromUsage.CreateFunction.Invoke.testLambdaArgument | Unprocessed | ||
| 50 | org.jetbrains.kotlin.idea.decompiler.navigation.NavigateJavaToLibrarySourceTestGenerated.testClassAndConstuctors | Unprocessed | ||
| 51 | org.jetbrains.kotlin.idea.decompiler.navigation.NavigateJavaToLibrarySourceTestGenerated.testOverloadedFun | Unprocessed | ||
| 52 | org.jetbrains.kotlin.idea.decompiler.navigation.NavigateJavaToLibrarySourceTestGenerated.testRenamedElements | Unprocessed | ||
| 53 | org.jetbrains.kotlin.idea.navigation.GotoWithMultipleLibrariesTest.testOneHasSourceAndOneDoesNot | FLAKY | ||
| 54 | org.jetbrains.kotlin.idea.navigation.GotoWithMultipleLibrariesTest.testOneHasSourceAndManyDoNot | FLAKY | ||
| 55 | org.jetbrains.kotlin.idea.navigation.GotoWithMultipleLibrariesTest.testSeveralWithSource | FLAKY | ||
| 56 | org.jetbrains.kotlin.tools.projectWizard.wizard.ProjectTemplateNewWizardProjectImportTestGenerated.GradleGroovy.testMultiplatformApplication | |||
| 57 | org.jetbrains.kotlin.tools.projectWizard.wizard.ProjectTemplateNewWizardProjectImportTestGenerated.GradleKts.testMultiplatformApplication | |||
| 58 | org.jetbrains.kotlin.gradle.NewMultiplatformIT.testJavaSupportInJvmTargets | |||
| 59 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinBinariesCheckerTestGenerated.testJvmOverloadsFunctions | FLAKY | ||
| 60 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinBinariesCheckerTestGenerated.testReturnInnerClasses | FLAKY | ||
| 61 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinBinariesCheckerTestGenerated.testThrowsOnGenericMethod | FLAKY | ||
| 62 | org.jetbrains.kotlin.idea.debugger.test.ContinuationStackTraceTestGenerated.testSuspendFunWithInner | FLAKY | ||
| 63 | org.jetbrains.kotlin.idea.debugger.test.XCoroutinesStackTraceTestGenerated.testSuspendMain | FLAKY | ||
| 64 | org.jetbrains.kotlin.gradle.SubpluginsIT.testKotlinVersionDowngradeInSupbrojectKt39809 | FLAKY | ||
| 65 | org.jetbrains.kotlin.findUsages.KotlinFindUsagesWithLibraryTestGenerated.KotlinLibrary.testLibrarySecondaryConstructorUsages | FLAKY | ||
| 66 | org.jetbrains.kotlin.findUsages.KotlinFindUsagesWithLibraryTestGenerated.KotlinLibrary.testLibraryNestedClassSecondaryConstructorUsages | FLAKY | ||
| 67 | org.jetbrains.kotlin.findUsages.FindUsagesTestGenerated.Java.FindJavaMethodUsages.testJavaInvokeWithStaticImport | FLAKY | ||
| 68 | org.jetbrains.kotlin.checkers.JavaAgainstKotlinBinariesCheckerTestGenerated.testEnumStaticImportInJava | FLAKY | ||
| 69 | org.jetbrains.kotlin.findUsages.KotlinFindUsagesWithLibraryTestGenerated.KotlinLibrary.testLibraryNestedClassUsages | FLAKY | ||
| 70 | org.jetbrains.kotlin.findUsages.KotlinFindUsagesWithLibraryTestGenerated.KotlinLibrary.testLibraryMemberFunctionUsages | FLAKY | ||
| 71 | org.jetbrains.kotlin.daemon.CompilerDaemonTest.testParallelDaemonStart | |||
| 72 | org.jetbrains.kotlin.idea.repl.IdeReplExecutionTest.testOnePlusOne | FLAKY | ||
| 73 | org.jetbrains.kotlin.idea.quickfix.QuickFixMultiFileTestGenerated.MakePrivateAndOverrideMember.testSetter | Unprocessed | ||
| 74 | org.jetbrains.kotlin.idea.caches.resolve.IdeLightClassTestGenerated.testAnnotatedPropertyWithSites | Unprocessed | ||
| 75 | org.jetbrains.kotlin.asJava.classes.UltraLightClassSanityTestGenerated.testAnnotatedPropertyWithSites | Unprocessed | ||
| 76 | org.jetbrains.kotlin.idea.caches.resolve.IdeLightClassTestGenerated.Facades.testSingleJvmClassName | Invalid behavior of old lightclasses in common tests | ||
| 77 | org.jetbrains.kotlin.idea.caches.resolve.IdeLightClassTestGenerated.CompilationErrors.testActualTypeAliasCustomJvmPackageName | Invalid behavior of old lightclasses in common tests | ||
| 78 | org.jetbrains.kotlin.idea.caches.resolve.IdeLightClassTestGenerated.CompilationErrors.testJvmPackageName | Invalid behavior of old lightclasses in common tests | ||
| 79 | org.jetbrains.uast.test.kotlin.SimpleKotlinRenderLogTest.testReceiverFun | Analysing of facade annotation with receiver site is broken (connected with KT-40403) | ||
| 80 | org.jetbrains.kotlin.checkers.FirKotlinHighlightingPassTestGenerated.Regression.testJet53 | FLAKY | ||
| 81 | org.jetbrains.kotlin.checkers.FirKotlinHighlightingPassTestGenerated.Checker.testResolveTypeInAnnotationArgumentRuntime | FLAKY | ||
| 82 | org.jetbrains.kotlin.idea.caches.resolve.MultiModuleHighlightingTest.testLanguageVersionsViaFacets | FLAKY | ||
| 83 | org.jetbrains.kotlin.jps.build.IncrementalJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAdded | KT-44844 fixed in IDEA 212 | ||
| 84 | org.jetbrains.kotlin.jps.build.IncrementalJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddedSamAdapter | KT-44844 fixed in IDEA 212 | ||
| 85 | org.jetbrains.kotlin.jps.build.IncrementalJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddDefault | KT-44844 fixed in IDEA 212 | ||
| 86 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAdded | KT-44844 fixed in IDEA 212 | ||
| 87 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddedSamAdapter | KT-44844 fixed in IDEA 212 | ||
| 88 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddDefault | KT-44844 fixed in IDEA 212 | ||
| 89 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAdded | KT-44844 fixed in IDEA 212 | ||
| 90 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddedSamAdapter | KT-44844 fixed in IDEA 212 | ||
| 91 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddDefault | KT-44844 fixed in IDEA 212 | ||
| 92 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAdded | KT-44844 fixed in IDEA 212 | ||
| 93 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddedSamAdapter | KT-44844 fixed in IDEA 212 | ||
| 94 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.WithJava.JavaUsedInKotlin.SamConversions.testMethodAddDefault | KT-44844 fixed in IDEA 212 | ||
| 95 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.PureKotlin.testRemoveMemberTypeAlias | KT-55195 | ||
| 96 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.PureKotlin.testRemoveMemberTypeAlias | KT-55195 | ||
| 97 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.PureKotlin.testRemoveMemberTypeAlias | KT-55195 | ||
| 98 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.PureKotlin.testAddMemberTypeAlias | KT-55195 | ||
| 99 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.PureKotlin.testAddMemberTypeAlias | KT-55195 | ||
| 100 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.PureKotlin.testAddMemberTypeAlias | KT-55195 | ||
| 101 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.IncrementalJvmCompilerOnly.testChangeAnnotationInJavaClass | KT-55696 | ||
| 102 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testChangeAnnotationInJavaClass | KT-55696 | ||
| 103 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testChangeAnnotationInJavaClass | KT-55696 | ||
| 104 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddNestedClass | KT-55696 | ||
| 105 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddNestedClass | KT-55696 | ||
| 106 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddNestedClass | KT-55696 | ||
| 107 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddAnnotationToJavaClass | KT-55696 | ||
| 108 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddAnnotationToJavaClass | KT-55696 | ||
| 109 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.IncrementalJvmCompilerOnly.testAddAnnotationToJavaClass | KT-55696 | ||
| 110 | org.jetbrains.kotlin.jps.build.IncrementalK2JvmJpsTestGenerated.PureKotlin.testAllConstants | test should be changed and fixed in next commits - KT-54991 | ||
| 111 | org.jetbrains.kotlin.jps.build.IncrementalK2LightTreeJvmJpsTestGenerated.PureKotlin.testAllConstants | test should be changed and fixed in next commits - KT-54991 | ||
| 112 | org.jetbrains.kotlin.jps.build.IncrementalK2FirICLightTreeJvmJpsTestGenerated.PureKotlin.testAllConstants | test should be changed and fixed in next commits - KT-54991 |