-
-
Notifications
You must be signed in to change notification settings - Fork 9.3k
Java 11 test failure: no need to log at WARNING #3811
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
java.lang.AssertionError: expected:<[]> but was:<[Running Jenkins with Java 11 which is available in the preview mode only. A custom experimental update center will be used: https://updates.jenkins.io/temporary-experimental-java11/]> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:834) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at jenkins.model.StartupTest.noWarnings(StartupTest.java:45) Note that this was marked as a flake because Surefire reruns the test (apparently in the same JVM despite reuse.forks=false) and the message is printed in a static initializer, which gets run just once.
oleg-nenashev
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
-0.5. I think it should be a warning while we are in the preview mode. It kinda duplicates the warning from Extras executable war, but IMHO here you are just adjust the behavior to the test. IMO we should ignore the warning for Java 11 and create a follow-up to remove it along with the experimental UC
Subjective I guess. To me this feels like an information message. Nothing is necessarily broken. |
Do you have a specific recommendation? I am loath to hard-code this message into |
Hardcoding looks like an acceptable option to me |
|
I tend to disagree, and since we are at an impasse, I would rather leave the test broken (but rerun as a flake) for the duration of the preview mode than clutter the test. |
Note that this was marked as a flake because Surefire reruns the test (apparently in the same JVM despite
reuse.forks=false) and the message is printed in astaticinitializer, which gets run just once.I was actually looking around at other flakes I saw in #3804, one of which I fixed there (08d273f) because it happened enough to mark the build unstable. The others I saw were
which are long-known flakes; in #2188 I let them be since
rerunFailingTestsCountseems to take care of them, but perhaps these tests should just be disabled (if there is no obvious way to fix them).