[AUTOCUT] Gradle Check Flaky Test Report for RemoteStoreKafkaIT

[opensearch-ci-bot]

Flaky Test Report for RemoteStoreKafkaIT

Noticed the RemoteStoreKafkaIT has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
17289b7	17663	54990	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
4c76c1d	18027	57085	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
6b976ea	17836	55861	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
a8b1734	18087	57282	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
ddb4354	17893	56370	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testErrorStrategy
e8b975d	17750	55870	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the RemoteStoreKafkaIT class are:

• 17631
• 17752
• 17764
• 17273
• 17712
• 17771
• 17815
• 17941
• 17336
• 17495
• 17575
• 17612
• 17615
• 17619
• 17679
• 17699
• 17729
• 17733
• 17757
• 17791
• 17843
• 17912
• 18054
• 18063
• 18153

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[krisfreedain]

Catch all triage - 1

[andrross]

@yupeng9 @varunbharadwaj Can one of you take a look here? These tests have been pretty flaky. Here's an example:

https://build.ci.opensearch.org/job/gradle-check/57507/consoleText

REPRODUCE WITH: ./gradlew ':plugins:ingestion-kafka:internalClusterTest' --tests "org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion" -Dtests.seed=99C705639E2EC4B4 -Dtests.security.manager=false -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=bem-ZM -Dtests.timezone=SystemV/AST4ADT -Druntime.java=21

RemoteStoreKafkaIT > testPauseAndResumeIngestion FAILED
    java.lang.AssertionError: expected:<2> but was:<4>
        at __randomizedtesting.SeedInfo.seed([99C705639E2EC4B4:473224DAFADE6AA]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion(RemoteStoreKafkaIT.java:216)

[yupeng9]

ack, will take a look