Skip to content

[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncycastle/opera… #5611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jan 10, 2024
Merged

[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncycastle/opera… #5611

merged 1 commit into from
Jan 10, 2024

Conversation

@NihalJain
Copy link
Contributor

@NihalJain NihalJain commented Jan 8, 2024

…tor/OperatorCreationException

@NihalJain
Copy link
Contributor Author

NihalJain commented Jan 8, 2024 •
edited
Loading

Searched for all tests invoking startMiniMapReduceCluster+ Flaky Test list. Ran them as follows:
mvn --no-snapshot-updates -Dtest=TestBackupSmallTests,TestIncrementalBackup,IntegrationTestLoadAndVerify,IntegrationTestBigLinkedList,IntegrationTestLoadCommonCrawl,IntegrationTestFileBasedSFTBulkLoad,IntegrationTestBulkLoad,IntegrationTestImportTsv,TestHBaseMRTestingUtility,TestVerifyReplicationCrossDiffHdfs,TestExportSnapshot,TestExportSnapshotWithTemporaryDirectory,TestMobExportSnapshot,,TestMobSecureExportSnapshot,TestSecureExportSnapshot -pl hbase-backup,hbase-it,hbase-mapreduce package

Some tests pass with patch, fails without. Except for IntegrationTestImportTsv which fails irrespective.

While trying to run these tests, found issues in IntegrationTestImportTsv,, will fix as part of HBASE-28297, as they are unrelated

CC: @Apache9

@NihalJain NihalJain changed the title [ADDENDUM] Few tests are failing due to NCDFE: org/bouncycastle/opera… [ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncycastle/opera… Jan 8, 2024
@Apache-HBase
Copy link

Apache-HBase commented Jan 8, 2024

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 32s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
_ master Compile Tests _
+0 🆗 mvndep 0m 14s Maven dependency ordering for branch
+1 💚 mvninstall 2m 58s master passed
+1 💚 compile 1m 24s master passed
+1 💚 spotless 0m 45s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 12s Maven dependency ordering for patch
+1 💚 mvninstall 2m 47s the patch passed
+1 💚 compile 1m 22s the patch passed
+1 💚 javac 1m 22s the patch passed
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 xml 0m 4s The patch has no ill-formed XML file.
+1 💚 hadoopcheck 4m 58s Patch does not cause any errors with Hadoop 3.3.6.
+1 💚 spotless 0m 42s patch has no errors when running spotless:check.
_ Other Tests _
+1 💚 asflicense 0m 29s The patch does not generate ASF License warnings.
22m 29s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR #5611
Optional Tests dupname asflicense javac hadoopcheck spotless xml compile
uname Linux 14fb8ecc76dd 5.4.0-166-generic #183-Ubuntu SMP Mon Oct 2 11:28:33 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 71cecb0
Default Java Eclipse Adoptium-11.0.17+8
Max. process+thread count 74 (vs. ulimit of 30000)
modules C: hbase-mapreduce hbase-backup hbase-it U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/console
versions git=2.34.1 maven=3.8.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

Apache-HBase commented Jan 8, 2024

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 31s Docker mode activated.
-0 ⚠️ yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗 mvndep 0m 17s Maven dependency ordering for branch
+1 💚 mvninstall 2m 39s master passed
+1 💚 compile 0m 46s master passed
+1 💚 shadedjars 5m 31s branch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 0m 33s master passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 12s Maven dependency ordering for patch
+1 💚 mvninstall 2m 24s the patch passed
+1 💚 compile 0m 46s the patch passed
+1 💚 javac 0m 46s the patch passed
+1 💚 shadedjars 5m 28s patch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 0m 31s the patch passed
_ Other Tests _
+1 💚 unit 13m 58s hbase-mapreduce in the patch passed.
+1 💚 unit 9m 6s hbase-backup in the patch passed.
+1 💚 unit 0m 38s hbase-it in the patch passed.
44m 42s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR #5611
Optional Tests javac javadoc unit shadedjars compile
uname Linux 0f321d909d4a 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 71cecb0
Default Java Temurin-1.8.0_352-b08
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/testReport/
Max. process+thread count 3647 (vs. ulimit of 30000)
modules C: hbase-mapreduce hbase-backup hbase-it U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/console
versions git=2.34.1 maven=3.8.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

Apache-HBase commented Jan 8, 2024

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 38s Docker mode activated.
-0 ⚠️ yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗 mvndep 0m 13s Maven dependency ordering for branch
+1 💚 mvninstall 3m 1s master passed
+1 💚 compile 0m 57s master passed
+1 💚 shadedjars 5m 3s branch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 0m 43s master passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 14s Maven dependency ordering for patch
+1 💚 mvninstall 2m 45s the patch passed
+1 💚 compile 0m 56s the patch passed
+1 💚 javac 0m 56s the patch passed
+1 💚 shadedjars 4m 59s patch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 0m 42s the patch passed
_ Other Tests _
+1 💚 unit 16m 51s hbase-mapreduce in the patch passed.
+1 💚 unit 9m 58s hbase-backup in the patch passed.
+1 💚 unit 0m 42s hbase-it in the patch passed.
49m 1s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR #5611
Optional Tests javac javadoc unit shadedjars compile
uname Linux f1eadbc43eab 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 71cecb0
Default Java Eclipse Adoptium-11.0.17+8
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/testReport/
Max. process+thread count 3515 (vs. ulimit of 30000)
modules C: hbase-mapreduce hbase-backup hbase-it U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5611/1/console
versions git=2.34.1 maven=3.8.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@NihalJain NihalJain mentioned this pull request Jan 9, 2024
Merged
@NihalJain NihalJain requested a review from Apache9 January 10, 2024 03:54
@NihalJain
Copy link
Contributor Author

NihalJain commented Jan 10, 2024 •
edited
Loading

Rebased and ran test. IntegrationTestImportTsv now fails due to reflection issue. Should I raise another issue and fix? I have figured out a fix to solve the error. or should I club with this change, although unrelated to this? Please let me know how to proceed. @Apache9

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 337.526 s <<< FAILURE! - in org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv
[ERROR] org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.testGenerateAndLoad  Time elapsed: 279.783 s  <<< ERROR!
java.lang.UnsupportedOperationException: Unable to find suitable constructor for class org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv$2
        at org.apache.hadoop.hbase.util.ReflectionUtils.findConstructor(ReflectionUtils.java:133)
        at org.apache.hadoop.hbase.util.ReflectionUtils.newInstance(ReflectionUtils.java:98)
        at org.apache.hadoop.hbase.client.RawAsyncTableImpl.getScanner(RawAsyncTableImpl.java:628)
        at org.apache.hadoop.hbase.client.RawAsyncTableImpl.getScanner(RawAsyncTableImpl.java:90)
        at org.apache.hadoop.hbase.client.TableOverAsyncTable.getScanner(TableOverAsyncTable.java:198)
        at org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.doLoadIncrementalHFiles(IntegrationTestImportTsv.java:156)
        at org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.generateAndLoad(IntegrationTestImportTsv.java:206)
        at org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.testGenerateAndLoad(IntegrationTestImportTsv.java:187)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
        at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
        at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
        at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
        at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
        at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
        at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
        at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
        at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
        at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
        at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
        at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:316)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:240)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:214)
        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:155)
        at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385)
        at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
        at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495)

[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Errors: 
[ERROR]   IntegrationTestImportTsv.testGenerateAndLoad:187->generateAndLoad:206->doLoadIncrementalHFiles:156 » UnsupportedOperation Unable to find suitable constructor for class org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv$2

@Apache9
Copy link
Contributor

Apache9 commented Jan 10, 2024

+1, please file another issue for fixing the test itself~

@NihalJain
Copy link
Contributor Author

NihalJain commented Jan 10, 2024

+1, please file another issue for fixing the test itself~

Sure let me commit this and raise a fix for reflection issue.

@NihalJain NihalJain merged commit 0db4231 into apache:master Jan 10, 2024
NihalJain added a commit that referenced this pull request Jan 10, 2024
@NihalJain
[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncy…
4e9431d 
…castle/operator/OperatorCreationException (#5611)

Signed-off-by: Duo Zhang <[email protected]>
NihalJain added a commit that referenced this pull request Jan 10, 2024
@NihalJain
[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncy…
b0d1402 
…castle/operator/OperatorCreationException (#5611)

Signed-off-by: Duo Zhang <[email protected]>
(cherry picked from commit 0db4231)
NihalJain added a commit that referenced this pull request Jan 10, 2024
@NihalJain
[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncy…
a2896e9 
…castle/operator/OperatorCreationException (#5611)

Signed-off-by: Duo Zhang <[email protected]>
(cherry picked from commit 0db4231)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Apache9 Apache9 Apache9 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@NihalJain @Apache-HBase @Apache9