BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.

[iwasakims]

https://issues.apache.org/jira/browse/BIGTOP-3926

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-shade-plugin:3.1.0:shade (default) on project hive-jdbc: Error creating shaded jar: null: IllegalArgumentException -> [Help 1

The error was caused by upgrading Bouncy Castle on Hadoop side. maven-shade-plugin must be upgraded to handle multi-JVM jar.

This is follow-up of #1101 and depending on #1102.

[guyuqi]

It failed to build Hbase (running Hadoop, Hive smoke tests ) when I applied PR #1101, #1102 and #1103 on Ubuntu-22.04 (x86_64/Arm64).

[INFO] Dependencies classpath:
/ws/bigtop/output/hbase/hbase-2.4.13/hbase-shaded/hbase-shaded-client/target/hbase-shaded-client-2.4.13.jar
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:exec (check-jar-contents-for-stuff-with-hadoop) @ hbase-shaded-with-hadoop-check-invariants ---
[ERROR] Found artifact with unexpected contents: '/ws/bigtop/output/hbase/hbase-2.4.13/hbase-shaded/hbase-shaded-client/target/hbase-shaded-client-2.4.13.jar'
    Please check the following and either correct the build or update
......
...
    com/sun/xml/txw2/output/XmlSerializer.class
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)
...
..
.
[INFO] Apache HBase - Assembly ............................ SUCCESS [ 36.068 s]
[INFO] Apache HBase - Shaded - Testing Util ............... SUCCESS [ 51.800 s]
[INFO] Apache HBase - Shaded - Testing Util Tester ........ SUCCESS [  3.054 s]
[INFO] Apache HBase Shaded Packaging Invariants ........... SUCCESS [  2.608 s]
[INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled) FAILURE [  1.547 s]
[INFO] Apache HBase - Archetypes .......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  07:48 min
[INFO] Finished at: 2023-04-17T08:23:28Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:
exec (check-jar-contents-for-stuff-with-hadoop) on project hbase-shaded-with-hadoop-check-invariants:
 Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]

[iwasakims]

It failed to build Hbase (running Hadoop, Hive smoke tests ) when I applied PR #1101, #1102 and #1103 on Ubuntu-22.04 (x86_64/Arm64).

The issue will be addressed by BIGTOP-3927. This(#1103) is a patch for Hive. HBase issue is not related at all. @guyuqi

[guyuqi]

oops, I didn't notice BIGTOP-3927 there.
I'm used to running smoke tests of hdfs, yarn ,mapreduce hbase and hive together.
Let me test it separately and thanks for the heads up.

[sekikn]

+1, tested on master with CentOS 7 using the following command:

$ ./docker-hadoop.sh -d -C config_centos-7.yaml -L -k hdfs,yarn,hive -s hive -c 3

and on branch-3.2 with Ubuntu 20.04 using the following command:

$ ./docker-hadoop.sh -d -C config_ubuntu-20.04.yaml -G -L -k hdfs,yarn,hive -s hive -c 3

[sekikn]

Merged into master and branch-3.2.