ERROR [26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10 #741
Description
I am currently trying to build hibench in docker and Im running into this issue
=> ERROR [26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10 3.7s
[26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10:
1.908 [INFO] Scanning for projects...
2.294 [WARNING]
2.294 [WARNING] Some problems were encountered while building the effective model for com.intel.hibench.stormbench:stormbench-streaming:jar:6.0
2.294 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-shade-plugin is missing. @ line 97, column 15
2.294 [WARNING]
2.295 [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
2.295 [WARNING]
2.295 [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
2.295 [WARNING]
2.305 [INFO] ------------------------------------------------------------------------
2.305 [INFO] Reactor Build Order:
2.305 [INFO]
2.306 [INFO] hibench
2.306 [INFO] hibench-common
2.306 [INFO] HiBench data generation tools
2.306 [INFO] sparkbench
2.306 [INFO] sparkbench-common
2.307 [INFO] sparkbench micro benchmark
2.307 [INFO] sparkbench machine learning benchmark
2.307 [INFO] sparkbench-websearch
2.307 [INFO] sparkbench-graph
2.307 [INFO] sparkbench-sql
2.308 [INFO] sparkbench-streaming
2.308 [INFO] sparkbench project assembly
2.309 [INFO] flinkbench
2.309 [INFO] flinkbench-streaming
2.310 [INFO] gearpumpbench
2.310 [INFO] gearpumpbench-streaming
2.310 [INFO] hadoopbench
2.311 [INFO] hadoopbench-sql
2.311 [INFO] mahout
2.311 [INFO] PEGASUS: A Peta-Scale Graph Mining System
2.312 [INFO] nutchindexing
2.312 [INFO] stormbench
2.313 [INFO] stormbench-streaming
2.319 [INFO]
2.319 [INFO] ------------------------------------------------------------------------
2.319 [INFO] Building hibench 6.0
2.319 [INFO] ------------------------------------------------------------------------
2.630 Downloading: https://oss.sonatype.org/content/groups/scala-tools/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom
Downloading: http://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom
[INFO] ------------------------------------------------------------------------
3.538 [INFO] Reactor Summary:
3.538 [INFO]
3.539 [INFO] hibench ........................................... FAILURE [1.219s]
3.539 [INFO] hibench-common .................................... SKIPPED
3.540 [INFO] HiBench data generation tools ..................... SKIPPED
3.540 [INFO] sparkbench ........................................ SKIPPED
3.540 [INFO] sparkbench-common ................................. SKIPPED
3.540 [INFO] sparkbench micro benchmark ........................ SKIPPED
3.541 [INFO] sparkbench machine learning benchmark ............. SKIPPED
3.541 [INFO] sparkbench-websearch .............................. SKIPPED
3.541 [INFO] sparkbench-graph .................................. SKIPPED
3.542 [INFO] sparkbench-sql .................................... SKIPPED
3.542 [INFO] sparkbench-streaming .............................. SKIPPED
3.542 [INFO] sparkbench project assembly ....................... SKIPPED
3.542 [INFO] flinkbench ........................................ SKIPPED
3.542 [INFO] flinkbench-streaming .............................. SKIPPED
3.543 [INFO] gearpumpbench ..................................... SKIPPED
3.543 [INFO] gearpumpbench-streaming ........................... SKIPPED
3.544 [INFO] hadoopbench ....................................... SKIPPED
3.544 [INFO] hadoopbench-sql ................................... SKIPPED
3.544 [INFO] mahout ............................................ SKIPPED
3.544 [INFO] PEGASUS: A Peta-Scale Graph Mining System ......... SKIPPED
3.544 [INFO] nutchindexing ..................................... SKIPPED
3.545 [INFO] stormbench ........................................ SKIPPED
3.545 [INFO] stormbench-streaming .............................. SKIPPED
3.545 [INFO] ------------------------------------------------------------------------
3.545 [INFO] BUILD FAILURE
3.545 [INFO] ------------------------------------------------------------------------
3.546 [INFO] Total time: 1.668s
3.546 [INFO] Finished at: Thu Mar 14 19:26:42 UTC 2024
3.619 [INFO] Final Memory: 6M/119M
3.619 [INFO] ------------------------------------------------------------------------
3.623 [ERROR] Plugin org.apache.maven.plugins:maven-clean-plugin:2.4.1 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-clean-plugin:jar:2.4.1: Could not transfer artifact org.apache.maven.plugins:maven-clean-plugin:pom:2.4.1 from/to scala-tools.org (https://oss.sonatype.org/content/groups/scala-tools/): Access denied to: https://oss.sonatype.org/content/groups/scala-tools/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom , ReasonPhrase:Forbidden. -> [Help 1]
3.623 [ERROR]
3.623 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
3.623 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
3.624 [ERROR]
3.624 [ERROR] For more information about the errors and possible solutions, please read the following articles:
3.624 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
Dockerfile:146
145 | RUN apt-get update && apt-get install -y thrift-compiler
146 | >>> RUN cd ${HIBENCH_HOME} &&
147 | >>> mvn clean package -Dspark=1.6 -Dscala=2.10
148 |
ERROR: failed to solve: process "/bin/sh -c cd ${HIBENCH_HOME} && mvn clean package -Dspark=1.6 -Dscala=2.10" did not complete successfully: exit code: 1
Start building hibench-docker image...
[+] Building 0.5s (2/2) FINISHED docker:default
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 2.71kB 0.0s
=> ERROR [internal] load metadata for docker.io/library/hibench-base:latest 0.4s
[internal] load metadata for docker.io/library/hibench-base:latest:
Dockerfile:19
17 | # build opensource environment on hibench-base
18 |
19 | >>> FROM hibench-base
20 |
21 | USER root
ERROR: failed to solve: hibench-base: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
Usage run_container.sh {cdh|open-source}
Where I am thinking it may be with downloading from http://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom where i believer it should be a https:// although I am not sure. I also don't know where to go to find this.