首页 > 编程语言 >hadoop-3.0.0-cdh6.3.2源码编译实践

hadoop-3.0.0-cdh6.3.2源码编译实践

时间:2022-09-21 09:33:05浏览次数:114  
标签:cloudera cdh6.3 hadoop 编译 源码 https

1.编译过程

参考:https://blog.mygallop.cn/2020/10/centos/hadoop-cdh6-compile/

2.问题记录

  1. CDH6.3.2 Hadoop源码位置发生变化,新地址为https://github.com/cloudera/hadoop-commo.old/archive/cdh6.3.2-release.tar.gz
wget https://github.com/cloudera/hadoop-common.old/archive/cdh6.3.2-release.tar.gz -O hadoop-common-cdh6.3.2-release.tar.gz
  1. 修改源码根目录下的pom.xml,pluginRepositories中添加cdh的repo:
<pluginRepositories>
  <pluginRepository>
    <id>huaweicloud-plugin</id>
    <url>http://mirrors.huaweicloud.com/repository/maven</url>
    <snapshots>
      <enabled>true</enabled>
    </snapshots>
  </pluginRepository>
        <pluginRepository>
            <id>cdh.repo.plugin</id>
            <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
            <name>Cloudera Repositories</name>
            <snapshots>
                <enabled>false</enabled>
            </snapshots>
        </pluginRepository>
</pluginRepositories>

  1. 编译过程中会下载大量的jar包,可能由于网络问题编译失败,多编译几次即可。

标签:cloudera,cdh6.3,hadoop,编译,源码,https
From: https://www.cnblogs.com/flowerbirds/p/16714438.html

相关文章