首页 > 其他分享 >Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1

Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1

时间：2023-09-27 17:01:38浏览次数：51  
标签：hod 1.0 单机 hodlib share hadoop Hadoop usr contrib


装完的HDFS用IE打开访问，查看其磁盘使用情况：http://192.168.33.10:50070/dfshealth.jsp

 step 1. 为Hadoop增加用户,记住设定的密码 



Java代码  


1. $ sudo addgroup hadoop  
2. $ sudo adduser --ingroup hadoop hduser


step 2. ssh的安装与设置 


由于Hadoop用ssh 通信，因此首先要安装SSH Server 


Java代码  


1. $ sudo apt-get install ssh


下面进行免密码登录设定，su 命令执行后，输入刚才设定的密码 


Java代码  

  
      
     
   
1. $ su - hduser   
2. $ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa   
3. $ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys   
4. $ ssh localhost



生成用于SSH的密钥 ，完成后请登入确认不用输入密码，（第一次登入需按enter键，第二次就可以直接登入到系统。 


Java代码  

1. ~$ ssh localhost  
2. ~$ exit  
3. ~$ ssh localhost  
4. ~$ exit


step 3. 安装java 



笔者采用的是离线的tar，解压到/opt/java1.7.0/ 


Java代码  


1. •$ tar zxvf jdk1.7.0.tar.gz  
2. •$ sudo mv jdk1.7.0 /opt/java/


配置环境 


Java代码  


    1. •$ sudo gedit /opt/profile



    在 "umask 022"之前输入 as below  


    export JAVA_HOME=/opt/java/jdk1.7.0  
  
export JRE_HOME=$JAVA_HOME/jre  
  
export CLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/lib  
  
export PATH=$PATH:$JRE_HOME/bin:$JAVA_HOME/bin


    step 4. 下载安装Hadoop 



    •下载 Hadoop-1.0.2，并解开压缩文件到 /opt 路径。 


    Java代码  


      1. •$ tar zxvf Hadoop-1.0.2.tar.gz  
2. •$ sudo mv Hadoop-1.0.2 /opt/  
3. •$ sudo chown -R hduser:hadoop /opt/Hadoop-1.0.2



      step 5. 设定 hadoop-env.sh 



      •进入 hadoop 目录，做进一步的设定。我们需要修改两个档案，第一个是 hadoop-env.sh，需要设定 JAVA_HOME, HADOOP_HOME, PATH 三个环境变量。


      /opt$ cd Hadoop-1.0.2/ 


      /opt/Hadoop-1.0.2$ cat >> conf/hadoop-env.sh << EOF 


      贴上以下信息  


      export JAVA_HOME=/opt/java/jdk1.7.0  
  
export HADOOP_HOME=/opt/Hadoop-1.0.2  
  
export PATH=$PATH:$HADOOP_HOME/bin  
  
EOF




      这里我有一点不明白，明明/etc/profile里已经指定了JAVA_HOME，这里为什么还需要指定? 



      step 6. 设定 hadoop配置文件 



      •编辑 $HADOOP_HOME/conf/core-site.xml  


      <configuration>  
  
  <property>  
  
    <name>fs.default.name</name>  
  
    <value>hdfs://localhost:9000</value>  
  
  </property>  
  
  <property>  
  
    <name>hadoop.tmp.dir</name>  
  
    <value>/tmp/hadoop/hadoop-${user.name}</value>  
  
  </property>  
  
</configuration>



      •编辑 HADOOP_HOME/conf/hdfs-site.xml  


      <configuration>  
  
  <property>  
  
    <name>dfs.replication</name>  
  
    <value>1</value>  
  
  </property>  
  
</configuration>


      • 编辑 HADOOP_HOME/conf/mapred-site.xml  


      <configuration>  
  
  <property>  
  
    <name>mapred.job.tracker</name>  
  
    <value>localhost:9001</value>  
  
  </property>  
  
</configuration>



      step 7. 格式化HDFS 



      •以上我们已经设定好 Hadoop 单机测试的环境，接着让我们来启动 Hadoop 相关服务，格式化 namenode， secondarynamenode, tasktracker


      Java代码  

      1. •$ cd /opt/Hadoop-1.0.2  
2. •$ source /opt/Hadoop-1.0.2/conf/hadoop-env.sh  
3. •$ hadoop namenode -format


      执行上面的语句会报空指针错误，因为默认 hadoop.tmp.dir= tmp/hadoop/hadoop-${user.name} 


      如果你要修改的话可以 


      Java代码  

      1. •/opt/hadoop-1.0.2/conf$ sudo gedit core-site.xml


      <!-- In: conf/core-site.xml -->  
  
<property>  
  
  <name>hadoop.tmp.dir</name>  
  
  <value>/tmp/hadoop/hadoop-${user.name}</value>  
  
  <description>A base for other temporary directories.</description>  
  
</property>



      给此路径路径设定权限 


      Java代码  

      1. $ sudo mkdir -p /tmp/hadoop/hadoop-hduser  
2. $ sudo chown hduser:hadoop /tmp/hadoop/hadoop-hduser  
3. # ...and if you want to tighten up security, chmod from 755 to 750...  
4. $ sudo chmod 750 /tmp/hadoop/hadoop-hduser


      在执行的格式化就会看到 


      执行画面如：  


      [: 107: namenode: unexpected operator  
  
12/05/07 20:47:40 INFO namenode.NameNode: STARTUP_MSG:  
  
/************************************************************  
  
STARTUP_MSG: Starting NameNode  
  
STARTUP_MSG:   host = seven7-laptop/127.0.1.1  
  
STARTUP_MSG:   args = [-format]  
  
STARTUP_MSG:   version = 1.0.2  
  
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0.2 -r 1304954; compiled by 'hortonfo' on Sat Mar 24 23:58:21 UTC 2012 
  
************************************************************/  
  
12/05/07 20:47:41 INFO util.GSet: VM type       = 32-bit  
  
12/05/07 20:47:41 INFO util.GSet: 2% max memory = 17.77875 MB  
  
12/05/07 20:47:41 INFO util.GSet: capacity      = 2^22 = 4194304 entries  
  
12/05/07 20:47:41 INFO util.GSet: recommended=4194304, actual=4194304  
  
12/05/07 20:47:41 INFO namenode.FSNamesystem: fsOwner=hduser  
  
12/05/07 20:47:41 INFO namenode.FSNamesystem: supergroup=supergroup  
  
12/05/07 20:47:41 INFO namenode.FSNamesystem: isPermissionEnabled=true  
  
12/05/07 20:47:41 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100  
  
12/05/07 20:47:41 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 
  
12/05/07 20:47:41 INFO namenode.NameNode: Caching file names occuring more than 10 times 
  
12/05/07 20:47:42 INFO common.Storage: Image file of size 112 saved in 0 seconds. 
  
12/05/07 20:47:42 INFO common.Storage: Storage directory /tmp/hadoop/hadoop-hduser/dfs/name has been successfully formatted. 
  
12/05/07 20:47:42 INFO namenode.NameNode: SHUTDOWN_MSG:  
  
/************************************************************  
  
SHUTDOWN_MSG: Shutting down NameNode at seven7-laptop/127.0.1.1  
  
************************************************************/

      step 7. 启动Hadoop 



      •接着用 start-all.sh 来启动所有服务，包含 namenode, datanode, 


      $HADOOP_HOME/bin/start-all.sh 


      Java代码  



        1. •opt/hadoop-1.0.2/bin$ sh ./start-all.sh



        执行画面如： 

        •starting namenode, logging to /opt/hadoop-1.0.2/logs/hadoop-hduser-namenode-seven7-laptop.out


        localhost: 


        localhost: starting datanode, logging to /opt/hadoop-1.0.2/logs/hadoop-hduser-datanode-seven7-laptop.out


        localhost: 


        localhost: starting secondarynamenode, logging to /opt/hadoop-1.0.2/logs/hadoop-hduser-secondarynamenode-seven7-laptop.out


        starting jobtracker, logging to /opt/hadoop-1.0.2/logs/hadoop-hduser-jobtracker-seven7-laptop.out


        localhost: 


        localhost: starting tasktracker, logging to /opt/hadoop-1.0.2/logs/hadoop-hduser-tasktracker-seven7-laptop.out



        step 8. 安装完毕测试 



        •启动之后，可以检查以下网址，来观看服务是否正常。 Hadoop 管理接口 Hadoop Task Tracker 状态 Hadoop DFS 状态 


        •http://localhost:50030/ - Hadoop 管理接口 


        至此 


        Ｈａｄｏｏｐ单节点安装完成，下面将在次单节点集群上进行作业 



         

         

         

        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_Hadoop

         

         

         

         

        <1>. Hadoop简介 hadoop是apache的开源项目，开发的主要目的是为了构建可靠，可拓展scalable，分布式的系统，hadoop是一系列的子工程的总和，其中包含。

        1. hadoop common：为其他项目提供基础设施


        2. HDFS：分布式的文件系统


        3. MapReduce：A software framework for distributed processing of large data sets on compute clusters。一个简化分布式编程的框架。


        4. 其他工程包含：Avro(序列化系统)，Cassandra(数据库项目)等 

         从此学习网 http://www.congci.com/item/596hadoop 

         

        http://www.congci.com/item/596hadoop

         


         

        在单机来模拟Hadoop基于分布式运行，最终通过在本机创建多个线程来模拟。主要就是实现运行Hadoop自带的WordCount这个例子，具体实现过程将在下面详细叙述。

        (PS：因为我是一个新手，刚接触Hadoop不久，在学习Hadoop过程中遇到很多问题，特别将自己的实践过程写得非常详细，为更多对Hadoop感兴趣的朋友提供尽可能多的信息，仅此而已。)

        模拟Linux环境配置

        使用cygwin来模拟Linux运行环境，安装好cygwin后，配置好OpenSSH以后才能进行下面的操作。

        Hadoop配置

        首先进行Hadoop配置：

        1、conf/hadoop-env.sh文件中最基本需要指定JAVA_HOME，例如我的如下：

         

        export JAVA_HOME="D:\Program Files\Java\jdk1.6.0_07"

         

        如果路径中存在空格，需要使用双引号。

        2、只需要修改conf/hadoop-site.xml文件即可，默认情况下，hadoop-site.xml并没有被配置，如果是基于单机运行，就会按照hadoop-default.xml中的基本配置选项执行任务。

        将hadoop-site.xml文件修改为如下所示：

         

        <?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?><!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
    <name>fs.default.name</name>
    <value>localhost:9000</value>
</property>
<property>
    <name>mapred.job.tracker</name>
    <value>localhost:9001</value>
</property>
<property>
    <name>dfs.replication</name>
    <value>1</value>
</property>
</configuration>

         

         

        实现过程

        1、认证配置

        启动cygwin，同时使用下面的命令启动ssh：

         

        $ net start sshd

         

        如图所示：




        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_大数据_02


        接着，需要对身份加密认证这一部分进行配置，这也是非常关键的，因为基于分布式的多个Datanode结点需要向Namenode提供任务执行报告信息，如果每次访问Namenode结点都需要密码验证的话就麻烦了，当然我要说的就是基于无密码认证的方式的配置，可以参考我的其他文章。

        生成RSA公钥的命令如下：

         

        $ ssh-keygen

         

        生成过程如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_Hadoop_03


        上面执行到如下步骤时需要进行设置：

         

        Enter file in which to save the key (/home/SHIYANJUN/.ssh/id_rsa):

         

        直接按回车键即可，按照默认的选项将生成的RSA公钥保存在/home/SHIYANJUN/.ssh/id_rsa文件中，以便结点之间进行通讯认证。

        继续执行，又会提示进行输入选择密码短语passphrase，在如下这里：

         

        Enter passphrase (empty for no passphrase):

         

        直接按回车键，而且一定要这么做，因为空密码短语就会在后面执行过程中免去结点之间通讯进行的认证，直接通过RSA公钥(事实上，我们使用的是DSA认证，当然RSA也可以进行认证，继续看后面)认证。

        RSA公钥主要是对结点之间的通讯信息加密的。如果RSA公钥生成过程如上图，说明正确生成了RSA公钥。

        接着生成DSA公钥，使用如下命令：

         

        $ ssh-keygen -t dsa

         

        生成过程与前面的RSA类似，如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_大数据_04


        然后，需要将DSA公钥加入到公钥授权文件authorized_keys中，使用如下命令：

         

        $ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

         

        如图所示，没有任何信息输出：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_web.xml_05


        到此，就可以进行Hadoop的运行工作了。

        2、Hadoop处理的数据文件准备

        我使用的是hadoop-0.16.4版本，直接拷贝到G:\根目录下面，同时，我的cygwin直接安装在G:\Cygwin里面。

        在目录G:\hadoop-0.16.4中创建一个input目录，里面准备几个TXT文件，我准备了7个，文件中内容就是使用空格分隔的多个英文单词，因为是运行WordCount这个例子，后面可以看到我存入了多少内容。

        3、运行过程

        下面，切换到G:\hadoop-0.16.4目录下面

         

        $ cd ../../cygdrive/g/hadoop-0.16.4

         

        其中通过cygdrive(位于Cygwin根目录中)可以直接映射到Windows下的各个逻辑磁盘分区中。

        在执行任务中，使用HDFS，即Hadoop的分布式文件系统，因此这时要做的就是格式化这个文件系统，使用下面命令可以完成：

         

        $ bin/hadoop namenode -format

         

        格式化过程如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_web.xml_06


        此时，应该启动Namenode、Datanode、SecondaryNamenode、JobTracer，使用这个命令启动：

         

        $ bin/start-all.sh

         

        启动过程如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_web.xml_07


        如果你没有配置前面ssh的无密码认证，或者配置了但是输入了密码短语，那么到这里就会每启动一个进程就提示输入密码，试想，如果有N多进程的话，那岂不是要命了。

        然后，需要把上面我们在本地的input目录中准备的文件复制到HDFS中的input目录中，以便在分布式文件系统管理这些待处理的数据文件，使用下面命令：

         

        $ bin/hadoop dfs -put ./input input

         

        执行上述命令如果没有信息输出就复制成功。

        现在，才可以执行Hadoop自带的WordCount列子了，使用下面命令开始提交任务，进入运行：

         

        $ bin/hadoop jar hadoop-0.16.4-examples.jar wordcount input output

         

        最后面两个参数分别为数据输入目录和数据处理完成后的输出目录，这里，不能在你的G:\hadoop-0.16.4目录中存在output这个目录，否则会报错的。

        运行过程如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_Hadoop_08


        通过上图，可以看出在运行一个Job的过程中，WordCount工具执行任务的进度情况，非常详细。

        最后查看执行任务后，处理数据的结果，使用的命令行如下所示：

         

        $ bin/hadoop dfs -cat output/part-00000

         

        输出结果如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_大数据_09


        最后，停止Hadoop进程，使用如下命令：

         

        $ bin/stop-all.sh

         

        如图所示：


        Hadoop 1.0.2 安装 使用 单机模式 Hadoop_1_web.xml_10


        以上就是全部的过程了。


         

        hadoop-1.1.2-1 RPM for x86_64


        The Apache Hadoop project develops open-source software for reliable, scalable,distributed computing. Hadoop includes these subprojects:Hadoop Common: The common utilities that support the other Hadoop subprojects.HDFS: A distributed file system that provides high throughput access to application data.MapReduce: A software framework for distributed processing of large data sets on compute clusters.


        Provides

        Requires

        License


        Apache License, Version 2.0


        Files


        /etc/hadoop/capacity-scheduler.xml/etc/hadoop/configuration.xsl/etc/hadoop/core-site.xml/etc/hadoop/fair-scheduler.xml/etc/hadoop/hadoop-env.sh/etc/hadoop/hadoop-metrics2.properties/etc/hadoop/hadoop-policy.xml/etc/hadoop/hdfs-site.xml/etc/hadoop/log4j.properties/etc/hadoop/mapred-queue-acls.xml
/etc/hadoop/mapred-site.xml
/etc/hadoop/masters
/etc/hadoop/slaves
/etc/hadoop/ssl-client.xml.example
/etc/hadoop/ssl-server.xml.example
/etc/hadoop/taskcontroller.cfg
/etc/rc.d/init.d
/etc/rc.d/init.d/hadoop-datanode
/etc/rc.d/init.d/hadoop-historyserver
/etc/rc.d/init.d/hadoop-jobtracker
/etc/rc.d/init.d/hadoop-namenode
/etc/rc.d/init.d/hadoop-secondarynamenode
/etc/rc.d/init.d/hadoop-tasktracker
/usr
/usr/bin
/usr/bin/hadoop
/usr/bin/task-controller
/usr/include
/usr/include/hadoop
/usr/include/hadoop/Pipes.hh
/usr/include/hadoop/SerialUtils.hh
/usr/include/hadoop/StringUtils.hh
/usr/include/hadoop/TemplateFactory.hh
/usr/lib
/usr/lib64
/usr/lib64/libhadoop.a
/usr/lib64/libhadoop.la
/usr/lib64/libhadoop.so
/usr/lib64/libhadoop.so.1
/usr/lib64/libhadoop.so.1.0.0
/usr/lib64/libhadooppipes.a
/usr/lib64/libhadooputils.a
/usr/lib64/libhdfs.a
/usr/lib64/libhdfs.la
/usr/lib64/libhdfs.so
/usr/lib64/libhdfs.so.0
/usr/lib64/libhdfs.so.0.0.0
/usr/libexec
/usr/libexec/hadoop-config.sh
/usr/libexec/jsvc.amd64
/usr/man
/usr/native
/usr/sbin
/usr/sbin/hadoop-create-user.sh
/usr/sbin/hadoop-daemon.sh
/usr/sbin/hadoop-daemons.sh
/usr/sbin/hadoop-setup-applications.sh
/usr/sbin/hadoop-setup-conf.sh
/usr/sbin/hadoop-setup-hdfs.sh
/usr/sbin/hadoop-setup-single-node.sh
/usr/sbin/hadoop-validate-setup.sh
/usr/sbin/rcc
/usr/sbin/slaves.sh
/usr/sbin/start-all.sh
/usr/sbin/start-balancer.sh
/usr/sbin/start-dfs.sh
/usr/sbin/start-jobhistoryserver.sh
/usr/sbin/start-mapred.sh
/usr/sbin/stop-all.sh
/usr/sbin/stop-balancer.sh
/usr/sbin/stop-dfs.sh
/usr/sbin/stop-jobhistoryserver.sh
/usr/sbin/stop-mapred.sh
/usr/sbin/update-hadoop-env.sh
/usr/share
/usr/share/doc
/usr/share/doc/hadoop
/usr/share/doc/hadoop/CHANGES.txt
/usr/share/doc/hadoop/LICENSE.txt
/usr/share/doc/hadoop/NOTICE.txt
/usr/share/doc/hadoop/README.txt
/usr/share/hadoop
/usr/share/hadoop/contrib
/usr/share/hadoop/contrib/datajoin
/usr/share/hadoop/contrib/datajoin/hadoop-datajoin-1.1.2.jar
/usr/share/hadoop/contrib/failmon
/usr/share/hadoop/contrib/failmon/hadoop-failmon-1.1.2.jar
/usr/share/hadoop/contrib/gridmix
/usr/share/hadoop/contrib/gridmix/hadoop-gridmix-1.1.2.jar
/usr/share/hadoop/contrib/hdfsproxy
/usr/share/hadoop/contrib/hdfsproxy/README
/usr/share/hadoop/contrib/hdfsproxy/bin
/usr/share/hadoop/contrib/hdfsproxy/bin/hdfsproxy
/usr/share/hadoop/contrib/hdfsproxy/bin/hdfsproxy-config.sh
/usr/share/hadoop/contrib/hdfsproxy/bin/hdfsproxy-daemon.sh
/usr/share/hadoop/contrib/hdfsproxy/bin/hdfsproxy-daemons.sh
/usr/share/hadoop/contrib/hdfsproxy/bin/hdfsproxy-slaves.sh
/usr/share/hadoop/contrib/hdfsproxy/bin/start-hdfsproxy.sh
/usr/share/hadoop/contrib/hdfsproxy/bin/stop-hdfsproxy.sh
/usr/share/hadoop/contrib/hdfsproxy/build.xml
/usr/share/hadoop/contrib/hdfsproxy/conf
/usr/share/hadoop/contrib/hdfsproxy/conf/configuration.xsl
/usr/share/hadoop/contrib/hdfsproxy/conf/hdfsproxy-default.xml
/usr/share/hadoop/contrib/hdfsproxy/conf/hdfsproxy-env.sh
/usr/share/hadoop/contrib/hdfsproxy/conf/hdfsproxy-env.sh.template
/usr/share/hadoop/contrib/hdfsproxy/conf/hdfsproxy-hosts
/usr/share/hadoop/contrib/hdfsproxy/conf/log4j.properties
/usr/share/hadoop/contrib/hdfsproxy/conf/ssl-server.xml
/usr/share/hadoop/contrib/hdfsproxy/conf/tomcat-forward-web.xml
/usr/share/hadoop/contrib/hdfsproxy/conf/tomcat-web.xml
/usr/share/hadoop/contrib/hdfsproxy/conf/user-certs.xml
/usr/share/hadoop/contrib/hdfsproxy/conf/user-permissions.xml
/usr/share/hadoop/contrib/hdfsproxy/hdfsproxy-2.0.jar
/usr/share/hadoop/contrib/hdfsproxy/logs
/usr/share/hadoop/contrib/hod
/usr/share/hadoop/contrib/hod/CHANGES.txt
/usr/share/hadoop/contrib/hod/README
/usr/share/hadoop/contrib/hod/bin
/usr/share/hadoop/contrib/hod/bin/VERSION
/usr/share/hadoop/contrib/hod/bin/checknodes
/usr/share/hadoop/contrib/hod/bin/hod
/usr/share/hadoop/contrib/hod/bin/hodcleanup
/usr/share/hadoop/contrib/hod/bin/hodring
/usr/share/hadoop/contrib/hod/bin/ringmaster
/usr/share/hadoop/contrib/hod/bin/verify-account
/usr/share/hadoop/contrib/hod/build.xml
/usr/share/hadoop/contrib/hod/conf
/usr/share/hadoop/contrib/hod/conf/hodrc
/usr/share/hadoop/contrib/hod/config.txt
/usr/share/hadoop/contrib/hod/getting_started.txt
/usr/share/hadoop/contrib/hod/hodlib
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/goldAllocationManager.py
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/goldAllocationManager.pyc
/usr/share/hadoop/contrib/hod/hodlib/AllocationManagers/goldAllocationManager.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common
/usr/share/hadoop/contrib/hod/hodlib/Common/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/Common/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/allocationManagerUtil.py
/usr/share/hadoop/contrib/hod/hodlib/Common/allocationManagerUtil.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/allocationManagerUtil.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/desc.py
/usr/share/hadoop/contrib/hod/hodlib/Common/desc.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/desc.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/descGenerator.py
/usr/share/hadoop/contrib/hod/hodlib/Common/descGenerator.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/descGenerator.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/hodsvc.py
/usr/share/hadoop/contrib/hod/hodlib/Common/hodsvc.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/hodsvc.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/logger.py
/usr/share/hadoop/contrib/hod/hodlib/Common/logger.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/logger.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/miniHTMLParser.py
/usr/share/hadoop/contrib/hod/hodlib/Common/miniHTMLParser.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/miniHTMLParser.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/nodepoolutil.py
/usr/share/hadoop/contrib/hod/hodlib/Common/nodepoolutil.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/nodepoolutil.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/setup.py
/usr/share/hadoop/contrib/hod/hodlib/Common/setup.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/setup.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/socketServers.py
/usr/share/hadoop/contrib/hod/hodlib/Common/socketServers.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/socketServers.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/tcp.py
/usr/share/hadoop/contrib/hod/hodlib/Common/tcp.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/tcp.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/threads.py
/usr/share/hadoop/contrib/hod/hodlib/Common/threads.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/threads.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/types.py
/usr/share/hadoop/contrib/hod/hodlib/Common/types.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/types.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/util.py
/usr/share/hadoop/contrib/hod/hodlib/Common/util.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/util.pyo
/usr/share/hadoop/contrib/hod/hodlib/Common/xmlrpc.py
/usr/share/hadoop/contrib/hod/hodlib/Common/xmlrpc.pyc
/usr/share/hadoop/contrib/hod/hodlib/Common/xmlrpc.pyo
/usr/share/hadoop/contrib/hod/hodlib/GridServices
/usr/share/hadoop/contrib/hod/hodlib/GridServices/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/GridServices/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/GridServices/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/GridServices/hdfs.py
/usr/share/hadoop/contrib/hod/hodlib/GridServices/hdfs.pyc
/usr/share/hadoop/contrib/hod/hodlib/GridServices/hdfs.pyo
/usr/share/hadoop/contrib/hod/hodlib/GridServices/mapred.py
/usr/share/hadoop/contrib/hod/hodlib/GridServices/mapred.pyc
/usr/share/hadoop/contrib/hod/hodlib/GridServices/mapred.pyo
/usr/share/hadoop/contrib/hod/hodlib/GridServices/service.py
/usr/share/hadoop/contrib/hod/hodlib/GridServices/service.pyc
/usr/share/hadoop/contrib/hod/hodlib/GridServices/service.pyo
/usr/share/hadoop/contrib/hod/hodlib/Hod
/usr/share/hadoop/contrib/hod/hodlib/Hod/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/Hod/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/Hod/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/Hod/hadoop.py
/usr/share/hadoop/contrib/hod/hodlib/Hod/hadoop.pyc
/usr/share/hadoop/contrib/hod/hodlib/Hod/hadoop.pyo
/usr/share/hadoop/contrib/hod/hodlib/Hod/hod.py
/usr/share/hadoop/contrib/hod/hodlib/Hod/hod.pyc
/usr/share/hadoop/contrib/hod/hodlib/Hod/hod.pyo
/usr/share/hadoop/contrib/hod/hodlib/Hod/nodePool.py
/usr/share/hadoop/contrib/hod/hodlib/Hod/nodePool.pyc
/usr/share/hadoop/contrib/hod/hodlib/Hod/nodePool.pyo
/usr/share/hadoop/contrib/hod/hodlib/HodRing
/usr/share/hadoop/contrib/hod/hodlib/HodRing/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/HodRing/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/HodRing/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/HodRing/hodRing.py
/usr/share/hadoop/contrib/hod/hodlib/HodRing/hodRing.pyc
/usr/share/hadoop/contrib/hod/hodlib/HodRing/hodRing.pyo
/usr/share/hadoop/contrib/hod/hodlib/NodePools
/usr/share/hadoop/contrib/hod/hodlib/NodePools/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/NodePools/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/NodePools/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/NodePools/torque.py
/usr/share/hadoop/contrib/hod/hodlib/NodePools/torque.pyc
/usr/share/hadoop/contrib/hod/hodlib/NodePools/torque.pyo
/usr/share/hadoop/contrib/hod/hodlib/RingMaster
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/idleJobTracker.py
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/idleJobTracker.pyc
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/idleJobTracker.pyo
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/ringMaster.py
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/ringMaster.pyc
/usr/share/hadoop/contrib/hod/hodlib/RingMaster/ringMaster.pyo
/usr/share/hadoop/contrib/hod/hodlib/Schedulers
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/torque.py
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/torque.pyc
/usr/share/hadoop/contrib/hod/hodlib/Schedulers/torque.pyo
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/serviceProxy.py
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/serviceProxy.pyc
/usr/share/hadoop/contrib/hod/hodlib/ServiceProxy/serviceProxy.pyo
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/__init__.pyo
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/serviceRegistry.py
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/serviceRegistry.pyc
/usr/share/hadoop/contrib/hod/hodlib/ServiceRegistry/serviceRegistry.pyo
/usr/share/hadoop/contrib/hod/hodlib/__init__.py
/usr/share/hadoop/contrib/hod/hodlib/__init__.pyc
/usr/share/hadoop/contrib/hod/hodlib/__init__.pyo
/usr/share/hadoop/contrib/hod/ivy
/usr/share/hadoop/contrib/hod/ivy.xml
/usr/share/hadoop/contrib/hod/ivy/libraries.properties
/usr/share/hadoop/contrib/hod/support
/usr/share/hadoop/contrib/hod/support/checklimits.sh
/usr/share/hadoop/contrib/hod/support/logcondense.py
/usr/share/hadoop/contrib/hod/support/logcondense.pyc
/usr/share/hadoop/contrib/hod/support/logcondense.pyo
/usr/share/hadoop/contrib/hod/testing
/usr/share/hadoop/contrib/hod/testing/__init__.py
/usr/share/hadoop/contrib/hod/testing/__init__.pyc
/usr/share/hadoop/contrib/hod/testing/__init__.pyo
/usr/share/hadoop/contrib/hod/testing/helper.py
/usr/share/hadoop/contrib/hod/testing/helper.pyc
/usr/share/hadoop/contrib/hod/testing/helper.pyo
/usr/share/hadoop/contrib/hod/testing/lib.py
/usr/share/hadoop/contrib/hod/testing/main.py
/usr/share/hadoop/contrib/hod/testing/main.pyc
/usr/share/hadoop/contrib/hod/testing/main.pyo
/usr/share/hadoop/contrib/hod/testing/testHadoop.py
/usr/share/hadoop/contrib/hod/testing/testHadoop.pyc
/usr/share/hadoop/contrib/hod/testing/testHadoop.pyo
/usr/share/hadoop/contrib/hod/testing/testHod.py
/usr/share/hadoop/contrib/hod/testing/testHod.pyc
/usr/share/hadoop/contrib/hod/testing/testHod.pyo
/usr/share/hadoop/contrib/hod/testing/testHodCleanup.py
/usr/share/hadoop/contrib/hod/testing/testHodCleanup.pyc
/usr/share/hadoop/contrib/hod/testing/testHodCleanup.pyo
/usr/share/hadoop/contrib/hod/testing/testHodRing.py
/usr/share/hadoop/contrib/hod/testing/testHodRing.pyc
/usr/share/hadoop/contrib/hod/testing/testHodRing.pyo
/usr/share/hadoop/contrib/hod/testing/testModule.py
/usr/share/hadoop/contrib/hod/testing/testModule.pyc
/usr/share/hadoop/contrib/hod/testing/testModule.pyo
/usr/share/hadoop/contrib/hod/testing/testRingmasterRPCs.py
/usr/share/hadoop/contrib/hod/testing/testRingmasterRPCs.pyc
/usr/share/hadoop/contrib/hod/testing/testRingmasterRPCs.pyo
/usr/share/hadoop/contrib/hod/testing/testThreads.py
/usr/share/hadoop/contrib/hod/testing/testThreads.pyc
/usr/share/hadoop/contrib/hod/testing/testThreads.pyo
/usr/share/hadoop/contrib/hod/testing/testTypes.py
/usr/share/hadoop/contrib/hod/testing/testTypes.pyc
/usr/share/hadoop/contrib/hod/testing/testTypes.pyo
/usr/share/hadoop/contrib/hod/testing/testUtil.py
/usr/share/hadoop/contrib/hod/testing/testUtil.pyc
/usr/share/hadoop/contrib/hod/testing/testUtil.pyo
/usr/share/hadoop/contrib/hod/testing/testXmlrpc.py
/usr/share/hadoop/contrib/hod/testing/testXmlrpc.pyc
/usr/share/hadoop/contrib/hod/testing/testXmlrpc.pyo
/usr/share/hadoop/contrib/index
/usr/share/hadoop/contrib/index/hadoop-index-1.1.2.jar
/usr/share/hadoop/contrib/streaming
/usr/share/hadoop/contrib/streaming/hadoop-streaming-1.1.2.jar
/usr/share/hadoop/contrib/vaidya
/usr/share/hadoop/contrib/vaidya/bin
/usr/share/hadoop/contrib/vaidya/bin/vaidya.sh
/usr/share/hadoop/contrib/vaidya/conf
/usr/share/hadoop/contrib/vaidya/conf/postex_diagnosis_tests.xml
/usr/share/hadoop/contrib/vaidya/hadoop-vaidya-1.1.2.jar
/usr/share/hadoop/hadoop-ant-1.1.2.jar
/usr/share/hadoop/hadoop-client-1.1.2.jar
/usr/share/hadoop/hadoop-core-1.1.2.jar
/usr/share/hadoop/hadoop-examples-1.1.2.jar
/usr/share/hadoop/hadoop-minicluster-1.1.2.jar
/usr/share/hadoop/hadoop-test-1.1.2.jar
/usr/share/hadoop/hadoop-tools-1.1.2.jar
/usr/share/hadoop/lib
/usr/share/hadoop/lib/asm-3.2.jar
/usr/share/hadoop/lib/aspectjrt-1.6.11.jar
/usr/share/hadoop/lib/aspectjtools-1.6.11.jar
/usr/share/hadoop/lib/commons-beanutils-1.7.0.jar
/usr/share/hadoop/lib/commons-beanutils-core-1.8.0.jar
/usr/share/hadoop/lib/commons-cli-1.2.jar
/usr/share/hadoop/lib/commons-codec-1.4.jar
/usr/share/hadoop/lib/commons-collections-3.2.1.jar
/usr/share/hadoop/lib/commons-configuration-1.6.jar
/usr/share/hadoop/lib/commons-daemon-1.0.1.jar
/usr/share/hadoop/lib/commons-digester-1.8.jar
/usr/share/hadoop/lib/commons-el-1.0.jar
/usr/share/hadoop/lib/commons-httpclient-3.0.1.jar
/usr/share/hadoop/lib/commons-io-2.1.jar
/usr/share/hadoop/lib/commons-lang-2.4.jar
/usr/share/hadoop/lib/commons-logging-1.1.1.jar
/usr/share/hadoop/lib/commons-logging-api-1.0.4.jar
/usr/share/hadoop/lib/commons-math-2.1.jar
/usr/share/hadoop/lib/commons-net-3.1.jar
/usr/share/hadoop/lib/core-3.1.1.jar
/usr/share/hadoop/lib/hadoop-capacity-scheduler-1.1.2.jar
/usr/share/hadoop/lib/hadoop-fairscheduler-1.1.2.jar
/usr/share/hadoop/lib/hadoop-thriftfs-1.1.2.jar
/usr/share/hadoop/lib/hsqldb-1.8.0.10.LICENSE.txt
/usr/share/hadoop/lib/hsqldb-1.8.0.10.jar
/usr/share/hadoop/lib/jackson-core-asl-1.8.8.jar
/usr/share/hadoop/lib/jackson-mapper-asl-1.8.8.jar
/usr/share/hadoop/lib/jasper-compiler-5.5.12.jar
/usr/share/hadoop/lib/jasper-runtime-5.5.12.jar
/usr/share/hadoop/lib/jdeb-0.8.jar
/usr/share/hadoop/lib/jdiff
/usr/share/hadoop/lib/jdiff/hadoop_0.17.0.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.18.1.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.18.2.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.18.3.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.19.0.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.19.1.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.19.2.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.20.1.xml
/usr/share/hadoop/lib/jdiff/hadoop_0.20.205.0.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.0.0.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.0.1.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.0.2.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.0.3.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.0.4.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.1.0.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.1.1.xml
/usr/share/hadoop/lib/jdiff/hadoop_1.1.2.xml
/usr/share/hadoop/lib/jersey-core-1.8.jar
/usr/share/hadoop/lib/jersey-json-1.8.jar
/usr/share/hadoop/lib/jersey-server-1.8.jar
/usr/share/hadoop/lib/jets3t-0.6.1.jar
/usr/share/hadoop/lib/jetty-6.1.26.jar
/usr/share/hadoop/lib/jetty-util-6.1.26.jar
/usr/share/hadoop/lib/jsch-0.1.42.jar
/usr/share/hadoop/lib/jsp-2.1
/usr/share/hadoop/lib/jsp-2.1/jsp-2.1.jar
/usr/share/hadoop/lib/jsp-2.1/jsp-api-2.1.jar
/usr/share/hadoop/lib/junit-4.5.jar
/usr/share/hadoop/lib/kfs-0.2.2.jar
/usr/share/hadoop/lib/kfs-0.2.LICENSE.txt
/usr/share/hadoop/lib/log4j-1.2.15.jar
/usr/share/hadoop/lib/mockito-all-1.8.5.jar
/usr/share/hadoop/lib/oro-2.0.8.jar
/usr/share/hadoop/lib/servlet-api-2.5-20081211.jar
/usr/share/hadoop/lib/slf4j-api-1.4.3.jar
/usr/share/hadoop/lib/slf4j-log4j12-1.4.3.jar
/usr/share/hadoop/lib/xmlenc-0.52.jar
/usr/share/hadoop/templates
/usr/share/hadoop/templates/conf
/usr/share/hadoop/templates/conf/capacity-scheduler.xml
/usr/share/hadoop/templates/conf/commons-logging.properties
/usr/share/hadoop/templates/conf/core-site.xml
/usr/share/hadoop/templates/conf/hadoop-env.sh
/usr/share/hadoop/templates/conf/hadoop-metrics2.properties
/usr/share/hadoop/templates/conf/hadoop-policy.xml
/usr/share/hadoop/templates/conf/hdfs-site.xml
/usr/share/hadoop/templates/conf/log4j.properties
/usr/share/hadoop/templates/conf/mapred-queue-acls.xml
/usr/share/hadoop/templates/conf/mapred-site.xml
/usr/share/hadoop/templates/conf/taskcontroller.cfg
/usr/share/hadoop/webapps
/usr/share/hadoop/webapps/datanode
/usr/share/hadoop/webapps/datanode/WEB-INF
/usr/share/hadoop/webapps/datanode/WEB-INF/web.xml
/usr/share/hadoop/webapps/hdfs
/usr/share/hadoop/webapps/hdfs/WEB-INF
/usr/share/hadoop/webapps/hdfs/WEB-INF/web.xml
/usr/share/hadoop/webapps/hdfs/index.html
/usr/share/hadoop/webapps/history
/usr/share/hadoop/webapps/history/WEB-INF
/usr/share/hadoop/webapps/history/WEB-INF/web.xml
/usr/share/hadoop/webapps/job
/usr/share/hadoop/webapps/job/WEB-INF
/usr/share/hadoop/webapps/job/WEB-INF/web.xml
/usr/share/hadoop/webapps/job/analysejobhistory.jsp
/usr/share/hadoop/webapps/job/gethistory.jsp
/usr/share/hadoop/webapps/job/index.html
/usr/share/hadoop/webapps/job/job_authorization_error.jsp
/usr/share/hadoop/webapps/job/jobblacklistedtrackers.jsp
/usr/share/hadoop/webapps/job/jobconf.jsp
/usr/share/hadoop/webapps/job/jobconf_history.jsp
/usr/share/hadoop/webapps/job/jobdetails.jsp
/usr/share/hadoop/webapps/job/jobdetailshistory.jsp
/usr/share/hadoop/webapps/job/jobfailures.jsp
/usr/share/hadoop/webapps/job/jobhistory.jsp
/usr/share/hadoop/webapps/job/jobhistoryhome.jsp
/usr/share/hadoop/webapps/job/jobqueue_details.jsp
/usr/share/hadoop/webapps/job/jobtasks.jsp
/usr/share/hadoop/webapps/job/jobtaskshistory.jsp
/usr/share/hadoop/webapps/job/jobtracker.jsp
/usr/share/hadoop/webapps/job/legacyjobhistory.jsp
/usr/share/hadoop/webapps/job/loadhistory.jsp
/usr/share/hadoop/webapps/job/machines.jsp
/usr/share/hadoop/webapps/job/taskdetails.jsp
/usr/share/hadoop/webapps/job/taskdetailshistory.jsp
/usr/share/hadoop/webapps/job/taskstats.jsp
/usr/share/hadoop/webapps/job/taskstatshistory.jsp
/usr/share/hadoop/webapps/secondary
/usr/share/hadoop/webapps/secondary/WEB-INF
/usr/share/hadoop/webapps/static
/usr/share/hadoop/webapps/static/hadoop-logo.jpg
/usr/share/hadoop/webapps/static/hadoop.css
/usr/share/hadoop/webapps/static/jobconf.xsl
/usr/share/hadoop/webapps/static/jobtracker.js
/usr/share/hadoop/webapps/static/sorttable.js
/usr/share/hadoop/webapps/task
/usr/share/hadoop/webapps/task/WEB-INF
/usr/share/hadoop/webapps/task/WEB-INF/web.xml
/usr/share/hadoop/webapps/task/index.html
/var/log/hadoop
/var/run/hadoop

        标签：hod,1.0,单机,hodlib,share,hadoop,Hadoop,usr,contrib
        From： https://blog.51cto.com/u_16203469/7626720

        相关文章

        • C语言学习日记1.0
          大学第一节c语言课结束感慨良多啊，我不太善于总结和表达，请各位见谅。第一节课就学习了hello,world简单程序的运行和c语言的特点：1、兼具高级语言的优点和对低级语言对硬件的操作能力，具有高级语言的高层抽象和良好的可移植性等优点。2、数据类型和运算符丰富3、它是完全模块化和......
        • Hadoop是什么？ Hadoop是一个由Apache开发的开源分布式计算框架，它能够处理大规模数据并
          Hadoop是什么？Hadoop是一个由Apache开发的开源分布式计算框架，它能够处理大规模数据并行处理任务，支持大规模数据存储和处理。Hadoop的核心组件包括分布式文件系统HDFS和分布式计算框架MapReduce，它们使得Hadoop可以在廉价的硬件上并行地处理大量数据。Hadoop还包括很多相关的项目和子......
        • Hadoop是什么？ Hadoop是一个由Apache开发的开源分布式计算框架，它能够处理大规模数据并
          Hadoop是什么？Hadoop是一个由Apache开发的开源分布式计算框架，它能够处理大规模数据并行处理任务，支持大规模数据存储和处理。Hadoop的核心组件包括分布式文件系统HDFS和分布式计算框架MapReduce，它们使得Hadoop可以在廉价的硬件上并行地处理大量数据。Hadoop还包括很多相关的项目和子......
        • Hadoop环境搭建
          前言  Hadoop是一个开源的、可运行与Linux集群上的分布式计算平台，用户可借助Hadoop存有基础环境的配置（虚拟机安装、Linux安装等），Hadoop集群搭建，配置和测试。二、Linux系统安装1.环境准备Centos7镜像文件(mini)Centos7下载链接：https://mirrors.tuna.tsinghua.edu.cn/centos/7.9.20......
        • Hadoop集群搭建(完全分布式)
          一，Hadoop集群简介1.1Hadoop集群整体概述Hadoop集群包括两个集群:HDFS集群、YARN集群两个集群逻辑上分离、通常物理上在一起两个集群都是标准的主从架构集群Hadoop两种集群内容：逻辑上分离，物理上合并的理解：逻辑上分离：两个集群互相之间没有依赖、互不影响物理上合并：某些......
        • Apache Hadoop开启HA
          一、修改配置文件hdfs-site.xml<configuration><!--NameNode元数据存储目录--><property><name>dfs.namenode.name.dir</name><value>"{{data_dir}}/hadoop/hdfs/namenode"</value><final>true&......
        • 华为云云耀云服务器L实例评测｜伪分布式环境下部署hadoop2.10.1
          文章目录前言云耀云服务器L实例简介Hadoop简介一、配置环境购买云耀云服务器L实例查看云耀云服务器L实例状态重置密码查看弹性公网IP地址FinalShell连接服务器二、搭建Hadoop单机版本详细安装步骤如下：我们先开始配置java环境hadoop2.x接下来需要利用vim来操作core-site和hdfs-si......
        • kingbaseES单机安装
          测试环境地址系统版本架构168.3.1.212rhel7.6v8.6单实例测试步骤关闭防火墙和selinuxsystemctlstopfirewalldsystemctldisablefirewalldsed-i's/SELINUX=enforcing/SELINUX=disabled/g'/etc/selinux/config修改系统内核cat>>/etc/sysctl.conf<<eofkernel.shmmax=......
        • hadoop和hive的兼容问题
          本人之前搭建的集群是hadoop3.3.5+hive3.1.3版本，后来发现这两个版本不兼容，虽然官方文档里面说hive3.1.3版本兼容hadoop3.x.y版本，但是当我在使用hive执行插入语句时发现一直报同一个错误java.lang.ClassCastException:org.apache.hadoop.hdfs.protocol.proto.ClientNamenodePro......
        • 【1.0】Pandos初识
          【一】Pandas是什么Pandas是一个开源的第三方Python库，从Numpy和Matplotlib的基础上构建而来，享有数据分析“三剑客之一”的盛名（NumPy、Matplotlib、Pandas）。Pandas已经成为Python数据分析的必备高级工具，它的目标是成为强大、灵活、可以支持任何编程语言的数据分析工具......

        赞助商

        阅读排行

        网站主页关于我们联系我们网站地图

        本网站内容转载自其他媒体，侵权联系[admin##ips99.com]。

        Copyright © 2020-2023 IPS99 版权所有 IPS99