hadoop安装单机模式
1、下载 hadoop-2.6.4-src.tar.gz
http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.6.4/
2、解压并拷贝到/usr/local/hadoop下
sudo tar xzf hadoop-2.6.4-src.tar.gz
sudo mv hadoop-2.4.0 /usr/local/hadoop
3、赋予用户对该文件夹的读写权限
sudo chmod 774 /usr/local/hadoop
4、配置~/.bashrc
查看Java安装路径
update-alternatives --config java
配置.bashrc文件
sudo vi ~/.bashrc
#HADOOP VARIABLES START
export JAVA_HOME=/usr/lib/jvm/jre-1.6.0-openjdk.x86_64
export HADOOP_INSTALL=/usr/local/hadoop
export PATH=$PATH:$HADOOP_INSTALL/bin
export PATH=$PATH:$HADOOP_INSTALL/sbin
export HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_HOME=$HADOOP_INSTALL
export HADOOP_HDFS_HOME=$HADOOP_INSTALL
export YARN_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib"
#HADOOP VARIABLES END
执行下面命,使添加的环境变量生效:
source ~/.bashrc
5、WordCount测试
在/usr/local/hadoop下新建一个input文件夹
mkdir input
拷贝一个文件到input中
cp README.txt input
执行
bin/hadoop jar share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.6.4-sources.jar org.apache.hadoop.examples.WordCount input output
执行结果:
执行 cat output/*,查看字符统计结果:
0 Comments