您的位置:首页 > 运维架构

Hadoop2.5.1测试(运行自带的wordcount)

2015-03-20 11:58 417 查看

一、准备工作

启动hadoop(如有疑问见上篇博文),jps查看进程:

hadoop@h1:~$ jps
3395 SecondaryNameNode
5222 Jps
3177 NameNode
4394 JobHistoryServer
3565 ResourceManager


二、进行测试

1、建立输入文件:
echo "My first hadoop example. Hello Hadoop in input. " > input


2、在hadoop上建立目录:
hdfs dfs -mkdir -p /user/hadoop
查看建立的目录,

hadoop@h1:~$ hdfs dfs -ls /user
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2015-03-22 20:17 /user/hadoop


3、上传文件:
hdfs dfs -put input /user/hadoop
查看上传的文件,

hadoop@h1:~$ hdfs dfs -ls /user/hadoop
Found 1 items
-rw-r--r--   2 hadoop supergroup         49 2015-03-22 20:21 /user/hadoop/input


4、运行wordcount程序

hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.1.jar wordcount /user/hadoop/input /user/hadoop/output


5、查看运行结果

hadoop@h1:~$ hdfs dfs -ls /user/hadoopFound 2 items
-rw-r--r--   2 hadoop supergroup         49 2015-03-22 20:21 /user/hadoop/input
drwxr-xr-x   - hadoop supergroup          0 2015-03-22 20:26 /user/hadoop/output
hadoop@h1:~$ hdfs dfs -ls /user/hadoop/output
Found 2 items
-rw-r--r--   2 hadoop supergroup          0 2015-03-22 20:26 /user/hadoop/output/_SUCCESS
-rw-r--r--   2 hadoop supergroup         64 2015-03-22 20:26 /user/hadoop/output/part-r-00000
hadoop@h1:~$ hdfs dfs -cat /user/hadoop/output/part-r-00000
Hadoop  1
Hello   1
My  1
example.    1
first   1
hadoop  1
in  1
input.  1
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: