Linux CentOS下Hadoop伪分布再配置，再次一定要玩真的集群啦~~

上次配了一次，没多少感觉。

代码看累了。

配置一次再轻松一下脑袋。。。

不过，这次是在家里的VM上，用最新的JDK-7U-17和上HADOOP-1.1.2搞的。

CENTOS版本来6.3-I386.

一次OK。

这次参考的贴子是：

http://bjbxy.blog.51cto.com/854497/352692

相关输出如下：

# jps
2614 Jps
2280 TaskTracker
1908 NameNode
2110 SecondaryNameNode
2012 DataNode
2169 JobTracker

报告输出：



HDFS管理界面：



WORDCOUNT的JOB测试样例运行：

]# ./hadoop jar hadoop-examples-1.1.2.jar wordcount bxy output
Exception in thread "main" java.io.IOException: Error opening job jar: hadoop-examples-1.1.2.jar
at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.io.FileNotFoundException: hadoop-examples-1.1.2.jar (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:214)
at java.util.zip.ZipFile.<init>(ZipFile.java:144)
at java.util.jar.JarFile.<init>(JarFile.java:153)
at java.util.jar.JarFile.<init>(JarFile.java:90)
at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
[root@localhost bin]# pwd
/usr/local/hadoop/hadoop-1.1.2/bin
[root@localhost bin]# ./hadoop jar /usr/local/hadoop/hadoop-1.1.2/hadoop-examples-1.1.2.jar wordcount bxy output
12/12/20 07:35:43 INFO input.FileInputFormat: Total input paths to process : 1
12/12/20 07:35:43 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/12/20 07:35:43 WARN snappy.LoadSnappy: Snappy native library not loaded
12/12/20 07:35:45 INFO mapred.JobClient: Running job: job_201212200705_0001
12/12/20 07:35:46 INFO mapred.JobClient: map 0% reduce 0%
12/12/20 07:36:10 INFO mapred.JobClient: map 100% reduce 0%
12/12/20 07:36:26 INFO mapred.JobClient: map 100% reduce 100%
12/12/20 07:36:30 INFO mapred.JobClient: Job complete: job_201212200705_0001
12/12/20 07:36:30 INFO mapred.JobClient: Counters: 29
12/12/20 07:36:30 INFO mapred.JobClient: Job Counters
12/12/20 07:36:30 INFO mapred.JobClient: Launched reduce tasks=1
12/12/20 07:36:30 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=25805
12/12/20 07:36:30 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
12/12/20 07:36:30 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
12/12/20 07:36:30 INFO mapred.JobClient: Launched map tasks=1
12/12/20 07:36:30 INFO mapred.JobClient: Data-local map tasks=1
12/12/20 07:36:30 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=15472
12/12/20 07:36:30 INFO mapred.JobClient: File Output Format Counters
12/12/20 07:36:30 INFO mapred.JobClient: Bytes Written=1135
12/12/20 07:36:30 INFO mapred.JobClient: FileSystemCounters
12/12/20 07:36:30 INFO mapred.JobClient: FILE_BYTES_READ=1600
12/12/20 07:36:30 INFO mapred.JobClient: HDFS_BYTES_READ=1280
12/12/20 07:36:30 INFO mapred.JobClient: FILE_BYTES_WRITTEN=105526
12/12/20 07:36:30 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=1135
12/12/20 07:36:30 INFO mapred.JobClient: File Input Format Counters
12/12/20 07:36:30 INFO mapred.JobClient: Bytes Read=1166
12/12/20 07:36:30 INFO mapred.JobClient: Map-Reduce Framework
12/12/20 07:36:30 INFO mapred.JobClient: Map output materialized bytes=1600
12/12/20 07:36:30 INFO mapred.JobClient: Map input records=34
12/12/20 07:36:30 INFO mapred.JobClient: Reduce shuffle bytes=1600
12/12/20 07:36:30 INFO mapred.JobClient: Spilled Records=230
12/12/20 07:36:30 INFO mapred.JobClient: Map output bytes=1824
12/12/20 07:36:30 INFO mapred.JobClient: Total committed heap usage (bytes)=131665920
12/12/20 07:36:30 INFO mapred.JobClient: CPU time spent (ms)=8970
12/12/20 07:36:30 INFO mapred.JobClient: Combine input records=169
12/12/20 07:36:30 INFO mapred.JobClient: SPLIT_RAW_BYTES=114
12/12/20 07:36:30 INFO mapred.JobClient: Reduce input records=115
12/12/20 07:36:30 INFO mapred.JobClient: Reduce input groups=115
12/12/20 07:36:30 INFO mapred.JobClient: Combine output records=115
12/12/20 07:36:30 INFO mapred.JobClient: Physical memory (bytes) snapshot=187215872
12/12/20 07:36:30 INFO mapred.JobClient: Reduce output records=115
12/12/20 07:36:30 INFO mapred.JobClient: Virtual memory (bytes) snapshot=755154944
12/12/20 07:36:30 INFO mapred.JobClient: Map output records=169