hadoop机群 运行wordcount出现 Input path does not exist: hdfs://ns1/user/root/a.txt
2017-11-13 10:31
951 查看
机群搭建好,执行自带wordcount时出现: Input path does not exist: hdfs://ns1/user/root/a.txt 此错误。
[root@slave1 hadoop]# lsa.txt dfs1 include libexec name sbin test tmp2bin etc journal LICENSE.txt NOTICE.txt share tmp zookeeper.outdata hdfs lib logs README.txt src tmp1[root@slave1 hadoop]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar wordcount a.txt /mrout 17/11/10 17:44:39 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1510302622448_0003 org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://ns1/user/root/a.txt 出错原因:单机读取的是本地的文件,分布式环境下需要从hdfs 上读取文件。
将本地的文件上传到hdfs上,然后再运行wordcount可以成功执行。
[root@slave1 hadoop]# bin/hdfs dfs -mkdir /input[root@slave1 hadoop]# bin/hdfs dfs iput test/a.txt /input
[root@slave1 hadoop]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar wordcount /input/a.txt /mrout217/11/13 10:22:48 INFO input.FileInputFormat: Total input paths to process : 117/11/13 10:22:49 INFO mapreduce.JobSubmitter: number of splits:117/11/13 10:22:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1510302622448_001017/11/13 10:22:50 INFO impl.YarnClientImpl: Submitted application application_1510302622448_001017/11/13 10:22:50 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1510302622448_0010/17/11/13 10:22:50 INFO mapreduce.Job: Running job: job_1510302622448_0010
[root@slave1 hadoop]# lsa.txt dfs1 include libexec name sbin test tmp2bin etc journal LICENSE.txt NOTICE.txt share tmp zookeeper.outdata hdfs lib logs README.txt src tmp1[root@slave1 hadoop]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar wordcount a.txt /mrout 17/11/10 17:44:39 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1510302622448_0003 org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://ns1/user/root/a.txt 出错原因:单机读取的是本地的文件,分布式环境下需要从hdfs 上读取文件。
将本地的文件上传到hdfs上,然后再运行wordcount可以成功执行。
[root@slave1 hadoop]# bin/hdfs dfs -mkdir /input[root@slave1 hadoop]# bin/hdfs dfs iput test/a.txt /input
[root@slave1 hadoop]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar wordcount /input/a.txt /mrout217/11/13 10:22:48 INFO input.FileInputFormat: Total input paths to process : 117/11/13 10:22:49 INFO mapreduce.JobSubmitter: number of splits:117/11/13 10:22:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1510302622448_001017/11/13 10:22:50 INFO impl.YarnClientImpl: Submitted application application_1510302622448_001017/11/13 10:22:50 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1510302622448_0010/17/11/13 10:22:50 INFO mapreduce.Job: Running job: job_1510302622448_0010
相关文章推荐
- Hadoop错误2_Hadoop伪分布式下,运行WordCount时,Input path does not exist错误原因
- 运行wordcount程序报 Input path does not exist 错
- Hadoop问题:Input path does not exist: hdfs://Master:9000/user/hadoop/input
- eclipse编译hadoop错误:Input path does not exist: hdfs://192.168.184.21:9001/user/xxxx/input
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException:input path does not exist:hdfs://10.0.2.
- 错误:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost/
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapred.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- "main" org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file
- Hadoop运行wordcount出现“JobTracker is not yet RUNNING”
- 解决Spark读取Hive分区表出现Input path does not exist的问题
- 解决Eclipse中运行WordCount出现 java.lang.ClassNotFoundException: org.apache.hadoop.examples.WordCount$TokenizerMapper问题【转】
- 解决问题:Input path does not exist: hdfs://localhost:9000/input
- org.apache.hadoop.mapred.InvalidInputException: Input path does not exist问题
- 解决Eclipse中运行WordCount出现 java.lang.ClassNotFoundException: org.apache.hadoop.examples.WordCount$Token
- 安装并运行apk时出现恼人的"Error: Activity class {xxx/xxx.MainActivity} does not exist."
- 运行hdfs的wordcount程序时出现的错误
- mysql运行语句时出现 FUNCTION *** does not exist