解决MapReduce编程过程中的 java.io.FileNotFoundException 问题
2017-09-14 17:50
501 查看
在运行WordCount程序的过程中出现了如下错误:
提示内容说的是找不到如下目录下的一个文件,经过多番周折才获知Hadoop运行过程中的文件路径中不能出现空格键。由于/tmp/hadoop-Gui%20Xiaolin……是根据电脑中的当前用户名产生的,因此只需要将用户名修改成不含空格即可。
DEBUG - LocalFetcher 1 going to fetch: attempt_local938878567_0001_m_000000_0 WARN - job_local938878567_0001 java.lang.Exception: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in localfetcher#1 at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529) Caused by: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in localfetcher#1 at org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:134) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:376) at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: java.io.FileNotFoundException: D:/tmp/hadoop-Gui%20Xiaolin/mapred/local/localRunner/Gui%20Xiaolin/jobcache/job_local938878567_0001/attempt_local938878567_0001_m_000000_0/output/file.out.index at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766) at org.apache.hadoop.io.SecureIOUtils.openFSDataInputStream(SecureIOUtils.java:156) at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:70) at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:62) at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:57) at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.copyMapOutput(LocalFetcher.java:124) at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.doCopy(LocalFetcher.java:102) at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.run(LocalFetcher.java:85) DEBUG - LocalFetcher 1 going to fetch: attempt_local938878567_0001_m_000000_0 DEBUG - LocalFetcher 1 going to fetch: attempt_local938878567_0001_m_000000_0
提示内容说的是找不到如下目录下的一个文件,经过多番周折才获知Hadoop运行过程中的文件路径中不能出现空格键。由于/tmp/hadoop-Gui%20Xiaolin……是根据电脑中的当前用户名产生的,因此只需要将用户名修改成不含空格即可。
D:/tmp/hadoop-Gui%20Xiaolin/mapred/local/localRunner/Gui%20Xiaolin/jobcache/job_local938878567_0001/attempt_local938878567_0001_m_000000_0/output/file.out.index
相关文章推荐
- java.io.FileNotFoundException: /data/user/0/**/cache/img1.jpg: open failed: ENOENT 问题解决
- 解决java java.io.FileNotFoundException: http:\localhost:8080 (文件名、目录名或卷)问题
- 解决java.io.FileNotFoundException: D:\xxx\yyy (拒绝访问。)问题
- 解决java.io.FileNotFoundException: D:\xxx\yyy (拒绝访问。)问题
- cloudera-scm-server启动时出现Caused by: java.io.FileNotFoundException: /var/lib/cloudera-scm-server/.keystore (No such file or directory)问题解决方法(图文详解)
- 解决java java.io.FileNotFoundException: http:\localhost:8080 (文件名、目录名或卷)问题
- 解决java.io.FileNotFoundException: D:\xxx\yyy (拒绝访问。)问题
- [原]在Oracle SOASUITE 10g 调用ESB 报“java.io.FileNotFoundException: /u01/esb/product/10.1.3.1/j2ee/home/../Context.properties”问题的解决办法
- 解决java.io.FileNotFoundException: D:\xxx\yyy (拒绝访问。)问题
- 解决java java.io.FileNotFoundException: http:\localhost:8080 (文件名、目录名或卷)问题
- 解决java java.io.FileNotFoundException: http:\localhost:8080 (文件名、目录名或卷)问题
- 如何解决java.io.FileNotFoundException: mysql.ini (系统找不到指定的文件。)
- 写文件流报:java.io.FileNotFoundException.....\img (拒绝访问。)的问题真正病根
- 【Bug解决】Spring配置错误:java.io.FileNotFoundException: class path resource [cxd/entity/User.hbm.xml] canno
- 使用HttpURLConnection下载文件时出现 java.io.FileNotFoundException彻底解决办法
- 使用HttpURLConnection下载文件时出现 java.io.FileNotFoundException彻底解决办法
- 出错解决:java.io.FileNotFoundException: /sdcard/fav.txt (Permission denied)
- 用jdbc中加载配置文件是出现java.io.FileNotFoundException的解决之道
- Eclipse中tomcat加载目录的设置引起的java.io.FileNotFoundException问题
- java.io.FileNotFoundException: class path resource [beans.xml] cannot be opened because it does not exist 解决方法