Hadoop分布式集群 EclipseException in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputExce
2017-09-23 17:09
1031 查看
最近使用Hadoop分布式集群,今天在Ubuntu上将Eclipse和Hadoop配置好了,然后运行一个去重的案例,我将输入文件传到了hdfs文件系统,但是过程中出现了Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: 这个错误,显示从项目位置中查找输入文件,结果报错了,解决办法当然就是讲输入输出文件地址好好写了呗,代码如下:
// 设置输入和输出目录
FileInputFormat.addInputPath(job, new Path("hdfs://Master:9000/user/ycl1/input/inputfile1"));
FileOutputFormat.setOutputPath(job, new Path("hdfs://Master:9000/user/ycl1/output"));
重新运行一下,OK了。
这个路径是根据core-site.xml里面的fs.default.name来的。
// 设置输入和输出目录
FileInputFormat.addInputPath(job, new Path("hdfs://Master:9000/user/ycl1/input/inputfile1"));
FileOutputFormat.setOutputPath(job, new Path("hdfs://Master:9000/user/ycl1/output"));
重新运行一下,OK了。
这个路径是根据core-site.xml里面的fs.default.name来的。
相关文章推荐
- Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path
- Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
- Exception in thread "main" org.apache.hadoop.hbase.client.RetriesExhaustedException
- 解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/ FSDataInputStream
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveExcept
- Exceptionin thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCrc32.nativeCo
- Exceptioninthread"main"java.lang.NoClassDefFoundError:org/apache/hadoop/util/ProgramDriver
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveExcept
- Exceptionin thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray(II[BI[BIILjav
- hadoop异常: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exi
- Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop
- Exception in thread "main" org.apache.hadoop.security.AccessControlException: Permission denied: use
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
- HIVE Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNee
- Exception in thread "main" org.apache.ibatis.binding.BindingException: Invalid bound statement (not
- Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/util/Apps Hadoop2.6.0编程问题与解决
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- Exception in thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Win