Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
2016-09-23 23:30
751 查看
当从SparkSql得到的dataFrame，映射成RDD之后向hbase中直接保存数据的时候报错：
Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set in JobConf.
采用的是saveAsNewApiHadoopDataSet
但是更换为saveAsHadoopDataset就可以使用，不知道在哪里出现了错误，对比发现应该是 没有使用sc.hadoopConfiguration,而是使用的JobConf 作为参数，新API不能用旧的configuration 。
Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set in JobConf.
采用的是saveAsNewApiHadoopDataSet
但是更换为saveAsHadoopDataset就可以使用，不知道在哪里出现了错误，对比发现应该是 没有使用sc.hadoopConfiguration,而是使用的JobConf 作为参数，新API不能用旧的configuration 。
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path
- "main" org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file
- Exception in thread "main" org.apache.ibatis.binding.BindingException: Invalid bound statement (not
- Hadoop分布式集群 EclipseException in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputExce
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io .nativeio.NativeIO$Windows.createDirectoryWithMode0(Ljava/lang/String;I)V
- HIVE Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNee
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Velocity报错： Exception in thread "main" org.apache.velocity.exception.ResourceNotFoundException:
- Exception in thread "main" org.apache.hadoop.security.AccessControlException: Permission denied: use
- Exceptionin thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray(II[BI[BIILjav
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
- Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/util/Apps Hadoop2.6.0编程问题与解决
- Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop
- Exception in thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Win
- Exceptioninthread"main"java.lang.NoClassDefFoundError:org/apache/hadoop/util/ProgramDriver
- MyBatis笔记----报错：Exception in thread "main" org.apache.ibatis.binding.BindingException: Invalid bound statement (not found)解决方法
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
- hadoop解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/util/Apps
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi