解决spark运行中ERROR Shell:Failed to locate the winutils binary in the hadoop binary path的问题
2017-09-03 21:32
627 查看
17/09/03 21:27:13 ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:278)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:300)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:293)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)
at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:362)
at org.apache.spark.SparkContext$$anonfun$hadoopFile$1$$anonfun$30.apply(SparkContext.scala:1014)
at org.apache.spark.SparkContext$$anonfun$hadoopFile$1$$anonfun$30.apply(SparkContext.scala:1014)
at org.apache.spark.rdd.HadoopRDD$$anonfun$getJobConf$6.apply(HadoopRDD.scala:179)
at org.apache.spark.rdd.HadoopRDD$$anonfun$getJobConf$6.apply(HadoopRDD.scala:179)
在代码中设置hadoop.home.dir
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:278)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:300)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:293)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)
at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:362)
at org.apache.spark.SparkContext$$anonfun$hadoopFile$1$$anonfun$30.apply(SparkContext.scala:1014)
at org.apache.spark.SparkContext$$anonfun$hadoopFile$1$$anonfun$30.apply(SparkContext.scala:1014)
at org.apache.spark.rdd.HadoopRDD$$anonfun$getJobConf$6.apply(HadoopRDD.scala:179)
at org.apache.spark.rdd.HadoopRDD$$anonfun$getJobConf$6.apply(HadoopRDD.scala:179)
在代码中设置hadoop.home.dir
System.setProperty("hadoop.home.dir", "D:\\hadoop-2.5.0\\hadoop-2.5.0")
相关文章推荐
- spark在windows下运行报错ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
- spark: ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
- ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- 本地运行hadoop-Failed to locate the winutils binary in the hadoop binary path
- 本地运行hadoop-Failed to locate the winutils binary in the hadoop binary path-转载
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- win7系统下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- Failed to locate the winutils binary in the hadoop binary path java.io.IOException: Could not locat
- 出现 ERROR org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary pa
- Spark报错:Failed to locate the winutils binary in the hadoop binary path
- Hadoop报错:Failed to locate the winutils binary in the hadoop binary path
- Failed to locate the winutils binary in the hadoop binary path
- IDEA开发Spark提示failed to locate the winutils binary in the hadoop binary
- spark运行过程中报错Could not locate executable null\bin\winutils.exe in the Hadoop binaries.解决
- windows中以本地模式运行spark遇到“Could not locate executable null\bin\winutils.exe in the Hadoop binarie”