eclipse 提交hadoop2 的mapreduce程序

1 、下载myeclipse10 安装完成后，下载hadoop-eclipse-plugin-2.2.0.jar文件放入×MyEclipse 10\dropins目录下，并在Window/Preference中配置hadoop安装路径。本机解压缩hadoop安装包即可。重启eclipse

2 、配置map/reducer，其中map/reducer（v2）Master端口为8031，DFS Master为9000，分别根据hadoop安装配置的yarn-site.xml的配置项 <name>yarn.resourcemanager.resource-tracker.address</name>和core-site.xml的配置项  <name>fs.defaultFS</name>配置

3 、准备环境并写mapreducer程序，如wordcount

4、提交mapreduce程序，程序报错。为查看错误需要在工程中提供log4j的配置文件，内容为：

log4j.rootLogger=debug,stdout

log4j.threshhold=ALL

log4j.appender.stdout=org.apache.log4j.ConsoleAppender

log4j.appender.stdout.layout=org.apache.log4j.PatternLayout

log4j.appender.stdout.layout.ConversionPattern=%d{ISO8601} %-5p [%t] %c{2} (%F:%M(%L)) - %m%n

5 、再次提交，错误信息如下：

2014-04-10 10:55:07,425 DEBUG [main] util.Shell (Shell.java:checkHadoopHome(283)) - Failed to detect a valid hadoop home directory

java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
 at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:265)

 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:290)

 at org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:431)

 at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:477)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:171)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:154)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 10:55:07,428 ERROR [main] util.Shell (Shell.java:getWinUtilsPath(336)) - Failed to locate the winutils binary in the hadoop binary path

java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

 at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)

 at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)

 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)

 at org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:431)

 at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:477)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:171)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:154)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 10:55:07,763 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[Rate of successful kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 10:55:07,771 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[Rate of failed kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 10:55:07,771 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[GetGroups], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 10:55:07,772 DEBUG [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:register(220)) - UgiMetrics, User and group related metrics

2014-04-10 10:55:07,884 DEBUG [main] util.KerberosName (KerberosName.java:<clinit>(87)) - Kerberos krb5 configuration not found, setting default realm to empty

2014-04-10 10:55:07,886 DEBUG [main] security.Groups (Groups.java:getUserToGroupsMappingService(237)) -  Creating new Groups object

2014-04-10 10:55:07,889 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(46)) - Trying to load the custom-built native-hadoop library...

2014-04-10 10:55:07,890 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(55)) - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path

2014-04-10 10:55:07,890 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(56)) - java.library.path=D:\Program Files\myEclipse10\Common\binary\com.sun.java.jdk.win32.x86_64_1.6.0.013\bin;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program
Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R)
Management Engine Components\IPT;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x86;C:\Program Files (x86)\Intel\OpenCL
SDK\3.0\bin\x64;D:\Program Files\TortoiseSVN\bin;D:\Program Files\Java\jdk1.7.0_25\bin;E:\Resouce\apache-maven-3.2.1\bin

2014-04-10 10:55:07,891 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2014-04-10 10:55:07,891 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback (JniBasedUnixGroupsMappingWithFallback.java:<init>(40)) - Falling back to shell based

2014-04-10 10:55:07,891 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback (JniBasedUnixGroupsMappingWithFallback.java:<init>(44)) - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping

2014-04-10 10:55:07,893 DEBUG [main] security.Groups (Groups.java:<init>(79)) - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000

2014-04-10 10:55:07,898 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:login(193)) - hadoop login

2014-04-10 10:55:07,899 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:commit(142)) - hadoop login commit

2014-04-10 10:55:07,902 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:commit(172)) - using local user:NTUserPrincipal: ysite

2014-04-10 10:55:07,903 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:loginUserFromSubject(754)) - UGI loginUser:ysite (auth:SIMPLE)

2014-04-10 10:55:07,996 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(393)) - dfs.client.use.legacy.blockreader.local = false

2014-04-10 10:55:07,997 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(396)) - dfs.client.read.shortcircuit = false

2014-04-10 10:55:07,997 DEBUG [main] hdfs.Bloc
4000
kReaderLocal (DFSClient.java:<init>(399)) - dfs.client.domain.socket.data.traffic = false

2014-04-10 10:55:07,997 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(402)) - dfs.domain.socket.path =

2014-04-10 10:55:08,031 DEBUG [main] retry.RetryUtils (RetryUtils.java:getDefaultRetryPolicy(74)) - multipleLinearRandomRetry = null

2014-04-10 10:55:08,051 DEBUG [main] ipc.Server (Server.java:registerProtocolEngine(222)) - rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper,

rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@11e7c5cb

2014-04-10 10:55:08,259 DEBUG [main] hdfs.BlockReaderLocal (DomainSocketFactory.java:<init>(63)) - Both short-circuit local reads and UNIX domain socket are disabled.

2014-04-10 10:55:08,273 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)

2014-04-10 10:55:08,277 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(90)) - Trying ClientProtocolProvider : org.apache.hadoop.mapred.YarnClientProtocolProvider

2014-04-10 10:55:08,277 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(108)) - Cannot pick org.apache.hadoop.mapred.YarnClientProtocolProvider as the ClientProtocolProvider - returned null protocol

2014-04-10 10:55:08,278 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(90)) - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider

2014-04-10 10:55:08,283 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id

2014-04-10 10:55:08,284 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=

2014-04-10 10:55:08,289 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(103)) - Picked org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider

2014-04-10 10:55:08,290 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Cluster.getFileSystem(Cluster.java:161)

2014-04-10 10:55:08,293 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)

2014-04-10 10:55:08,309 DEBUG [main] ipc.Client (Client.java:<init>(424)) - The ping interval is 60000 ms.

2014-04-10 10:55:08,309 DEBUG [main] ipc.Client (Client.java:setupIOstreams(690)) - Connecting to hapmaster/192.168.136.140:9000

2014-04-10 10:55:08,329 DEBUG [IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:run(940)) - IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite: starting, having connections 1

2014-04-10 10:55:08,330 DEBUG [IPC Parameter Sending Thread #0] ipc.Client (Client.java:run(1003)) - IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite sending #0

2014-04-10 10:55:08,337 DEBUG [IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:receiveRpcResponse(1060)) - IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite got value #0

2014-04-10 10:55:08,338 DEBUG [main] ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 39ms

Exception in thread "main" java.lang.NullPointerException

 at java.lang.ProcessBuilder.start(ProcessBuilder.java:441)

 at org.apache.hadoop.util.Shell.runCommand(Shell.java:445)

 at org.apache.hadoop.util.Shell.run(Shell.java:418)

 at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)

 at org.apache.hadoop.util.Shell.execCommand(Shell.java:739)

 at org.apache.hadoop.util.Shell.execCommand(Shell.java:722)

 at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:631)

 at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:421)

 at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:277)

 at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:125)

 at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:348)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)

 at java.security.AccessController.doPrivileged(Native Method)

 at javax.security.auth.Subject.doAs(Subject.java:396)

 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

 at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)

 at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)

 at com.hadoop.test.patent.Patent.run(Patent.java:51)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 10:55:08,357 DEBUG [Thread-1] ipc.Client (Client.java:stop(1213)) - Stopping client

2014-04-10 10:55:08,357 DEBUG [IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:close(1163)) - IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite: closed

2014-04-10 10:55:08,357 DEBUG [IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:run(958)) - IPC Client (477108775) connection to hapmaster/192.168.136.140:9000 from ysite: stopped, remaining connections
0

 

6 、在window环境变量中设置HADOOP_HOME或使用-Dhadoop.home.dir=xxx指定目录，如HADOOP_HOME=E:\hadoop-2.3.0-src\hadoop-dist\target\hadoop-2.3.0，重启eclipse让环境变量在eclipse中生效

7 、继续提交mapreduce程序，发现如下错误。如果有安全方面的错误则修改hdfs-site.xml中的<name>dfs.permissions.enabled</name>配置项为false，这里已经配置。

2014-04-10 11:09:35,534 ERROR [main] util.Shell (Shell.java:getWinUtilsPath(336)) - Failed to locate the winutils binary in the hadoop binary path

java.io.IOException: Could not locate executable E:\hadoop-2.3.0-src\hadoop-dist\target\hadoop-2.3.0\bin\winutils.exe in the Hadoop binaries.
 at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)

 at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)

 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)

 at org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:431)

 at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:477)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:171)

 at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:154)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 11:09:35,866 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[Rate of successful kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 11:09:35,875 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[Rate of failed kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 11:09:35,875 DEBUG [main] lib.MutableMetricsFactory (MutableMetricsFactory.java:newForField(42)) - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[GetGroups], always=false, type=DEFAULT, sampleName=Ops)

2014-04-10 11:09:35,876 DEBUG [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:register(220)) - UgiMetrics, User and group related metrics

2014-04-10 11:09:35,992 DEBUG [main] util.KerberosName (KerberosName.java:<clinit>(87)) - Kerberos krb5 configuration not found, setting default realm to empty

2014-04-10 11:09:35,994 DEBUG [main] security.Groups (Groups.java:getUserToGroupsMappingService(237)) -  Creating new Groups object

2014-04-10 11:09:35,996 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(46)) - Trying to load the custom-built native-hadoop library...

2014-04-10 11:09:35,997 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(55)) - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path

2014-04-10 11:09:35,997 DEBUG [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(56)) - java.library.path=D:\Program Files\myEclipse10\Common\binary\com.sun.java.jdk.win32.x86_64_1.6.0.013\bin;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program
Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R)
Management Engine Components\IPT;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x86;C:\Program Files (x86)\Intel\OpenCL
SDK\3.0\bin\x64;D:\Program Files\TortoiseSVN\bin;D:\Program Files\Java\jdk1.7.0_25\bin;E:\Resouce\apache-maven-3.2.1\bin

2014-04-10 11:09:35,997 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2014-04-10 11:09:35,997 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback (JniBasedUnixGroupsMappingWithFallback.java:<init>(40)) - Falling back to shell based

2014-04-10 11:09:35,998 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback (JniBasedUnixGroupsMappingWithFallback.java:<init>(44)) - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping

2014-04-10 11:09:35,999 DEBUG [main] security.Groups (Groups.java:<init>(79)) - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000

2014-04-10 11:09:36,003 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:login(193)) - hadoop login

2014-04-10 11:09:36,003 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:commit(142)) - hadoop login commit

2014-04-10 11:09:36,007 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:commit(172)) - using local user:NTUserPrincipal: ysite

2014-04-10 11:09:36,008 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:loginUserFromSubject(754)) - UGI loginUser:ysite (auth:SIMPLE)

2014-04-10 11:09:36,105 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(393)) - dfs.client.use.legacy.blockreader.local = false

2014-04-10 11:09:36,106 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(396)) - dfs.client.read.shortcircuit = false

2014-04-10 11:09:36,106 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(399)) - dfs.client.domain.socket.data.traffic = false

2014-04-10 11:09:36,106 DEBUG [main] hdfs.BlockReaderLocal (DFSClient.java:<init>(402)) - dfs.domain.socket.path =

2014-04-10 11:09:36,158 DEBUG [main] retry.RetryUtils (RetryUtils.java:getDefaultRetryPolicy(74)) - multipleLinearRandomRetry = null

2014-04-10 11:09:36,178 DEBUG [main] ipc.Server (Server.java:registerProtocolEngine(222)) - rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper,

rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@3963b3e

2014-04-10 11:09:36,388 DEBUG [main] hdfs.BlockReaderLocal (DomainSocketFactory.java:<init>(63)) - Both short-circuit local reads and UNIX domain socket are disabled.

2014-04-10 11:09:36,401 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)

2014-04-10 11:09:36,405 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(90)) - Trying ClientProtocolProvider : org.apache.hadoop.mapred.YarnClientProtocolProvider

2014-04-10 11:09:36,405 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(108)) - Cannot pick org.apache.hadoop.mapred.YarnClientProtocolProvider as the ClientProtocolProvider - returned null protocol

2014-04-10 11:09:36,406 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(90)) - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider

2014-04-10 11:09:36,411 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id

2014-04-10 11:09:36,412 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=

2014-04-10 11:09:36,417 DEBUG [main] mapreduce.Cluster (Cluster.java:initialize(103)) - Picked org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider

2014-04-10 11:09:36,418 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Cluster.getFileSystem(Cluster.java:161)

2014-04-10 11:09:36,422 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)

2014-04-10 11:09:36,437 DEBUG [main] ipc.Client (Client.java:<init>(424)) - The ping interval is 60000 ms.

2014-04-10 11:09:36,438 DEBUG [main] ipc.Client (Client.java:setupIOstreams(690)) - Connecting to hapmaster/192.168.136.140:9000

2014-04-10 11:09:36,457 DEBUG [IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:run(940)) - IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite: starting, having connections 1

2014-04-10 11:09:36,459 DEBUG [IPC Parameter Sending Thread #0] ipc.Client (Client.java:run(1003)) - IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite sending #0

2014-04-10 11:09:36,465 DEBUG [IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:receiveRpcResponse(1060)) - IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite got value #0

2014-04-10 11:09:36,466 DEBUG [main] ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 39ms

Exception in thread "main" java.lang.NullPointerException

 at java.lang.ProcessBuilder.start(ProcessBuilder.java:441)

 at org.apache.hadoop.util.Shell.runCommand(Shell.java:445)

 at org.apache.hadoop.util.Shell.run(Shell.java:418)

 at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)

 at org.apache.hadoop.util.Shell.execCommand(Shell.java:739)

 at org.apache.hadoop.util.Shell.execCommand(Shell.java:722)

 at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:631)

 at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:421)

 at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:277)

 at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:125)

 at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:348)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)

 at java.security.AccessController.doPrivileged(Native Method)

 at javax.security.auth.Subject.doAs(Subject.java:396)

 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

 at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)

 at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)

 at com.hadoop.test.patent.Patent.run(Patent.java:51)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 11:09:36,485 DEBUG [Thread-1] ipc.Client (Client.java:stop(1213)) - Stopping client

2014-04-10 11:09:36,485 DEBUG [IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:close(1163)) - IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite: closed

2014-04-10 11:09:36,485 DEBUG [IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:run(958)) - IPC Client (424162811) connection to hapmaster/192.168.136.140:9000 from ysite: stopped, remaining connections
0

8、需要下载安装winutils.exe文件并放到hadoop的bin目录下，winutils.exe有64和32位之分。64位下载路径https://github.com/srccodes/hadoop-common-2.2.0-bin/archive/master.zip

9、再次提交mapreduce程序，继续报错

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.zk-state-store.parent-path

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.job.task.listener.thread-count

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.list.cache.pools.num.responses

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.safemode.extension

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.zookeeper.parent-znode

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.container-executor.class

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.skip.checksum.errors

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.path.based.cache.refresh.interval.ms

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.user.name

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.scheduler.client.thread-count

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.http.authentication.kerberos.principal

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.log.level

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.s3.maxRetries

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.resourcemanager.minimum.version

2014-04-10 11:14:00,711 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.kerberos.kinit.command

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.log-aggregation.retain-check-interval-seconds

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.process-kill-wait.ms

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.linux-container-executor.cgroups.mount

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.working.dir

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.handler.count

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.name.dir.restore

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.admin.address

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.client-am.ipc.max-retries

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.use.datanode.hostname

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.util.hash.type

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.seqfile.lazydecompress

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.dns.interface

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.disk-health-checker.min-healthy-disks

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.maxtaskfailures.per.tracker

2014-04-10 11:14:00,712 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.healthchecker.script.timeout

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.client.max-nodemanagers-proxies

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping.ldap.search.attr.group.name

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.df.interval

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.tracker

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.kerberos.internal.spnego.principal

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.reduce.class

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.map.class

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.reduce.shuffle.consumer.plugin.class

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.address

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.tasks.sleeptimebeforesigkill

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.journalnode.rpc-address

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.fs-limits.max-blocks-per-file

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.acl-view-job

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.block.write.replace-datanode-on-failure.policy

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.job.committer.cancel-timeout

2014-04-10 11:14:00,713 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.replication.interval

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.num.checkpoints.retained

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.minicluster.fixed.ports

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.admin.acl

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.scheduler.address

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.http.address

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.directoryscan.threads

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping.ldap.ssl

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.http.policy

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.merge.progress.records

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.heartbeat.interval

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.recovery.enabled

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for net.topology.script.number.args

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.local.clientfactory.class.name

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.user.name

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client-write-packet-size

2014-04-10 11:14:00,714 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping.ldap.directory.search.timeout

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.native.lib.available

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.failover.connection.retries

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.disk-health-checker.interval-ms

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.blocksize

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.webapp.address

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.resource-tracker.client.thread-count

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.client.failover-retries

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.blockreport.initialDelay

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.zk-timeout-ms

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.aux-services.mapreduce_shuffle.class

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.health-monitor.rpc-timeout.ms

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.markreset.buffer.percent

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.ha.tail-edits.period

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.admin.user.env

2014-04-10 11:14:00,715 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.client.thread-count

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.health-checker.script.timeout-ms

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for file.bytes-per-checksum

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.replication.max

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.max.extra.edits.segments.retained

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.map.index.skip

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.timeout

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.du.reserved

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.cpu.vcores

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.support.append

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for
ftp.blocksize

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.file-block-storage-locations.num-threads

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.container-manager.thread-count

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.server.listen.queue.size

2014-04-10 11:14:00,716 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.amliveliness-monitor.interval-ms

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.hostname.verifier

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.ha.automatic-failover.enabled

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.dns.interface

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping.ldap.search.attr.member

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.userlog.retain.hours

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.outofband.heartbeat

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.name

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.resource.memory-mb

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.webhdfs.user.provider.user.pattern

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.delegation.token.renew-interval

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.keystores.factory.class

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.http.policy

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.sync.behind.writes

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.maxattempts

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.handler.count

2014-04-10 11:14:00,717 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.require.client.cert

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for
ftp.client-write-packet-size

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.write.exclude.nodes.cache.expiry.interval.millis

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.server.tcpnodelay

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.cleaner.enable

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.du.interval

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.retry-delay.max.ms

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.profile.reduces

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.health-monitor.connect-retry-interval.ms

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.fuse.connection.timeout

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.permissions.superusergroup

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.jobhistory.task.numberprogresssplits

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.ftp.host.port

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.speculative

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.client.submit.file.replication

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.data.dir.perm

2014-04-10 11:14:00,718 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3native.blocksize

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.ubertask.maxmaps

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.replication.min

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.cluster.acls.enabled

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.uid.cache.secs

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.localizer.fetch.thread-count

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.trash.checkpoint.interval

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for map.sort.class

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapred.queue.default.acl-administer-jobs

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.jobtracker.port

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.image.transfer.timeout

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.name.dir

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.staging-dir

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.connect.timeout

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.AbstractFileSystem.file.impl

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.env-whitelist

2014-04-10 11:14:00,719 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.image.compression.codec

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.reduces

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.recovery.store.class

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.complete.cancel.delegation.tokens

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping.ldap.search.filter.user

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.sleep-delay-before-sigkill.ms

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.enable.retrycache

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.joblist.cache.size

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.outputformat.class

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.healthchecker.interval

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.heartbeats.in.second

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.persist.jobstatus.dir

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.backup.http-address

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.rpc.protection

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.container.log.backups

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.https-address

2014-04-10 11:14:00,720 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for
ftp.stream-buffer-size

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.ha.log-roll.period

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.input.fileinputformat.numinputfiles

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.admin.client.thread-count

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.socks.proxy.host

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.fsdatasetcache.max.threads.per.volume

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for file.client-write-packet-size

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.http.authentication.simple.anonymous.allowed

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.drop.cache.behind.reads

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.log.retain-seconds

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.image.transfer.bandwidthPerSec

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.failover-controller.cli-check.rpc-timeout.ms

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.instrumentation

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.linux-container-executor.cgroups.hierarchy

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.groups.cache.warn.after.ms

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.write.stale.datanode.ratio

2014-04-10 11:14:00,721 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.client.thread-count

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.mapfile.bloom.size

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.zk-num-retries

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.ha.fencing.ssh.connect-timeout

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3.bytes-per-checksum

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.edit.log.autoroll.check.interval.ms

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.automatic.close

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.trash.interval

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.authentication

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.defaultFS

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.connect.max.retries

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.server.conf

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.delayed.delegation-token.removal-interval-ms

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.journalnode.http-address

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.masters.colocate

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.speculative.speculativecap

2014-04-10 11:14:00,722 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.taskscheduler

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.output.fileoutputformat.compress

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.am.liveness-monitor.expiry-interval-ms

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for net.topology.node.switch.mapping.impl

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.replication.considerLoad

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.fs-limits.min-block-size

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.swift.impl

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.audit.loggers

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.max.split.locations

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.counters.max

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.address

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.block.write.retries

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.nm.liveness-monitor.interval-ms

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.map.index.interval

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapred.child.java.opts

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.local.dir.minspacestart

2014-04-10 11:14:00,723 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.client.progressmonitor.pollinterval

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.https.keystore.resource

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.profile.map.params

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for rpc.engine.org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.queuename

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.tasktracker.maxblacklists

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.localizer.address

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.mapfile.bloom.error.rate

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.delete.thread-count

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.split.metainfo.maxsize

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.scheduler.maximum-allocation-vcores

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapred.mapper.new-api

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.tcpnodelay

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.dir

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.resource.mb

2014-04-10 11:14:00,724 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.dns.nameserver

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.output.compress.codec

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.accesstime.precision

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.log.level

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.seqfile.compress.blocksize

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.taskcontroller

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.groups.cache.secs

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.socks.server

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.end-notification.max.attempts

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.namenode.port

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.webapp.address

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.recovery.enable

2014-04-10 11:14:00,725 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.submithostname

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.expire.trackers.interval

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.webapp.address

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.loadedjobs.cache.size

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.health-checker.interval-ms

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.map.output.collector.class

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.authorization

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.am.max-attempts

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.ftp.host

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.location.name

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.ifile.readahead

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.scheduler.monitor.enable

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.zk-retry-interval-ms

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.zookeeper.session-timeout.ms

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.taskmemorymanager.monitoringinterval

2014-04-10 11:14:00,726 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.parallelcopies

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.output.value.class

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.skip.maxrecords

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.classloader.system.classes

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.avoid.read.stale.datanode

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.https.enable

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.read.timeout

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.remote-app-log-dir-suffix

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.instrumentation

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.output.fileoutputformat.compress.codec

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.blockreport.intervalMsec

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.connect.retry.interval

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.speculative

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.keytab

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.datestring.cache.size

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.balance.bandwidthPerSec

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for file.blocksize

2014-04-10 11:14:00,727 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.admin.address

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.cpu.vcores

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.resource-tracker.address

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.local.dir.minspacekill

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.staging.root.dir

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.retiredjobs.cache.size

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.connect.max.retries.on.timeouts

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.zookeeper.acl

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.local-dirs

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.connect.timeout

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for rpc.metrics.quantile.enable

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.block.access.key.update.interval

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.block.access.token.lifetime

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.end-notification.retry.attempts

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.system.dir

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.admin-env

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.log-aggregation.retain-seconds

2014-04-10 11:14:00,728 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.jobhistory.block.size

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.indexcache.mb

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.checkpoint.check.period

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.block.write.replace-datanode-on-failure.enable

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.hostname

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.directoryscan.interval

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for net.topology.impl

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.container-monitor.interval-ms

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.default.chunk.view.size

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.speculative.slownodethreshold

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.reduce.slowstart.completedmaps

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.instrumentation.requires.admin

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.compression.codec.bzip2.library

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.http.authentication.signature.secret.file

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.safemode.min.datanodes

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.input.fileinputformat.inputdir

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.localizer.cache.target-size-mb

2014-04-10 11:14:00,729 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.maxattempts

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.https.address

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3native.replication

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.path.based.cache.retry.interval.ms

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.skip.proc.count.autoincr

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for file.replication

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.cleaner.interval-ms

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.hdfs.configuration.version

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.idlethreshold

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.tmp.dir

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.store.class

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.restart.recover

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.address

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.cluster.local.dir

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.client.nodemanager-client-async.thread-pool-max-size

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.ipc.serializer.type

2014-04-10 11:14:00,730 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.decommission.nodes.per.interval

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.resource.cpu-vcores

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.inputformat.class

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.delegation.key.update-interval

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.jobtracker.host

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.s3.buffer.dir

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.support.allow.format

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.remote-app-log-dir

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.edit.log.autoroll.multiplier.threshold

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.work.around.non.threadsafe.getpwuid

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.profile.reduce.params

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.ha.automatic-failover.enabled

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.stale.datanode.interval

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.edits.noeditlogchannelflush

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.persist.jobstatus.active

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.logging.level

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.log-dirs

2014-04-10 11:14:00,731 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.health-monitor.sleep-after-disconnect.ms

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.checkpoint.edits.dir

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.fs.state-store.uri

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.rpc.socket.factory.class.default

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.keytab

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.http.address

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.profile

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.move.interval-ms

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.edits.dir

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.fuse.timer.period

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.http.policy

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.namenode.host

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.intermediate-done-dir

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.skip.proc.count.autoincr

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.AbstractFileSystem.viewfs.impl

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.speculative.slowtaskthreshold

2014-04-10 11:14:00,732 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3native.stream-buffer-size

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.delete.debug-delay-sec

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.secondary.namenode.kerberos.internal.spnego.principal

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.safemode.threshold-pct

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.ifile.readahead.bytes

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.scheduler.maximum-allocation-mb

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ipc.client.fallback-to-simple-auth-allowed

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3native.bytes-per-checksum

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.committer.setup.cleanup.needed

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.log-aggregation.compression-type

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.job.committer.commit-window

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.http.authentication.type

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.failover.sleep.base.millis

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.submithostaddress

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.vmem-check-enabled

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.jetty.logs.serve.aliases

2014-04-10 11:14:00,733 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.failover-controller.graceful-fence.rpc-timeout.ms

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.input.buffer.percent

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.max.transfer.threads

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.io.sort.mb

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.merge.inmem.threshold

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.client.application-client-protocol.poll-interval-ms

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.handler.count

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.connect.max-wait.ms

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.retrycache.heap.percent

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.client.conf

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.container.liveness-monitor.interval-ms

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.vmem-pmem-ratio

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.client.completion.pollinterval

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.client.max-retries

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.ssl.enabled

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.AbstractFileSystem.hdfs.impl

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.client.resolve.remote.symlinks

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.reduce.tasks.maximum

2014-04-10 11:14:00,734 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.client.genericoptionsparser.used

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.hostname

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.input.buffer.percent

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.command-opts

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.invalidate.work.pct.per.iteration

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.bytes-per-checksum

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.webapp.https.address

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.replication

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.shuffle.ssl.file.buffer.size

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.list.cache.directives.num.responses

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.permissions.enabled

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.maxtasks.perjob

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.use.datanode.hostname

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.userlog.limit.kb

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.fs-limits.max-directory-items

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3.client-write-packet-size

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.user.group.static.mapping.overrides

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.shuffle.max.threads

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.failover.sleep.max.millis

2014-04-10 11:14:00,735 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.maps

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.fs-limits.max-component-length

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.map.output.compress

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3.blocksize

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.edits.journal-plugin.qjournal

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.datanode.registration.ip-hostname-check

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.pmem-check-enabled

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.https.need-auth

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.scheduler.minimum-allocation-mb

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.max-age-ms

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for
ftp.replication

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.input.fileinputformat.split.minsize

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.s3n.block.size

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.token.tracking.ids.enabled

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.ipc.rpc.class

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.num.extra.edits.retained

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.localizer.cache.cleanup.interval-ms

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.http.staticuser.user

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.move.thread-count

2014-04-10 11:14:00,736 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.jvm.numtasks

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.profile.maps

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.resourcemanager.connect.wait.secs

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for eclipse.plug-in.socks.proxy.port

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.max.locked.memory

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.cachereport.intervalMsec

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.shuffle.port

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.nodemanager.minimum.version

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.reduce.shuffle.merge.percent

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobtracker.http.address

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.connect.retry-interval.ms

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.skip.start.attempts

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.scheduler.minimum-allocation-vcores

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.task.io.sort.factor

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.checkpoint.dir

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for tfile.fs.input.buffer.size

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for tfile.io.chunk.size

2014-04-10 11:14:00,737 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.s3.block.size

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.serializations

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.max-completed-applications

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.jobhistory.principal

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.output.fileoutputformat.outputdir

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.ha.automatic-failover.zk-base-path

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.end-notification.retry.interval

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.backup.address

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.seqfile.sorter.recordlimit

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.block.access.token.enable

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for s3native.client-write-packet-size

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.security.group.mapping

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for
ftp.bytes-per-checksum

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.file-block-storage-locations.timeout

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.end-notification.max.retry.interval

2014-04-10 11:14:00,738 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.acl.enable

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nm.liveness-monitor.expiry-interval-ms

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.client.mmap.cache.size

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.map.tasks.maximum

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.nodemanager.linux-container-executor.resources-handler.class

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.max.objects

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.state-store.max-completed-applications

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.delegation.token.max-lifetime

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.classloader

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.hdfs-servers

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for nfs3.mountd.port

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.dns.nameserver

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.hdfs-blocks-metadata.enabled

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.readahead.bytes

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.image.compress

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.ubertask.maxreduces

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.shuffle.ssl.enabled

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.log-aggregation-enable

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.report.address

2014-04-10 11:14:00,739 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.tasktracker.http.threads

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.stream-buffer-size

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for tfile.fs.output.buffer.size

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.permissions.umask-mode

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.resourcemanager.am.max-attempts

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for ha.failover-controller.graceful-fence.connection.retries

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.datanode.drop.cache.behind.writes

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for yarn.app.mapreduce.am.resource.cpu-vcores

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for hadoop.common.configuration.version

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.ubertask.enable

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for dfs.namenode.replication.work.multiplier.per.iteration

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.job.acl-modify-job

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for io.seqfile.local.dir

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for fs.s3.sleepTimeSeconds

2014-04-10 11:14:00,740 DEBUG [main] conf.Configuration (Configuration.java:handleDeprecation(599)) - Handling deprecation for mapreduce.client.output.filter

2014-04-10 11:14:00,812 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1749873012_0001

2014-04-10 11:14:00,863 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2345)) - file:/tmp/hadoop-ysite/mapred/staging/ysite1749873012/.staging/job_local1749873012_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; 
Ignoring.

2014-04-10 11:14:00,863 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2345)) - file:/tmp/hadoop-ysite/mapred/staging/ysite1749873012/.staging/job_local1749873012_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; 
Ignoring.

2014-04-10 11:14:00,895 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1570)) - PrivilegedAction as:ysite (auth:SIMPLE) from:org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:329)

2014-04-10 11:14:00,929 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(441)) - Cleaning up the staging area file:/tmp/hadoop-ysite/mapred/staging/ysite1749873012/.staging/job_local1749873012_0001
Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
 at org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)

 at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:560)

 at org.apache.hadoop.fs.FileUtil.canRead(FileUtil.java:977)

 at org.apache.hadoop.util.DiskChecker.checkAccessByFileMethods(DiskChecker.java:177)

 at org.apache.hadoop.util.DiskChecker.checkDirAccess(DiskChecker.java:164)

 at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:98)

 at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:285)

 at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)

 at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)

 at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)

 at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)

 at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:131)

 at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)

 at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)

 at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)

 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)

 at java.security.AccessController.doPrivileged(Native Method)

 at javax.security.auth.Subject.doAs(Subject.java:396)

 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

 at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)

 at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)

 at com.hadoop.test.patent.Patent.run(Patent.java:51)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

 at com.hadoop.test.patent.Patent.main(Patent.java:23)

2014-04-10 11:14:00,940 DEBUG [Thread-1] ipc.Client (Client.java:stop(1213)) - Stopping client

2014-04-10 11:14:00,940 DEBUG [IPC Client (1802010236) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:close(1163)) - IPC Client (1802010236) connection to hapmaster/192.168.136.140:9000 from ysite: closed

2014-04-10 11:14:00,940 DEBUG [IPC Client (1802010236) connection to hapmaster/192.168.136.140:9000 from ysite] ipc.Client (Client.java:run(958)) - IPC Client (1802010236) connection to hapmaster/192.168.136.140:9000 from ysite: stopped, remaining connections
0

9、上面错误是因为程序找不到hadoop.dll文件，可以把E:\hadoop-2.3.0-src\hadoop-dist\target\hadoop-2.3.0\bin目录中的hadoop.dll放入system32目录，或者设置环境变量path中添加hadoop的bin路径，path=××××;E:\hadoop-2.3.0-src\hadoop-dist\target\hadoop-2.3.0\bin。重启eclipse使环境变量在eclipse生效

10、继续提交程序，run in hadoop，然后就没有错误了