运行Mapreduce,运行一半卡着不动了
@[[root@master mr_inverted_test]# bash run.sh
rmr: DEPRECATED: Please use ‘rm -r’ instead.
19/01/17 23:22:23 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /output_z_fenci
rmr: DEPRECATED: Please use ‘rm -r’ instead.
19/01/17 23:22:25 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /output_d_fenci
19/01/17 23:22:26 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
19/01/17 23:22:27 WARN streaming.StreamJob: -jobconf option is deprecated, please use -D instead.
19/01/17 23:22:27 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
19/01/17 23:22:27 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
packageJobJar: [./jieba.tar.gz, ./map.py, /tmp/hadoop-unjar193075096903318331/] [] /tmp/streamjob6610733331047694604.jar tmpDir=null
19/01/17 23:22:28 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
19/01/17 23:22:29 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
19/01/17 23:22:31 INFO mapred.FileInputFormat: Total input paths to process : 1
19/01/17 23:22:31 INFO mapreduce.JobSubmitter: number of splits:2
19/01/17 23:22:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1547795510928_0002
19/01/17 23:22:31 INFO impl.YarnClientImpl: Submitted application application_1547795510928_0002
19/01/17 23:22:32 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1547795510928_0002/
19/01/17 23:22:32 INFO mapreduce.Job: Running job: job_1547795510928_0002
- (3)Hadoop 配置部署启动YARN及在YARN上运行MapReduce程序
- Hadoop运行任务时一直卡在: INFO mapreduce.Job: Running job
- 从零开始学习Hadoop--第7章 Hadoop MapReduce的运行机制
- 在windows 使用eclipse 跨平台运行mapreduce 提示连接不上
- windows上运行MapReduce出错(Failed to set permissions of path)
- 如何利用MapReduce的分治策略提高KNN算法的运行速度
- Ubuntu系统下的Hadoop集群(2)_使用命令行编译打包运行自己的MapReduce程序
- 使用Eclipse编译运行MapReduce程序 Hadoop2.6.0_Ubuntu/CentOS
- mapreduce中启用多线程运行map
- 自动编译并运行mapreduce程序的脚本
- hadoop 中MapReduce代码运行在win7上(本地)
- hadoop MapReduce运行异常:Unknown protocol to name node: org.apache.hadoop.mapred.JobSubmissionProtocol
- MapReduce作业运行流程
- 关于MapReduce,Map能完全执行,Reduce执行到一半卡住不执行
- Hadoop: Intellij结合Maven本地运行和调试MapReduce程序 (无需搭载Hadoop和HDFS环境)
- 如何在Amazon Elastic MapReduce(EMR)上运行MapReduce程序
- windows下不需要插件使用MyEclipse运行hadoop2.6.0 MapReduce程序。
- 编写简单的Mapreduce程序并部署在Hadoop2.2.0上运行
- MapReduce1和YARN(MapReduce2)运行机制
- yarn运行mapreduce的工作机制