您的位置:首页 > 其它

YARN伪分布式安装

2017-12-15 21:45 106 查看
一 修改core-site.xml

etc/hadoop/core-site.xml
fs.defaultFS配置NameNode的URI
[root@master hadoop]# cat core-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>


二 修改hdfs-site.xml
etc/hadoop/hdfs-site.xml
dfs.replication设置块的复制数量
[root@master hadoop]# cat hdfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>

三 修改mapred-site.xml
etc/hadoop/mapred-site.xml
mapreduce.framework.name配置MapReduce应用使用Yarn框架
[root@master hadoop]# cat mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>


四 修改yarn-site.xml文件
etc/hadoop/yarn-site.xml
yarn.nodemanager.aux-services:为NodeManager配置MapReduce应用的Shuffle服务
[root@master hadoop]# cat yarn-site.xml
<?xml version="1.0"?>
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>


五 修改slaves文件
文件内容如下:
127.0.0.1

六 检查Yarn是否安装成功
启动资源管理器(ResouceManager)和节点管理器(NodeManager)守护进程
sbin/start-yarn.sh
[root@master hadoop-2.7.4]# cd sbin
[root@master sbin]# ./start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-resourcemanager-master.out
localhost: \S
localhost: Kernel \r on an \m
localhost: starting nodemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-nodemanager-master.out
[root@master sbin]# jps
3392 NodeManager
3302 ResourceManager
3691 Jps

访问资源管理器的web接口
http://192.168.0.105:8088/



七 参考
http://www.jikexueyuan.com/course/1588.html
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  YARN 伪分布式