Zookeeper分布式集群搭建
2018-11-15 14:34
141 查看
版权声明:版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/chaosbead/article/details/84103808
Zookeeper分布式集群搭建
一.描述
在centos7上搭建zookeeper集群,zookeeper运行依赖于java环境
# 查看java版本 java -version
二.步骤
1. 安装环境准备
准备三台centos7服务器,我用的VM虚拟机,ip分别为:
- 192.168.3.10
- 192.168.3.12
- 192.168.3.13
2. 下载安装zookeeper
以其中192.168.3.10为例,其他两台安装过程一样
zookeeper下载地址,下载好zookeeper-3.4.9.tar.gz,解压
[root@zookeeper ~]# tar -zxvf zookeeper-3.4.9.tar.gz
进入zookeeper中的conf目录
[root@zookeeper conf]# cp zoo-sample.cfg zoo.cfg
进入bin目录,启动zookeeper,进行单机操作
# 启动 [root@zookeeper bin]# sh zkServer.sh start# 查看状态 [root@zookeeper bin]# sh zkServer.sh status # 连接 [root@zookeeper bin]# sh zkCli.sh # 停止 [root@zookeeper bin]# sh zkServer.sh stop
上述操作没有问题可以进行zookeeper的集群配置
3. zookeeper集群配置
编辑zoo.cfg文件,以192.168.3.10为例,修改配置
[root@zookeeper conf]# vim zoo.cfg # sending a request and getting an acknowledgement syncLimit=5 # the directory where the snapshot is stored. # do not use /tmp for storage, /tmp here is just # example sakes. dataDir=/apps/servers/data/d_1 dataLogDir=/apps/servers/logs/logs_1 # the port at which the clients will connect clientPort=2181 # the maximum number of client connections. # increase this if you need to handle more clients #maxClientCnxns=60 # # Be sure to read the maintenance section of the # administrator guide before turning on autopurge. # # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance # # The number of snapshots to retain in dataDir #autopurge.snapRetainCount=3 # Purge task interval in hours # Set to "0" to disable auto purge feature #autopurge.purgeInterval=1 server.1=192.168.3.10:2188:2888 server.2=192.168.3.12:2188:2888 server.3=192.168.3.13:2188:2888
在原有基础上修改dataDir目录,增加dataLogDir和sever配置
dataDir=/apps/servers/data/d_1 dataLogDir=/apps/servers/logs/logs_1 server.1=192.168.3.10:2188:2888 server.2=192.168.3.12:2188:2888 server.3=192.168.3.13:2188:2888
192.168.3.12和 192.168.3.13同上
修改过后创建dataDir和dataLogDir,以及指定server.id
#创建dataDir和dataLogDir目录 [root@zookeeper conf]# mkdir -p /apps/servers/data/d_1 [root@zookeeper conf]# mkdir -p /apps/servers/logs/logs_1 #指定192.168.3.10的id [root@zookeeper conf]# echo "1">/apps/servers/data/d_1/myid
192.168.3.12 中
#创建dataDir和dataLogDir目录 [root@zookeeper conf]# mkdir -p /apps/servers/data/d_2 [root@zookeeper conf]# mkdir -p /apps/servers/logs/logs_2 #指定192.168.3.12的id [root@zookeeper conf]# echo "2">/apps/servers/data/d_2/myid
192.168.3.13 中
#创建dataDir和dataLogDir目录 [root@zookeeper conf]# mkdir -p /apps/servers/data/d_3 [root@zookeeper conf]# mkdir -p /apps/servers/logs/logs_3 #指定192.168.3.13的id [root@zookeeper conf]# echo "3">/apps/servers/data/d_3/myid
4. 启动集群
检查并关闭防火墙
#查看防火墙的状态 firewall-cmd --state #开启防火墙 systemctl start firewalld.service #关闭防火墙 systemctl stop firewalld.service
进入bin目录,依次启动zookeeper
sh zkServer.sh start
测试连接是否成功
sh zkCli.sh -server 192.168.3.10:2181,192.168.3.12:2181,192.168.3.13:2181 2018-11-15 13:33:16,523 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT 2018-11-15 13:33:16,525 [myid:] - INFO [main:Environment@100] - Client environment:host.name=zookeeper 2018-11-15 13:33:16,525 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_181 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/usr/local/jdk1.8.0_181/jre 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/root/zookeeper-3.4.9/bin/../build/classes:/root/zookeeper-3.4.9/bin/../build/lib/*.jar:/root/zookeeper-3.4.9/bin/../lib/slf4j-log4j12-1.6.1.jar:/root/zookeeper-3.4.9/bin/../lib/slf4j-api-1.6.1.jar:/root/zookeeper-3.4.9/bin/../lib/netty-3.10.5.Final.jar:/root/zookeeper-3.4.9/bin/../lib/log4j-1.2.16.jar:/root/zookeeper-3.4.9/bin/../lib/jline-0.9.94.jar:/root/zookeeper-3.4.9/bin/../zookeeper-3.4.9.jar:/root/zookeeper-3.4.9/bin/../src/java/lib/*.jar:/root/zookeeper-3.4.9/bin/../conf:/usr/local/jdk1.8.0_181/lib/ 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA> 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:os.version=3.10.0-862.el7.x86_64 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root 2018-11-15 13:33:16,527 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root 2018-11-15 13:33:16,528 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/root/zookeeper-3.4.9/bin 2018-11-15 13:33:16,529 [myid:] - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=192.168.3.10:2181,192.168.3.12:2181,192.168.3.13:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@67424e82 2018-11-15 13:33:16,556 [myid:] - INFO [main-SendThread(192.168.3.12:2181):ClientCnxn$SendThread@1032] - Opening socket connection to server 192.168.3.12/192.168.3.12:2181. Will not attempt to authenticate using SASL (unknown error) Welcome to ZooKeeper! JLine support is enabled 2018-11-15 13:33:16,625 [myid:] - INFO [main-SendThread(192.168.3.12:2181):ClientCnxn$SendThread@876] - Socket connection established to 192.168.3.12/192.168.3.12:2181, initiating session 2018-11-15 13:33:16,672 [myid:] - INFO [main-SendThread(192.168.3.12:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server 192.168.3.12/192.168.3.12:2181, sessionid = 0x26715da4f250000, negoti 3ff7 ated timeout = 30000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: 192.168.3.10:2181,192.168.3.12:2181,192.168.3.13:2181(CONNECTED) 1] ls / [zookeeper]
相关文章推荐
- 一脸懵逼搭建Zookeeper分布式集群
- zoo 4000 keeper学习笔记(二)Zookeeper伪分布式集群搭建
- hadoop2.74+zookeeper3.4.10+hbase1.2.6完全分布式HA集群搭建
- 搭建3个节点的hadoop集群(完全分布式部署)--3 zookeeper与hbase安装
- ZooKeeper一二事 - 搭建ZooKeeper伪分布式及正式集群 提供集群服务
- 分布式架构中一致性解决方案——Zookeeper集群搭建
- zookeeper伪分布式集群环境搭建
- Hadoop2.7.3+HBase1.2.5+ZooKeeper3.4.6搭建分布式集群环境
- Zookeeper分布式集群搭建
- 伪分布式集群环境hadoop、hbase、zookeeper搭建(全)
- hadoop+hbase+zookeeper 分布式集群搭建 + eclipse远程连接hdfs 完美运行
- Hadoop2.7.3+HBase1.2.5+ZooKeeper3.4.6搭建分布式集群环境
- 分布式集群环境hadoop、hbase、zookeeper搭建(全)
- (伪分布式)zookeeper+solr搭建集群(2)
- HBase 分布式安装搭建/独立Zookeeper集群
- hadoop-2.7.4+hbase-1.3.1+zookeeper-3.4.9搭建分布式集群环境
- zookeeper分布式集群的搭建过程
- zookeeper伪分布式集群搭建
- 分布式架构中一致性解决方案——Zookeeper集群搭建
- 基于zookeeper的分布式集群的搭建