kafka深度研究之路(3)-kafka 与zk 集群启停脚本
2019-09-11 21:24
686 查看
编写 kafka集群 启动 和 停止脚本
[hadoop@kafka01-55-11 scripts]$ cat kafka_cluster_stop.sh #!/bin/bash -x #date 20190801 #autnor majihui clush -g all "source /etc/profile ;jps|grep Kafka|awk '{print $1}' | xargs kill -9 " [hadoop@kafka01-55-11 scripts]$ cat kafka_cluster_start.sh #!/bin/bash -x #author majihui #date 20190801 clush -g all "source /etc/profile ;jps|grep Kafka|awk '{print $1}' | xargs kill -9 " sleep 3 clush -g all "source /etc/profile;/home/hadoop/kafka/bin/kafka-server-start.sh -daemon /home/hadoop/kafka/config/server.properties"
他的输出日志 在
[hadoop@kafka01-55-11 scripts]$ ls -l ~/kafka/logs/ total 164 -rw-rw-r-- 1 hadoop hadoop 316 Aug 2 17:25 controller.log -rw-rw-r-- 1 hadoop hadoop 0 Aug 2 17:25 kafka-authorizer.log -rw-rw-r-- 1 hadoop hadoop 0 Aug 2 17:25 kafka-request.log -rw-rw-r-- 1 hadoop hadoop 6123 Aug 2 17:25 kafkaServer-gc.log.0.current -rw-rw-r-- 1 hadoop hadoop 54058 Aug 2 17:25 kafkaServer.out -rw-rw-r-- 1 hadoop hadoop 172 Aug 2 17:25 log-cleaner.log -rw-rw-r-- 1 hadoop hadoop 54058 Aug 2 17:25 server.log -rw-rw-r-- 1 hadoop hadoop 33737 Aug 2 17:25 state-change.log [hadoop@kafka01-55-11 scripts]$ cat /etc/clustershell/groups all: kafka01-55-11 kafka02-55-12 kafka03-55-13 kafka_slave: kafka02-55-12 kafka03-55-13
zookeeper 启动和停止脚本
[hadoop@kafka01-55-11 scripts]$ cat zookeeper_cluster_stop.sh #!/bin/bash -x #author:majihui #date:20190801 clush -g all "source /etc/profile; zkServer.sh stop"
[hadoop@kafka01-55-11 scripts]$ cat zookeeper_cluster_start.sh // 这里面指定了zookeeper.out 输出到 /data/zookeeper/data/zookeeper.out #!/bin/bash -x #author:majihui #date:20190801 clush -g all "source /etc/profile; cd /data/zookeeper/data && zkServer.sh start|sort" sleep 3 clush -g all "source /etc/profile; zkServer.sh status|sort"
[hadoop@kafka03-55-13 ] pwd /data/zookeeper/data [hadoop@kafka03-55-13 data]$ ll total 20 -rw-rw-r-- 1 hadoop hadoop 2 Aug 1 01:04 myid drwxrwxr-x 2 hadoop hadoop 45 Aug 1 01:33 version-2 -rw-rw-r-- 1 hadoop hadoop 11623 Aug 1 01:33 zookeeper.out -rw-rw-r-- 1 hadoop hadoop 5 Aug 1 01:33 zookeeper_server.pid [hadoop@kafka01-55-11 scripts]$ cat jps_cluster_check.sh #!/bin/bash clush -g all "source /etc/profile;jps|sort"
以上启动脚本 编写完成
需要结合与clush
[hadoop@kafka01-55-11 scripts]$ cat /etc/clustershell/groups all: kafka01-55-11 kafka02-55-12 kafka03-55-13 kafka_slave: kafka02-55-12 kafka03-55-13 [hadoop@kafka01-55-11 scripts]$ ll total 28 -rw-rw-r-- 1 hadoop hadoop 57 Aug 1 15:01 jps_cluster_check.sh -rw-rw-r-- 1 hadoop hadoop 312 Aug 1 14:51 kafka_cluster_start.sh -rw-rw-r-- 1 hadoop hadoop 132 Aug 1 14:43 kafka_cluster_stop.sh -rw-rw-r-- 1 hadoop hadoop 291 Aug 1 14:23 start_kafka_manager.sh -rw-rw-r-- 1 hadoop hadoop 286 Aug 1 14:28 stop_kafka_manager.sh -rw-rw-r-- 1 hadoop hadoop 176 Aug 1 14:57 zookeeper_cluster_start.sh -rw-rw-r-- 1 hadoop hadoop 101 Aug 1 14:56 zookeeper_cluster_stop.sh [hadoop@kafka01-55-11 scripts]$ chmod +x *sh [hadoop@kafka01-55-11 scripts]$ ll total 28 -rwxrwxr-x 1 hadoop hadoop 57 Aug 1 15:01 jps_cluster_check.sh -rwxrwxr-x 1 hadoop hadoop 312 Aug 1 14:51 kafka_cluster_start.sh -rwxrwxr-x 1 hadoop hadoop 132 Aug 1 14:43 kafka_cluster_stop.sh -rwxrwxr-x 1 hadoop hadoop 291 Aug 1 14:23 start_kafka_manager.sh -rwxrwxr-x 1 hadoop hadoop 286 Aug 1 14:28 stop_kafka_manager.sh -rwxrwxr-x 1 hadoop hadoop 176 Aug 1 14:57 zookeeper_cluster_start.sh -rwxrwxr-x 1 hadoop hadoop 101 Aug 1 14:56 zookeeper_cluster_stop.sh
相关文章推荐
- kafka深度研究之路(4)-kafka和zookeeper 配置文件详细说明(来龙去脉)之zk配置
- shell脚本一键安装kafka集群
- zookeeper+kafka集群一键安装脚本
- kafka集群启停脚本
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十四)Structured Streaming:Encoder
- kafka、zk集群一
- 【Kafka】集群群起、停止脚本
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十二)Spark Streaming接收流数据及使用窗口函数
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十五)Structured Streaming:同一个topic中包含一组数据的多个部分,按照key它们拼接为一条记录(以及遇到的问题)。
- kafka、zk集群二
- 多个Kafka集群能用同一个zk集群吗?
- flink集群一键安装脚本 -- kafka消息中间件依赖zookeeper集群安装脚本
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十一)NIFI1.7.1安装
- kafka+zk 集群--3个broker 3个zookeeper
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十七):kafka manager安装
- flink集群一键安装脚本 -- 消息中间件kafka集群安装
- kafka集群设置shell脚本一键启动和关闭
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十六)Structured Streaming:WARN clients.NetworkClient: Error while fetching metadata with correlation id 1 : {my-topic=LEADER_NOT_AVAILABLE}
- Hadoop学习之路(一):Hadoop完全分布式搭建(附带实用集群管理脚本)
- kafka集群一键安装、启动、停止脚本