docker-compose跨机器部署kafka集群(包含zookeeper集群搭建) 第一版本
2019-06-26 18:37
2436 查看
- 需要的镜像:
zookeeper:3.5.5
wurstmeister/kafka:2.12-2.2.1
kafkamanager/kafka-manager:1.3.3.23 - ip规划:
zookeeper集群:
10.100.46.3
10.100.46.5
10.100.46.6
kafka集群:
10.100.46.7
10.100.46.9
kafka manager :
10.100.46.7 - docker-compose文件:
zookeeper集群:
10.100.46.3:version: '2' services: zookeeper-3: image: zookeeper container_name: zookeeper-3 restart: always network_mode: "host" ports: - 2181:2181 - 2888:2888 - 3888:3888 volumes: - "/data/zookeeper/data:/data" - "/data/zookeeper/datalog:/datalog" - "/data/zookeeper/log:/log" environment: ZOO_MY_ID: 3 ZOO_SERVERS: server.3=10.100.46.3:2888:3888;2181 server.5=10.100.46.5:2888:3888;2181 server.6=10.100.46.6:2888:3888;2181
10.100.46.5version: '2' services: zookeeper-5: image: zookeeper container_name: zookeeper-5 restart: always network_mode: "host" ports: - 2181:2181 - 2888:2888 - 3888:3888 volumes: - "/data/zookeeper/data:/data" - "/data/zookeeper/datalog:/datalog" - "/data/zookeeper/log:/log" environment: ZOO_MY_ID: 5 ZOO_SERVERS: server.3=10.100.46.3:2888:3888;2181 server.5=10.100.46.5:2888:3888;2181 server.6=10.100.46.6:2888:3888;2181
10.100.46.6version: '2' services: zookeeper-6: image: zookeeper container_name: zookeeper-6 restart: always network_mode: "host" ports: - 2181:2181 - 2888:2888 - 3888:3888 volumes: - "/data/zookeeper/data:/data" - "/data/zookeeper/datalog:/datalog" - "/data/zookeeper/log: 3ff7 /log" environment: ZOO_MY_ID: 6 ZOO_SERVERS: server.3=10.100.46.3:2888:3888;2181 server.5=10.100.46.5:2888:3888;2181 server.6=10.100.46.6:2888:3888;2181
kafka集群:
10.100.46.7version: '2' services: kafka: image: wurstmeister/kafka container_name: kafka-7 network_mode: "host" ports: - "9092:9092" environment: KAFKA_BROKER_ID: 7 KAFKA_ADVERTISED_HOST_NAME: 10.100.46.7 KAFKA_ZOOKEEPER_CONNECT: 10.100.46.5:2181,10.100.46.6:2181,10.100.46.3:2181
10.100.46.9version: '2' services: kafka: image: wurstmeister/kafka container_name: kafka-9 network_mode: "host" ports: - "9092:9092" environment: KAFKA_BROKER_ID: 9 KAFKA_ADVERTISED_HOST_NAME: 10.100.46.9 KAFKA_ZOOKEEPER_CONNECT: 10.100.46.5:2181,10.100.46.6:2181,10.100.46.3:2181
kafka manager :docker run -d -p 9000:9000 --name kafka_manager -eZK_HOSTS=10.100.46.3 kafkamanager/kafka-manager
相关文章推荐
- 使用 k8s/docker-compose 部署 zookeeper集群
- 使用Docker Compose部署单机TiDB集群时指定版本的一个方法
- 【拆分版】Docker-compose构建Zookeeper集群管理Kafka集群
- Kafka集群搭建01-Zookeeper 集群部署
- 使用docker容器创建Kafka集群管理、状态保存是通过zookeeper实现,所以先要搭建zookeeper集群
- 使用Docker快速搭建Zookeeper和kafka集群
- 使用Docker快速搭建Zookeeper和kafka集群
- docker-compose搭建zookeeper集群
- Zookeeper 最新版本集群搭建部署
- Spark集群基于Zookeeper的HA搭建部署笔记
- 搭建3个节点的hadoop集群(完全分布式部署)--3 zookeeper与hbase安装
- Spark集群基于Zookeeper的HA搭建部署笔记(转)
- Zookeeper的安装部署 zookeeper参数配置说明 集群搭建,查看集群状态
- Docker下的Kafka学习之二:搭建集群环境
- zookeeper+kafka集群搭建
- 学习使用Docker、Docker-Compose和Rancher搭建部署Pipeline(一)
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十五)Structured Streaming:同一个topic中包含一组数据的多个部分,按照key它们拼接为一条记录(以及遇到的问题)。
- Redis——使用docker-compose.yml部署哨兵集群
- mesos+marathon+zookeeper的docker管理集群亲手搭建实例(详细)
- centos7.6下kafka_2.12-2.1.1+zookeeper-3.4.13集群部署