利用docker-compose和docker-swarm搭建ELK环境

步骤一 搭建swarm集群环境

1、创建keystore宿主机，创建命令如下：

eval "$(docker-machine env elk-keystore)"

2、在elk-keystore宿主机上创建consul容器，创建命令如下：

1）eval "$(docker-machine env elk-keystore)"

2）docker run -d \
-p "8500:8500" \
-h "consul" \
progrium/consul -server -bootstrap

3）创建elasticsearch宿主机（同时作为swarm集群的master节点），创建命令如下：

docker-machine create \
-d virtualbox \
--swarm --swarm-master \
--swarm-discovery="consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-store=consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-advertise=eth1:2376" \
mh-elasticsearch

4）创建logstash宿主机，创建命令如下：

docker-machine create -d virtualbox \
--swarm \
--swarm-discovery="consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-store=consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-advertise=eth1:2376" \
mh-logstash

5）创建kibana宿主机，创建命令如下：

docker-machine create -d virtualbox \
--swarm \
--swarm-discovery="consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-store=consul://$(docker-machine ip mh-keystore):8500" \
--engine-opt="cluster-advertise=eth1:2376" \
mh-kibana

步骤二 检验集群环境是否搭建成功，利用命令docker info监测



步骤三 利用docker-compose搭建创建ELK容器，yml文件如下所示：

version: '2'
services:
elasticsearch:
image: elasticsearch:latest
volumes:
- /c/Users/xu/Desktop/elkcompose/elasticsearch/data/:/usr/share/elasticsearch/data
environment:
- "constraint:node==mh-elasticsearch"
#- ES_CLUSTERNAME=elasticsearch
command: elasticsearch -Des.config=/usr/share/elasticsearch/config/elasticsearch.yml
ports:
- "9200:9200"
- "9300:9300"
networks:
- mynet
kibana:
image: kibana:latest
ports:
- "5601:5601"
depends_on:
- elasticsearch
networks:
- mynet
links:
- elasticsearch:elasticsearch
environment:
- "constraint:node==mh-kibana"
logstash:
image: logstash:latest
ports:
- "25826:25826"
- "25826:25826/udp"
networks:
- mynet
links:
- elasticsearch:elasticsearch
depends_on:
- elasticsearch
volumes:
- /c/Users/xu/Desktop/elkcompose/logstash/conf/:/conf
- /c/Users/xu/Desktop/elkcompose/logstash/testdata/:/testdata
command: logstash agent -f /conf/logstash.conf
environment:
- "constraint:node==mh-logstash"
networks:
mynet:

启动docker-compose，命令如下：

1）eval $(docker-machine env --swarm mh-elasticsearch)

2) docker-compose up