Files
inspurericzhang 3af2caebb8 [Trivial Fix] Replace Chinese punctuation with English punctuation 
Curly quotes(Chinese punctuation) usually input from Chinese input method.
When read from english context, it makes some confusion.
Change-Id: I1b34eef0913dc0cda1c58d27e8f53ffdcfc3aa22
2018年09月28日 09:41:38 +08:00
..

install Elk stack with topbeat to gather metrics

tags

openstack, ansible

About this repository

This set of playbooks will deploy elk cluster (Elasticsearch, Logstash, Kibana) with topbeat to gather metrics from hosts metrics to the ELK cluster.

Process

Clone the elk-osa repo

 cd /opt
 git clone https://github.com/openstack/openstack-ansible-ops

Copy the env.d file into place

 cd openstack-ansible-ops
 cp env.d/elk.yml /etc/openstack_deploy/env.d/

Copy the conf.d file into place

 cp conf.d/elk.yml /etc/openstack_deploy/conf.d/

In elk.yml, list your logging hosts under elastic-logstash_hosts to create the elasticsearch cluster in multiple containers and one logging host under kibana_hosts to create the kibana container

 vi /etc/openstack_deploy/conf.d/elk.yml

Create the containers

 cd /opt/openstack-ansible-playbooks
 openstack-ansible lxc-containers-create.yml -e 'container_group=elastic-logstash:kibana'

install master/data elasticsearch nodes on the elastic-logstash containers

 cd /opt/openstack-ansible-ops
 openstack-ansible installElastic.yml -e elk_hosts=elastic-logstash -e node_master=true -e node_data=true

Install an Elasticsearch client on the kibana container to serve as a loadbalancer for the Kibana backend server

 openstack-ansible installElastic.yml -e elk_hosts=kibana -e node_master=false -e node_data=false

Install Logstash on all the elastic containers

 openstack-ansible installLogstash.yml

InstallKibana on the kibana container

 openstack-ansible installKibana.yml

(Optional) Reverse proxy kibana container to your loadbalancer host

 openstack-ansible reverseProxyKibana.yml

load topbeat indices into elastic-search and kibana

 openstack-ansible loadKibana.yml

install Topbeat everywhere to start shipping metrics to our logstash instances

 openstack-ansible installTopbeat.yml --forks 100