elk

• key components

  • elastic stack

  • elk process schema

• references

[!NOTE|label:note:]

• * How to set up a secure logging platform with Elastic Stack and Search Guard

• Kubernetes Logging with Filebeat and Elasticsearch Part 1

• Installing Elastic Stack | Setting up the index patterns in Kibana | Filtering out logs | Using the Elasticsearch Curator

• Elasticsearch Sizing and Configuration

key components

• es-data

• es-master

• es-client

• kibana

• logstash

• filebeat

$ kubectl -n logging get deploy,sts
NAME                              DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE
deployment.extensions/es-client   1         1         1            1           2y130d
deployment.extensions/kibana      1         1         1            1           2y130d

NAME                         DESIRED   CURRENT   AGE
statefulset.apps/es-data     1         1         2y131d
statefulset.apps/es-master   2         2         2y132d
statefulset.apps/logstash    1         1         2y130d

elastic stack

elk stack

elk process schema

elk process

references

[!NOTE|label:references:]

• Elastic 技术栈
• Elastic 技术栈之快速入门
• Elastic 技术栈之 Logstash 基础
• Elastic 技术栈之 Kibana
• Elastic 技术栈之 Filebeat
• Elasticsearch的内存调优与解析
• 理解Elasticsearch和面试总结

ELK

• HA Cluster
• Remote Cluster
• Nodes

Shard/Index Routing

• Cluster-level shard allocation filtering
• Index-level shard allocation filtering

Open Distro Open Distro References Open Distro on Kubernetes Open Distro Kibana Multi Tenant

Logstash

• Grok filter pattern tester

Filebeat

• Multiline input pattern tester
• Prebuilt RPI beats
• RPI beats build script
• beats with additional env_file processor

Kubernetes - Helm Charts

• Open Distro
• Logstash
• ELK