In-person + Virtual
16 -20 May
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2022 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central European Summer Time (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.
Back To Schedule
Thursday, May 19 • 11:00 - 11:35
Autoscaling Elasticsearch for Logs on Kubernetes - Radu Gheorghe, Sematext Group & Ciprian Hacman, polypoly

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.

Elasticsearch (and its fork, OpenSearch) is the go-to storage for logs. As with any storage, the cluster likely needs to scale to keep up with the change of load. But autoscaling Elasticsearch isn't trivial: indices and shards need to be well sized and well balanced across nodes. Otherwise the cluster will have hotspots and scaling it further will be less and less efficient. This talk focuses on two aspects: - best practices around scaling Elasticsearch for logs and other time-series data - how to apply them when deploying Elasticsearch on Kubernetes. In the process, a new (open-source) operator will be introduced (yes, there will be a demo!). This operator will autoscale Elasticsearch while keeping a good balance of load. It does so by changing the number of shards in the index template and rotating indices when the number of nodes changes.

Click here to view captioning/translation in the MeetingPlay platform!

avatar for Ciprian Hacman

Ciprian Hacman

Site Reliability Engineer, Microsoft
Ciprian Hacman is a DevOps/Software Engineer, helping companies modernize their infrastructure and migrate to Kubernetes. He is also an open source project maintainer for kOps (Kubernetes Operations), etcd-manager, cloud-provider-aws and frequent contributor to other projects in the... Read More →
avatar for Radu Gheorghe

Radu Gheorghe

Search Consultant, Sematext Group
Radu Gheorghe works mainly as a search consultant at Sematext, working with clients of all sizes on their Elasticsearch and Solr projects. He is also a trainer and does production support for both these search engines. Sometimes he helps out with the development of Sematext Cloud... Read More →

Thursday May 19, 2022 11:00 - 11:35 CEST
Pavilion 4, Room B | Level 2 | Central Forum