Go Efficiency & Benchmarking
12.2024 · Gdańsk, PL
Go Micro-Benchmarking & Efficiency Assessment
Practical guide to reliable microbenchmarks in Go, avoiding noise traps, and analyzing multi-dimensional benchmark results with benchstat.
Bartłomiej (Bartek) Płotka
Senior SWE Tech Lead @ Google
Prometheus Steering Committee & Maintainer | Author of “Efficient Go” book | Co-Founder of CNCF Thanos | Host of “Optimize All The Things” Podcast
O'REILLY®
Efficient Go
With technological advancements, fast markets, and higher complexity of systems, software engineers tend to skip the uncomfortable topic of software efficiency. However, tactical, observability-driven performance optimizations are vital for every product to save money and ensure business success.
Author Bartłomiej Płotka provides the tools and knowledge required to make your systems faster and less resource-hungry. Efficient Go guides you in achieving better day-to-day efficiency using Go.
This book shows you how to:
- Clarify and negotiate efficiency goals
- Optimize efficiency on various levels
- Use common resources like CPU and memory effectively
- Assess efficiency using observability signals like metrics, logging, tracing, and continuous profiling via Prometheus, Jaeger, and Parca
- Apply tools like
go test,pprof,benchstat, andk6to create reliable micro and macro benchmarks - Efficiently use Go features like slices, generics, goroutines, allocation semantics, garbage collection, and more!
“Efficient Go is a marvelous and insightful book that changes your outlook on software efficiency with Go. You learn how to make data-driven assessments while optimizing your code base and identifying optimizable patterns. It simply makes it easy for you and makes you want to care about the efficiency of your code as soon as you type it!”
Bartłomiej Płotka is a principal software engineer with a background in observability and SRE. He’s a CNCF Ambassador, TAG Observability tech lead, and cofounder of the Thanos project. He’s also a core maintainer of other open-source projects written in Go, including Prometheus and bingo.
Prometheus & Remote Write
11.2024 · Salt Lake City, US
Unlocking Cost Savings & New Possibilities: Guide to Prometheus Remote Write 2.0
Deep dive into the Prometheus Remote Write 2.0 protocol specification: string interning, native histograms, metadata, and bandwidth reductions.
Prometheus 3.0
11.2024 · Salt Lake City, US
Celebrating Prometheus 3.0: All You Need To Know!
Overview of major new capabilities in Prometheus 3.0: UTF-8 support, native histograms, Remote Write 2.0, new UI, and OpenTelemetry interoperability.
Prometheus & Cloud Scale
09.2024 · Berlin, DE
Learnings from Running Prometheus on Google Cloud Scale
Production lessons from operating managed Prometheus collection and querying across thousands of GKE clusters at Google Cloud scale.
Go Efficiency & Runtime
08.2024 · London, UK
The Key to Go Efficiency is Just a Few Go Runtime Metrics Away!
How to use Go's runtime/metrics package (GC cycles, heap goal, goroutine scheduling latency, CPU limit) to diagnose production bottlenecks before profiling.
Thanos & Architecture
03.2024 · Paris, FR
ThanosCon24 + 6 Learnings from Building Thanos Project
Key technical and community takeaways from six years of scaling Prometheus metrics globally with Thanos.
CNCF & Open Source
03.2024 · Paris, FR
Observability TAG: A Review and the Rise of Gen-AI Observability
CNCF TAG Observability annual review, emerging telemetry standards, and observability patterns for AI/ML workloads.
Prometheus & Operators
03.2024 · Paris, FR
Prometheus Operators in the Wild & Scaling Metric Collection
Comparing Kubernetes operator patterns for Prometheus and hands-on ContribFest scaling techniques for high-cardinality clusters.
Prometheus & TSDB
09.2023 · Berlin, DE
When My Counter Restarted? Addressing Decade-Old Counter Limitation With Created Timestamp
How Created Timestamps solve missing counter reset detection and rate() accuracy in Prometheus and OpenTelemetry.
Go Efficiency & Benchmarking
09.2023 · London, UK
The Art of Macro Benchmarking using Cloud Native Observability
Using isolated Kubernetes environments (`e2e`), Prometheus metrics, and continuous profiles to validate end-to-end system efficiency.
CNCF & Open Source Leadership
02.2023 · London, UK
Building Sustainable Open Source: 7 Key Lessons After 5 Years of Leading Thanos
Governance, maintainer burnout prevention, mentoring pipelines, and growing a multi-company CNCF Incubating project.
Go Efficiency & Benchmarking
02.2023 · Brussels, BE
Five Steps to Make Your Go Code Faster & More Efficient
The pragmatic TFBO (Test, Fix, Benchmark, Optimize) workflow from the O'Reilly Efficient Go book applied to real Go codebases.
Prometheus & PromQL
11.2022 · Munich, DE
Opening Pandora's Box: Redesigning PromQL for Scalable Computation
Exploring vectorized and distributed execution engines for PromQL to speed up high-cardinality analytical queries.
Thanos & Correlations
04.2022 · Valencia, ES
Story of Correlation: Integrating Thanos Metrics with Observability Signals
Connecting metrics, traces, and profiles via OpenMetrics exemplars across Thanos, Prometheus, Jaeger, and Parca.
Thanos & Cortex
11.2019 · San Diego & Munich
Thanos Deep Dive & Two Households, Both Alike in Dignity: Cortex and Thanos
Architectural trade-offs between object-storage block shipping and remote-write sharding, and how Cortex and Thanos joined forces on shared components.
Thanos & Global Monitoring
02.2019 · Los Angeles & Brussels
Thanos: Transforming Prometheus to a Global Scale in Seven Simple Steps
Live demonstration of evolving standalone Prometheus servers into a globally federated, long-term storage setup with Thanos Sidecar, Store, and Compactor.
12 min read
The (lazy) Git UI You Didn't Know You Need
When my son was born last April, I had ambitious learning plans for the upcoming 5w paternity leave. As you can imagine, with two kids, life quickly verified this …
12 min read
Optimizing in-process gRPC with Go 1.23 Iterators and Coroutines
A few years back I have been exploring solutions for the in-process gRPC pattern in Go, for the Thanos project . Recently, a friend and a Thanos maintainer Filip …
16 min read
Leveraging benchstat Projections in Go Benchmark Analysis!
Go’s built-in micro-benchmarking framework is extremely useful and widely known. Sill, not many developers are aware of the additional, yet essential, benchstat tool …
9 min read
Announcing Our Book with O'Reilly: Efficient Go!
TL;DR: I am super excited to announce an exact topic of our book we write together with O’Reilly publisher. “Efficient Go” will consist of 10 chapters! The book is …
14 min read
ThanosCon Retrospective
Hello back! 👋🏽 Curious how your last weeks looked like, mine were a bit busy: My daughter’s 1st birthday, then she started daycare adaption with the weekly spread …
11 min read
How To Achieve More and Go Through Boring Stuff
Hello Everyone! 👋 Through the recent years in open source and in my role as the Principal Software Engineer at Red Hat, I had the opportunity to do a lot of work …
18 min read
Correlating Signals Efficiently in Modern Observability
NOTE: I wrote this article for the CNCF TAG (previously SIG) Observability Whitepaper about Observability , so you will see some of this write up there. The …
21 min read
How Thanos Would Program in Go
TL;DR: Recently we introduced extended Go Style Guide for the Thanos project , a high scale open-source distributed metric system where, with our large community, we …
14 min read
Automate Your Documentation With mdox!
Writing software documentation is hard. Maintaining it is even more challenging in both closed and open-source worlds. You are probably familiar with the disdain …
27 min read
How to Become an Amazing OSS Project Maintainer, Survive, And Have Fun on The Way!
In this post, I would like to share what, in my honest opinion, a “perfect” maintainer of an open source software should do. Yes, no one ever will be perfect: we all …
10 min read
What to expect when monitoring memory usage for modern Go applications.
EDIT (2020.12.13): From Go 1.16, Go on Linux moves back to using MADV_DONTNEED when releasing memory. However, this blog post still applies in terms of how to …
1 min read
Metric monitoring architecture at Improbable using Thanos
Available on Improbable blog here .
6 min read
Last Day @ Red Hat...
“Something ends,” Geralt said with difficulty. “Something ends, Dandelion .” “Not at all,” the poet shot back seriously. “Something begins.” – Andrzej Sapkowski; …
11 min read
My 'Efficient Go' Book with O'Reilly is Released 🎉
I would never have believed anyone telling me that such a moment would happen in my life. Yet it happened–my book was released this week! 🎉 It is one of the things …
2 min read
My book is about to be published!
After ~1100h of work, my Efficient Go book was sent to production. 😱 Thanks to all who helped me in this journey! With the publish date around November-December …
15 min read
Need to Version Go Tools for Your Project? That's a Bingo!
See bigger version of the above demo as .gif here In this blog post, I would like to introduce bingo , a simple and efficient CLI (Command Line Interface) Tool , I …
10 min read
📈 Becoming Tech Lead for the CNCF SIG Observability!
TL;DR: In March 2020, we established the official CNCF’s Special Interest Group (SIG) for Observability . Last week, the TOC vote for the first Tech Lead for this …
16 min read
Flagarize Your Go Configuration Struct!
TL;DR In my free time I wrote a simple but powerful, open source Go library flagarize to register your flags from Go struct tags! Please try it, share feedback and …
4 min read
Thanos Announces Weekly Mentoring Office Hours
During Summer of 2020, on top of our full-time work, on-call rotations, open source project’s work, preparing conference talks and ☕ we had extra duties: 75% of the …