Customizing Istio's trace sampling rate per-pod
We're using Istio across an increasing range of services, and occasionally we need to "dial up" the default sampling rate from 1% to 100% for debug / analysis reasons (we send our traces to Jaeger).
I wanted to know whether it's possible to change sampling rate for some pods/namespaces, without changing the sampling rate globally (we'd receive far too many traces in this case!)
There's a thread over at https://github.com/istio/istio/issues/12818 which touches on this requirement, but as of Aug 2021, it hasn't come to an easy conclusion.
However, I found an elegant-but-slightly-convoluted method to achieve the custom sampling rate, using pod annotations...
This post is for paying subscribers only
Sign up now and upgrade your account to read the post and get access to the full library of posts for paying subscribers only.
Sign up now
Already have an account? Sign in
You’ve successfully subscribed to 👨💻 Funky Penguin
Welcome back! You’ve successfully signed in.
Great! You’ve successfully signed up.
Your link has expired
Success! Check your email for magic link to sign-in.