Source: thenewstack.io
Sailing Faster with Istio, Part 2Category: github
While our intrepid team tackled the problem of scaling for high-throughput workloads by adding sidecar proxies, we encountered a bottleneck not entirely unlike what the Ever Given experienced not long ago in the Suez Canal.
During this scaling experiment, queries per second (QPS) remained stubbornly low in spite of adding sidecar proxies, an unacceptable result).
At this point, trying this out seemed worthwhile, so we looked at how to enable this in Istio. Note that as part of this PR, the per-worker thread metrics were added, which was useful in diagnosing this problem).
To turn the “exact balance” feature on, we created an EnvoyFilter resource like this: With this configuration applied and with bated breath, we ran the experiment again and looked at the per-worker thread metrics.
During this scaling experiment, queries per second (QPS) remained stubbornly low in spite of adding sidecar proxies, an unacceptable result).
At this point, trying this out seemed worthwhile, so we looked at how to enable this in Istio. Note that as part of this PR, the per-worker thread metrics were added, which was useful in diagnosing this problem).
To turn the “exact balance” feature on, we created an EnvoyFilter resource like this: With this configuration applied and with bated breath, we ran the experiment again and looked at the per-worker thread metrics.
Related Articles
Community Partners
DevOps Careers