3 years ago

Category: Kubernetes

It is inevitable that something will fail in a distributed system, and we should plan as if it is a normal occurrence. Redundancy has a cost to it, and we should consider this when deciding how much resiliency we need.

By scaling at 75% of the capacity of the service, we can lose 25% of the pods and only be at capacity.

If we have 20 pods and one fails, the remaining pods would only have to deal with 95rps.

I hope you have a better understanding of the options available to you and you can use this to reduce the costs of your cloud bill whilst maintaining service uptime.