How does aL4 orL7 load balancer knows how to route traffic during deployments.Say, InCanary deployment strategy, how does LB route only 10% traffic to a certain server or in case ofBlue-Green deployment strategy, how does LB knows that the updated application is available on another set of servers and I should be routing the traffic to them.
Where should we make those configuration ideally ?
1 Answer1
Your load balancer usually offers this as configuration. Using HAProxy as an example (this is similar for most load balancers) you can change:
- Whether a server is in balance or not
- What proportion of traffic it should receive
- What strategy to use to divide traffic between servers
Common use cases for this would be:
- Taking a server out of balance (and allowing existing connections to drain) before running a deployment, then warming it back up with a slower rate of traffic.
- Splitting a small proportion of traffic for a canary release, which you might also use "session pinning" for, to make sure a canary userstays on the canary server, rather than flip-flopping between the old and new version
With HAProxy, you can perform some operations via the command line to take servers in and out of balance. For the load balancing strategy, you'd normally change the config and reload it (which, again, you could automate via the command line).
It's not uncommon for people to set up HAProxy with "redispatch" configured. They can then surprise it by deploying to a server without telling it. HAProxy will receive the failure and re-send the request to a different server. The user has no idea there was any issue. You need to make sure this doesn't cause a domino effect in your scenario.
Nginx is pretty similar. Other load balancers offer things like REST APIs for these operations.
- 1Appreciate the clarification !!Chel MS– Chel MS2023-03-24 09:59:53 +00:00CommentedMar 24, 2023 at 9:59
Explore related questions
See similar questions with these tags.