Load Balancer Server using NGINX

Load balancing across multiple application instances is a commonly used technique for optimizing resource utilization, maximizing throughput, reducing latency, scalability and ensuring fault-tolerant configurations.

Load Balancer Methods:

Round-robin: Requests to the application servers are distributed in a round-robin fashion.

Least-connected: Next request is assigned to the server with the least number of active connections.

IP-hash: A hash-function is used to determine what server should be selected for the next request based on the clients IP address.

Session persistence: With ip-hash, the clients IP address is used as a hashing key to determine what server in a server group should be selected for the clients requests. This method ensures that the requests from the same client will always be directed to the same server.

Weighted load balancing: It is also possible to influence Nginx load balancing algorithms even further by using server weights

Reverse proxy implementation in Nginx includes load balancing for HTTP, HTTPS, FastCGI, uwsgi, SCGI, memcached, and gRPC

Load balancing health checks:

NGINX can continually test your HTTP upstream servers, avoid the servers that have failed, and gracefully add the recovered servers into the load balanced group.

Passive Health Checks
Health check a URI
Define Custom Conditions
Test your TCP upstream servers
UDP Health Checks