Nginx + haproxy + mongrel - issue persists

Server NGINX
1

We have configured nginx + haproxy + mongrels [ more than 150
instances].
While it works perfectly fine for small configuration, a larger set of
mongrels - fail completely.

I have attached the configuration file for your reference. Apologies for
the
inconvenience if this is coming into the wrong list.

Each of those servers are 16G RAM, Quad Core, Dual Processor Machines by
Dell. So - the memory shouldn’t really be a problem.

Although someone did mention that ip_conntrack module might be a
problem.

I am not sure what the issue is and not able to understand - why
haproxy is
unable to route requests.

Can you please tell me if there could be some other issue? All the
servers
are marked DOWN even through they’re up

Nov 21 14:08:46 mw-server9 haproxy[323]: Server rails_proxy/mon170 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:46 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:08:49 mw-server9 haproxy[323]: Server rails_proxy/mon078 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:49 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:08:54 mw-server9 haproxy[323]: Server rails_proxy/mon166 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:54 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:08:54 mw-server9 haproxy[323]: Server rails_proxy/mon167 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:54 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:08:56 mw-server9 haproxy[323]: Server rails_proxy/mon081 is
DOWN.
1 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:56 mw-server9 haproxy[323]: Server rails_proxy/mon089 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:08:56 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:09:01 mw-server9 haproxy[323]: Server rails_proxy/mon155 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:09:01 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:09:01 mw-server9 haproxy[323]: Server rails_proxy/mon074 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:09:01 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon124 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:09:04 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon162 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:09:04 mw-server9 haproxy[323]: Proxy rails_proxy has no server
available !
Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon142 is
DOWN.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon090 is
DOWN.
74 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon095 is
DOWN.
73 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon118 is
DOWN.
72 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon079 is
DOWN.
71 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon096 is
DOWN.
70 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon162 is
DOWN.
69 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon125 is
DOWN.
68 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue

2

On Thu, Dec 04, 2008 at 10:59:19AM +0530, Asif A. wrote:

Although someone did mention that ip_conntrack module might be a problem.
0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0
remaining in queue.
[ … ]

These are all haproxy error messages, probably best to send this to the
haproxy list.

enjoy,

-jeremy

3

Asif-

We are working on a new nginx balancer module that emulates haproxy’s
maxconns setting. So far it is testing out very well. Please give it a
try and see if it might be the right solution for you:

Cheers-
-Ezra

On Dec 3, 2008, at 9:29 PM, Asif A. wrote:

Although someone did mention that ip_conntrack module might be a
Nov 21 14:08:46 mw-server9 haproxy[323]: Server rails_proxy/mon170
is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0
requeued, 0 remaining in queue.
Nov 21 14:09:01 mw-server9 haproxy[323]: Server rails_proxy/mon074
is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0
is DOWN. 73 active and 0 backup servers left. 0 sessions active, 0
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon162
is DOWN. 69 active and 0 backup servers left. 0 sessions active, 0
requeued, 0 remaining in queue.
Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon125
is DOWN. 68 active and 0 backup servers left. 0 sessions active, 0
requeued, 0 remaining in queue

Ezra Z.
[email protected]