I wrote a module for nginx 4 years ago which limited the number of
connections to upstream in order that the upstream servers would not be
busy to work efficiently. Now I think this module is stable, and expect
to be merged into nginx official if possible.