Does Nginx have separate queuing mechanism for requests?

Server NGINX
1

Hello.

Consider the following situation: you are deploying application that can
serve 1 req./sec. What would happen if I send 10 request in 1 second? I
wrote simple app to test that:
GitHub - amezhenin/nginx_slow_upstream: This is small test for Nginx upstream mechanism. .
This test shows that your requests will be served in_exact_same_order
they were sent.

For now, this looks like Nginx have some kind of queue for requests, but
my
colleague(administrator) sayd that there is no any queues in Nginx. So I
wrote another question about epoll here:

. From that discussion I figured that epoll does preserves the order of
requests.

I have two questions:

  1. Is there any mistakes in reasoning/code above?
  2. Does Nginx have some sort of queue for requests on top of epoll? Or
    Nginx
    uses pure epoll functionality?

Thank you, and sorry for my English :slight_smile:

Posted at Nginx Forum:

2

Hello!

On Wed, Oct 02, 2013 at 10:04:23AM -0400, amehzenin wrote:

colleague(administrator) sayd that there is no any queues in Nginx. So I
wrote another question about epoll here:

. From that discussion I figured that epoll does preserves the order of
requests.

I have two questions:

  1. Is there any mistakes in reasoning/code above?
  2. Does Nginx have some sort of queue for requests on top of epoll? Or Nginx
    uses pure epoll functionality?

There is no queue in nginx, but there is queue in a listen socket
of your backend app. It’s called “listen queue” or “backlog” and
likely it’s what preserves a request order for you.

–
Maxim D.
http://nginx.org/en/donation.html

3

Maxim D. Wrote:

nginx mailing list
[email protected]
nginx Info Page

You meen application server has listen socket:

#include <sys/types.h>
#include <sys/socket.h>

int listen(int sockfd, int backlog);

(listen(2): listen for connections on socket - Linux man page)

And backlog defines the length of this queue. Nginx pushes requests to
app-server as they come and app-server take this requests from his own
queue
when he is ready to serve next request. Am I right?

Posted at Nginx Forum:

4

Hello!

On Thu, Oct 03, 2013 at 10:26:33AM -0400, amehzenin wrote:

Maxim D. Wrote:

There is no queue in nginx, but there is queue in a listen socket
of your backend app. It’s called “listen queue” or “backlog” and
likely it’s what preserves a request order for you.

[…]

app-server as they come and app-server take this requests from his own queue
when he is ready to serve next request. Am I right?

Yes.

–
Maxim D.
http://nginx.org/en/donation.html