Nginx causing high IO

Hello ladies and gents,

I am using nginx to serve video on our video sharing platform. We are
seeing high IO from nginx which is causing extremely slow responsiveness
from the servers. I have tried changing the number of child nginx
services to four but still the services go into a D state.

Image: http://oi41.tinypic.com/214pq9.jpg
Image: http://oi43.tinypic.com/244slkx.jpg

My servers are running centos 5 32bit.

Here’s how my configs look: worker_processes 4; worker_rlimit_nofile 10240; worker_rlimit_sigpending... - bcc99261

There’s some more to the configs but the rest is related to the script
that we’re running to operate our website. Anyhow, any suggested would
be greatly appreciated as I’m not very familiar with nginx.

Thank you

Which video sharing platform do you have? We are building a massive
network down in miami to serv a few million cable boxes at a time. glad
to help out if i can.
Whats the hardware looking like for the server?

Our Config Pulled from a beta node.

User node24 in Beta Cluster 3

user node24;
worker_processes 54;
pid /var/run/nginx.pid;
error_log /logserver/nginx/cluster/node34/logs/error.log;
events
{

worker_connections 65535;
 multi_accept on;

}

http
{
##
# Changed.
##
sendfile on;
tcp_nopush on;
tcp_nodelay on;
keepalive_timeout 9;
types_hash_max_size 2048;
# server_tokens off;
# server_names_hash_bucket_size 64;
# server_name_in_redirect off;

Posted at Nginx Forum:

DavidJS wrote in post #1041997:

Which video sharing platform do you have? We are building a massive
network down in miami to serv a few million cable boxes at a time. glad
to help out if i can.
Whats the hardware looking like for the server?

Hello David,

The hardware is the following.

E3-1270, 8GB Ram and 2x2TB HDD Raid 0 all over gbit connection.

We are using a custom built perl script for this. It was working nicely
before on our old servers. Any ideas? I don’t see anything obvious in
your configs that could help me. I know your workers are pretty high but
in my case I don’t need that many. This is very frustrating because I’m
seeing poor performance because of this.

Any help would be greatly appreciated :slight_smile:

What disks did you have in old servers? The reason for high io is
usually disks, but I have had it caused by cheap network cards too!

Also what does your perl script do exactly?

Sent from my iPhone

Can you contact me outside the forum?

Posted at Nginx Forum: