Forum: NGINX nginix not servic static content as part of page

I have a Mongrel cluster behind nginx and am trying to get nginx to 
serve up the static contents of my site with the following rule (RESTful 
URLs):

    location / {
        if (-f $request_filename) {
            break;
        }

        if (!-f $request_filename) {
            proxy_pass http://mycluster$request_uri;
            break;
        }
    }

When I load up a page which has images in it (referenced from 
/public/images) the requests for the images seem to hang forever (same 
goes for JS, CSS, etc). However, if I go straight to an image URL (right 
click, "view image") all the files are served as expected - and they 
continue to be served if i turn the Mongrel cluster off. So nginx can 
clearly see and access all the static files. Also, when looking in 
firebug while loading a page I can see that double requests are being 
made for some of the files (not always the same ones!) and that 
sometimes one of them is served correctly while the other request will 
hang indefinitely. Latency for content that does get served is also much 
worse than when pointing straight to a Mongrel instance.

If I change the rule to redirect everything to my cluster the statics 
are all served fine - exactly the same result as if I go to one of the 
Mongrels directly - and performce improves massively:

    location / {
        proxy_pass http://mycluster$request_uri;
    }

That's of course not an option as I very much want nginix to serve this 
content instead. Another strange thing is it seems the files do actually 
get sent; for example I can see the images in firebug when hovering over 
the never completing requests. I'm fairly new to nginix so it's likely 
I've missed something obvious - I've tried my best to find the answer on 
my own but I really could do with some help!

Many thanks,

JS

P.S. Could it be that nginx and Mongrel are conflicting over who should 
serve the file?

Posted at Nginx Forum: 
http://forum.nginx.org/read.php?2,50870,50870#msg-50870

As people have pointed out if() is bad choice:

Try this instead:


   location / {
        try_files $uri @fallback;
    }

    location @fallback {
        proxy_pass  http://mycluster$request_uri;
    }



----- Original Message -----
From: "JohnSchulze" <nginx-forum@nginx.us>
To: <nginx@nginx.org>
Sent: Friday, February 05, 2010 1:08 PM
Subject: nginix not servic static content as part of page

Hello!

On Fri, Feb 05, 2010 at 06:08:20AM -0500, JohnSchulze wrote:

>         }
> files (not always the same ones!) and that sometimes one of them 
> is served correctly while the other request will hang 
> indefinitely. Latency for content that does get served is also 
> much worse than when pointing straight to a Mongrel instance. 

Could you please provide nginx -V output, full config and debug
log for faulty request(s)?  See here for instructions how to
obtain debug log:

http://nginx.org/en/docs/debugging_log.html

Note well: using try_files and not using dynamic hostname
resolution as suggested in previous reply is anyway preffered.
But config as shown in your post should work without problems, and
it would be good to investigate problem roots.

Maxim Dounin

Maxim Dounin Wrote:
-------------------------------------------------------
> resolution as suggested in previous reply is
> anyway preffered.  
> But config as shown in your post should work
> without problems, and 
> it would be good to investigate problem roots.
> 
> Maxim Dounin

Many thanks for your suggestions, I have changed to use the try_files 
method instead (is this a new directive?). Unfortunately the behaviour 
is exactly the same. I've run off a debug log for a page request but 
it's 99kb(!) so I can't really post it all here. In it I can see there 
are double requests for some files and for some of these I can't see the 
200. Here is a part of the debug log where you can see two requests for 
"main.css" (there should only be one request) and it looks to me as if 
only one of them is finished with proper response headers:

2010/02/05 19:42:53  38652#171748: *4 http process request line
2010/02/05 19:42:53  38652#171748: *4 http request line: "GET /main.css 
HTTP/1.1"
2010/02/05 19:42:53  38652#171748: *4 http uri: "/main.css"
2010/02/05 19:42:53  38652#171748: *4 http args: ""
2010/02/05 19:42:53  38652#171748: *4 http exten: "css"
2010/02/05 19:42:53  38652#171748: *4 http process request header line
2010/02/05 19:42:53  38652#171748: *4 http header: "Host: 
new.mysite.co.uk"
2010/02/05 19:42:53  38652#171748: *4 http header: "User-Agent: 
Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB; rv:1.9.1.7) 
Gecko/20091221 Firefox/3.5.7"
2010/02/05 19:42:53  38652#171748: *4 http header: "Accept: 
text/css,*/*;q=0.1"
2010/02/05 19:42:53  38652#171748: *4 http header: "Accept-Language: 
en-gb,en;q=0.5"
2010/02/05 19:42:53  38652#171748: *4 http header: "Accept-Encoding: 
gzip,deflate"
2010/02/05 19:42:53  38652#171748: *4 http header: "Accept-Charset: 
ISO-8859-1,utf-8;q=0.7,*;q=0.7"
2010/02/05 19:42:53  38652#171748: *4 http header: "Keep-Alive: 300"
2010/02/05 19:42:53  38652#171748: *4 http header: "Connection: 
keep-alive"
2010/02/05 19:42:53  38652#171748: *4 http header: "Referer: 
http://new.mysite.co.uk/"
2010/02/05 19:42:53  38652#171748: *4 http alloc large header buffer
2010/02/05 19:42:53  38652#171748: *4 malloc: 007C2900:8192
2010/02/05 19:42:53  38652#171748: *4 http large header alloc: 007C2900 
8192
2010/02/05 19:42:53  38652#171748: *4 http large header copy: 646
2010/02/05 19:42:53  38652#171748: *4 WSARecv: fd:300 rc:0 43 of 7546
2010/02/05 19:42:53  38652#171748: *4 http header: "Cookie: 
__utma=199252669.1348250431.1258842534.1265312340.1265330842.32; 
__utmz=199252669.1265242890.29.5.utmcsr=localhost:3002|utmccn=(referral)|utmcmd=referral|utmcct=/; 
__utma=254979479.1627312296.1265337519.1265366781.1265398672.6; 
__utmz=254979479.1265337519.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); 
__utmc=254979479; 
_MySite_session=BAh7CToPc2Vzc2lvbl9pZCIlYjhlOTZiZDllZTMxZmRlYzIxYTRjYjE5NDM0YzRlYzk6EF9jc3JmX3Rva2VuIjFXZkFDb0wyVWtMblRxeFZuZTJ1N0NEUk9ULzVxakhoSkhqaE0rR2syUTM0PSIMdXNlcl9pZGkGIgpmbGFzaElDOidBY3Rpb25Db250cm9sbGVyOjpGbGFzaDo6Rmxhc2hIYXNoewAGOgpAdXNlZHsA--f4af4fb56bea7b896f827000b464cb24ea0045d5; 
__utmc=199252669; __utmb=254979479.1.10.1265398672"
2010/02/05 19:42:53  38652#171748: *4 http header done
2010/02/05 19:42:53  38652#171748: *4 event timer del: 300: 2678663774
2010/02/05 19:42:53  38652#171748: *4 generic phase: 0
2010/02/05 19:42:53  38652#171748: *4 generic phase: 1
2010/02/05 19:42:53  38652#171748: *4 test location: "/"
2010/02/05 19:42:53  38652#171748: *4 using configuration "/"
2010/02/05 19:42:53  38652#171748: *4 http cl:-1 max:1048576
2010/02/05 19:42:53  38652#171748: *4 generic phase: 3
2010/02/05 19:42:53  38652#171748: *4 post rewrite phase: 4
2010/02/05 19:42:53  38652#171748: *4 generic phase: 5
2010/02/05 19:42:53  38652#171748: *4 generic phase: 6
2010/02/05 19:42:53  38652#171748: *4 generic phase: 7
2010/02/05 19:42:53  38652#171748: *4 access phase: 8
2010/02/05 19:42:53  38652#171748: *4 access phase: 9
2010/02/05 19:42:53  38652#171748: *4 post access phase: 10
2010/02/05 19:42:53  38652#171748: *4 try files phase: 11
2010/02/05 19:42:53  38652#171748: *4 http script var: "/main.css"
2010/02/05 19:42:53  38652#171748: *4 try to use file: "/main.css" 
"c:\nginx/../rails/MySite/public/main.css"
2010/02/05 19:42:53  38652#171748: *4 try file uri: "/main.css"
2010/02/05 19:42:53  38652#171748: *4 content phase: 12
2010/02/05 19:42:53  38652#171748: *4 content phase: 13
2010/02/05 19:42:53  38652#171748: *4 content phase: 14
2010/02/05 19:42:53  38652#171748: *4 content phase: 15
2010/02/05 19:42:53  38652#171748: *4 content phase: 16
2010/02/05 19:42:53  38652#171748: *4 content phase: 17
2010/02/05 19:42:53  38652#171748: *4 http filename: 
"c:\nginx/../rails/MySite/public/main.css"
2010/02/05 19:42:53  38652#171748: *4 add cleanup: 007C1ECC
2010/02/05 19:42:55  160580#180468: master WaitForMultipleObjects: 4
2010/02/05 19:42:55  160580#180468: reap worker
2010/02/05 19:42:55  160580#180468: worker process 38652 exited with 
code C0000005
2010/02/05 19:42:55  160580#180468: GetModuleFileName: 
"c:\nginx\nginx.exe"
2010/02/05 19:42:55  160580#180468: start worker process 149388
2010/02/05 19:42:55  149388#151852: bind() 77.235.41.34:80 #240
2010/02/05 19:42:55  149388#151852: malloc: 00775560:24
2010/02/05 19:42:55  149388#151852: counter: 00B00080, 5
2010/02/05 19:42:55  149388#151852: nginx/0.8.33
2010/02/05 19:42:55  149388#151852: OS: 250220 build:3790, "Service Pack 
2", suite:112, type:3
2010/02/05 19:42:55  149388#151852: worker started
2010/02/05 19:42:56  160580#180468: WaitForMultipleObjects: 0
2010/02/05 19:42:56  160580#180468: process: 0 149388 000006F0 e:0 j:0
2010/02/05 19:42:55  149388#151852: create thread 142336
2010/02/05 19:42:55  149388#142336: malloc: 007758D8:8192
2010/02/05 19:42:55  149388#142336: malloc: 007778E0:106496
2010/02/05 19:42:55  149388#142336: malloc: 007918E8:98304
2010/02/05 19:42:55  149388#151852: create thread 180212
2010/02/05 19:42:56  149388#180212: cache manager 
WaitForMultipleObjects: 129
2010/02/05 19:42:56  149388#142336: malloc: 007A98F0:98304
2010/02/05 19:42:56  149388#151852: create thread 163456
2010/02/05 19:42:56  149388#142336: select add event fd:240 ev:0
2010/02/05 19:42:56  149388#142336: worker cycle
2010/02/05 19:42:56  149388#142336: select event: fd:240 wr:0
2010/02/05 19:42:56  149388#142336: select timer: 500
2010/02/05 19:42:56  149388#142336: select ready 1
2010/02/05 19:42:56  149388#142336: select read 240
2010/02/05 19:42:56  149388#142336: post event 007918E8
2010/02/05 19:42:56  149388#142336: timer delta: 141
2010/02/05 19:42:56  149388#142336: posted event 007918E8
2010/02/05 19:42:56  149388#142336: delete posted event 007918E8
2010/02/05 19:42:56  149388#142336: accept on 77.235.41.34:80, ready: 0
2010/02/05 19:42:56  149388#142336: malloc: 007546E0:256
2010/02/05 19:42:56  149388#142336: *5 accept: 78.86.0.188 fd:300
2010/02/05 19:42:56  149388#142336: *5 event timer add: 300: 
60000:2678651603
2010/02/05 19:42:56  149388#142336: *5 select add event fd:300 ev:0
2010/02/05 19:42:56  149388#142336: posted event 00000000
2010/02/05 19:42:56  149388#142336: posted events 00000000
2010/02/05 19:42:56  149388#142336: worker cycle
2010/02/05 19:42:56  149388#142336: select event: fd:240 wr:0
2010/02/05 19:42:56  149388#142336: select event: fd:300 wr:0
2010/02/05 19:42:56  149388#142336: select timer: 500
2010/02/05 19:42:56  149388#142336: select ready 1
2010/02/05 19:42:56  149388#142336: select read 300
2010/02/05 19:42:56  149388#142336: *5 post event 00791948
2010/02/05 19:42:56  149388#142336: timer delta: 15
2010/02/05 19:42:56  149388#142336: posted events 00791948
2010/02/05 19:42:56  149388#142336: posted event 00791948
2010/02/05 19:42:56  149388#142336: *5 delete posted event 00791948
2010/02/05 19:42:56  149388#142336: *5 malloc: 0075C128:720
2010/02/05 19:42:56  149388#142336: *5 malloc: 00900048:1024
2010/02/05 19:42:56  149388#142336: *5 malloc: 00767FA8:4096
2010/02/05 19:42:56  149388#142336: *5 http process request line
2010/02/05 19:42:56  149388#142336: *5 WSARecv: fd:300 rc:0 1024 of 1024
2010/02/05 19:42:56  149388#142336: *5 http request line: "GET /main.css 
HTTP/1.1"
2010/02/05 19:42:56  149388#142336: *5 http uri: "/main.css"
2010/02/05 19:42:56  149388#142336: *5 http args: ""
2010/02/05 19:42:56  149388#142336: *5 http exten: "css"
2010/02/05 19:42:56  149388#142336: *5 http process request header line
2010/02/05 19:42:56  149388#142336: *5 http header: "Host: 
new.mysite.co.uk"
2010/02/05 19:42:56  149388#142336: *5 http header: "User-Agent: 
Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB; rv:1.9.1.7) 
Gecko/20091221 Firefox/3.5.7"
2010/02/05 19:42:56  149388#142336: *5 http header: "Accept: 
text/css,*/*;q=0.1"
2010/02/05 19:42:56  149388#142336: *5 http header: "Accept-Language: 
en-gb,en;q=0.5"
2010/02/05 19:42:56  149388#142336: *5 http header: "Accept-Encoding: 
gzip,deflate"
2010/02/05 19:42:56  149388#142336: *5 http header: "Accept-Charset: 
ISO-8859-1,utf-8;q=0.7,*;q=0.7"
2010/02/05 19:42:56  149388#142336: *5 http header: "Keep-Alive: 300"
2010/02/05 19:42:56  149388#142336: *5 http header: "Connection: 
keep-alive"
2010/02/05 19:42:56  149388#142336: *5 http header: "Referer: 
http://new.mysite.co.uk/"
2010/02/05 19:42:56  149388#142336: *5 http alloc large header buffer
2010/02/05 19:42:56  149388#142336: *5 malloc: 0075C400:256
2010/02/05 19:42:56  149388#142336: *5 malloc: 00768FB0:8192
2010/02/05 19:42:56  149388#142336: *5 http large header alloc: 00768FB0 
8192
2010/02/05 19:42:56  149388#142336: *5 http large header copy: 646
2010/02/05 19:42:56  149388#142336: *5 WSARecv: fd:300 rc:0 43 of 7546
2010/02/05 19:42:56  149388#142336: *5 http header: "Cookie: 
__utma=199252669.1348250431.1258842534.1265312340.1265330842.32; 
__utmz=199252669.1265242890.29.5.utmcsr=localhost:3002|utmccn=(referral)|utmcmd=referral|utmcct=/; 
__utma=254979479.1627312296.1265337519.1265366781.1265398672.6; 
__utmz=254979479.1265337519.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); 
__utmc=254979479; 
_MySite_session=BAh7CToPc2Vzd2lvbl9pZCIlYjhlOTZiZDllZTMxZmRlYzIxYURjYjE5NDM0YzRlYzk6EF9jc3JmX3Rva2VuIjFXZkFDb0wyVWtMblRxeFZuZTJ1N0NEUk9ULzVxalhoSkhqaE0rR2syUTM0PSIMdXNlcl9pZGkGIgpmbGFzaElDOidBY3Rpb25Db250cm9sbGVyOjpGbGFzaDo6Rmxhc2hIYZNoewAGOgpAdXNlZHsA--f4af4fb56bea7b896f827000b464cb24ea0045d5; 
__utmc=199252669; __utmb=254979479.1.10.1265398672"
2010/02/05 19:42:56  149388#142336: *5 http header done
2010/02/05 19:42:56  149388#142336: *5 event timer del: 300: 2678651603
2010/02/05 19:42:56  149388#142336: *5 generic phase: 0
2010/02/05 19:42:56  149388#142336: *5 generic phase: 1
2010/02/05 19:42:56  149388#142336: *5 test location: "/"
2010/02/05 19:42:56  149388#142336: *5 using configuration "/"
2010/02/05 19:42:56  149388#142336: *5 http cl:-1 max:1048576
2010/02/05 19:42:56  149388#142336: *5 generic phase: 3
2010/02/05 19:42:56  149388#142336: *5 post rewrite phase: 4
2010/02/05 19:42:56  149388#142336: *5 generic phase: 5
2010/02/05 19:42:56  149388#142336: *5 generic phase: 6
2010/02/05 19:42:56  149388#142336: *5 generic phase: 7
2010/02/05 19:42:56  149388#142336: *5 access phase: 8
2010/02/05 19:42:56  149388#142336: *5 access phase: 9
2010/02/05 19:42:56  149388#142336: *5 post access phase: 10
2010/02/05 19:42:56  149388#142336: *5 try files phase: 11
2010/02/05 19:42:56  149388#142336: *5 http script var: "/main.css"
2010/02/05 19:42:56  149388#142336: *5 try to use file: "/main.css" 
"c:\nginx/../rails/MySite/public/main.css"
2010/02/05 19:42:56  149388#142336: *5 try file uri: "/main.css"
2010/02/05 19:42:56  149388#142336: *5 content phase: 12
2010/02/05 19:42:56  149388#142336: *5 content phase: 13
2010/02/05 19:42:56  149388#142336: *5 content phase: 14
2010/02/05 19:42:56  149388#142336: *5 content phase: 15
2010/02/05 19:42:56  149388#142336: *5 content phase: 16
2010/02/05 19:42:56  149388#142336: *5 content phase: 17
2010/02/05 19:42:56  149388#142336: *5 http filename: 
"c:\nginx/../rails/MySite/public/main.css"
2010/02/05 19:42:56  149388#142336: *5 add cleanup: 0076857C
2010/02/05 19:42:56  149388#142336: *5 http static fd: 312
2010/02/05 19:42:56  149388#142336: *5 http set discard body
2010/02/05 19:42:56  149388#142336: *5 HTTP/1.1 200 OK
Server: nginx/0.8.33
Date: Fri, 05 Feb 2010 19:42:56 GMT
Content-Type: text/css
Content-Length: 527
Last-Modified: Fri, 05 Feb 2010 01:25:56 GMT
Connection: keep-alive
Accept-Ranges: bytes

Posted at Nginx Forum: 
http://forum.nginx.org/read.php?2,50870,51089#msg-51089

Oh, and here is my full nginx.conf contents:

error_log  logs/error.log;
worker_processes  1;
events {
    worker_connections  1024;
}

http {
    include mime.types;
    default_type application/octet-stream;

    upstream  mysite {
        server 127.0.0.1:4004;
    }
    server {
        #note: not actual IP
        listen 111.222.333.444:80;
        server_name  _;
        return 444;
    }
    server {
        #note: not actual IP
        listen 111.222.333.444:80;
        server_name new.mysite.co.uk;
        root ../rails/MySite/public;

            location / {
                try_files $uri @rails;
            }

            location @rails {
                proxy_pass http://mysite$request_uri;
            }

        proxy_set_header        Host            $host;
        proxy_set_header        X-Real-IP       $remote_addr;
        proxy_set_header        X-Forwarded-For 
$proxy_add_x_forwarded_for;
    }
}

Grateful for any help!

JS

Posted at Nginx Forum: 
http://forum.nginx.org/read.php?2,50870,51099#msg-51099

On Fri, Feb 05, 2010 at 03:04:07PM -0500, JohnSchulze wrote:

> > Note well: using try_files and not using dynamic
> > hostname 
> > resolution as suggested in previous reply is
> > anyway preffered.  
> > But config as shown in your post should work
> > without problems, and 
> > it would be good to investigate problem roots.
> > 
> > Maxim Dounin
> 
> Many thanks for your suggestions, I have changed to use the try_files method instead (is this a new directive?). Unfortunately the behaviour is exactly the same. I've run off a debug log for a page request but it's 99kb(!) so I can't really post it all here. In it I can see there are double requests for some files and for some of these I can't see the 200. Here is a part of the debug log where you can see two requests for "main.css" (there should only be one request) and it looks to me as if only one of them is finished with proper response headers: 

> 2010/02/05 19:42:53  38652#171748: *4 http filename: "c:\nginx/../rails/MySite/public/main.css"
> 2010/02/05 19:42:53  38652#171748: *4 add cleanup: 007C1ECC
> 2010/02/05 19:42:55  160580#180468: master WaitForMultipleObjects: 4
> 2010/02/05 19:42:55  160580#180468: reap worker
> 2010/02/05 19:42:55  160580#180468: worker process 38652 exited with code C0000005

The worker exited abnormaly. I do not know how to troubleshoot such bugs
on Windows without coredumps. Probably you may look the DrWatson log 
file
for stack dump to estimate the point of failure.


--
Igor Sysoev
http://sysoev.ru/en/

Thank you Igor, is it not possible to get some clues from the exit code 
(C0000005)? Also, maybe it's because I've been restarting the nginx 
service over and over, but nginx just crashed and I couldn't restart it 
without a reboot (even after terminating the nginx processes manually). 
The service is running under the local system account and it does have 
acess to the correct folders etc btw.

JS

Posted at Nginx Forum: 
http://forum.nginx.org/read.php?2,50870,51136#msg-51136

On Fri, Feb 05, 2010 at 05:21:30PM -0500, JohnSchulze wrote:

> Thank you Igor, is it not possible to get some clues from the exit code (C0000005)? Also, maybe it's because I've been restarting the nginx service over and over, but nginx just crashed and I couldn't restart it without a reboot (even after terminating the nginx processes manually). The service is running under the local system account and it does have acess to the correct folders etc btw. 

C0000005 means GPF, general protection fault, or segmentation fault in
Unix world. Only DrWatson stack dump may help somehow here.


--
Igor Sysoev
http://sysoev.ru/en/

Many thanks for your advice Igor, the problem has mysteriously gone away 
and I can't seem to trigger the error again. Strange, becuase I can't 
really think what I've changed that would fix it, but I'm not 
complaining!

JS

Posted at Nginx Forum: 
http://forum.nginx.org/read.php?2,50870,53761#msg-53761