Nginx does not Cache Google Adsense and Some other widgets - help

Server NGINX
1

Nginx 1.0.x

I have set up my cache like this:

proxy_cache_key $host$uri$is_args$args;
proxy_cache_methods POST;
proxy_cache STATIC;
proxy_cache_valid 200 1d;
proxy_cache_use_stale error timeout invalid_header updating http_500
http_502 http_503 http_504;

The URLs that are not being cached are of this form:

URI?id=parameter&h=parameter or URI?
id=parameter&h=parameter&w=parameter

Any ideas how I can configure the cache key so that uris with those
parameters get cached too?

Thanks,

Alex

2

Nginx does not Cache Google Adsense

To understand this correctly - theese requests aren’t coming directly
from
google servers (otherways unleast you put nginx as a proxy above google
it
won’t be able to cache anything)?

The URLs that are not being cached are of this form:
URI?id=parameter&h=parameter or URI?
id=parameter&h=parameter&w=parameter

Can you show what the full request headers look like (for example with:
wget -S url)?

You have: proxy_cache_valid 200 1d;

which means that only 200 responses are cached and not for example 301
or
302 … (you can try to remove ‘200’ and see if the response is cached
then).

rr

3

Dear RR:

Thank you for your insights. In regards to the wget -S url, this is
what I get:

–2011-10-05 18:09:32–
http://myWebDomain.com/contentAsset/resize-image/7e061df4-0fc3-481f-b75d-7ce3ff2e8cac/?w=175
Resolving myWebDomain.com… IP ADDRESS
Connecting to myWebDomain.com|IP ADDRESS|:80… connected.
HTTP request sent, awaiting response…
HTTP/1.1 404 Not Found
Server: nginx
Date: Wed, 05 Oct 2011 14:09:32 GMT
Content-Type: text/html;charset=UTF-8
Connection: close
Vary: Accept-Encoding
Set-Cookie: JSESSIONID=5AB2FF5CF72E237DCEC48FAE19AE09F4; Path=/
Set-Cookie: SHARED_SESSION_ID=GZ3W4CP2F07E; Expires=Thu, 06-
Oct-2011 14:09:32 GMT; Path=/
2011-10-05 18:09:32 ERROR 404: Not Found.

Note the address “contentAsset/resize-image/7e061df4-0fc3-481f-
b75d-7ce3ff2e8cac/?w=175” is inside an image tag. If I disable the
cache, it works fine.

I tried to set proxy_cache_valid any 1d; and proxy_cache_valid 200
404 1d; Then, clear the cache, and restarted nginx and it still stays
the same.

4

–2011-10-05 18:09:32–
http://myWebDomain.com/contentAsset/resize-image/7e061df4-0fc3-481f-b75d-7ce3ff2e8cac/?w=175
HTTP/1.1 404 Not Found
Server: nginx
Content-Type: text/html;charset=UTF-8
Vary: Accept-Encoding
Set-Cookie: JSESSIONID=5AB2FF5CF72E237DCEC48FAE19AE09F4; Path=/
Set-Cookie: SHARED_SESSION_ID=GZ3W4CP2F07E; Expires=Thu, 06- Oct-2011 14:09:32
GMT; Path=/
2011-10-05 18:09:32 ERROR 404: Not Found.

Without the full nginx config (and the application specifics (looks like
some java app/tomcat?) you are trying to proxy/cache) it is
hard to understand what is going wrong.

While you are getting a 404 response nginx cache should not influence if
the object exists or not on the backend (unless the backend
is using something dynamic (like active sessionid/cookie) for the
embedded object/image serving).

Is it possible to get the request/headers for the object directly from
the backend (without nginx)?

Also can you show the proxy_cache_path for STATIC zone and/or check if
nginx actually creates any cache file there?

In the end you could also enable/check the nginx error_log in more
verbose mode.

But if it was intended to cache the 404 responses it is clear why nginx
didn’t it before since proxy_cache_valid didn’t have 404
specified.

rr

5

Dear RR:

The application uses tomcat. It is a java 2EE cms called dotCMS. Here
are the headers without NGINX:

HTTP request sent, awaiting response…
HTTP/1.1 200 OK
Date: Wed, 05 Oct 2011 17:53:05 GMT
Server: Apache/2.0.63 (Unix) mod_ssl/2.0.63 OpenSSL/0.9.8e-fips-
rhel5 mod_bwlimited/1.4 mod_jk/1.2.31
Set-Cookie: JSESSIONID=0B54F628C20BD330D58B871703A27128; Path=/
Expires: Thu, 04 Oct 2012 17:53:05 +0000
Cache-Control: public, max-age=31536000
Last-Modified: Wed, 05 Oct 2011 13:38:53 GMT
ETag: dot:null:1317821933000:64442
Content-Length: 64442
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: image/png
Length: 64442 (63K) [image/png]

My config file is here http://pastebin.com/Ubi0pjyq

Yes, the CACHE is created. This is what I see in the cache directory.

0 1 2 3 4 5 6 7 8 9 a b c d e f tmp

I appreciate your help!

Alex