How to merge subrequest header

Dobai-Pataky_BSSSSl · November 24, 2010, 2:01pm

Hi,all.

I use ngx_http_subrequest to send a subrequest with the parent’s
response
body,after the sub request processed, I got the subrequest’s body, but
It
seems has no way to merge the subrequest header to parent request.

Anybody else has met this same problem, and how to do this?

Thanks.

The time you enjoy wasting is not wasted time!

Roast · November 25, 2010, 1:55am

Anybody else has met this same problem, and how to do this?

Roast · November 25, 2010, 11:20am

On Wed, Nov 24, 2010 at 9:00 PM, Roast [email protected] wrote:

Hi,all.

I use ngx_http_subrequest to send a subrequest with the parent’s response
body,after the sub request processed, I got the subrequest’s body, but It
seems has no way to merge the subrequest header to parent request.

You can register a post_subrequest callback function to your
ngx_http_subrequest call and do subrequest header processing there.

Anybody else has met this same problem, and how to do this?

You can check out the corresponding code in our ngx_echo or ngx_lua
module. There’s a live example for merging subrequest headers and body
into the main request in ngx_lua (untested though, but should work):

location /proxy {
    proxy_pass http://foo.bar.com/$query_string;
}

location /main {
    content_by_lua '
        var res = ngx.location.capture("/proxy",
            { args = "/foo/bar/baz" }
        )
        if res.status == ngx.HTTP_OK then
            for k,v in pairs(res.header) do
                ngx.header[k] = v
            end
            ngx.print(res.body)
        else
            ngx.exit(res.status)
        end
    ';
}

Cheers,
-agentzh

Roast · November 25, 2010, 11:37am

Thanks agentzh.

You can register a post_subrequest callback function to your

ngx_http_subrequest call and do subrequest header processing there.

It seems post_subrequest callback function can’t change the parent’s
header,because the parent’s header filter has been process finished
before
the function call, and the output buf has created.

And I have fixed this problem, at the header filter function. Just like
following steps,maybe that’s not a good way, agentzh pls give me some
more
advanced suggestion.

static ngx_int_t

    part = &sr->headers_out.headers.part;

            part = part->next;

         hh->lowcase_key = ngx_pnalloc(r->pool, h[i].key.len);

return ngx_http_next_header_filter(r);

}

You can check out the corresponding code in our ngx_echo or ngx_lua

module. There’s a live example for merging subrequest headers and body
into the main request in ngx_lua (untested though, but should work):

That’s two great module,but we need more work within our module.

Roast · November 25, 2010, 11:32am

On Thu, Nov 25, 2010 at 6:18 PM, agentzh [email protected] wrote:

You can check out the corresponding code in our ngx_echo or ngx_lua
module. There’s a live example for merging subrequest headers and body
into the main request in ngx_lua (untested though, but should work):

Sorry, the previous sample has bugs. The following example is tested
and working:

location /proxy {
proxy_pass 百度安全验证;
}

location /main {
content_by_lua ’
local res = ngx.location.capture(“/proxy”,
{ args = { wd = “Perl” } }
)

       if res.status == ngx.HTTP_OK then
           for k,v in pairs(res.header) do
               ngx.header[k] = v
           end
           ngx.print(res.body)
       else
           ngx.exit(res.status)
       end
   ';

}

I used the following command line to test the /main location to check
the response body:

curl localhost/main|grep Perl|iconv -f gbk -t utf8

and the following command to check the response headers:

$ curl -I localhost/main
HTTP/1.1 200 OK
Server: nginx/0.8.41
Date: Thu, 25 Nov 2010 10:30:12 GMT
Content-Type: text/html;charset=gbk
Connection: keep-alive
Content-Length: 32274
Cache-Control: private
Set-Cookie: BAIDUID=F8A74DD5F378F2EFFEA0EC6B8BD10E1B:FG=1;

expires=Thu, 25-Nov-40 10:30:11 GMT; path=/; domain=.baidu.com
P3P: CP=" OTI DSP COR IVA OUR IND COM "

Cheers,
-agentzh

Roast · November 25, 2010, 12:23pm

On Thu, Nov 25, 2010 at 6:36 PM, Roast [email protected] wrote:

It seems post_subrequest callback function can’t change the parent’s
header,because the parent’s header filter has been process finished before
the function call, and the output buf has created.

The key point is that not to send out the parent headers when you need
to change it later (according to its subrequests or other things).

And I have fixed this problem, at the header filter function. Just like
following steps,maybe that’s not a good way, agentzh pls give me some more
advanced suggestion.

static ngx_int_t
ngx_http_social_header_filter(ngx_http_request_t *r)
{
… //some other works

You can surely buffer the parent requests’ headers and any outputs
before your subrequest actually finishes in your output filter
functions

Cheers,
-agentzh

Roast · February 27, 2012, 10:24am

On Sun, Feb 26, 2012 at 8:02 AM, edo888 [email protected] wrote:

Can you please share some piece of code. I want to make a post
subrequest to send the response body to fastcgi and filter it there.

See the detailed discussions here:

github.com/openresty/echo-nginx-module

POST subrequest body doesn't get passed to fastcgi

opened 04:14PM - 26 Feb 12 UTC

closed 06:22PM - 12 Oct 13 UTC

edo888

Hi, Here is my config location /hello { default_type text/plain; echo_…subrequest POST '/test' -q 'foo=Foo&bar=baz' -b 'request_body=test&test=3'; } location /test { # default example works #echo "querystring: $query_string"; #echo "method: $echo_request_method"; #echo "body: $echo_request_body"; #echo "content length: $http_content_length"; #echo '///'; ``` fastcgi_pass 127.0.0.1:1234; include fastcgi_params; fastcgi_param SCRIPT_FILENAME /root/test.php; #deny all; ``` } In test.php file I have this: <?php print_r($_GET); print_r($_POST); // always_populate_raw_post_data => On echo $HTTP_RAW_POST_DATA; ?> When I make a request with the default example I can see > curl 'http://localhost/hello' > querystring: foo=Foo&bar=baz > method: POST > body: request_body=test&test=3 > content length: 24 > /// When I make the same request with fastcgi I can see > curl 'http://localhost/hello' > Array > ( > [foo] => Foo > [bar] => baz > ) > Array > ( > ) So, as you can see GET params are passed. No request_body or POST params though. I expect it to output: Array ( [foo] => Foo [bar] => baz ) Array ( [request_body] => test [test] => 3 ) request_body=test&test=3 Is this a bug or it is by design? I'm using v0.37 which comes with nginx 1.1.13.

Best regards,
-agentzh

Roast · February 26, 2012, 1:03am

Hi,

Can you please share some piece of code. I want to make a post
subrequest to send the response body to fastcgi and filter it there.

Posted at Nginx Forum: