# Problem in downloading large file with apache+mongrel **URL:** \ **Category:** Mongrel\ **Created:** [September 22, 2010, 3:01pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392 "2010-09-22T15:01:00Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 3:01pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/1 "2010-09-22T15:01:00Z")
hii all, am using apache as frontend to mongrel and loaded xsendfile module in apache ,am looking for 1 GB of download .this is download routine def download @stream = Stream.find(params[:id]) send\_file(@stream.location,:filename =\> @stream.name,:disposition \> ‘attachment’,:x\_sendfile =\> true ) and And this is how it is processed Processing StreamsController#download (for 127.0.0.1 at 2010-09-22 12:32:10) [GET] Parameters: {“id”=\>“6596”} \<-[4;36;1mSQL (0.0ms)?[0m ?[0;1mSET NAMES ‘utf8’?[0m \<-[4;35;1mSQL (0.0ms)?[0m ?[0mSET SQL\_AUTO\_IS\_NULL=0?[0m \<-[4;36;1mStream Columns (15.0ms)?[0m ?[0;1mSHOW FIELDS FROM streams?[0m \<-[4;35;1mStream Load (0.0ms)?[0m ?[0mSELECT \* FROM streams WHERE (streams.id = 6596) ?[0m \<-[4;36;1mCACHE (0.0ms)?[0m ?[0;1mSELECT \* FROM streams WHERE (streams.id = 596) ? ?[0m Sending X-Sendfile header d:/dm/predator\_720x480\_5mbps\_30fps\_17minclip.264.filepart Completed in 57513ms (View: 0, DB: 15) | 200 OK [[http://src/streams/download/6596](http://src/streams/download/6596)] very first times its okk i getting full 1.1 GB of file getting downloaded,but when i am trying to download this 1.1 gb of file again, am getting failed to allocate memroy what could be soultion?? and can i use cache.clear before send\_file function?? and more thing to again download 1.1 gb of file i have to restart my servers… thanks?? ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 3:06pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/2 "2010-09-22T15:06:28Z")
On Wed, Sep 22, 2010 at 10:01 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > hii all, > am using apache as frontend to mongrel and loaded xsendfile > module in apache ,am looking for 1 GB of download .this is download > routine ## Replied your previous message to the list also. Please provide the answers to my questions. ## Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 3:50pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/3 "2010-09-22T15:50:13Z")
Luis L. wrote: > On Wed, Sep 22, 2010 at 10:01 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) > wrote: > > > hii all, > > am using apache as frontend to mongrel and loaded xsendfile > > module in apache ,am looking for 1 GB of download .this is download > > routine > > ## Replied your previous message to the list also. Please provide the answers to my questions. > > ## Luis L. AREA 17 > > Perfection in design is achieved not when there is nothing more to add, > but rather when there is nothing more to take away. > Antoine de Saint-Exupé²¹ just now i seen your message… i am running apache 2.2.11 that comes with XAMPP 1.7.1 and mongrel version is 1.1.2, ruby version is ruby 1.8.6 luis you are saying Rails is serving the request, the 1.1GB, not Apache but how do i know rails is serving the request..or Apache 1. d:/dm is not a network drive..its folder on d drive how do i know whther it available to apache ?? i am sending you access logs of apache after few mintues ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 3:58pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/4 "2010-09-22T15:58:41Z")
when i am trying to downnload following happen in logs of apache 127.0.0.1 - - [22/Sep/2010:19:11:12 +0530] “GET /streams/download/6598 HTTP/1.1” 500 1024 “[http://src/streams/6598](http://src/streams/6598)” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.3 (KHTML, like Gecko) Chrome/6.0.472.33 Safari/534.3” where 6598 is id of file to be downloaded ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 4:22pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/5 "2010-09-22T16:22:22Z")
soory but how do i setup s virtual server configuration?? and i have to install that plugin?? ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 4:37pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/6 "2010-09-22T16:37:15Z")
On Wed, Sep 22, 2010 at 11:22 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > soory but how do i setup s virtual server configuration?? Read apache documentation. > and i have to install that plugin?? ## No, in your controller action set the headers, _do not_ install the plugin. ## Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 4:06pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/7 "2010-09-22T16:06:48Z")
On Wed, Sep 22, 2010 at 10:50 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > just now i seen your message… > i am running apache 2.2.11 that comes with XAMPP 1.7.1 and mongrel > version is > 1.1.2, > ruby version is ruby 1.8.6 > > Rails is serving the request, the 1.1GB, not Apache > but how do i know rails is serving the request..or Apache Please answer all the questions I put, analyze the process memory usage. If you don’t see in apache serving the X-Sendfile request, then is not. Try setting the headers on your own and render nothing: Implement the first code example of this page: [http://john.guen.in/past/2007/4/17/send\_files\_faster\_with\_xsendfile/](http://john.guen.in/past/2007/4/17/send_files_faster_with_xsendfile/) Not the plugin. > 1. d:/dm is not a network drive..its folder on d drive > how do i know whther it available to apache ?? Try to setup a virtual server configuration that access D: and see if it works. ## – Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:00pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/8 "2010-09-22T17:00:51Z")
Luis L. wrote: > On Wed, Sep 22, 2010 at 11:22 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) > wrote: > > > soory but how do i setup s virtual server configuration?? > > Read apache documentation. > > > and i have to install that plugin?? > > ## No, in your controller action set the headers, _do not_ install the plugin. > > ## Luis L. AREA 17 > > Perfection in design is achieved not when there is nothing more to add, > but rather when there is nothing more to take away. > Antoine de Saint-Exupé²¹ luis i change my code as you said filename = “#{@stream.location}” response.headers[‘Content-Type’] = “application/force-download” response.headers[‘Content-Disposition’] = “attachment; filename="#{File.basename(filename)}"” response.headers[“X-Sendfile”] = filename response.headers[‘Content-length’] = File.size(filename) render :nothing =\> true this is how it is processed… ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:15pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/9 "2010-09-22T17:15:54Z")
On Wed, Sep 22, 2010 at 12:00 PM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > this is how it is processed… This? How? can you provide answers to my previous questions about process memory usage? Please? ## – Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:01pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/10 "2010-09-22T17:01:32Z")
Amit T. wrote: > Luis L. wrote: > > > On Wed, Sep 22, 2010 at 11:22 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) > > wrote: > > > > > soory but how do i setup s virtual server configuration?? > > > > Read apache documentation. > > > > > and i have to install that plugin?? > > > > ## No, in your controller action set the headers, _do not_ install the plugin. > > > > ## Luis L. AREA 17 > > > > Perfection in design is achieved not when there is nothing more to add, > > but rather when there is nothing more to take away. > > Antoine de Saint-Exupé²¹ > > luis i change my code as you said > > filename = “#{@stream.location}” > response.headers[‘Content-Type’] = “application/force-download” > response.headers[‘Content-Disposition’] = “attachment; > filename="#{File.basename(filename)}"” > response.headers[“X-Sendfile”] = filename > response.headers[‘Content-length’] = File.size(filename) > render :nothing =\> true > > this is how it is processed… Processing StreamsController#download (for 127.0.0.1 at 2010-09-22 20:22:06) [GET] Parameters: {“id”=\>“6600”} ?[4;36;1mSQL (0.0ms)?[0m ?[0;1mSET NAMES ‘utf8’?[0m ?[4;35;1mSQL (0.0ms)?[0m ?[0mSET SQL\_AUTO\_IS\_NULL=0?[0m ?[4;36;1mStream Columns (0.0ms)?[0m ?[0;1mSHOW FIELDS FROM `streams`?[0m ?[4;35;1mStream Load (0.0ms)?[0m ?[0mSELECT \* FROM `streams` WHERE (`streams`.`id` = 6600) ?[0m ?[4;36;1mCACHE (0.0ms)?[0m ?[0;1mSELECT \* FROM `streams` WHERE (`streams`.`id` = 6600) ?[0m 0) ?[0m Completed in 65347ms (View: 0, DB: 0) | 200 OK [[http://src/streams/download/6600](http://src/streams/download/6600)] ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:17pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/11 "2010-09-22T17:17:23Z")
Amit T. wrote: > Amit T. wrote: > > > Luis L. wrote: > > > > > On Wed, Sep 22, 2010 at 11:22 AM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) > > > wrote: > > > > > > > soory but how do i setup s virtual server configuration?? > > > > > > Read apache documentation. > > > > > > > and i have to install that plugin?? > > > > > > ## No, in your controller action set the headers, _do not_ install the plugin. > > > > > > ## Luis L. AREA 17 > > > > > > Perfection in design is achieved not when there is nothing more to add, > > > but rather when there is nothing more to take away. > > > Antoine de Saint-Exupé²¹ > > > > luis i change my code as you said > > > > filename = “#{@stream.location}” > > response.headers[‘Content-Type’] = “application/force-download” > > response.headers[‘Content-Disposition’] = “attachment; > > filename="#{File.basename(filename)}"” > > response.headers[“X-Sendfile”] = filename > > response.headers[‘Content-length’] = File.size(filename) > > render :nothing =\> true > > > > this is how it is processed… > > Processing StreamsController#download (for 127.0.0.1 at 2010-09-22 > 20:22:06) [GET] > Parameters: {“id”=\>“6600”} > ?[4;36;1mSQL (0.0ms)?[0m ?[0;1mSET NAMES ‘utf8’?[0m > ?[4;35;1mSQL (0.0ms)?[0m ?[0mSET SQL\_AUTO\_IS\_NULL=0?[0m > ?[4;36;1mStream Columns (0.0ms)?[0m ?[0;1mSHOW FIELDS FROM > `streams`?[0m > ?[4;35;1mStream Load (0.0ms)?[0m ?[0mSELECT \* FROM `streams` WHERE > (`streams`.`id` = 6600) ?[0m > ?[4;36;1mCACHE (0.0ms)?[0m ?[0;1mSELECT \* FROM `streams` WHERE > (`streams`.`id` = 6600) ?[0m > 0) ?[0m > Completed in 65347ms (View: 0, DB: 0) | 200 OK > [[http://src/streams/download/6600](http://src/streams/download/6600)] and these are the lines i added in httpd.conf \ Options Indexes FollowSymLinks AllowOverride FileInfo Order allow,deny Allow from all for virtual server configuration to access D: what should i do now ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:29pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/12 "2010-09-22T17:29:02Z")
Amit T. wrote: > yaa am looking to provide answer for that also memory usage Luis when i download file httpd.exe is varied from at 49,892k to 50,264k while ruby.exe 934800 k to 1,208688k ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:36pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/13 "2010-09-22T17:36:58Z")
On Wed, Sep 22, 2010 at 12:01 PM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > ?[4;36;1mCACHE (0.0ms)?[0m ?[0;1mSELECT \* FROM `streams` WHERE > (`streams`.`id` = 6600) ?[0m > 0) ?[0m > Completed in 65347ms (View: 0, DB: 0) | 200 OK > [[http://src/streams/download/6600](http://src/streams/download/6600)] Rails log do not help, we need to know Apache headers, responses and also mongrel headers sent to apache via the proxy. Please use curl --head on mongrel to request the URL and provide the complete output Also do the same from apache. ## Beyond that, I cannot help you more because I don’t have time to attempt replicate your environment and scenario. ## Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:37pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/14 "2010-09-22T17:37:46Z")
Amit T. wrote: > Amit T. wrote: > > > yaa am looking to provide answer for that also memory usage > > Luis when i download file > httpd.exe is varied from at 49,892k to 50,264k > while ruby.exe 934800 k to 1,208688k and louis as soon while getting downloded memoryuse of httd.exe is getting decrerase to 768 k and the when the file completely downloded memory use get down to 324 k ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:39pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/15 "2010-09-22T17:39:55Z")
Amit T. wrote: > Amit T. wrote: > > > Amit T. wrote: > > > > > yaa am looking to provide answer for that also memory usage > > > > Luis when i download file > > httpd.exe is varied from at 49,892k to 50,264k > > while ruby.exe 934800 k to 1,208688k > > and louis as soon while getting downloded memoryuse of httd.exe is > getting decrerase to 768 k and the when the file completely downloded > memory use get down to 324 k yaa louis tahnks for your help… you must be very good person… ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:19pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/16 "2010-09-22T17:19:24Z")
yaa am looking to provide answer for that also memory usage ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:47pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/17 "2010-09-22T17:47:31Z")
On Wed, Sep 22, 2010 at 12:29 PM, Amit T. [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote: > Amit T. wrote: > > > yaa am looking to provide answer for that also memory usage > > Luis when i download file > httpd.exe is varied from at 49,892k to 50,264k > while ruby.exe 934800 k to 1,208688k That makes then clear that Ruby is trying to read the file, not apache. ## Sorry, I can’t help you more if you don’t keep an structure conversation and you investigate also. ## Luis L. AREA 17 Perfection in design is achieved not when there is nothing more to add, but rather when there is nothing more to take away. Antoine de Saint-Exupéry ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 23, 2010, 7:40am UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/18 "2010-09-23T07:40:30Z")
but louis,how do i force apache to read the file and this problem can occur with Apache also?? ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 22, 2010, 5:47pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/19 "2010-09-22T17:47:31Z")
On 22 Sep 2010, at 12:00, Amit T. wrote: > luis i change my code as you said > > filename = “#{@stream.location}” > response.headers[‘Content-Type’] = “application/force-download” > response.headers[‘Content-Disposition’] = “attachment; > filename="#{File.basename(filename)}"” The problem is here ^^^^ > response.headers[“X-Sendfile”] = filename > response.headers[‘Content-length’] = File.size(filename) File.size should fail, as rails will be in Dir.pwd == Rails.root, and as such, File.size(filename) for filename with no path should fail. This should be raising Errno::ENOENT. ---
**Author:** ![amit-singh](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/a/9f8e36/32.png) [@amit-singh](https://www.ruby-forum.com/u/amit-singh)\ **Post date:** [September 23, 2010, 7:02pm UTC](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392/20 "2010-09-23T19:02:32Z")
On 23 Sep 2010, at 02:42, Amit T. wrote: > > > response.headers[“X-Sendfile”] = filename > > > response.headers[‘Content-length’] = File.size(filename) > > > > File.size should fail, as rails will be in Dir.pwd == Rails.root, and as > > such, File.size(filename) for filename with no path should fail. This > > should be raising Errno::ENOENT. > > but tucker, i am getting failed to allocate memory and that is also of > second time… You confuse me for someone that doesn’t read. You also clearly don’t understand “should”, or what I’ve just told you. [Next page](https://www.ruby-forum.com/t/problem-in-downloading-large-file-with-apache-mongrel/195392.md?page=2)