I have a web-app created for reporting purpose with over 150,000 rows in the DB that has anywhere between 3-8 clauses being run on it everytime someone creats a report. Reports return back anywere from a couple hundred rows to over 100,000 if I am exporting it to excel. Their is between 200-500 reports being created a day. I was wondering how much ram and what hardware requirements do you think such a system would require? Correct me if I am wrong but the slowless I think is due to the amount of ram allocated to mySQL. Apache needs to be restarted every couple of days. Thanks for your input. Your Friend, John -- John Kopanas email@example.com http://www.kopanas.com http://www.cusec.net http://www.soen.info
on 2007-05-15 02:23
on 2007-05-15 02:32
> Reports return back anywere from a couple hundred rows to over 100,000 > if I am exporting it to excel. You need to paginate and write this in chunks. Fetching 100K rows is going to take enormous amounts of RAM. Then instantiating them as objects is going to take another elephant. The simple way to do this is just to use offset and limit. Fetch 1k objects at a time, process, write to disk, grab the next 1k and so forth.
on 2007-05-15 18:40
On 5/15/07, DHH <firstname.lastname@example.org> wrote: > The simple way to do this is just to use offset and limit. > Fetch 1k objects at a time, process, write to disk, grab the next 1k and > so forth. .. as documented by Jamis Buck in: http://weblog.jamisbuck.org/2007/4/6/faking-cursor... Alain Ravet -------- http://blog.ravet.com