# Real time stats engine for high traffic web sites

**URL:** <https://www.ruby-forum.com/t/real-time-stats-engine-for-high-traffic-web-sites/200305>\
**Category:** NGINX\
**Created:** [December 8, 2010, 10:12pm UTC](https://www.ruby-forum.com/t/real-time-stats-engine-for-high-traffic-web-sites/200305 "2010-12-08T22:12:06Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Dobai-Pataky\_BSSSSl](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/d/77aa72/32.png) [@Dobai-Pataky\_BSSSSl](https://www.ruby-forum.com/u/Dobai-Pataky_BSSSSl)\
**Post date:** [December 8, 2010, 10:12pm UTC](https://www.ruby-forum.com/t/real-time-stats-engine-for-high-traffic-web-sites/200305/1 "2010-12-08T22:12:06Z")

</div>

Hi guys

We are looking for a tool / service that can manage real-time log  
analysis of high traffic web sites.

We have 15+ front end servers and around 2.2M visits per day, all  
running nginx.

Any suggestions ?

Thanks

–  
Maxime Ducharme  
Systems Architect

---

<div class="post-metadata">

**Author:** ![Maxime\_Ducharme](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/m/ad7895/32.png) [@Maxime\_Ducharme](https://www.ruby-forum.com/u/Maxime_Ducharme)\
**Post date:** [December 8, 2010, 10:14pm UTC](https://www.ruby-forum.com/t/real-time-stats-engine-for-high-traffic-web-sites/200305/2 "2010-12-08T22:14:36Z")

</div>

There are few tools that will handle volume like that. Analog probably  
will, but it’s not real time. Urchin probably can, but it’s also not  
real time. We’ve gone down the Hadoop path and it’s both painful and  
powerful.

phil.

On Dec 8, 2010, at 4:11 PM, Maxime Ducharme wrote:

> Thanks  
> [mailman.nginx.org archive](http://nginx.org/mailman/listinfo/nginx)  
> –  
> Philip Jacob  
> [Philip Jacob](http://www.whirlycott.com/phil/)