Wednesday
Apr152009
Implementing large scale web analytics
Wednesday, April 15, 2009 at 1:04AM
Does anyone know of any articles or papers that discuss the nuts and bolts of how web analytics is implemented at organizations with large volumes of web traffic and a critcal business need to analyze that data - e.g. places like Amazon.com, eBay, and Google?
Just as a fun project I'm planning to build my own web log analysis app that can effectively index and query large volumes of web log data (i.e. TB range). But first I'd like to learn more about how it's done in the organizations whose lifeblood depends on this stuff. Even just a high level architectural overview of their approaches would be nice to have.
Just as a fun project I'm planning to build my own web log analysis app that can effectively index and query large volumes of web log data (i.e. TB range). But first I'd like to learn more about how it's done in the organizations whose lifeblood depends on this stuff. Even just a high level architectural overview of their approaches would be nice to have.
Reader Comments (2)
There is a video of a Facebook presentation on the same. On the Yahoo cofee talk series I think.
I can't seem to find it, but I did find this:
http://www.facebook.com/note.php?note_id=16121578919
The post/article can be summarized as "we use Hadoop". I wish there were more details though.