Irrational Exuberance

Page Summary

One of the most common quickie projects on the web is to screenscrape a website and play around with its data. These projects are a lot of fun, and can allow for inventive mashups, but often the screepscraping scripts cause unnecessary load on the site's servers due to inconsiderate technique. This is an introduction to the art of compassionate screenscraping.

Page Statistics

An Introduction to Compassionate Screen Scraping has received 43933 pageviews (an average of 25 views per day since publication).

Pageviews for Recent Days

Show daily pageviews for trailing window.

Date	Views
05/24/2013	23
05/23/2013	26
05/22/2013	16
05/21/2013	25
05/20/2013	26
05/19/2013	34
05/18/2013	25
05/17/2013	21
05/16/2013	19
05/15/2013	21
05/14/2013	18
05/13/2013	32
05/12/2013	20
05/11/2013	30
05/10/2013	18
05/09/2013	21
05/08/2013	35
05/07/2013	33
05/06/2013	21
05/05/2013	37
05/04/2013	27
05/03/2013	29
05/02/2013	28
05/01/2013	38
04/30/2013	31
04/29/2013	24
04/28/2013	20
04/27/2013	27
04/26/2013	19
04/25/2013	39
04/24/2013	23

Page Referrers

Top referrers for this page. Show up to 50 referrers with at least 10 pageviews.

Refer	Views
direct	15272
imported from google analytics	10839
news.ycombinator.com	4772
www.google.com	3982
www.poynter.org	1779
www.stumbleupon.com	1360
lethain.com	1203
www.reddit.com	1073
paradox1x.org	1032
stackoverflow.com	354
www.quora.com	298
dev.lethain.com	262
www.delicious.com	95
www.mozenda.com	92
webscraping.com	85
news.ycombinator.org	85
sitescraper.net	75
schoolofdata.org	67
www.codeproject.com	53
hackerne.ws	41
twitter.com	36
searchyc.com	32
www.instapaper.com	31
mail.python.org	31
wiki.greasespot.net	30
realtime.michaelhart.me	30
hckrnews.com	25
www.hnsearch.com	22
hackurls.com	20
www.netvibes.com	18
www.jimmyr.com	18