An Introduction to Compassionate Screen Scraping

08/10/2008

Page Summary

One of the most common quickie projects on the web is to screenscrape a website and play around with its data. These projects are a lot of fun, and can allow for inventive mashups, but often the screepscraping scripts cause unnecessary load on the site's servers due to inconsiderate technique. This is an introduction to the art of compassionate screenscraping.

Page Statistics

An Introduction to Compassionate Screen Scraping has received 57200 pageviews (an average of 24 views per day since publication).

Pageviews for Recent Days

Show daily pageviews for trailing window.

DateViews
12/21/20149
12/20/201419
12/19/201413
12/18/201425
12/17/201425
12/16/201427
12/15/201421
12/14/201423
12/13/201422
12/12/201417
12/11/201426
12/10/201433
12/09/201419
12/08/201433
12/07/201424
12/06/201431
12/05/201430
12/04/201421
12/03/201430
12/02/201425
12/01/201420
11/30/201432
11/29/201433
11/28/201438
11/27/201432
11/26/201434
11/25/201439
11/24/201434
11/23/201422
11/22/201427
11/21/201434

Page Referrers

Top referrers for this page. Show up to 50 referrers with at least 10 pageviews.

ReferViews
direct21140
imported from google analytics10839
news.ycombinator.com4775
www.google.com4574
www.poynter.org3907
lethain.com3631
www.stumbleupon.com1380
www.reddit.com1099
paradox1x.org1086
www.quora.com608
stackoverflow.com484
schoolofdata.org375
dev.lethain.com274
webscraping.com259
feeds.delicious.com147
www.codeproject.com111
www.mozenda.com110
www.delicious.com96
news.ycombinator.org85
sitescraper.net75
es.schoolofdata.org68
ask.metafilter.com66
wiki.greasespot.net47
hackerne.ws41
twitter.com36
searchyc.com32
mail.python.org32
www.instapaper.com31
realtime.michaelhart.me30
hckrnews.com25
www.bing.com23

All Rights Reserved, Will Larson 2007 - 2014.