An Introduction to Compassionate Screen Scraping

08/10/2008

Page Summary

One of the most common quickie projects on the web is to screenscrape a website and play around with its data. These projects are a lot of fun, and can allow for inventive mashups, but often the screepscraping scripts cause unnecessary load on the site's servers due to inconsiderate technique. This is an introduction to the art of compassionate screenscraping.

Page Statistics

An Introduction to Compassionate Screen Scraping has received 59765 pageviews (an average of 24 views per day since publication).

Pageviews for Recent Days

Show daily pageviews for trailing window.

DateViews
04/23/201516
04/22/201515
04/21/201517
04/20/201522
04/19/201514
04/18/201512
04/17/201518
04/16/201515
04/15/201525
04/14/201526
04/13/201522
04/12/201521
04/11/201527
04/10/201518
04/09/201520
04/08/201527
04/07/201524
04/06/201515
04/05/201522
04/04/201521
04/03/20159
04/02/201541
04/01/201513
03/31/201524
03/30/201522
03/29/201520
03/28/201522
03/27/201516
03/26/201520
03/25/201516

Page Referrers

Top referrers for this page. Show up to 50 referrers with at least 10 pageviews.

ReferViews
direct22415
imported from google analytics10839
www.google.com4782
news.ycombinator.com4776
lethain.com4241
www.poynter.org4000
www.stumbleupon.com1386
www.reddit.com1104
paradox1x.org1086
www.quora.com755
stackoverflow.com498
schoolofdata.org429
webscraping.com289
dev.lethain.com275
feeds.delicious.com166
www.codeproject.com117
www.mozenda.com110
www.delicious.com96
es.schoolofdata.org96
news.ycombinator.org85
sitescraper.net75
ask.metafilter.com74
wiki.greasespot.net51
hackerne.ws41
twitter.com36
searchyc.com32
mail.python.org32
www.instapaper.com31
realtime.michaelhart.me30
thiagomarzagao.com27
www.bing.com25

All Rights Reserved, Will Larson 2007 - 2015.