Google News Scraper

The scraper batch queries news.google.com, outputting a table of returns including URL, title, source, city/country, date and teaser text.

Enter a project name for the results file. Select desired number of results per query (default is 100, as greater numbers require multiple scrapes). Select a date range for your query in the form of month-day. Multiple queries are possible.

Optionally, the scraper retrieves thumbnail images attached to each search return.

For advanced use, see also a more detailed set of instructions concerning news scraping and output.

Discover uses of "security fence," "apartheid wall" and "security barrier" in news media, outputting a table. Select all, and paste special in MS-Excel. Results may be visualized in a number of ways, including the following network diagram showing associations between terms and media sources.

See: R. Rogers and A. Ben-David, "Coming to Terms: A conflict analysis of the usage, in official and unofficial sources, of 'security fence,' 'apartheid wall,' and other terms for the structure between Israel and the Palestinian Territories," unpublished ms., 2005. [pdf] [summary]