Group 1
Team
- Erik, Carolien, Marijn
Steps
- Issue Discovery
- query del.icio.us related tags for tag related to global warming
- query global warming and related tags (subissues) - as found in del.icio.us - in live web (technorati)
- Source Distances
- query issues and subissues in google, get top 10 results (= rank sources for (sub)issue)
- query each of the (sub)issues in combination with those sources the blog and the news sphere
- compare google rank with frequency of mentionings in news and blog sphere
- Probs:
- it is not possible to search for a link (source) and a keyword in any of technorati, blogpulse, and news.google.com
- only if the full link is written as text in the article the search engine will find it
- in Technorati and Blogpulse however, it is possible to search only for links. This changes the research question somewhat. We now cannot look for (sub)issues in combination with a link. We can however see how many times a url was linked to from the blogosphere. Thus, we can still compare ranks with google, but not for a specific subissue.
- Findings
- See if the news and blog sphere ranks the sources (by frequency of mentionings) in the same way as google. Is google following what the news and blog sphere says?
Received critique
- Q: Talking del.icio.us as issue discovery tool skews your results
A: We could have taken any issue discovery tool / method. We just want to use our tools. We actually have two methods: issue discovery / issue ranking (frequency of bookmarks of subissues vs frequency of mentionings of subissues) - Q: Query del.icio.us for issue + subissue, get top 10 of most bookmarked urls, rank them according to nr of times bookmarked. Compare that with the top 10 sources of google
A: good idea, let's see if we have enough time to do it
Results
Issue Discovery
- Delicious results, top 10 on 1/7/7 after leaving out too generic results (like climate)
- carbon (33)
- energy (29)
- gore (21)
- co2 (18)
- bush (18)
- diy (16)
- emissions (13)
- efficiency (10)
- sustainability (10)
- pollution (8)
- ice (8)
- technorati charts
- note on tool: we want to be able to enter 10 subissues and 1 main issue
| technorati rank | delicious rank | issue | chart in technorati of last 365 days |
| "global warming" | |
||
| 1 | 3 | "global warming" + gore | |
| 2 | 2 | "global warming" + energy | |
| 3 | 7 | "global warming" + emissions | |
| 4 | 11 | "global warming" + ice | |
| 5 | 1 | "global warming" + carbon | |
| 6 | 5 | "global warming" + bush | |
| 7 | 10 | "global warming" + pollution | |
| 8 | 4 | "global warming" + co2 | |
| 9 | 8 | "global warming" + efficiency | |
| 10 | 9 | "global warming" + sustainability | |
| 11 | 6 | "global warming" + diy | |
Rank of sources in different devices
- google
- results (1/7/7, default settings):
- google news
- query 'issue + subissue + url'
- get nr of results
- results for us news, default settings, scrape on 050707 (1 months news), all (sub)issues + all sources for those issues.
- preliminary findings:
- Only a small part of the sources is mentioned in the news from the past 3 months.
- Only 2 images are found for all (120) queries
- technorati
- query 'issue + subissue + url'
- get nr of results
- source_distance_exercise_wg1_technorati_results.xls: Results of technorati scrape on 05-07-07, with default settings (but further specified for authority)
This file contains the results of the technorati scrape. Each source has been queried in Technorati. Then the source was queried in combination with the issue and the subissue. The percentage of blogposts that reference the source in combination with the issue and subissue is also depicted. The queries have all been done for blogs with any authority, blogs with a little authority, blogs with some authority, and blogs with a lot of authority. - preliminary findings (didn't have time to actually look at it yet, but ...)
- wikipedia is popular
- gore is mentioned a lot in combination with his site
- compare google rank with ranking of nr of mentionings in blog and news sphere (todo)
Todo
- look of what kind (gov, movie, ...) the few sites mentioned in the news are. Take care to note that googlenews doesn't find hyper links but only text - so only if the source was written in plain text or as anchor text like "gore's site is climatecrisis.net"
- look of what kind (gov, person, encyclopedia, ... ) the few sites mentioned in the blogs are. Technorati does find hyperlinks, in contrast with news.google.com
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | Global warming - Wikipedia, the free encyclopedia | http://en.wikipedia.org/wiki/Global_warming | |
| 2 | 1 | Global Warming | http://www.globalwarming.org/ | |
| 3 | 4 | US EPA - Global Warming Site | http://www.epa.gov/climatechange/ | |
| 4 | 4 | US EPA - Global Warming Site | http://epa.gov/climatechange/ | |
| 5 | 0 | Global Warming: Early Warning Signs | http://www.climatehotmap.org/ | |
| 6 | 0 | Global Warming International Center - Home | http://globalwarming.net/ | |
| 7 | 0 | NRDC: Global Warming | http://www.nrdc.org/globalwarming/ | |
| 8 | 0 | Global Warming- Science - The New York Times | http://topics.nytimes.com/top/news/science/topics/globalwarming/index.html?inline=nyt-classifier | |
| 9 | 0 | Global warming, photography, pictures, photos, climate change ... | http://www.worldviewofglobalwarming.org/ | |
| 10 | 0 | global warming update | http://www.ncdc.noaa.gov/ol/climate/globalwarming.html |
| google rank | # blogposts | # news articles | page title | url | |
| 1 | 0 | Global Warming and Clean Energy Main - Sierra Club | http://www.sierraclub.org/globalwarming/ | ||
| 2 | 0 | Smart Energy Solutions Sierra Club | http://www.sierraclub.org/energy/ | ||
| 3 | 0 | Global Warming and Energy | Greenpeace USA | http://www.greenpeace.org/usa/campaigns/global-warming-and-energy | |
| 4 | 0 | n/a | /url?q=http://www.youtube.com/watch%3Fv%3D7sGKvDNdJNA&sa=X&oi=video_result&resnum=4&ct=thumbnail&usg=AFQjCNGYwNpUB7QMKb1hd3lCifW8U74NnQ | ||
| 5 | 0 | Union of Concerned Scientists | http://www.ucsusa.org/ | ||
| 6 | 0 | Worry About: Energy & Global Warming | http://www.working-minds.com/energy.htm | ||
| 7 | 0 | Global Warming - Global Warming Articles, Climate Change ... | http://www.bestglobalwarmingarticles.com/ | ||
| 8 | 0 | Climate change - co2 emissions & global warming - Energy Saving Trust | http://www.energysavingtrust.org.uk/your_impact_on_climate_change | ||
| 9 | 0 | Climate Ark: Climate Change and Global Warming Portal | http://www.climateark.org/ | ||
| 10 | 0 | Diet, Energy, and Global Warming | http://geosci.uchicago.edu/~gidon/papers/nutri/nutriEI.pdf |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 3 | An Inconvenient Truth | http://www.climatecrisis.net/ | |
| 2 | 0 | NPR : Al Gore Screens His Global Warming Message | http://www.npr.org/templates/story/story.php?storyId=5439305 | |
| 3 | 0 | NPR : Al Gore Sounds Global Warming Alert | http://www.npr.org/templates/story/story.php?storyId=5441976 | |
| 4 | 0 | Does Gore overheat global warming? csmonitor.com | http://www.csmonitor.com/2006/0608/p14s02-sten.html | |
| 5 | 0 | On Katrina, Global Warming | http://www.commondreams.org/views05/0912-32.htm | |
| 6 | 0 | The Seattle Times: Nation & World: The truth about global warming | http://seattletimes.nwsource.com/html/nationworld/2002549346_globewarm11.html | |
| 7 | 0 | Al Gore, Sundance's Leading Man - washingtonpost.com | http://www.washingtonpost.com/wp-dyn/content/article/2006/01/25/AR2006012502230.html | |
| 8 | 0 | FOXNews.com - Gore's Global Warming Film Gets Rave Reviews From ... | http://www.foxnews.com/story/0,2933,201208,00.html | |
| 9 | 0 | Scientists respond to Gore's warnings of climate catastrophe | http://www.canadafreepress.com/2006/harris061206.htm | |
| 10 | 0 | ABC and Al Gore: A Global Warming Love Story? | http://www.cato.org/dailys/6-08-98.html |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | The Rise of CO2 & Warming | http://earthguide.ucsd.edu/globalchange/global_warming/03.html | |
| 2 | 0 | Environmental Effects of Increased Atmospheric Carbon Dioxide ... | http://www.oism.org/pproject/s33p36.htm | |
| 3 | 8 | CO2 Science | http://www.co2science.org/ | |
| 4 | 0 | Global Warming - science | http://www.uic.com.au/nip24.htm | |
| 5 | 0 | NCDC: Global Warming | http://lwf.ncdc.noaa.gov/oa/climate/globalwarming.html | |
| 6 | 0 | Global warming, photography, pictures, photos, climate change ... | http://www.worldviewofglobalwarming.org/ | |
| 7 | 0 | Carbon-Cycle Modeling | http://www.llnl.gov/str/Duffy.html | |
| 8 | 0 | Terra Pass? Prevent global warming, reduce carbon dioxide ... | http://www.terrapass.com/ | |
| 9 | 0 | Global Warming CO2 Curbs Could Cripple Airline Industry and Cost ... | http://newsbusters.org/node/13281 | |
| 10 | 0 | Competitive Enterprise Institute | http://streams.cei.org/ |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | Will Ferrell - Bush on Global Warming@ Transbuddha | http://www.transbuddha.com/mediaHolder.php?id=1147 | |
| 2 | 0 | CNN.com In-Depth Specials - Global Warming: U.S. turns its back on ... | http://www.cnn.com/SPECIALS/2001/globalwarming/ | |
| 3 | 0 | NASA scientist rips Bush on global warming - Environment - MSNBC.com | http://www.msnbc.msn.com/id/6341451/ | |
| 4 | 0 | Now the Pentagon tells Bush: climate change will destroy us ... | http://observer.guardian.co.uk/international/story/0,6903,1153513,00.html | |
| 5 | 0 | President Bush Discusses Global Climate Change | http://www.whitehouse.gov/news/releases/2001/06/20010611-2.html | |
| 6 | 0 | Bush Disses Global Warming Report, Dismisses His Own Environmental ... | http://www.cbsnews.com/stories/2002/06/03/tech/main510920.shtml | |
| 7 | 0 | Administration Shifts on Global Warming (washingtonpost.com) | http://www.washingtonpost.com/wp-dyn/articles/A37232-2004Aug26.html | |
| 8 | 0 | Bush: Global warming is just hot air - Salon | http://www.salon.com/tech/feature/2004/09/10/bush/ | |
| 9 | 0 | Bush: Global warming is just hot air - Salon | http://www.salon.com/tech/feature/2004/09/10/bush/index_np.html | |
| 10 | 0 | Global Warming Bush - How to Call His Bluff | http://www.truthout.org/docs_2006/060507J.shtml |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global Warming | http://www.tiempocyberclimate.org/portal/archive/diy/diy.htm | |
| 2 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... | http://www.tiempocyberclimate.org/portal/archive/diy/whatis.htm | |
| 3 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... | http://www.tiempocyberclimate.org/portal/archive/diy/time.htm | |
| 4 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... | http://www.tiempocyberclimate.org/portal/archive/diy/whatare.htm | |
| 5 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... | http://www.tiempocyberclimate.org/portal/archive/diy/trees.htm | |
| 6 | 0 | Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... | http://www.tiempocyberclimate.org/portal/archive/diy/wider.htm | |
| 7 | 0 | Science Museum Saving the planet: a DIY guide Saving the ... | http://www.sciencemuseum.org.uk/antenna/climatechange/ | |
| 8 | 0 | Slash greenhouse emissions yourself - the DIY answer to global ... | http://www.mitra.biz/blog/archives/2005/06/slash_greenhous.html | |
| 9 | 0 | Top Ten Tips to Fight Global Warming » Netscape.com | http://diy.netscape.com/story/2007/06/25/top-ten-tips-to-fight-global-warming | |
| 10 | 0 | Global warming will increase world death rate » Netscape.com | http://diy.netscape.com/story/2007/06/27/global-warming-will-increase-world-death-rate |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | NRDC: Global Warming Basics | http://www.nrdc.org/globalWarming/f101.asp | |
| 2 | 0 | NRDC: The Consequences of Global Warming | http://www.nrdc.org/globalWarming/fcons.asp | |
| 3 | 0 | Global warming - Wikipedia, the free encyclopedia | http://en.wikipedia.org/wiki/Global_warming | |
| 4 | 0 | Best global warming, emissions, and climate change websites | http://www.care2.com/channels/ecoinfo/global_warming | |
| 5 | 0 | Global Warming Basics: The Pew Center on Global Climate Change | http://pewclimate.org/global-warming-basics | |
| 6 | 4 | US EPA - Global Warming Site | http://www.epa.gov/climatechange/ | |
| 7 | 4 | US EPA - Global Warming Site | http://epa.gov/climatechange/ | |
| 8 | 0 | Global Warming - science | http://www.uic.com.au/nip24.htm | |
| 9 | 3 | Terra Pass? Prevent global warming, reduce carbon dioxide ... | http://www.terrapass.com/ | |
| 10 | 0 | CA Global Warming Impacts | http://www.ucsusa.org/clean_california/ca-global-warming-impacts.html |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | NRDC: Global Warming Basics | http://www.nrdc.org/globalWarming/f101.asp | |
| 2 | 0 | Global Climate Change and Its Impact on Minnesota - Minnesota ... | http://www.pca.state.mn.us/hot/globalwarming.html | |
| 3 | 0 | CNN.com - Nature - Report strengthens link between pollution ... | http://archives.cnn.com/2000/NATURE/10/27/earth.matters/ | |
| 4 | 0 | CNN.com - Nature - Pollution adding to severe global warming ... | http://www.cnn.com/2000/NATURE/10/25/global.warming.ap/ | |
| 5 | 0 | the global warming pollution reduction act | http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=110_cong_bills&docid=f:s309is.txt.pdf | |
| 6 | 0 | BBC NEWS Science/Nature Pollution 'hides' global warming | http://news.bbc.co.uk/1/hi/sci/tech/3589662.stm | |
| 7 | 0 | Environmental News - Get the Latest Global Warming and ... | http://www.msnbc.msn.com/id/3032493/ | |
| 8 | 0 | http://Sanders.senate.gov - Technical difficulties. | http://sanders.senate.gov/files/global-warm-facts.cfm | |
| 9 | 0 | Take Action: Tell Congress to get serious about stopping global ... | http://www.nrdconline.org/campaign/nrdcaction_012207 | |
| 10 | 0 | S. 3698 [109th]: Global Warming Pollution Reduction Act (Gov Track? .us) | http://www.govtrack.us/congress/bill.xpd?bill=s109-3698 |
| google rank | # blogposts | # news articles | page title | url |
| 1 | 0 | Global Warming: A Chilling Perspective | http://www.clearlight.com/~mhieb/WVFossils/ice_ages.html | |
| 2 | 0 | Global Warming Heats Up - TIME | http://www.time.com/time/magazine/article/0,9171,1176980,00.html | |
| 3 | 0 | How Global Warming May Cause the Next Ice Age... | http://www.commondreams.org/views04/0130-11.htm | |
| 4 | 0 | Global Warming Approaching Point of No Return, Warns Leading ... | http://www.commondreams.org/headlines05/0123-01.htm | |
| 5 | 0 | Global Warming in Antarctica | http://www.climatehotmap.org/antarctica.html | |
| 6 | 0 | CNN.com - Be worried, be very worried - Mar 26, 2006 | http://www.cnn.com/2006/US/03/26/coverstory/index.html | |
| 7 | 0 | Special Report on Climate Change - New Scientist Environment | http://environment.newscientist.com/channel/earth/climate-change/ | |
| 8 | 0 | Global Warming = Ice Age? Abrupt Climate Change | http://www.21stcenturyradio.com/articles/02/1010140.html | |
| 9 | 0 | NRDC: The Consequences of Global Warming | http://www.nrdc.org/globalWarming/fcons.asp | |
| 10 | 0 | Dry/Ice: Global Warming Revealed | http://www.spiritofmaat.com/announce/ann_dryice.htm |
Cross-Spherical Analyzer
Onderzoek tot nu toe
Allereerst is er onderzocht wat de 10 belangrijkste subissues waren m.b.t global warming. Dit is gedaan door Technorati te scrapen. Hierna is er per subissue gekeken wat volgens Google de 10 belangrijkste links waren. Hierna de vraag hoevaak deze links voor komen in blogposts en nieuwsposts. Belangrijk op te merken is dat Google nieuws geen hyperlinks gebruikt maar alleen tekst. Dit is volgens ons de reden dat heel weinig overeenkomsten te vinden zijn tussen Google's top 10 van links en de gevonden nieuws artikelen. (Scrapen van de blogposts op de to do list.) Het webadres moet volledig in het artikel voorkomen wat tevens de reden kan zijn dat er zo weinig artikelen gevonden zijn. Nieuws linkt weinig. Deze bevinding heeft belangrijke implicaties en zou in een nieuwe tool gebruikt moeten worden, willen er conclusies gevonden kunnen worden welke sfeer wie volgt. Wat zeggen de aanwezige links in beide sferen over de organisaties, waarom hebben zij wel deze links? Goede marketing, meer wetenschappellijke artikelen etc.? Tot nu toe is het enige wat we erover kunnen zeggen het volgende: Links naar hosts zijn de enige returns in de nieuwsartikelen. Deep links worden niet gebruikt en komen hierdoor ook niet voor in de ranking. Wat we hard kunnen maken is dat Al Gore nummer 1 op Google Page Rank staat en in 3 artikelen, dus dat zijn link goed vertegenwoordigd is, in vergelijking met de andere links. Te doen In nieuwsartikelen naar global warming zoeken en kijken wat de top 10 aan sources hierbij zijn. Wat wordt er in de blogosphere over vermeld? Ook beide kanten op.Cross-Spherical Analyzer
Deze tool vergelijkt per informatiesfeer voor een bepaalde issue de sources die overeenkomen.- Datum invoer coördineren tussen verschillende tools om niet appels met peren te gaan vergelijken
- Tegelijkertijd beide kanten op analyseren
Tags: , view all tags
| I | Attachment | Action | Size | Date | Who | Comment |
|---|---|---|---|---|---|---|
 xls |
source_distance_exercise_wg1_technorati_results.xls | manage | 142.0 K | 05 Jul 2007 - 21:57 | Unknown User | Results of technorati scrape on 05-07-07 |
Topic revision: r9 - 31 Aug 2007 - 12:03:20 - Erik Borra
Course
Digital Methods
- About
- FAQ
- Course
- Tools
- Projects by Theme
- Research Protocols
- Summer School
- Winter School
- Papers and Publications
- Blog
- Admin
archive climate change skeptics dataset delicious related tags geo-location google image scraper google news scraper google scraper hyperlink hyves brands iraq israel issue animals issuecrawler issuegeographer link ripper localising hyves no follow pagerank palestine politicians hyves robot exclusion policy scrape source distance tag tag cloud generator technorati scraper thread wayback machine webantenne wikiscanner