Group 1

Team

  • Erik, Carolien, Marijn

Steps

  • Issue Discovery

  • Source Distances
    • query issues and subissues in google, get top 10 results (= rank sources for (sub)issue)
    • query each of the (sub)issues in combination with those sources the blog and the news sphere
    • compare google rank with frequency of mentionings in news and blog sphere

  • Probs:
    • it is not possible to search for a link (source) and a keyword in any of technorati, blogpulse, and news.google.com
    • only if the full link is written as text in the article the search engine will find it
    • in Technorati and Blogpulse however, it is possible to search only for links. This changes the research question somewhat. We now cannot look for (sub)issues in combination with a link. We can however see how many times a url was linked to from the blogosphere. Thus, we can still compare ranks with google, but not for a specific subissue.

  • Findings
    • See if the news and blog sphere ranks the sources (by frequency of mentionings) in the same way as google. Is google following what the news and blog sphere says?

Received critique

  • Q: Talking del.icio.us as issue discovery tool skews your results
    A: We could have taken any issue discovery tool / method. We just want to use our tools. We actually have two methods: issue discovery / issue ranking (frequency of bookmarks of subissues vs frequency of mentionings of subissues)
  • Q: Query del.icio.us for issue + subissue, get top 10 of most bookmarked urls, rank them according to nr of times bookmarked. Compare that with the top 10 sources of google
    A: good idea, let's see if we have enough time to do it smile

Results

Issue Discovery

  • Delicious results, top 10 on 1/7/7 after leaving out too generic results (like climate)
    • carbon (33)
    • energy (29)
    • gore (21)
    • co2 (18)
    • bush (18)
    • diy (16)
    • emissions (13)
    • efficiency (10)
    • sustainability (10)
    • pollution (8)
    • ice (8)
  • technorati charts
    • note on tool: we want to be able to enter 10 subissues and 1 main issue

Rank of (sub) issues in del.icio.us and technorati

technorati rank delicious rank issue chart in technorati of last 365 days
    "global warming"
1 3 "global warming" + gore
2 2 "global warming" + energy
3 7 "global warming" + emissions
4 11 "global warming" + ice
5 1 "global warming" + carbon
6 5 "global warming" + bush
7 10 "global warming" + pollution
8 4 "global warming" + co2
9 8 "global warming" + efficiency
10 9 "global warming" + sustainability
11 6 "global warming" + diy

Rank of sources in different devices

  • google
  • google news
    • query 'issue + subissue + url'
    • get nr of results
    • results for us news, default settings, scrape on 050707 (1 months news), all (sub)issues + all sources for those issues.
    • preliminary findings:
      • Only a small part of the sources is mentioned in the news from the past 3 months.
      • Only 2 images are found for all (120) queries
  • technorati
    • query 'issue + subissue + url'
    • get nr of results
    • source_distance_exercise_wg1_technorati_results.xls: Results of technorati scrape on 05-07-07, with default settings (but further specified for authority)
      This file contains the results of the technorati scrape. Each source has been queried in Technorati. Then the source was queried in combination with the issue and the subissue. The percentage of blogposts that reference the source in combination with the issue and subissue is also depicted. The queries have all been done for blogs with any authority, blogs with a little authority, blogs with some authority, and blogs with a lot of authority.
    • preliminary findings (didn't have time to actually look at it yet, but ...)
      • wikipedia is popular
      • gore is mentioned a lot in combination with his site
  • compare google rank with ranking of nr of mentionings in blog and news sphere (todo)

Todo

  • look of what kind (gov, movie, ...) the few sites mentioned in the news are. Take care to note that googlenews doesn't find hyper links but only text - so only if the source was written in plain text or as anchor text like "gore's site is climatecrisis.net"
  • look of what kind (gov, person, encyclopedia, ... ) the few sites mentioned in the blogs are. Technorati does find hyperlinks, in contrast with news.google.com

"global warming"
google rank # blogposts # news articles page title url
1   0 Global warming - Wikipedia, the free encyclopedia http://en.wikipedia.org/wiki/Global_warming
2   1 Global Warming http://www.globalwarming.org/
3   4 US EPA - Global Warming Site http://www.epa.gov/climatechange/
4   4 US EPA - Global Warming Site http://epa.gov/climatechange/
5   0 Global Warming: Early Warning Signs http://www.climatehotmap.org/
6   0 Global Warming International Center - Home http://globalwarming.net/
7   0 NRDC: Global Warming http://www.nrdc.org/globalwarming/
8   0 Global Warming- Science - The New York Times http://topics.nytimes.com/top/news/science/topics/globalwarming/index.html?inline=nyt-classifier
9   0 Global warming, photography, pictures, photos, climate change ... http://www.worldviewofglobalwarming.org/
10   0 global warming update http://www.ncdc.noaa.gov/ol/climate/globalwarming.html

"global warming" + carbon
google rank # blogposts # news articles page title url
1   0 Global Warming- Introduction http://www.clearlight.com/~mhieb/WVFossils/global_warming.html
2   0 Global Warming- Introduction http://www.geocraft.com/WVFossils/global_warming.html
3   0 The EPA Global Warming Kids Page--Carbon Cycle Animation http://epa.gov/climatechange/kids/carbon_cycle_version2.html
4   0 Environmental Effects of Increased Atmospheric Carbon Dioxide ... http://www.oism.org/pproject/s33p36.htm
5   0 How carbon causes global warming Focus The Observer http://observer.guardian.co.uk/focus/story/0,6903,1509762,00.html
6   0 NCDC: Global Warming http://lwf.ncdc.noaa.gov/oa/climate/globalwarming.html
7   0 ScienceDaily: Cold Storage Solution For Global Warming? Carbon ... http://www.sciencedaily.com/releases/2007/02/070207090926.htm
8   0 Center for the Study of Carbon Dioxide and Global Change http://www.co2science.org/
9   0 global warming - briefing document http://www.abelard.org/briefings/global_warming.htm
10   0 Global Warming - Carbon Dioxide - Environment - Climate Change ... http://www.nytimes.com/2007/04/29/weekinreview/29revkin.html?ex=1335499200&en=5b39c8411640c2cd&ei=5088&partner=rssnyt&emc=rss

"global warming" + energy
google rank # blogposts # news articles page title url
1   0 Global Warming and Clean Energy Main - Sierra Club http://www.sierraclub.org/globalwarming/
2   0 Smart Energy Solutions Sierra Club http://www.sierraclub.org/energy/
3   0 Global Warming and Energy Greenpeace USA http://www.greenpeace.org/usa/campaigns/global-warming-and-energy
4   0 n/a /url?q=http://www.youtube.com/watch%3Fv%3D7sGKvDNdJNA&sa=X&oi=video_result&resnum=4&ct=thumbnail&usg=AFQjCNGYwNpUB7QMKb1hd3lCifW8U74NnQ
5   0 Union of Concerned Scientists http://www.ucsusa.org/
6   0 Worry About: Energy & Global Warming http://www.working-minds.com/energy.htm
7   0 Global Warming - Global Warming Articles, Climate Change ... http://www.bestglobalwarmingarticles.com/
8   0 Climate change - co2 emissions & global warming - Energy Saving Trust http://www.energysavingtrust.org.uk/your_impact_on_climate_change
9   0 Climate Ark: Climate Change and Global Warming Portal http://www.climateark.org/
10   0 Diet, Energy, and Global Warming http://geosci.uchicago.edu/~gidon/papers/nutri/nutriEI.pdf

"global warming" + gore
google rank # blogposts # news articles page title url
1   3 An Inconvenient Truth http://www.climatecrisis.net/
2   0 NPR : Al Gore Screens His Global Warming Message http://www.npr.org/templates/story/story.php?storyId=5439305
3   0 NPR : Al Gore Sounds Global Warming Alert http://www.npr.org/templates/story/story.php?storyId=5441976
4   0 Does Gore overheat global warming? csmonitor.com http://www.csmonitor.com/2006/0608/p14s02-sten.html
5   0 On Katrina, Global Warming http://www.commondreams.org/views05/0912-32.htm
6   0 The Seattle Times: Nation & World: The truth about global warming http://seattletimes.nwsource.com/html/nationworld/2002549346_globewarm11.html
7   0 Al Gore, Sundance's Leading Man - washingtonpost.com http://www.washingtonpost.com/wp-dyn/content/article/2006/01/25/AR2006012502230.html
8   0 FOXNews.com - Gore's Global Warming Film Gets Rave Reviews From ... http://www.foxnews.com/story/0,2933,201208,00.html
9   0 Scientists respond to Gore's warnings of climate catastrophe http://www.canadafreepress.com/2006/harris061206.htm
10   0 ABC and Al Gore: A Global Warming Love Story? http://www.cato.org/dailys/6-08-98.html

"global warming" + co2
google rank # blogposts # news articles page title url
1   0 The Rise of CO2 & Warming http://earthguide.ucsd.edu/globalchange/global_warming/03.html
2   0 Environmental Effects of Increased Atmospheric Carbon Dioxide ... http://www.oism.org/pproject/s33p36.htm
3   8 CO2 Science http://www.co2science.org/
4   0 Global Warming - science http://www.uic.com.au/nip24.htm
5   0 NCDC: Global Warming http://lwf.ncdc.noaa.gov/oa/climate/globalwarming.html
6   0 Global warming, photography, pictures, photos, climate change ... http://www.worldviewofglobalwarming.org/
7   0 Carbon-Cycle Modeling http://www.llnl.gov/str/Duffy.html
8   0 TerraPass Prevent global warming, reduce carbon dioxide ... http://www.terrapass.com/
9   0 Global Warming CO2 Curbs Could Cripple Airline Industry and Cost ... http://newsbusters.org/node/13281
10   0 Competitive Enterprise Institute http://streams.cei.org/

"global warming" + bush
google rank # blogposts # news articles page title url
1   0 Will Ferrell - Bush on Global Warming@ Transbuddha http://www.transbuddha.com/mediaHolder.php?id=1147
2   0 CNN.com In-Depth Specials - Global Warming: U.S. turns its back on ... http://www.cnn.com/SPECIALS/2001/globalwarming/
3   0 NASA scientist rips Bush on global warming - Environment - MSNBC.com http://www.msnbc.msn.com/id/6341451/
4   0 Now the Pentagon tells Bush: climate change will destroy us ... http://observer.guardian.co.uk/international/story/0,6903,1153513,00.html
5   0 President Bush Discusses Global Climate Change http://www.whitehouse.gov/news/releases/2001/06/20010611-2.html
6   0 Bush Disses Global Warming Report, Dismisses His Own Environmental ... http://www.cbsnews.com/stories/2002/06/03/tech/main510920.shtml
7   0 Administration Shifts on Global Warming (washingtonpost.com) http://www.washingtonpost.com/wp-dyn/articles/A37232-2004Aug26.html
8   0 Bush: Global warming is just hot air - Salon http://www.salon.com/tech/feature/2004/09/10/bush/
9   0 Bush: Global warming is just hot air - Salon http://www.salon.com/tech/feature/2004/09/10/bush/index_np.html
10   0 Global Warming Bush - How to Call His Bluff http://www.truthout.org/docs_2006/060507J.shtml

"global warming" + diy
google rank # blogposts # news articles page title url
1   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global Warming http://www.tiempocyberclimate.org/portal/archive/diy/diy.htm
2   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... http://www.tiempocyberclimate.org/portal/archive/diy/whatis.htm
3   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... http://www.tiempocyberclimate.org/portal/archive/diy/time.htm
4   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... http://www.tiempocyberclimate.org/portal/archive/diy/whatare.htm
5   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... http://www.tiempocyberclimate.org/portal/archive/diy/trees.htm
6   0 Tiempo Climate Cyberlibrary, The DIY Guide to Combating Global ... http://www.tiempocyberclimate.org/portal/archive/diy/wider.htm
7   0 Science Museum Saving the planet: a DIY guide Saving the ... http://www.sciencemuseum.org.uk/antenna/climatechange/
8   0 Slash greenhouse emissions yourself - the DIY answer to global ... http://www.mitra.biz/blog/archives/2005/06/slash_greenhous.html
9   0 Top Ten Tips to Fight Global Warming » Netscape.com http://diy.netscape.com/story/2007/06/25/top-ten-tips-to-fight-global-warming
10   0 Global warming will increase world death rate » Netscape.com http://diy.netscape.com/story/2007/06/27/global-warming-will-increase-world-death-rate

"global warming" + emissions
google rank # blogposts # news articles page title url
1   0 NRDC: Global Warming Basics http://www.nrdc.org/globalWarming/f101.asp
2   0 NRDC: The Consequences of Global Warming http://www.nrdc.org/globalWarming/fcons.asp
3   0 Global warming - Wikipedia, the free encyclopedia http://en.wikipedia.org/wiki/Global_warming
4   0 Best global warming, emissions, and climate change websites http://www.care2.com/channels/ecoinfo/global_warming
5   0 Global Warming Basics: The Pew Center on Global Climate Change http://pewclimate.org/global-warming-basics
6   4 US EPA - Global Warming Site http://www.epa.gov/climatechange/
7   4 US EPA - Global Warming Site http://epa.gov/climatechange/
8   0 Global Warming - science http://www.uic.com.au/nip24.htm
9   3 TerraPass Prevent global warming, reduce carbon dioxide ... http://www.terrapass.com/
10   0 CA Global Warming Impacts http://www.ucsusa.org/clean_california/ca-global-warming-impacts.html

"global warming" + efficiency
google rank # blogposts # news articles page title url
1   0 Energy Efficiency: No Silver Bullet for Global Warming http://www.cato.org/pubs/pas/pa-356es.html
2   0 Energy Efficiency: No Silver Bullet for Global Warming http://www.cato.org/pubs/pas/pa356.pdf
3   0 Climate change - co2 emissions & global warming - Energy Saving Trust http://www.energysavingtrust.org.uk/your_impact_on_climate_change
4   0 NET.org >> Fuel Efficiency and Global Warming http://www.net.org/fuel_economy/
5   0 NET.org >> Global Warming Solutions and Policies http://www.net.org/proactive/newsroom/release.vtml?id=29229
6   0 Climate Ark: Climate Change and Global Warming Portal http://www.climateark.org/
7   0 Plant Enzyme Efficiency May Hold Key To Global Warming http://www.terradaily.com/reports/Plant_Enzyme_Efficiency_May_Hold_Key_To_Global_Warming.html
8   0 Solutions Greenpeace International http://www.greenpeace.org/international/solargen/climate-solutions
9   0 Cars and Trucks and Global Warming http://www.ucsusa.org/clean_vehicles/vehicles_health/cars-and-trucks-and-global-warming.html
10   0 What You Can Do about Global Warming http://www.ucsusa.org/global_warming/solutions/what-you-can-do-about-global-warming.html

"global warming" + sustainability
google rank # blogposts # news articles page title url
1   0 Environmental Economics: Global Warming and Sustainability http://www.env-econ.net/2006/08/global_warming_.html
2   0 Sustainability - Global Warming http://sustainability.wollongong.nsw.gov.au/global%20warming.htm
3   0 Global Warming, Air Quality, Climate Change, Ozone, Weather http://www.ace.mmu.ac.uk/eae/
4   0 Thanksgiving Coffee Company - Environmental Sustainability ... http://www.thanksgivingcoffee.com/justcup/environsustain/globalwarming.lasso
5   0 Climate Change http://www.portlandonline.com/osd/index.cfm?c=ebijg
6   0 EurActiv.com - Scientists fear global warming higher than expected ... http://www.euractiv.com/en/sustainability/scientists-fear-global-warming-higher-expected/article-146995
7   0 Open Directory - Science: Environment: Sustainability http://dmoz.org/Science/Environment/Sustainability/
8   0 Global Warming Footprints http://www.sustainableinnovation.org/global-warming-footprints.html
9   0 Environment - Global Warming & Sustainability LiveScience http://www.livescience.com/environment/
10   0 wheaton march version http://www.jri.org.uk/brief/Briefing14_print.pdf

"global warming" + pollution
google rank # blogposts # news articles page title url
1   0 NRDC: Global Warming Basics http://www.nrdc.org/globalWarming/f101.asp
2   0 Global Climate Change and Its Impact on Minnesota - Minnesota ... http://www.pca.state.mn.us/hot/globalwarming.html
3   0 CNN.com - Nature - Report strengthens link between pollution ... http://archives.cnn.com/2000/NATURE/10/27/earth.matters/
4   0 CNN.com - Nature - Pollution adding to severe global warming ... http://www.cnn.com/2000/NATURE/10/25/global.warming.ap/
5   0 the global warming pollution reduction act http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=110_cong_bills&docid=f:s309is.txt.pdf
6   0 BBC NEWS Science/Nature Pollution 'hides' global warming http://news.bbc.co.uk/1/hi/sci/tech/3589662.stm
7   0 Environmental News - Get the Latest Global Warming and ... http://www.msnbc.msn.com/id/3032493/
8   0 http://Sanders.senate.gov - Technical difficulties. http://sanders.senate.gov/files/global-warm-facts.cfm
9   0 Take Action: Tell Congress to get serious about stopping global ... http://www.nrdconline.org/campaign/nrdcaction_012207
10   0 S. 3698 [109th]: Global Warming Pollution Reduction Act (GovTrack.us) http://www.govtrack.us/congress/bill.xpd?bill=s109-3698

"global warming" + ice
google rank # blogposts # news articles page title url
1   0 Global Warming: A Chilling Perspective http://www.clearlight.com/~mhieb/WVFossils/ice_ages.html
2   0 Global Warming Heats Up - TIME http://www.time.com/time/magazine/article/0,9171,1176980,00.html
3   0 How Global Warming May Cause the Next Ice Age... http://www.commondreams.org/views04/0130-11.htm
4   0 Global Warming Approaching Point of No Return, Warns Leading ... http://www.commondreams.org/headlines05/0123-01.htm
5   0 Global Warming in Antarctica http://www.climatehotmap.org/antarctica.html
6   0 CNN.com - Be worried, be very worried - Mar 26, 2006 http://www.cnn.com/2006/US/03/26/coverstory/index.html
7   0 Special Report on Climate Change - New Scientist Environment http://environment.newscientist.com/channel/earth/climate-change/
8   0 Global Warming = Ice Age? Abrupt Climate Change http://www.21stcenturyradio.com/articles/02/1010140.html
9   0 NRDC: The Consequences of Global Warming http://www.nrdc.org/globalWarming/fcons.asp
10   0 Dry/Ice: Global Warming Revealed http://www.spiritofmaat.com/announce/ann_dryice.htm

Cross-Spherical Analyzer

Onderzoek tot nu toe

Allereerst is er onderzocht wat de 10 belangrijkste subissues waren m.b.t global warming. Dit is gedaan door Technorati te scrapen. Hierna is er per subissue gekeken wat volgens Google de 10 belangrijkste links waren. Hierna de vraag hoevaak deze links voor komen in blogposts en nieuwsposts.

Belangrijk op te merken is dat Google nieuws geen hyperlinks gebruikt maar alleen tekst. Dit is volgens ons de reden dat heel weinig overeenkomsten te vinden zijn tussen Google's top 10 van links en de gevonden nieuws artikelen. (Scrapen van de blogposts op de to do list.) Het webadres moet volledig in het artikel voorkomen wat tevens de reden kan zijn dat er zo weinig artikelen gevonden zijn.

Nieuws linkt weinig. Deze bevinding heeft belangrijke implicaties en zou in een nieuwe tool gebruikt moeten worden, willen er conclusies gevonden kunnen worden welke sfeer wie volgt.

Wat zeggen de aanwezige links in beide sferen over de organisaties, waarom hebben zij wel deze links? Goede marketing, meer wetenschappellijke artikelen etc.? Tot nu toe is het enige wat we erover kunnen zeggen het volgende: Links naar hosts zijn de enige returns in de nieuwsartikelen. Deep links worden niet gebruikt en komen hierdoor ook niet voor in de ranking. Wat we hard kunnen maken is dat Al Gore nummer 1 op Google Page Rank staat en in 3 artikelen, dus dat zijn link goed vertegenwoordigd is, in vergelijking met de andere links.

Te doen

In nieuwsartikelen naar global warming zoeken en kijken wat de top 10 aan sources hierbij zijn. Wat wordt er in de blogosphere over vermeld? Ook beide kanten op.

Cross-Spherical Analyzer

Deze tool vergelijkt per informatiesfeer voor een bepaalde issue de sources die overeenkomen.

  • Datum invoer coördineren tussen verschillende tools om niet appels met peren te gaan vergelijken
  • Tegelijkertijd beide kanten op analyseren


Tags:
delicious related tags1Add my vote for this tag google news scraper1Add my vote for this tag google scraper1Add my vote for this tag pagerank1Add my vote for this tag technorati scraper1Add my vote for this tag create new tag
, view all tags
Topic attachments
I Attachment Action Size Date Who CommentSorted ascending
source_distance_exercise_wg1_technorati_results.xlsxls source_distance_exercise_wg1_technorati_results.xls manage 142 K 05 Jul 2007 - 21:57 ErikBorra Results of technorati scrape on 05-07-07
Topic revision: r9 - 31 Aug 2007, ErikBorra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback