DMI Tools

The Actor Profiler works in tandem with the Issue Crawler. It calculates the top ten actors on an Issue Crawler map, and profiles each of them. The profile consists of each actor's inlinks a...

Input tags and values to produce relatively sized bubbles. Output is an svg.

Check whether a URL is censored in a particular country by using proxies located around the world.

Compare two lists of URLs for their commonalities and differences.

Compares Issue Crawler networks over time, and displays ranked actor lists. The over time module is best used in tandem with the Issue Crawler scheduler. The results may be plotted to line g...

Enter a tag and show which other tags are most related to it. Visualized in a tag cloud.

Enter a URL and show which tags are most related to it. Visualized in a tag cloud.

Input tags and values to produce a Dorling Map (i.e. bubbles). Output is an svg.

Expands URLs that have been shortend by tools like tinyurl.com or bit.ly. Often used in social media such as Twitter or Facebook.

Extracts URLs from an Issuecrawler result file (.xml). Useful for retrieving starting points as well as a clean list of the actors in the network.

Translates URLs and/or IPs to geo-location

Batch queries Google Blog Search. Query the resonance of a particular term, or a series of terms, in a set of blogs.

Query images.google.com with one or more keywords, and/or use images.google.com to query specific sites for images.

Scrapes Google News.

Analyzes a results file from the Google Scraper to get unique phrases from the teaser (or lead) text for each google search return.

Batch queries Google. Query the resonance of a particular term, or a series of terms, in a set of Websites.

Extract URLs from text, source code or search engine results. Produces a clean list of URLs.

Scrape images from a single page.

Scrapes links from the Wayback Machine

Enter URLs, and discover the most relevant words and phrases contained in them. One also may enter text, or an Issuecrawler result file (.xml). Based on Yahoo Term Extraction

Enter up to 3 URLs as well as a key word. The Issuedramaturg queries Google for the key word, and shows the Pageranks of the URLs over time. The output is a graph of the Pagerank of the URLs...

Enter URLs. Issuefeed.net summarizes the content of a set of sites as a list of key words.

Geo-locates the organizations on an Issue Crawler map, using whois information, and visualizes the organizations' registered locations on a geographical map.

Extracts the URLs from an Issue Crawler result, and allows the user to query all the URLs or hosts for key words (through Google). It outputs a tag cloud. Good for the analysis of the conten...

Enter URLs and the Issue Crawler performs co-link analysis in one, two or three iterations, and outputs a cluster graph. The Issue Crawler also has modules for snowball crawling (up to 3 deg...

Queries Google for a set of keywords to calculate overlap.

Detects language for given URLs. The first 500 characters on the Web page(s) are extracted, and the language of each page is detected.

Capture all internal links and/or outlinks from a page.

The Lippmannian device is named after Walter Lippmann, and provides a coarse means of showing actor partisanship.

Discovers the most relevant words and phrases among a set of websites, within a text, or within an issue network. Based on Reuters Open Calais.

Discover a website's Google Pagerank in the returned results per issue/query.

Discovers RSS/ATOM/RDF feeds in websites.

Enter an Issuecrawler XML file and this script will get out all pages from the core network and rank those by pages by inlink count.

Takes and counts raw text or a Google Scraper results file and returns an ordered, unordered or alphabetically ordered tagcloud.

Input a text or Google Scraper results file and visualize the word counts in a Tree Map. Output is in svg.

Rip text from a specified page and force line breaks between sentences.

Display a site's robot exclusion policy.

Calculates the log-likelihood ratio of words in two texts.

Building upon Alexa's related sites feature, this tool determines which sites are likely to be in the actual surfer paths of other sites related to the same issue.

Enter URLS, and count the top level domains.

Input tags and values to produce a tag cloud. Output is in html, svg, and pdf.

This tool allows one to transform a normal tag cloud into a fancy Wordle one.

Queries Technorati and charts the resonance among a single actor and any number of related actors.

Rip all non-html (i.e. text) from a specified page.

Rips and displays a web page's last modification date (using the page's HTML header). Beware of dynamically generated pages, where the date stamps will be the time of fetching.

Input tags and values to produce a Tree Map. Output is in svg.

Enter two or more lists of URLs or other items to discover commonalities among them. Possible visualizations include a Venn Diagram.

Scrapes Twitter

Retrieves the edits made by Wikipedia bots

Scrapes Wikipedia history and does IP to Geo for anonymous edits

This tool checks if the issues exist as a Wikipedia page, i.e., an article. If it exists it checks whether the organization is mentioned on that page.

Find a hyperlink network around a Wikipedia topic (see here for more information).

Retrieves all inlinks to a site, according to Yahoo.

Enter the URL for a YouTube movie and retrieve all video responses.

Analyzes a results file from the Google Scraper to discover, count, and rank YouTube and Google Video links in the descriptions. (It may also be used for Ikbis and other video compilati...