Novel information discovery for intelligence and counterterrorism

Intelligence analysts construct hypotheses from large volumes of data, but are often limited by social and organizational norms and their own preconceptions and biases. The use of exploratory data-mining technology can mitigate these limitations by requiring fewer assumptions. We present the design of the Athens system, which discovers novel information, relative to a specified set of existing knowledge, in large information repositories such as the world wide web. We illustrate the use of the system by starting from the terms “al Qaeda” and “bin Laden” and running the Athens system as if on September 12th,

• Type: Journal
• Year: 2007
• Where: DSS
• Authors: David B. Skillicorn, Nikhil Vats
• Keywords: DSS 2007, Exploratory Data-mining, Intelligence Analysts, Large Volumes