Access: news and blog analysis for the social sciences

The social sciences strive to understand the political, social, and cultural world around us, but have been impaired by limited access to the quantitative data sources enjoyed by the hard sciences. Careful analysis of Web document streams holds enormous potential to solve longstanding problems in a variety of social science disciplines through massive data analysis. This paper introduces the TextMap Access system, which provides ready access to a wealth of interesting statistics on millions of people, places, and things across a number of interesting web corpora. Powered by a flexible and scalable distributed statistics computation framework using Hadoop, continually updated corpora include newspapers, blogs, patent records, legal documents, and scientific abstracts; well over a terabyte of raw text and growing daily. The Lydia Textmap Access system, available through http://www.textmap.com/access, provides instant access for students and scholars through a convenient web user-inter...

• Type: Conference
• Year: 2010
• Where: WWW
• Authors: Mikhail Bautin, Charles B. Ward, Akshay Patil, Steven Skiena
• Keywords: Internet Technology, Social Science Disciplines, Social Sciences, Textmap Access System, WWW 2010