Mining Data from the Congressional Record

We propose a data storage and analysis method for using the US Congressional record as a policy analysis tool. We use Amazon Web Services and the Solr search engine to store and process Congressional record data from 1789 to the present, and then query Solr to find how frequently language related to...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Ma, Zhengyu, Qi, Tianjiao, Route, James, Ziai, Amir
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 03.06.2019
Subjects
Data analysis
Data storage
Indicators
Policy analysis
Query languages
Search engines
Web services
Online AccessGet full text

Cover

More Information
Summary:We propose a data storage and analysis method for using the US Congressional record as a policy analysis tool. We use Amazon Web Services and the Solr search engine to store and process Congressional record data from 1789 to the present, and then query Solr to find how frequently language related to tax increases and decreases appears. This frequency data is compared to six economic indicators. Our preliminary results indicate potential relationships between incidence of tax discussion and multiple indicators. We present our data storage and analysis procedures, as well as results from comparisons to all six indicators.
ISSN:2331-8422