Mining Big Data in Education: Affordances and Challenges

• Published in: Review of research in education Vol. 44; no. 1; pp. 130 - 160
• Main Authors: Fischer, Christian, Pardos, Zachary A., Baker, Ryan Shaun, Williams, Joseph Jay, Smyth, Padhraic, Yu, Renzhe, Slater, Stefan, Baker, Rachel, Warschauer, Mark
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.03.2020
• Subjects: Cognitive Processes; Data Analysis; Data Collection; Decision Making; Grouping (Instructional Purposes); Institutional Characteristics; Instructional Effectiveness; Integrated Learning Systems; Learner Engagement; Online Courses; Privacy; School Effectiveness; Student Behavior; Student Evaluation; Student Writing Models; Thinking Skills
• ISSN: 0091-732X; 1935-1038
• DOI: 10.3102/0091732X20903304

The emergence of big data in educational contexts has led to new data-driven approaches to support informed decision making and efforts to improve educational effectiveness. Digital traces of student behavior promise more scalable and finer-grained understanding and support of learning processes, which were previously too costly to obtain with traditional data sources and methodologies. This synthetic review describes the affordances and applications of microlevel (e.g., clickstream data), mesolevel (e.g., text data), and macrolevel (e.g., institutional data) big data. For instance, clickstream data are often used to operationalize and understand knowledge, cognitive strategies, and behavioral processes in order to personalize and enhance instruction and learning. Corpora of student writing are often analyzed with natural language processing techniques to relate linguistic features to cognitive, social, behavioral, and affective processes. Institutional data are often used to improve student and administrational decision making through course guidance systems and early-warning systems. Furthermore, this chapter outlines current challenges of accessing, analyzing, and using big data. Such challenges include balancing data privacy and protection with data sharing and research, training researchers in educational data science methodologies, and navigating the tensions between explanation and prediction. We argue that addressing these challenges is worthwhile given the potential benefits of mining big data in education.