← Research using Delve

Online Learning · March 2022

Evaluating a Structured Online Peer Evaluation System Among Graduate-Level Communication Capstone Students Through Action Research

Karen L Wilkinson

Southern New Hampshire University

Mixed methodsContent analysisThematic analysis Education

How they used Delve

An education researcher at Southern New Hampshire University uploaded four qualitative data sources from an online graduate capstone course into Delve for structural, descriptive, and pattern coding with analytic memos, then built a second Delve project with seven a priori Community of Inquiry codes to code student posts sentence by sentence and tallied the category counts for the quantitative strand.

“Digital content from the four data sources was uploaded into Delve, an online digital tool for creating projects and coding digital transcripts ("Delve," n.d.). Coding began with Structural Coding to align the segments of data with the study's research questions (Saldaña, 2016).”

Field
Online higher education / peer evaluation
Data
Pre- and post-term questionnaires with open-ended items, observational field notes, 20 to 25 minute semi-structured interviews with graduate capstone students, interview notations, and student discussion post artifacts from weeks four and seven
Approach
Action research with a triangulation mixed-methods design; inductive analysis with structural, descriptive, and pattern coding (Saldaña) plus code mapping, and a separate deductive Community of Inquiry analysis with a priori social and cognitive presence codes tallied sentence by sentence
Data types
Open-ended survey responses, Interviews, Observation, Documents

Abstract

Although enrollment in online courses continues to accelerate, challenges exist in online learning. A failure to experience collaboration and interaction can impact student retention and success. While peer review activity promotes student interaction, a collaborative community of learners, and critical thinking skills, higher education environments have failed to equip students with the knowledge and tools to ensure adept participation. As students offered limited participation and low-quality engagement in routine online peer review activities, the purpose of this action research was to implement and evaluate the impact of a structured online peer evaluation system for Graduate Communication Capstone students at the University of North Coast Muscari (UNCM). This study incorporated a structured peer evaluation system, including an interactive educational technology peer review tool kit innovation. The theoretical framework of the innovation was aligned to learning theory and grounded in Vygotsky’s zone of proximal development, cognitive and mind tools, and Constructivist theory of cognitive apprenticeship. Data collection offered seven methods and data analysis included quantitative and qualitative approaches as part of a triangulation mixed methods design. Community of Inquiry (CoI) deductive analysis was performed to denote social and cognitive presences, while further validating the themes that had emerged through qualitative data analysis. As an impact of this research study, students used the structured peer evaluation system to transform anxiety into social and cognitive freedom, producing a focused, responsible approach to peer learning.

Citation

Karen L Wilkinson (2022). Evaluating a Structured Online Peer Evaluation System Among Graduate-Level Communication Capstone Students Through Action Research. Online Learning. https://doi.org/10.24059/olj.v26i1.3077

Resources

Start your 14 day free trial of Delve