Do online readiness surveys do what they claim? Validity, reliability, and subsequent student enrollment decisions

Citation metadata

Date: July 2016
From: Computers & Education(Vol. 98)
Publisher: Elsevier B.V.
Document Type: Author abstract; Report
Length: 315 words

Document controls

Main content

Abstract :

To link to full-text access for this article, visit this link: Byline: Claire Wladis, Jason Samuels Abstract: Online readiness surveys are commonly administered to students who wish to enroll in online courses in college. However, there have been no well-controlled studies to confirm whether these instruments predict online outcomes specifically (as opposed to predicting course outcomes more generally). This study used a sample of 24,006 students to test the validity and reliability of an online readiness survey similar to those used in practice at a majority of U.S. colleges. Multilevel models were used to determine if it was a valid predictor of differential online versus face-to-face course outcomes while controlling for unobserved heterogeneity among courses taken by the same student. Student self-selection into online courses was also controlled using student-level covariates. The study also tested the extent to which survey score correlated with subsequent decisions to enroll in an online course. No aspect of the survey was a significant predictor of differential online versus face-to-face performance. In fact, student characteristics commonly collected by institutional research departments were better predictors of differential online versus face-to-face course outcomes than the survey. Furthermore, survey score was inversely related to subsequent online enrollment rates, suggesting that the use of online readiness surveys may discourage some students from enrolling in online courses even when they are not at elevated risk online. This suggests that institutions should be extremely cautious about implementing online readiness surveys before they have been rigorously tested for validity in predicting differential online versus face-to-face outcomes. Author Affiliation: (a) Borough of Manhattan Community College at the City University of New York, Mathematics Dept., 199 Chambers St., New York, NY 10007, USA (b) The Graduate Center at the City University of New York, Urban Education, 365 Fifth Avenue, New York, NY 10016, USA Article History: Received 29 June 2015; Revised 27 February 2016; Accepted 1 March 2016

Source Citation

Source Citation   

Gale Document Number: GALE|A471230210