Comparison and AI-based prediction of graph comprehension skills based on the visual strategies of first-year physics and medicine students

Abstract

Graphical representations of data are common in many disciplines. Previous research has found that physics students appear to have better graph comprehension skills than students from social science disciplines, regardless of the task context. However, the graph comprehension skills of physics students have not yet been compared with (veterinary) medicine students, both of which are disciplines that require multiple science, technology, engineering, and mathematics (STEM) courses. This study extends previous research on this subject by exploring whether physics majors possess superior graph comprehension skills due to their study discipline. Here, participants solved 24 graph comprehension tasks across various subjects, including mathematics, physics, and medicine; these tests were conducted at the beginning and end of their first semester. Graph comprehension gain was calculated based on the percentage of correct and incorrect answers in the pretest and the post-test. In addition to these comparisons, we replicated previous research that successfully distinguished correct and incorrect solvers based on their visual behavior by using a novel machine-learning method tailored to small datasets. Through this replication of statistical analyses, we aim to ensure the reliability of adaptive learning systems in the future, regardless of data size, using the same machine-learning method. Physics and medical students were found to exhibit relatively similar graph comprehension gain; this is in contrast to previous research comparing physics and non-STEM students. Our results also revealed that both physics and medical students use similar visual strategies to solve these tasks. However, correct and incorrect solvers could be distinguished via machine-learning methods regardless of their discipline. Our research suggests that visual behavior is a good predictor of graph comprehension skills.