Students with Non-Proficient Information Seeking Skills Greatly Over-Estimate Their Abilities. A Review of: Gross, Melissa, and Don Latham.

Abstract

Objective – The objective of this study is an investigation of the relationship between students’ self-assessment of their information literacy skills and their actual skill level, as well as an analysis of whether library anxiety is related to information skill attainment. Design – Quantitative research design (Information Literacy Test (ILT), Library Anxiety Scale (LAS), pre and post surveys).Setting – Florida State University, United States.Subjects – Students, incoming freshmen.Methods – Information literacy skills were measured using the Information Literacy Test (ILT), presenting subjects with 65 multiple choice items designed around four of the five ACRL information literacy standards, in which students were expectedto: 1) determine the nature and extent of the information needed; 2) access needed information effectively and efficiently; 3) evaluate information and its sources critically and incorporates selected information into his/her knowledge base system; 4) understand many of the economic, legal and social issues surrounding the use of information and accesses and uses information ethically and legally. The ILT categorized participant scores as non-proficient(Main Results – The main aim of the study was to test the hypothesis that students who test non-proficient on an information literacy test tend to overestimate their competency to a higher degree than proficient and advanced students. In the pre- and post-surveys, the students were asked to estimate their performance onthe ILT in terms of the expected percentage of questions they would answer correctly, the number of questions they expected to answer correctly, and how their performance on the ILT would compare toothers taking the test (in percentage). The results of the study show that all students overestimate their abilities, both in terms of performance and relative performance, in the pre-survey. The estimated percentage correct answers for the whole group was 75%, but the actual percentage correct was 65%. The estimated score was 50 and the actual 39, and the estimated comparison with their peers was 77% and the actual 53%. All three measures demonstrated a significant difference between estimated and actual values. On the ILT, the mean score for the bottom tier of the students was 34, and the mean score for the top tier was 42, showing a significant difference between the top and bottom tier in a t-test. On the ILT, 23 students scored less than 39 (= nonproficient), 27 scored between 39-53 (proficient). Only one student, a top quartile participant, showed advanced information literacy skills (a score above 53). In the post-survey, the students still over-estimated their performance, but to a lesser degree. All three groups adjusted their self-estimates in the post-survey in response to information skills testing, but the non-proficient group over-estimated their skills to a higher degree, on both pre-and post-surveys. The estimated percentage correct answers for the whole group was69%, but the actual was 65%, the estimated score was 44 and the actual 39, and the estimated comparison with their peers was 70% and the actual 53%. All three measures demonstrated a significant difference. All results show that the original hypothesis holds: non-proficient students over-estimate their abilities to a greater degree, both in terms of score and performance relative totheir peers. The LAS was used to see if there was a relationship between student scores on the ILT and library anxiety. Bi-variate analysis was performed on the ILT scores and student total scores on the LAS, and the results show that library anxiety tended to decrease with higher scores on the ILT. This result was not expected from the theory. In the pre-survey, the students were asked how they had obtained their information literacy skills. The top tier indicated a reliance on more formal sources (e.g. school library media center, classroom, and/or public library), while the bottom tier relied on less formal sources (e.g. friends and self-teaching). This suggested that library instruction was not effective reaching the weakest group of students. In addition, nearly 75% of all participants responded that they were largely self-taught. Conclusions – The results show a difference between the level of information literacy skills between lower-performing and higher-performing freshmen, but the study as a whole gives some evidence that many students could be information illiterate when entering university (45% tested non-proficient). There is an association between scores on an information literacy test and students’ estimates of their information literacy skills. Students who demonstrate low-level skills hold even more inflated views of their abilities, and the very competent may tend to underestimate their performance. However, the limited number of subjects in this study makes further analysis impossible. No correlation was found between performance on the ILT and the experience of library anxiety as measured by the LAS, although the subscale “knowledge of the library” demonstrated a negative relationship with information literacy skills. That is, the higher the score, the less the anxiety.There are several limitations of the study (which the authors acknowledge). One limitation that is important to note the small sample size, which limits the possibility to generalize the findings to the broader population of incoming students. More research is needed on how to best design, market, and deliver information literacy education to students with non-proficient information literacy skills since they seem to be unaware of their deficiencies.