Академический Документы
Профессиональный Документы
Культура Документы
Don Latham is Assistant Professor, College of Information, Florida State University, email: latham@ci.fsu.edu; Melissa
Gross is Associate Professor, College of Information, Florida State University, email: mgross@ci.fsu.edu.
277
278 Don Latham and Melissa Gross
correlation between level of information literacy skills voluntary and had no effect on student grades. As an
and level of library anxiety (Gross 2005). incentive to participate, participants were given a $20
This paper describes a pilot study that measured the gift certificate to the university bookstore. As an added
information literacy skills of incoming college fresh- incentive to try to perform well on the ILT, participants
men, their own self-assessment of their skill level, and were told that those who scored in the top 15 percent
the extent to which they experience library anxiety. Spe- on the ILT would be entered in a lottery to receive one
cifically, it will address: of four additional $50 gift certificates.
1. the relationship between low-level information The ILT, the Library Anxiety Scale, and the two sur-
literacy skills, self-assessments of performance, and li- veys were administered via computer at the university’s
brary anxiety, Academic and Professional Program Services (APPS)
2. the characteristics of students who have low-level Center for Assessment and Testing on campus. Partici-
or high-level skills sets in information literacy, and pants were randomly assigned to comparison groups.
3. the implications of competency theory and library Half of the participants took the ILT before the Library
anxiety theory for information literacy instruction. Anxiety Scale; the other half took the Library Anxiety
Scale before taking the ILT. Both groups completed the
Methodology same short surveys, one survey at the beginning of the
Participants’ information-seeking skills were measured session, the other at the end.
using the Information Literacy Test (ILT) developed at
James Madison University ( JMU n.d.). The ILT mea- Demographics
sures information literacy skills based on the definition Fifty-eight students participated in the study. Seven of
of information literacy developed by the Association of the participants were under the age of 18, so these par-
College and Research Libraries (2000). This assessment ticipants were deleted from the final data analysis, leav-
instrument was chosen because it provides a validated ing a total of 51 participants.
instrument for assessing information literacy skills. Un- Of the 51 participants, 33 (65%) were in the top
like the assessment instrument developed by Project quartile of their class according to admissions data,
SAILS, the ILT provides assessment at the individual while 18 (35%) were in the bottom quartile. There were
level. And, unlike the Educational Testing Service’s 37 (72%) females in the study and 14 (27%) males. For-
ICT Literacy Assessment, the ILT focuses exclusively ty-nine (96%) participants were 18 years old; two (4%)
on information literacy rather than a combination of were 19 years old.
information and computer literacy. In terms of race/ethnicity, 37 (72%) of the partici-
Library anxiety was measured using the Library pants were white, six (12%) were Hispanic, five (10%)
Anxiety Scale developed by Bostick to provide a quan- were black, and one (2%) was Asian, one (2%) was
titative test of Mellon’s (1986) theory of library anxiety multi-race/multi-ethnic, and one (2%) provided no an-
(Bostick 1993). In addition to these two tests, two short swer to the question.
surveys developed by the researchers were used to col- The mean high school GPA of participants in the
lect demographic data, information about how students top quartile was 3.967 while that of participants in the
had developed their information literacy skills, and both bottom quartile was 3.039. The mean ACT (or adjusted
pre-test and post-test data on students’ self-assessments SAT) score for those in the top quartile was 26.94; that
of how they would perform on the ILT. (The two sur- of those in the bottom quartile was 21.39. Overall, the
veys are included in Appendices A and B.) mean high school GPA for all participants was 3.639,
Subjects for the study were recruited from Florida and the mean ACT (or adjusted SAT) score was 24.98.
State University’s incoming freshman class enrolled in
the second six-week summer session of 2006. Specifical- Information Literacy Skills, Library Anxiety, and
ly, students in the top and bottom quartiles (as defined Self-assessments
by a combination of high school grade-point average 4.1 Information literacy skills
and scores on a standardized admissions test—either Students in the top quartile of the entering freshman
the SAT or the ACT) were targeted. The registrar’s of- class performed better on the ILT (their mean score was
fice provided a list of eligible students based on the de- approximately 8 points higher) than their peers in the
fined criteria. Participants were recruited through email bottom quartile. The mean scores by quartile are sum-
solicitations; participation in this research was strictly marized in Table 1.
Table 3: ILT Mean Score Predictions and Mean study, some interesting characteristics emerge, which
Actual Scores by Quartile can provide insights into students with low levels of in-
formation literacy skills.
Quar- Pre-test Post-test Actual
N
tile Prediction Prediction ILT Score
5.1 Information literacy and overall academic skills
Top 33 50.70 45.24 42.15
It might be expected that past academic performance, as
Bottom 18 47.89 41.39 33.94 determined by college-admissions test scores and high
Total 51 49.71 43.88 39.25 school grade point average, would be a positive indica-
tor of performance on a standardized assessment of in-
Similarly, students who scored in the non-proficient formation literacy skills, and, to a degree, that proved to
range tended to overestimate their information literacy be the case in this study. Students with a demonstrated
skill level, more so than their counterparts who scored record of higher academic achievement tended to score
in the proficient range. Both groups predicted higher higher on the assessment than did students with lower
levels of performance, both before and after taking the academic skills levels. Approximately 78 percent of stu-
ILT, than they actually achieved, although both groups dents in the bottom quartile in this study scored in the
adjusted their post-test predictions downward. Table 4 non-proficient range on the ILT, as compared to ap-
summarizes the pre- and post-test predictions by profi- proximately 27 percent of students in the top quartile.
ciency level, along with the actual test scores. However, it should be noted that previous academic
performance—especially for top quartile students—was
Table 4: ILT Mean Score Predictions and Mean not necessarily a predictor of a high level of informa-
Actual Scores by Proficiency Level tion literacy skills. Only one student scored in the ad-
Proficiency Pre-test Post-test Actual vanced range on the ILT, while more than 25 percent of
N the top-quartile students scored in the non-proficient
Level Prediction Prediction ILT Score
Proficient 28 51.11 45.64 44.00
range. Removing the advanced score from the data,
the mean score among the proficient students was only
Non- 43.59. Nineteen (70.3%) of the 27 students who scored
23 48.00 41.74 33.48
proficient
in the proficient range (again, with the advanced score
Total 51 49.71 43.88 39.25 removed) achieved scores between 39 and 45, which es-
sentially can be considered the low proficient range.
Prior to taking the ILT, students in the top quartile The results of this study further suggest that stu-
predicted that they would score, on average, in the 79th dents with lower overall academic performance also
percentile on the test, while students in the bottom quar- tend to overestimate their information literacy skills,
tile predicted that they would score in the 72nd percen- more so than their counterparts with higher overall
tile. After taking the ILT test, both groups of students academic performance. In other words, students with
adjusted their predictions downward by an average of 7 low levels of information literacy skills are unlikely to
to 8 points. Students who scored in the proficient range recognize their deficit.
reported pre-test predictions of scoring in the 82nd per- It should be remembered that all of the students
centile, and post-test predictions of the 77th percentile. who participated in the study had relatively strong aca-
Students who scored in the non-proficient range offered demic credentials, certainly strong enough to gain them
pre-test predictions of scoring in the 71st percentile and entry into a Research I state university with a competi-
post-test predictions of the 62nd percentile. Again the tive admissions process.
predictions were much greater than actual performance.
The mean score for non-proficient students was 33.48, 5.2 Information literacy knowledge
and their mean percentile rank was 15.7. By compari- In the pre-test survey, participants were asked how they
son, the mean score for proficient students was 43.59, had learned what they already knew about information
and their mean percentile rank was 70.6. literacy. Respondents could select all that applied, and
could also stipulate “other” ways they had gained such
5. Student Characteristics and Information Literacy knowledge. The results are summarized in Table 5.
Although the results of this pilot study cannot be gener- Thirty-eight (74.5%) participants indicated that at
alized to students beyond those who participated in the least some of their information literacy knowledge was
would appear to argue for mandatory information liter- ship was seen between information literacy skills and
acy instruction. Future research is needed to determine library anxiety.
the appropriate length and format of such instruction. More research is needed to determine whether
Finally, a much greater proportion of the non-pro- these findings prove to be consistent in larger groups of
ficient students in this study indicated that their infor- incoming college freshmen as well as in other popula-
mation literacy knowledge came from classmates and tions, such as middle school and high school students,
friends. This, of course, raises questions about how ac- adults, and senior adults. Additional research can also
curate and useful this knowledge really is, especially help to identify the best ways to develop and market
since competency theory suggests that those with low information literacy instruction to people with low skill
skills often have difficulty recognizing expertise in oth- levels.
ers (Kruger and Dunning 1999). But it also indicates
a means by which these students perhaps prefer to 8. Acknowledgments
construct knowledge. Information literacy instruction The authors gratefully acknowledge the support of the
perhaps should be developed that makes use of collab- Florida State University Office of Research; the Col-
orative learning and peer feedback. Again, additional lege of Information; and the Center for Assessment and
research is needed to determine how best to facilitate Testing, especially Bonnie Armstrong, Karin Smalkoski,
this kind of instruction. and their staff. The authors are also grateful to Profes-
Finally, it seems likely that many millenials will pre- sor Stephen Wise at James Madison University for his
fer instruction delivered through innovative uses of new continuing interest in this research.
technology, such as podcasting and simulations. Future
research should investigate which technologies are pre- 9. References
ferred and which are most effective in strengthening Association of College and Research Libraries. 2000. Infor-
various information literacy skills. mation literacy competency standards for higher education.
Chicago: Association of College and Research Libraries.
6.3 Distance learning students Bostick, S. L. 1993. “The Development and Validation of the
This study did not include distance learners. However, it Library Anxiety Scale.” In Research in Reference Effective-
should be acknowledged that distance learning presents ness, eds. M. E. Murfin and J. B. Whitlatch, 1–7. Chicago:
its own challenges that can make identifying students American Library Association.
with low-level information literacy skills even more dif- Collins, B. L., C. A. Mellon, and S.B. Young. 1987. “The
ficult. To compound the problem, instructors may as- Needs and Feelings of Beginning Researchers.” In Biblio-
sume, erroneously, that students in online courses have graphic Instruction: The Second Generation, ed. C. A. Mel-
strong information literacy skills because they have lon, 73–84. Littleton, Colo.: Libraries Unlimited, Inc.
strong computer literacy skills. In fact, these are differ- Gross, M. 2005. “The Impact of Low-level Skills on Infor-
ent skill sets, and students in online courses may very mation Seeking Behavior: Implications of Competency
well be deficient in information literacy skills. Non-pro- Theory for Research and Practice.” Reference and User Ser-
ficient students are unlikely to recognize that they need vices Quarterly 45: 54–62.
remediation, and those who do may be less likely to self James Madison University. n.d. Information Literacy Test
identify because they may assume, rightly or wrongly, (ILT). http://www.jmu.edu/assessment/wm_library/ILT.
that interactive help and remediation are not available pdf.
to them because they are studying at a distance. Clearly, Jiao, Q. G., A. Onwuegbuzie, and A. A. Lichtenstein. 1996.
research must be devoted to this particular group of stu- “Library Anxiety: Characteristics of ‘At Risk” College
dents as distance learning proliferates. Students.” Library & Information Science Research 18:
151–63.
7. Conclusion Kuhlthau, C. C. 1993. Seeking Meaning: A Process Approach
This study investigated the applicability of Compe- to Library and Information Services. Norwood, N.J.: Ablex
tency Theory in the domain of information literacy Publishing.
skills among incoming college freshmen. Results in- Kruger, J., and D. Dunning. 1999. “Unskilled and Unaware
dicated that non-proficient students do greatly over- of It: How Difficulties in Recognizing One’s Own In-
estimate their information literacy skills, more so competence Lead to Inflated Self-assessments.” Journal of
than their proficient counterparts. No clear relation- Personality and Social Psychology 77: 1121–34.
Mellon, C. A. 1986. “Library Anxiety: A Grounded Theory and brary Anxiety.” Journal of the American Society for Informa-
Its Development.” College & Research Libraries 47: 160–65. tion Science and Technology 55: 41–54.
Onwuegbuzie, A. J., and Q. G. Jiao. 2004. “Information Search Wise, S. L., L. Cameron, S. Yang, and S. Davis. n.d. “Informa-
Performance and Research Achievement: An Empirical tion Literacy Test,” Test Development and Administration
Test of the Anxiety-expectation Mediation Model of Li- Manual. James Madison University.
Appendix A
3. Asian 6. Please estimate how well you think you will perform
on the Information Literacy Test in terms of the per-
4. American Indian cent of questions you expect to be able to answer cor-
5. Hispanic rectly (for example: 100% would be a perfect score;
6. Native Hawaiian/Other Pacific 75% means that you would get 75% of the questions
right; etc.). Enter your estimate in the box below.
7. Multi-race/Ethnic
7. The Information Literacy Test asks you to respond
4. How have you learned what you know about using to 65 questions. Please estimate how many of these
the library or how to find information? (You may questions you think you will be able to answer cor-
choose more than one answer.) rectly. (For example do you expect to get a score of
1. library instruction in the school library media 34 out of 65? 54 out of 65? A perfect score of 65 out
center of 65?) Please enter your estimated score in the box
below.
2. library instruction in the classroom
8. Using percentages again, please estimate how you
3. helped by a parent
think your performance on the Information Literacy
4. helped by librarian in a public library (includes Test will compare to other incoming freshmen tak-
library tour or group instruction) ing this test. (For example an estimate of 80% means
5. helped by a librarian in a college or university li- that you think 20% of the students will score higher
brary (includes library tour or group instruction) than you.) Enter your estimate in the box below.
Appendix B