Академический Документы
Профессиональный Документы
Культура Документы
Validating the Academic Self-regulated Learning Scale with the Motivated Strategies
for Learning Questionnaire (MSLQ) and Learning and Study Strategies Inventory
(LASSI)
Carlo Magno
De La Salle University, Manila, Philippines
Abstract
The present study further established the construct validity of the Academic Self-regulated
Learning Scale (A-SRL-S, Magno, 2010) through its functional correlation with the
Motivated Strategies for Learning Questionnaire (MSLQ) and Learning and Study
Strategies Inventory (LASSI). The three questionnaires were administered to 755 college
students from different universities in the National Capital Region in the Philippines. All
subscales of the three instruments had significant intercorrelations ( p<.001). Three
measurement models, using Confirmatory Factor Analysis were tested to determine which
best explains the construction of the A-SRL-S. A two factor model where the A-SRL-S was
combined with MLSQ with LASSI on a separate factor turned to have a bad fit
( =2648.02, df=89, RMSEA=.26, SRMR=.20, AIC=3.39, SBC=3.78, BCCVI=3.60).
2
Another two-factor model where A-SRL-S was combined with LASSI with MSLQ this time
on a separate factor improved its fit as compared to the first model ( =1052.99, df=89,
2
SBC=.92, BCCVI=.71). Implications about the usefulness and validity of the A-SRL-S in
research were discussed.
Introduction
Method
Participants
The participants in the study are 755 college students from different
universities in the National Capital Region of the Philippines. These students were
all enrolled in a degree course who is already taking up their major courses. In the
Philippines major courses are taken from second year college until the last year.
There is much evidence of self-regulation behavior because these students are
already experienced several academic tasks and requirements in school.
Instruments
High interbal consistencies were also attained for each factor (.73 to .87). Using an
IRT Graded Response Model, the scale showed appropriate step calibration where
the responses are monotonically increasing. The Test Information Function curve
showed precision for the overall instrument. Almost all items showed to have good
fit and the few items that did not fit the GRM were revised.
Learning and Study Strategies Inventory (LASSI). The short version of the
LASSI (with a 5-point scale and 77 items) was used which is a prescriptive and
diagnostic assessment of “student’s awareness” about the use of learning and study
strategies. The three components cover: (1) Skill - learning strategies, skills and
thought processes that help prepare and demonstrate new knowledge on tests or
other evaluative procedures (subscales include information processing, selecting
main ideas, and test strategies), (2) Will - worry to academic performance,
receptivity to learning new information, attitudes and interest in college, diligence,
self-discipline, and willingness to exert the effort necessary to successfully complete
academic requirements (subscales include anxiety, attitude, and motivation), and (3)
Self- Regulation - manage, or self-regulate and control, the whole learning process
through time management, maintaining concentration, checking learning demands,
and using study aids (subscales include concentration, self-testing, study aids, and
time management) (Weinstein & Palmer, 2002). Participants answered the learning
and study strategies inventory on how often they do the given case/scenario through
the response format “not at all like me, not very much like me, somewhat like me,
fairly much like me, and very much like me.” The reliability of LASSI indicates a
Cronbach’s Alpha of .84, .89, and .80 for Information Processing, Selecting Main
Ideas and Test Strategies scales for the “Skill” component respectively. For the
Procedure
All the participants were briefed about the guidelines in answering the
questionnaires. They were asked if they are willing to participate in the study by
answering a series of questionnaires. The participants were guided accordingly on
how they answered the forms: (1) The researcher gave the rationale of the study, (2)
read the questions carefully; (2) instructed that there are no right or wrong answers
for the questionnaires. The researcher informed the participants that the study
needs to get authentic answer for more accurate result. The participants were also
made aware that their answers will not affect their class standing in school and
failure to follow the guidelines will be forfeited on the participation in the study.
The researchers administered to the participants all the questionnaires during their
class time. The researchers then scored the questionnaires for each subscale. Each
participant was assigned with a call number used for the purpose of identifying and
recording all the instruments.
Data Analysis
covariance matrix and the implied covariance matrix from the hypothesized model
(Fan, Thompson, & Wang, 1999). A statistically non-significant χ2 indicates
adequate model fit. Because the χ2 test is very sensitive to large sample sizes (Hu &
Bentler, 1995), additional absolute fit indices were examined. The RMSEA is
moderately sensitive to simple model misspecification and very sensitive to complex
model misspecification (Hu & Bentler, 1998). Hu and Bentler (1999) suggest that
values of .06 or less indicate a close fit. The SRMR is very sensitive to simple
model misspecification and moderately sensitive to complex model
misspecification (Hu & Bentler, 1998). Hu and Bentler (1998) suggest that
adequate fit is represented by values of .08 or less. In addition, two incremental fit
indices, the comparative fit index (CFI) and the Tucker-Lewis Index (TLI) were
examined. The CFI and the TLI are moderately sensitive to simple model
misspecification and very sensitive to complex model misspecification (Hu &
Bentler, 1998). Hu and Bentler (1998) recommend a cutoff of .95 or greater for
both the CFI and the TLI.
Results
The scores obtained from the three questionnaires were summarized
according to their factors. The seven scores were obtained from the A-SRL-S, five
scores for MSLQ, and three scores for the LASSI. Descriptive statistics were
reported including their internal consistency using Cronbach’s alpha.
The mean scores for the A-SRL-S were still within the confidence interval
level of the means in the previous study (see Magno, 2009). However, the standard
deviations for this sample are lower than the previous study. The Cronbach’s alpha
for the A-SRL-S are still within the same range (.70-.84). The reported means
scores of the MSLQ and LASSI had higher means for this sample as compared
with the previous samples in the study of Pintrich, Smith, Garcia, and McKeachie
(1991) and Weinstein and Palmer (2002).
Table 1
Means, Standard Deviations, Confidence Intervals, and Internal Consistency
N M Confidence Confidence SD Cronbach’s
-95.00% 95.00% alpha
A-SRL-S
Memory Strategy 755 2.80 2.76 2.84 0.56 .84
Goal-setting 755 2.83 2.78 2.88 0.69 .74
Self-evaluation 755 2.81 2.77 2.85 0.54 .82
Seeking Assistance 755 2.90 2.86 2.94 0.54 .71
Environmental
755 2.84 2.79 2.89 0.66 .70
Structuring
Learning Responsibility 755 2.95 2.90 2.99 0.64 .72
Planning and
755 2.99 2.95 3.03 0.60 .71
Organizing
MSLQ
Values 755 4.43 4.35 4.52 1.19 .92
Expectancies 755 4.33 4.25 4.41 1.12 .90
Affective 755 4.07 3.99 4.15 1.15 .80
Cognitive and
755 4.33 4.25 4.40 1.03 .95
Metacognitive
Resource Management 755 4.37 4.30 4.45 1.08 .93
LASSI
Skill 755 3.13 3.09 3.18 0.65 .75
Will 755 3.12 3.08 3.17 0.64 .74
Self-regulation 755 3.14 3.10 3.18 0.59 .72
To further establish the convergence of the factors of the A-SRL-S with the
MSLQ and the LASSI, Pearson correlation was conducted. The results of the
correlation showed that all coefficients are significant below .001 alpha levels. The
significant correlations indicate that convergence was attained among the factors of
A-SRL-S, MSLQ, and LASSI.
Three measurement models were constructed to determine which structure
best explains the relationship of the A-SRL-S with the MSLQ and LASSI.
The first measurement models include A-SRL-S combined with MSLQ factors and
this is structured in a two factor model. A second measurement model consisting
of a two-latent factor model where A-SRL-S was combined with LASSI factors
structured with MSLQ. And lastly, a three-factor model was constructed where the
A-SRL-S, MSLQ, and LASSI were placed as separate latent factors that are
correlated.
Table 2
Correlation Matrix for the A-SRL-S, MSLQ, and LASSI
(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15)
A-SRL-S
MSLQ
(10) Expectancies .15 .20 .21 .25 .20 .27 .30 .85 --
(11) Affective .12 .23 .19 .23 .10 .20 .19 .57 .63 --
(12) Cognitive and
Metacognitive .17 .20 .23 .30 .21 .30 .33 .77 .82 .64 --
(13) Resource
Management .15 .20 .20 .29 .19 .30 .34 .77 .80 .56 .87 --
LASSI
(14) Skill .35 .25 .30 .28 .26 .31 .27 .31 .33 .23 .30 .27 --
(15) Will .29 .29 .24 .25 .26 .30 .29 .36 .37 .29 .34 .35 .51 --
(16) Self-regulation .38 .27 .31 .31 .33 .35 .35 .35 .36 .26 .34 .32 .66 .57 --
Note. All correlation coefficients are significant at p<.001
The results show that the three-factor model is best fitting model indicting
further support for the convergence of A-SRL-S with the MSLQ and LASSI
(2=473.97, df=87, RMSEA=.08, PGI=.93, GFI=.92, NFI=.94, CFI=.95, and
TLI=.95). What is common in all the three models are the significant paths of all
manifest variables and significant correlations among latent factors. However, in the
model where A-SRL-S was combined with the two other measures, the model did
not reach adequate fit. The second model where A-SRL-S was combined with the
LASSI, the SRMR (.09) showed adequate fit. It was also observed that the path
estimates of the factors of A-SRL-S increased when it was combined with the
LASSI factors in one latent construct. The third model also showed that the
relationship between A-SRL-S and LASSI is stronger (.47) than the relationship
between A-SRL-S and MSLQ (.35). This indicates that the A-SRL-S has some
degree of equivalence with the LASSI where both are strong indicators of learning
strategies.
Table 3
Comparison of Fit Indices
Model A-SRL-S + MSLQ A-SRL-S + LASSI with 3 Factor Model
with LASSI (2 Factor MSLQ (2 Factor Model)
Model)
2 2648.02 1052.99 473.97
Df 89 89 87
RMSEA .26 .13 .08
SRMR .20 .09 .04
AIC 3.39 1.47 .71
SBC 3.78 1.66 .92
BCCVI 3.60 1.48 .71
Discussion
The present study established the construct validity of the A-SRL-S with the
MSLQ and LASSI. This was done by first correlating the factors of the three scales
in a zero order correlation. Three measurement models were tested to determine
how the A-SRL-S is best related to MSLQ and LASSI.
It was found in the study that all subscales of the A-SRL-S, MSLQ, and
LASSI were significantly related. The low p values obtained in the correlation
coefficients indicate that there is a small chance that the correlations are influenced
with some random error. This further proved the relationship of each A-SRL-S
subscale with the other established two measures. This initial analysis proved
evidence about the similarity of the A-SRL-S with the two other established
measures.
In the zero order correlations, higher convergence is observed when the
subscales of the A-SRL-S are intercorrelated among each other. There is also
slightly higher correlation among the A-SRL-S subscales with the LASSI subscales
as compared to the MSLQ subscales. This shows there is a closer similarity
between A-SRL-S factors and LASSI factors. More specifically, the self-regulation
component of the LASSI (concentration, self-testing, study aids, and time
management) had stronger correlations with all factors of the A-SRL-S.
The results of the zero order correlation was further strengthened by the
results of the CFA. The CFA first showed that there was improvement in the fit of
the model (using SRMR, AIC, SBC, and BCCVI) when the A-SRL-S factors were
combined with the LASSI factors under one latent factor. Second, the path
estimates of the factors of A-SRL-S increased when joined with the factors of
LASSI under one latent variable. Third, the correlation of A-SRL-S and LASSI as
latent constructs was stronger (.47) in the three-factor model. These results
generally suggest that there is closer similarity and equivalence in the measurement
of self-regulation between the A-SRL-S and the LASSI. The kind of self-regulation
measured by the LASSI is approximated by the A-SRL-S.
Both the A-SRL-S and LASSI are strong indicators of specific learning
strategies. The A-SRL-S deals with six learning strategies that include memory
strategy, goal-setting, self-evaluation, seeking assistance, environmental structuring,
and planning and organizing. On the other hand, the LASSI’s skill and self-
regulation aspects also specify specific strategies such as information processing,
selecting main ideas, test strategies, concentration, self-testing, study aids, and time
management. These strategies are commonly used by students when studying
materials and preparing for exams. The manual of the LASSI even described
explicitly that “The LASSI scales related to the self-regulation component of
strategic learning are: Concentration, Self-Testing, Study Aids, and Time
Management” (p. 5). This was further supported in the present study where A-SRL-
S is strongly related to the LASSI scales. The LASSI scales cover self-regulation of
the “learning process by using time effectively, focusing attention and maintaining
concentration over time, checking to see if learning demands are met for a class, an
assignment or a test, and using study supports such as review sessions, tutors or
special features of a textbook” (p. 5) that are similar with the contexts covered in the
A-SRL-S. Examples of these scenarios in the A-SRL-S include taking notes, reading
aloud, making schedules, asking for assistance and feedback, checking ones
progress, avoiding distractions, and marking important concepts.
The similarity between the as A-SRL-S and the LASSI as evidenced in the
correlations and the CFA means that the A-SRL-S is a strong indicator of specific
aspects of learning strategy measured by the LASSI. These aspects include
measurement of how students study and learn and how they feel about studying and
learning (see Eldrege, 1990).
In the previous studies that developed the A-SRL-S, the validity of the tool
is constructed using only the scale without other measures. The present study now
used external and prior measures of self-regulation (such as the MSLQ and LASSI)
that provide proof to its precision in measurement. This step in the development of
the A-SRL-S is necessary to build evidence that the tool has some degree of
similarity in the constructs measured by other scales (such as the MSLQ and
LASSI).
Since the construct validity of the A-SRL-S is now established with the
LASSI and MSLQ, there is evidence about the precision of the A-SRL-S as a
measure of self-regulation in general with specific learning strategies. The
theoretical conception of self-regulation is clarified as a tool that covers aspects of
learning strategies and study skills. It is safe to assume that the A-SRL-S covers
specific learning strategies that help learners achieve specific learning goals.
Given the established construct validity of the A-SRL-S, the tool is
recommended to be used as alternative to the MSLQ and LASSI when academic
self-regulation is needed to be measured. The tool can provide evidence about
skills and characteristics of learners that will lead to better learning. The next step in
establishing the tool is to provide a predictive validity to determine is consequences
to learning that includes criterion such as students’ achievement and other learning
strategies and metacognition.
References
Abreu-Ellis, C., Ellis, J., & Hayes, R. (2009). College preparedness and time of
learning disability identification. Journal of Developmental Education,
32(3), 28-38.
Anastasi, A., & Urbina, S. (2002). Psychological testing (7th ed.). NJ: Prentice Hall.
Bembenutty, H. (2007). Self-regulated learning and academic delay of gratification:
Gender and ethnic differences among college students. Journal of
Advanced Academics, 18(4), 586-618.
Blakey, E. & Spencer, S. (1990). Developing metacognition. ERIC Digest,
ED327218.
Chen, C. S. (2002). Self-regulated learning strategies and achievement in an
introduction to information systems course. Information Technology,
Learning and Performance Journal, 20(1), 11-29.
Collins, J. L. (1982, March). Self-efficacy and ability in achievement behavior.
Paper presented at the annual meeting of the American Educational
Research Association, New York.
Corsale, K. & Ornstein, P. A. (1971). Developmental changes in children’s use of
semantic information in recall. Journal of Experimental Child Psychology,
30, 231-245.
Dembo, M. H. (2001). Learning to teach is not enough-future teachers also need to
learn how to learn. Teacher Education Quarterly, 28(4), 23-35.
Downing, K., Chan, S., Downing, W., Kwon, T., & Lam, T. (2008). Measuring
gender differences in cognitive functioning. Multicultural Education and
Technology Journal, 2(1), 4-18.
Edens, K. M. (2009). The interaction of pedagogical approach, gender, self-
regulation, and goal orientation using student response system technology.
Journal of Research in Technology Education, 41(2), 161-177.
Eldrege, J. L. (1990). Learning and study strategies inventory--high school version
(LASSI-HS). Journal of Reading, 34(2), 146-149.
Ertmer, P. H., Newby, T. J., & MacDougal, M. (1996). Students responses and
approaches to case-based instruction: The role of reflective self-regulation.
American Educational Research Journal, 33(3), 719-752.
Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation
methods, and model specification on structural equation modeling fit
indexes. Structural Equation Modeling, 6, 56-83.
Garner, J. K. (2009). Conceptualizing the relations between executive functions and
self-regulated learning. The Journal of Psychology, 143(4), 405-426.
Guvenc, H. (2010). The effects of cooperative learning and learning journals on
teacher candidates’ self-regulated learning. Educational Sciences: Theory
and Practice, 10(3), 1477-1487.
Hamman, D. (1998). Preservice teachers’ value for learning-strategy instruction.
The Journal of Experimental Education, 66(3), 209-221.
Hu, L., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.),
Structural equation modeling: Concepts, issues, and applications (pp. 76-
99). Thousand Oaks, CA: Sage.
Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling:
Sensitivity to underparameterized model misspecification. Psychological
Methods, 3, 424-453.
Joo, Y., Bong, M., & Choi, H. (2000). Self-efficacy for self-regulated learning,
academic self-efficacy, and internet self-efficacy in web-based motivation.
Educational Technology, Research and Development, 48(2), 5-17.
Kesici, S., & Erdogan, A. (2009). Predicting college students’ mathematics anxiety
by motivational beliefs and self-regulated learning strategies. College Student
Journal, 43(2), 361-370.
Kirby, J. R., Silvestri, R., Alklingham, B. H., Parrilla, R., & La Fave, C. B. (2008).
Learning strategies and study approaches of postsecondary students with
dyslexia. Journal of Learning Disability, 41(1), 85-96.
Kitsantas, A., Winsler, A., & Hui, F. (2008). Self-regulation and ability predictions
of academic success during college: A predictive validity study. Journal of
Advanced Academics, 20(1), 42-68.
Kluwe, R. H. (1982). Cognitive knowledge and execution control: Metacognition.
In D. R. Griffin (Ed.), Animal mind – human mind (pp. 201-224). New
York: Springer-Verlag.
Lee, H. W., Lim, K. Y., & Grabowski, B. (2009). Generative learning strategies and
metacognitive feedback to facilitate comprehension of computer science
topics and self-regualtion. Journal of Educational Multimedia and
Hypermedia, 18(1), 5-25.
Lopez, D.F., Little, T. D., Oettingen, G., & Baltes, P. B. (1998). Self-regulation and
school performance: Is there optimal level of action-control?. Journal of
Experimental Child Psychology, 70, 54-75.
Malmivuori, M. (2006). Affect and self-regulation. Educational Studies in
Mathematics, 63, 149-164.
Magno, C. (2009). Assessing and developing self-regulated learning. The
Assessment Handbook, 1, 24-26.
Magno, C. (2010). Assessing academic self-regulated learning among Filipino
college students: The factor structure and item fit. The International Journal
of Educational and Psychological Assessment, 5(1), 61-78.
Moos, D. C., & Azevedo, R. (2006). The role of goal structure in undergraduates’
use of self-regulatory process in two hypermedia learning tasks. Journal of
Educational Multimedia and Hypermedia, 15(1), 49-87.
Mullen, P. A. (2006). Use of self-regulated learning strategies by students in the
second and third trimesters of an accelerated second-degree baccalaureate
nursing program. Journal of Nursing Education, 46(9), 406-412.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. NY: MacGraw
Hill.
Olaussen, B. D., & Braten, R. (1999), Students' use of strategies for self-regulated
learning: Cross-cultural perspectives. Scandinavian Journal of Educational
Research, 43(4), 409-433.
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. (1993). Reliability
and validity of the Motivated Strategies for Learning Questionnaire
(MSLQ). Educational and Psychological Measurement, 53, 801-813.
Special thanks to Ms. MR Aplaon for the help in gathering literature reviews and
my educational psychology students for the assistance in the data gathering.