TIMSS AND PISA (Neutral)

Presented by:
1. Sim Wei Na D20121058475
2. Siva Shangary Balasubramaniam D20121058479
Lecturer: Dr. Faizal Nizam Lee Bin Abdullah

Trends in International Mathematics and

Science Study (TIMMS)
International Association for the Evaluation of Educational Achievement (IEA)

Standard 4 and form 2 (Malaysia join form 4 only)

2 domain mathematics and science
4 years once (1995,1999,2003,2007,2011) Malaysia join in 1999
Minimum of 4,500 to 5,000 students are evaluated
Curriculum based, reflecting the skills and knowledge taught in school
Aim allowing educational systems to compare students educational achievement and
learn from the experiences of others in designing effective education policy

Methods of evaluating (TIMMS)

Questionnaire
Students
Teacher
school

Booklet assessment

Countries took part (TIMMS)

Year

Standard 4

Form 2

1995

25

41

1999

38

2003

25

46

2007

36

49

2011

52

45

Cognitive Domain for Mathematics

(TIMMS)
Knowing facts, procedures
and concepts

Applying knowledge and

conceptual understanding

Reasoning

Recall

Select

Analyze

Recognize

Represent

Generalize

Compute

Model

Synthesize / Integrate

Retrieve

Implement

Justify

Measure

Solve routine problems

Solve non-routine problems

Know
Classify / Order

Content Domain for Mathematics (TIMMS)

Numbers

(30%)

Algebra

(30%)

Geometry

(20%)

Data and chance

(20%)

Cognitive Domain for Science(TIMMS)

Knowing

Applying

Reasoning

Recall / Recognize

Compare / Contrast / Classify

Analyze

Define

Use models

Integrate / Synthesize

Describe

Relate

Hypothesize / Predict

Illustrate with examples

Interpret information

Design

Demonstrate knowledge of
scientific instrument

Final solution

Draw conclusion

explain

Generalize
Evaluate
Justify

Content Domain for Science (TIMMS)

Biology

(35%)

Chemistry

(20%)

Physics

(25%)

Earth Science

(20%)

Program for International Student

Assessment (PISA)
The Organization for Economic Co-operation and Development (OECD)
Measures 15 year old students (Form 3)

Three domains: reading, mathematics and science literacy.

3 years once (2000, 2003, 2006, 2009, 2012) Malaysia join in 2009
Not only mastery of the school curriculum but in terms of important knowledge and skills in
adult life.
Aim : The prime aim of the OECD/PISA assessment is to determine the extent to which
young people have acquired the wider knowledge in reading literacy, mathematical
literacy and scientific literacy that they will need in adult life. (OECD, 2004, 4).

Methods of evaluating (PISA)

Booklet Assessment
Questionnaire (Student)
Electronic Assessment

Questionnaire (Principal)

Countries took part (PISA)

Year

Domain Tested

OECD Countries

Partner Countries

2000

Reading

28

15

2003

Mathematics

30

11

2006

Science

30

27

2009

Reading

34

51

2012

Mathematics

34

31

Details at: http://nces.ed.gov/surveys/pisa/countries.asp

Framework Domain (Mathematics)-PISA

Format
Closed
Constructed
Response
Complex Multiple
Choice
Multiple Choice
Open Constructed
Response

Short Response

Strand

Topics

Algebra

Change and
Relationship

Discrete
Mathematics

Quantity

Functions

Space and
Shape

Geometry

Number

Probability

Statistics

Uncertainty

Competency
Connections

Reflection

Reproduction

Framework Domain (Science) -PISA

Format

Area

Knowledge

Closed Constructed
Response

Environment

Scientific Inquiry

Complex Multiple
Choice

Frontiers

Scientific
Explanations

Multiple Choice

Hazards

Earth and Space

System

Open Constructed
Response

Health

Living System

Natural Resources

Physical System

Short Response

Technology
System

Competency
Explain
phenomena
Scientifically
Identifying
scientific issues
Using Scientific
Evidence

Framework Domain (Reading) - PISA

Format

Text Format

Text Type

Aspect

Closed Constructed
Response

Continuous

Argumentation

Access and
Retrieve

Complex Multiple
Choice

Mixed

Description

Integrate and
Interpret

Multiple Choice

Multiple

Exposition

Reflect and
Evaluation

Open Constructed
Response

Non Continuous

Instruction

Short Response

Narration

Major Domain (PISA)

Every cycle, one domain is chosen as the major domain and assessed in greater detail.

Reading Literacy (PISA 2000 & 2009)

Mathematical Literacy (PISA 2003 & 2012)
Scientific Literacy (PISA 2006)

Problem Solving (PISA 2003)

Rotating

How to join PISA?

1. Contact OECD secretariat.

2. The PISA Governing Board the approves membership according to certain criteria.
3. Technical expertise + able to meet the full cost of participation.

4. Participants must join two years before cycle of PISA.

Uniqueness of PISA
Worldwide Scope and regularity
More than 70 countries and economies have taken part in PISA so far and the surveys, which
are given every three years, allow them to track their progress in meeting key learning goals.
Application in real life
Students ability to apply knowledge and skills in key subject areas and to analyze, reason
and communicate effectively as they examine, interpret and solve problems.

Lifelong learning
In order to be effective lifelong learners, young people need not only knowledge and skills,
but also an awareness of why and how they learn.
(resource from http://www.oecd.org/pisa/aboutpisa/pisafaq.htm on 27-9-2014)

Why Malaysia join TIMSS and PISA?

Monitor Student
Achievement
Over Time
(Internationally)

Identify
Students
Strengths and
Weaknesses
(Internationally)

Experience
Cutting Edge
Assessment by
International
Experts

Holistic Students

Four Approaches

KSSR/KSSM

i-Think
Program

Follow Up
Studies

Malaysia
Education
Blueprint
2013-2025

Why Malaysian Students Failed to Score?

Question format, example: Mathematics question
TIMSS

PISA

Why Malaysian Students Failed to Score?

(Cont)
Language of Instruction

Conclusion

TIMSS tests students mastery of what have been taught from the
curriculum. While, PISA assesses how students can use the
knowledge and skills that they were taught in real life.
Last but not least, TIMSS and PISA can be a guideline for every
country to achieve a standard education level.