Does teaching the ‘Singaporean way’ improve maths test performance

ISRCTN ISRCTN70922140
DOI https://doi.org/10.1186/ISRCTN70922140
Secondary identifying numbers N/A
Submission date
07/01/2013
Registration date
07/03/2013
Last edited
20/01/2023
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data

Plain English summary of protocol

Background and study aims
Mathematics Mastery is based on a simple way to teach mathematics originally developed by the Singapore Ministry for Education. The Mathematics Mastery model is distinctive in two ways. First, it aims to give pupils a thorough understanding of mathematical concepts, rather than a set of techniques or routines to get to the right answer. Mathematics Mastery shows that problems can be solved in a variety of ways, and ensures that pupils learn in sequence – first by manipulating real objects, then by drawing pictorial representations, and ultimately by using mathematical symbols. Second, Mathematics Mastery uses a 'mastery' approach, in which teachers do not move on until all pupils have acquired a basic understanding of the current topic. Additionally, the course is designed so that more able pupils can explore each topic in depth, and therefore remain engaged.

Who can participate?
We are currently asking schools to volunteer to participate in the Maths Mastery programme. In London there are only 25 funded places available in the programme and so volunteer schools will enter a lottery to determine which school is awarded a place in the programme.

What does the study involve?
For the 25 successful schools, the programme will begin in September 2013 following a summer of training teachers in Maths Mastery. Initial follow-up testing will take place in June 2014, with a further follow-up in June 2018 (children’s GCSE test scores). Only schools with a high number of disadvantaged pupils will be invited to take part (as either intervention or control schools).
We will be evaluating the effectiveness of the programme and to do that we will ask schools that are not successful in the lottery to remain involved as a comparison group. All pupils in year 7 in the schools that initially volunteered to take part will be tested in June 2014 for their understanding of mathematics (both treatment and control groups). Children’s Key Stage 2 test scores shall be used as baseline controls. Note that participation in this programme (even if schools are not successful in the lottery) will meet OFSTED requirements for schools to participate in research. We will also be able to certify schools’ co-operation and involvement with the Education Endowment Fund.

What are the possible benefits and risks of participating?
The participation of all schools (whether they receive one of the lottery places or not) is critical to the success of the programme. All schools, even those not introducing Maths Mastery, will receive feedback at the end of the year on the level of understanding of mathematics of each child tested and the progress they have made. We are therefore hopeful that this information can be used by the school for formative purposes.
The test will take approximately one hour. The test will simply be used to measure the effectiveness of the Maths Mastery approach and not the effectiveness of any individual teacher.

Where is the study run from?
The programme will be run by the charity ARK (http://www.arkschools.org/). A team from the Institute of Education will be evaluating the impact of Maths Mastery on pupils’ understanding of mathematics.

When is the study starting and how long is it expected to run for?
The programme will begin in September 2013 following a summer of training teachers in Maths Mastery. Initial follow-up testing will take place in June 2014, with a further follow-up in June 2018 (GCSE test scores).

Who is funding the study?
Education Endowment Fund, UK.

Who is the main contact?
Dr. John Jerrim
J.Jerrim@ioe.ac.uk

Contact information

Dr John Jerrim
Scientific

Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Email J.Jerrim@ioe.ac.uk

Study information

Study designCluster randomised controlled trial, with random allocation at the school level
Primary study designInterventional
Secondary study designRandomised controlled trial
Study setting(s)Other
Study typeOther
Participant information sheet Not available in web format, please use the contact details below to request a patient information sheet
Scientific titleMaths Mastery secondary school evaluation: a cluster randomised controlled trial
Study objectivesThat the Maths Mastery programme will have a positive impact (on average) on pupils maths test scores after (i) one year and (ii) after five years.
Ethics approval(s)Not provided at time of registration
Health condition(s) or problem(s) studiedMaths skills
InterventionThe Maths Mastery programme aims to give pupils a thorough understanding of mathematical concepts, rather than a set of techniques or routines to get to the right answer. Mathematics Mastery shows that problems can be solved in a variety of ways, and ensures that pupils learn in sequence – first by manipulating real objects, then by drawing pictorial representations, and ultimately by using mathematical symbols. Second, Mathematics Mastery uses a 'mastery' approach, in which teachers do not move on until all pupils have acquired a basic understanding of the current topic. Additionally, the course is designed so that more able pupils can explore each topic in depth, and therefore remain engaged.

Teachers in the intervention group will receive training in the maths mastery programme prior to the start of the September 2013 school year.

Those in the control group will not receive any intervention.

The skills teachers learn in Maths Mastery will then be applied throughout the school year.
Intervention typeOther
Primary outcome measureCurrent primary outcome measures as of 29/04/2013:
The primary outcome we will consider is children’s overall performance on the maths test children will sit at the end of year 7.

Previous primary outcome measures until 29/04/2013:
Scores on a standardised maths test at the end of year 7
Secondary outcome measuresCurrent secondary outcome measures as of 29/04/2013:
For secondary outcomes, ARK (the intervention provider) will identify particular questions / sub-scales of interest – that they believe the Maths Mastery programme will particularly influence. They will inform the Institute of Education of these before they conduct any analysis of the test score data. The Institute of Education will then compare children’s performance on these questions / sub-scales as secondary outcomes. Corrections for multiple testing will be applied if appropriate. GCSE test scores (follow-up in June 2018) will also be a secondary outcome.

Previous secondary outcome measures until 29/04/2013:
GCSE grades / performance in national math exam at age 16
Overall study start date01/09/2013
Completion date01/09/2018

Eligibility

Participant type(s)Patient
Age groupChild
SexBoth
Target number of participants50 schools (25 intervention and 25 control). All pupils within the chosen school. Approximately 2000 pupils.
Key inclusion criteriaSampling frame are the ARK schools within certain geographic areas (mainly London and the West Midlands). These are mainly schools with a high proportion of children receiving free school meals. All children within a school are included.
Key exclusion criteriaThose who are absent from school on the day of the test
Date of first enrolment01/09/2013
Date of final enrolment01/09/2018

Locations

Countries of recruitment

  • England
  • United Kingdom

Study participating centre

Institute of Education
London
WC1H 0AL
United Kingdom

Sponsor information

Education Endowment Fund (UK)
Charity

9th Floor
Millbank Tower
21 – 24 Millbank
London
SW1P 4QP
United Kingdom

Website http://educationendowmentfoundation.org.uk/
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Charity

Education Endowment Fund (EEF) (UK)

No information available

Results and Publications

Intention to publish date
Individual participant data (IPD) Intention to shareNo
IPD sharing plan summaryNot provided at time of registration
Publication and dissemination planNot provided at time of registration
IPD sharing planNot provided at time of registration

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Funder report results 01/02/2015 20/01/2023 No No

Editorial Notes

20/01/2023: Funder report added.