Do the onebillion maths apps promote young children’s mathematics attainment?

ISRCTN ISRCTN10520083
DOI https://doi.org/10.1186/ISRCTN10520083
Secondary identifying numbers n/a
Submission date
16/05/2018
Registration date
30/05/2018
Last edited
05/09/2019
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Mental and Behavioural Disorders
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data

Plain English summary of protocol

Background and study aims
The aim of this study is to evaluate whether children who practise mathematical concepts and vocabulary using the onebillion maths apps in a tablet make more progress in mathematics than children of comparable age and ability who did not use the apps during their first year in school. Two maths apps – one for ages 3 to 5 and the other for ages 4 to 6 – are being evaluated. They are used as a sequence: the children first complete all the activities in the app for 3 to 5 years and then go on to the second one, for ages 4 to 6.
The apps were developed by Onebillion.org, a non-profit organization registered as a charity in England and Wales (Number 1159480). They are designed using principles from instructional psychology known as the sequence “model, lead, test”. This means that the children first see a worked out example of the activity they need to do; then they have the opportunity to do the same thing as they receive instruction from a teacher built into the apps; after a sufficient large amount of practise, they are tested on the same activity. At the end of the test, children who get all the answers right are rewarded by the appearance of a star on the screen. If they do not receive the star, they are encouraged to go back, practise again, and repeat the quiz.
Pupils progress through topics on their own and at their own pace. The apps cover several topics: for example, counting (with activities organized in different levels, taking counting up to 100), classification by different criteria (shape, color), shape (geometrical shapes vocabulary, symmetry), lines and patterns (straight or curved; repetitions of figures in a pattern), position (vocabulary about spatial relations), measures (length, time, mass and capacity), addition and subtraction (arithmetic with pictures, number bonds and number line work), sharing and fractions (half and quarter).
The apps have been evaluated in Malawi and in a small study in England with promising results. The Education Endowment Foundation is funding this large scale study in order to support schools in their decision regarding whether to acquire the apps.
Who can participate?
Children aged 5-6 years in Year 1 at a participating school in the 2017/18 academic year

What does the study involve?
At the start of the study, all schools nominate 9 or 10 pupils who are struggling with mathematics and could benefit from additional support.
The schools are randomly allocated to one of two groups, after the children participate in a pre-test of mathematical achievement. Schools in the first group take part in the onebillion programme. At the end of the project, children in both intervention and control schools are tested in the outcome measure.

What are the possible benefits and risks of participating?
Participants may benefit from improved skills in maths. There are no notable risks involved with participating.

Where is the study run from?
113 schools, mostly in the Greater Manchester, Lancashire, Liverpool, and West Yorkshire regions (UK)

When is the study starting and how long is it expected to run for?
September 2017 to December 2018

Who is funding the study?
Education Endowment Foundation (UK)

Who is the main contact?
1. Prof Terezinha Nunes (scientific)
terezinha.nunes@education.ox.ac.uk
2. Dr Lars-Erik Malmberg (scientific)
3. Ms Rossana Barros (scientific)
4. Ms Deborah Evans (public)
evaluation@education.ox.ac.uk
5. Ms Susan Baker (public)
6. Mr David Sanders-Ellis (public)
evaluation@education.ox.ac.uk

Contact information

Ms Deborah Evans
Public

15 Norham Gardens
Department of Education
Oxford
OX2 6PY
United Kingdom

Prof Terezinha Nunes
Scientific

15 Norham Gardens
Department of Education
Oxford
OX2 6PY
United Kingdom

Mr David Sanders-Ellis
Public

15 Norham Gardens
Department of Education
Oxford
OX2 6PY
United Kingdom

Study information

Study designCluster randomised controlled trial
Primary study designInterventional
Secondary study designCluster randomised trial
Study setting(s)School
Study typeTreatment
Participant information sheet ISRCTN10520083_PIS_v1_30May18.pdf
Scientific titleA randomised control trial of the impact of the onebillion maths apps on Year 1 children’s mathematics attainment
Study objectivesPrimary hypothesis:
Children identified by their teachers as struggling with mathematics at the start of Year 1 who participate in the onebillion intervention should show greater progress in mathematics than children identified by their teachers as struggling with mathematics at the start of Year 1 who do not participate in the intervention.

Secondary hypotheses:
1. The onebillion intervention is as effective for children entitled to FSM as for other children from the onebillion intervention, as assessed by the progress test in maths
2. The onebillion intervention is as effective for boys as for girls, as assessed by the progress test in maths
Ethics approval(s)Central University Research Ethics Committee of the University of Oxford, 06/11/2018, ref: ED-CIA-17-014
Health condition(s) or problem(s) studiedMathematic attainment
InterventionAll schools nominate 9 to 10 pupils, depending on the number of year 1 children in the classroom, who are considered by teachers to need additional practice with mathematics.

When this has been provided to the evaluation team, the schools are randomly assigned either to an intervention or to a control group by the evaluation team, with an equal allocation of schools to each group.

Intervention group: The intervention is delivered to the children who work individually on an iPad tablet through two different onebillions apps. It is managed by teaching assistants (TAs) who supervise the children as a group and provide pedagogical and technical support where needed. Teaching Assistants (TAs) and/or schools receive the opportunity to be trained in person or via online communication to enable their delivery of the intervention. These TAs supervise the children for four 30 minute sessions each week for twelve weeks. These sessions are in addition to usual, daily classes of mathematics. In this RCT, the sessions are delivered during the end of term 2 and the remainder during term 3 of Year 1.

Control group: Schools take a business as usual approach to supporting pupils who struggle with mathematics. The schools are offered a financial incentive of £1,000 in order to cooperate with the evaluation team up to the end of the trial and the further incentive of receiving free access to the app once the project is completed.
Intervention typeBehavioural
Primary outcome measureMathematics ability is assessed using the Progress Test in Maths 5, from GL Assessments, in February before the start of the intervention and the parallel form the Progress Test in Maths 6, in June/July, at the end of the academic year. This assessment is given immediately after the end of the intervention. It is administered by teachers to children individually.
Secondary outcome measuresThere are no secondary outcome measures
Overall study start date01/08/2017
Completion date01/12/2018

Eligibility

Participant type(s)Other
Age groupChild
SexBoth
Target number of participants1124
Total final enrolment1124
Key inclusion criteria1. Year 1 pupils in English state supported primary schools in the 2017/18 academic year
2. Children identified by their teachers as struggling with mathematics at the start of the year
Key exclusion criteria1. Children in the higher half of their class according to the teachers assessment for mathematics
2. Children with a statement of special educational needs
3. Children who have difficulty in understanding English
Date of first enrolment01/09/2017
Date of final enrolment01/01/2018

Locations

Countries of recruitment

  • United Kingdom

Study participating centre

113 schools in the UK
Mostly in the Greater Manchester, Lancashire, Liverpool, and West Yorkshire regions
Nottingham
-
United Kingdom

Sponsor information

Education Endowment Foundation
Charity

9th Floor
Millbank Tower
21-24 Millbank
London
SW1P 4QP
United Kingdom

Phone +44 (0)207 802 1676
Email info@eefoundation.org.uk
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Charity

Education Endowment Foundation
Private sector organisation / Trusts, charities, foundations (both public and private)
Alternative name(s)
EducEndowFoundn, Education Endowment Foundation | London, EEF
Location
United Kingdom

Results and Publications

Intention to publish date30/06/2020
Individual participant data (IPD) Intention to shareNo
IPD sharing plan summaryNot expected to be made available
Publication and dissemination planPlanned publication of an evaluation report with the Education Endowment Foundation.
IPD sharing planThe datasets generated during and/or analysed during the current study are not expected to be made available to anyone outside of the team. Anonymised data is sent to the funders, The Education Endowment Foundation. They keep this archived and allow access following an application through the Department for Education.

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Funder report results results No No
Basic results 22/03/2019 25/03/2019 No No
Participant information sheet version v1 30/05/2018 02/04/2019 No Yes

Additional files

ISRCTN10520083_BasicResults_22Mar19.pdf
Uploaded 25/03/2019
ISRCTN10520083_PIS_v1_30May18.pdf
Uploaded 02/04/2019

Editorial Notes

05/09/2019: The intention to publish date was updated from 01/03/2019 to 30/06/2020.
03/09/2019: The following changes have been made:
1. Publication reference added.
2. The final enrolment number has been added from the reference.
02/04/2019: The participant information sheet has been uploaded.
25/03/2019: The basic results of this trial have been uploaded as an additional file.