Condition category
Not Applicable
Date applied
26/09/2017
Date assigned
05/10/2017
Last edited
10/10/2017
Prospective/Retrospective
Prospectively registered
Overall trial status
Ongoing
Recruitment status
No longer recruiting

Plain English Summary

Background and study aims:
Metacognition is awareness and understanding of one's own thought processes. It is increasingly recognised as valuable for student learning for students of all ages, valuable in terms of additional progress that can be made for something that is relatively low cost to implement. Research suggests that there is a link between metacognition and student attainment. ReflectED is a metacognition-based programme developed by Rosendale Primary School, in partnership with London Connected Learning Centre (London CLC) and the National Education Trust (NET). A previous evaluation of ReflectED reported a positive impact on student progress in maths. Research about metacognition also suggests positive links to reading. ReflectED is a whole school approach delivered through a series of pre-prepared lesson plans spanning Reception to Key Stage 2 (KS2). Teachers provide opportunities for pupils to make reflections and make use of the metacognitive skills in their day-to-day learning. The aim of this study is to investigate the effectiveness of the whole school application of ReflectED on attainment in maths and reading for students in KS1 and KS2. This study is also exploring the impact of ReflectED on student’s self-reported levels of metacognition in KS2.

Who can participate?
Students in schools that have signed up to participate in the evaluation of ReflectED. The evaluation focuses on students who are in year 5 and year 1 in January 2018 and who will therefore be in year 6 and year 2 respectively in July 2020.

What does the study involve?
Schools are randomly allocated to one of two groups. The schools in the first group receive ReflectED, and also receive funding to cover the costs of releasing specified staff to attend training. ReflectED is a whole school approach delivered through a series of pre-prepared lesson plans spanning Reception to Key Stage 2 (KS2). Teachers provide opportunities for pupils to make reflections and make use of the metacognitive skills in their day-to-day learning. The whole school approach to ReflectED being evaluated includes a visit to Rosendale School, an initial day of training (launch event) for head teachers and their nominated lead practitioners and termly local hub training sessions which they then cascade to the remaining teachers in each intervention school. The schools in the second group continue as usual in their approach to teaching, they are an offered alternative (one session) training opportunity, are given the option to access ReflectED after the study and are offered a small financial incentive (£250). At the end of the school year, students' math and English exams results are reviewed to see if there has been any change in their achievement levels.

What are the possible benefits and risks of participating?
Participants may benefit from potentially improving their mathematics, reading or metacognition skills. There are no notable risks involved with taking part in this study.

Where is the study run from?
The study is a collaboration involving York Trials Unit, University of York; the School of Education, Durham University and the Department of Education, University of York. The study takes place in primary schools in the UK.

When is the study starting and how long is it expected to run for?
February 2017 to March 2020

Who is funding the study?
Education Endowment Foundation (UK)

Who is the main contact?
1. Dr Louise Gascoine (public)
2. Prof. David Torgerson (scientific)

Trial website

https://www.york.ac.uk/healthsciences/research/trials/research/trials/reflected/

Contact information

Type

Public

Primary contact

Dr Louise Gascoine

ORCID ID

http://orcid.org/0000-0002-5688-6176

Contact details

York Trials Unit
Department of Health Sciences
University of York
York
YO10 5DD
United Kingdom

Type

Scientific

Additional contact

Prof David Torgerson

ORCID ID

Contact details

York Trials Unit
Department of Health Sciences
University of York
York
YO10 5DD
United Kingdom

Additional identifiers

EudraCT number

ClinicalTrials.gov number

Protocol/serial number

ReflectED protocol September 2017_1.8

Study information

Scientific title

Independent Evaluation of ReflectED metacognition: a pragmatic two armed cluster randomised controlled trial

Acronym

Study hypothesis

Primary research questions:
1. How effective is ReflectED in improving pupil outcomes in maths at the end of KS2?
2. How effective is ReflectED in improving pupil outcomes in reading at the end of KS2?

Secondary research questions:
1. How effective is ReflectED in improving pupil outcomes in maths at the end of KS1?
2. How effective is ReflectED in improving pupil outcomes in reading at the end of KS1?
3. How effective is ReflectED in improving pupil outcomes in grammar, punctuation and spelling (GPS) at the end of KS2?
4. How effective is ReflectED in improving primary and secondary outcomes for pupils with Free School Meals (FSM)?
5. Does ReflectED have an impact on metacognition for pupils in KS2, as measured by the Junior Metacognitive Awareness Inventory (JrMAI)?

Ethics approval

School of Education, Durham University, 09/10/2017, ref: 2840

Study design

Pragmatic two-armed cluster randomised controlled trial

Primary study design

Interventional

Secondary study design

Cluster randomised trial

Trial setting

Schools

Trial type

Other

Patient information sheet

Not available in web format, please use contact details to request a participant information sheet

Condition

Students in year 1 and year 5 at the beginning of the intervention period (academic year 2017/2018) in trial schools

Intervention

Randomisation is implemented at school level, ReflectED is a whole school intervention taught across Reception - KS2 (aged 4 - 11 years, primary school). The data collected in this study, for the purposes of evaluating ReflectED, will have a dual focus on KS1 (pupils aged 5 - 6 years in year 1 at the beginning of the intervention period in January 2018) and KS2 (pupils in year 5 aged 9 - 10 years at the beginning of the intervention period in January 2018). Randomisation will be stratified by geographical location, school size and percentage of EverFSM (a record that shows if students have been entitled to FSM (free school meals)). Participating schools will be randomised to one of two conditions: the intervention group or the control group.

Participating schools allocated to the intervention group will receive ReflectED as described below:

ReflectED is a metacognition based programme developed by Rosendale Primary School, in partnership with London Connected Learning Centre (London CLC) and the National Education Trust (NET). ReflectED focuses on metacognition skills (helping learners to think about their own learning and reflect on ‘learning moments and strategies’) to support attainment (ReflectED, 2017). ReflectED is a whole school approach delivered through a series of pre-prepared lesson plans spanning Reception to Key Stage 2 (KS2) (including technology aided reflection and other visual scaffolds). Teachers provide opportunities for pupils to make reflections and make use of the metacognitive skills in their day-to-day learning. The whole school approach to ReflectED being evaluated includes a visit to Rosendale School, an initial 1 day of training (launch event) for head teachers and their nominated lead practitioners and termly local hub training sessions. Training received by the lead teacher and head teacher is cascaded to the remaining teachers in each intervention school. Intervention schools will be expected to release specified staff for training, for this they will be provided with funding to provide cover to release the specified staff.

Participating schools allocated to the control group will be required to continue with business as usual (usual teaching). Control schools will be provided with a choice of local and high quality professional development options during the intervention period and will be eligible for a financial payment of £250 following their submission of the final data collected at the end of the trial. Control schools will also have free access to ReflectED for the following academic year (2019-2020).

Intervention type

Behavioural

Phase

Drug names

Primary outcome measure

Raw KS2 scores in maths and reading for the Year 5 pupils (at the end of Year 6, when they will be aged 10-11 years), collected from the National Pupil Database (NPD). The NPD holds information (exam results, student characteristics) about all students who attend schools in England. This primary outcome data will be collected in summer 2019.

Secondary outcome measures

KS1 maths raw scores and the KS1 reading raw scores collected from schools (encrypted and transferred securely) for the Year 1 pupils (at the end of Year 2, when they will be aged 6-7 years old)

Additional secondary outcomes for KS2 will be:
1. Grammar, punctuation and spelling (GPS) score collected via NPD in summer 2019
2. Junior Metacognitive Awareness Inventory (JrMAI, version A). This data will be collected by the evaluation team at baseline (autumn 2017) and at the end of the intervention period (summer 2019). The JrMAI is a self-report measure that will be administered by class teachers and returned in an anonymous form to the the evaluation team

Overall trial start date

08/02/2017

Overall trial end date

31/03/2020

Reason abandoned (if study stopped)

Eligibility

Participant inclusion criteria

Schools will be eligible to participate if they are not currently implementing ReflectED Metacognition and are willing to implement the programme throughout the school (including participating in training), if they are randomised to the intervention group. There will be an emphasis on recruiting schools with average or higher proportions of disadvantaged pupils (as measured by EverFSM in the National Pupil Database).

Participant type

Other

Age group

Child

Gender

Both

Target number of participants

140 schools (8400 children)

Participant exclusion criteria

Not meeting inclusion criteria (as specified)

Recruitment start date

09/10/2017

Recruitment end date

30/11/2017

Locations

Countries of recruitment

United Kingdom

Trial participating centre

York Trials Unit
University of York
York
YO10 5DD
United Kingdom

Trial participating centre

School of Education, Durham University
Leazes Road
Durham
DH1 1TA
United Kingdom

Trial participating centre

Department of Education
University of York
York
YO10 5DD
United Kingdom

Sponsor information

Organisation

University of York

Sponsor details

Research Innovation Office
Innovation Centre
York Science Park
York
YO10 5DD
United Kingdom

Sponsor type

University/education

Website

Funders

Funder type

Charity

Funder name

Education Endowment Foundation (EEF), UK

Alternative name(s)

Funding Body Type

Funding Body Subtype

Location

Results and Publications

Publication and dissemination plan

1. Study documents (SAP, protocol etc) will be published on the funder website as soon as possible: https://educationendowmentfoundation.org.uk/
2. Publication of a final report by the Education Endowment Foundation
3. Planned publication of the outcomes of the research in academic journals

IPD sharing statement
The datasets generated during and/or analysed during the current study will be deposited in the EEF Data Archive (in association with the Fischer Family Trust). Enquiries to FFT’s Datalab can be made via educationdatalab@fft.org.uk.

Intention to publish date

31/03/2020

Participant level data

Stored in repository

Basic results (scientific)

Publication list

Publication citations

Additional files

Editorial Notes

10/10/2017: Ethics approval details added.