Evaluating a mastery approach to teaching English in Key Stage 3

ISRCTN ISRCTN76965629
DOI https://doi.org/10.1186/ISRCTN76965629
Submission date
05/04/2022
Registration date
05/04/2022
Last edited
19/07/2023
Recruitment status
No longer recruiting
Overall study status
Ongoing
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data
Record updated in last year

Plain English summary of protocol

Background and study aims
The aim of English Mastery is to improve achievement in the subject of English. This is done by providing teachers with subject-specific training, curriculum materials and ongoing in-school support and coaching.

Who can participate?
Key Stage 3 pupils (Years 7 and 8, ages 11-13 years).

What does the study involve?
EM is delivered through in-class teaching during regular timetabled English lessons. Weekly departmental co-planning materials are provided to aid teachers in adapting the English Mastery lessons for their pupils. Teachers also receive training and support through induction, additional training for the KS3 lead, remote development sessions, biannual school coaching visits, Assessing for Mastery standardisation sessions each term and optional webinar workshops. All pupils receive the same dosage and study the same topics, but the foundation curriculum is designed to be accessible to lower attaining pupils (such as through the use of abridged texts).

What are the possible benefits and risks of participating?
Pupils could benefit from higher attainment in English. The intervention is delivered in class and presents no conceivable additional risks.

Where is the study run from?
Sheffield Institute of Education (UK) is the independent evaluator. Ark Curriculum (UK) have designed the intervention and is responsible for the teacher training and ongoing support for schools.

When is the study starting and how long is it expected to run for?
January 2022 to January 2026

Who is funding the study?
Education Endowment Foundation (UK)

Who is the main contact?
Dr Martin Culliney, m.culliney@shu.ac.uk

Study website

Contact information

Dr Martin Culliney
Principal Investigator

10101 Arundel Building
Sheffield
S1 1AY
United Kingdom

ORCiD logoORCID ID 0000-0002-7329-8675
Phone +44 1142256072
Email m.culliney@shu.ac.uk

Study information

Study designTwo-arm three-level cluster randomised controlled trial
Primary study designInterventional
Secondary study designCluster randomised trial
Study setting(s)School
Study typeOther
Participant information sheet No participant information sheet available
Scientific titleEvaluation of English mastery
Study objectivesThe mastery approach to English leads to improved attainment among Key Stage 3 pupils as measured by the GL Assessment Progress Test in English
Ethics approval(s)Approved 26/01/2022, Sheffield Hallam University ethics committee (no address provided; no telephone number provided; ethicssupport@shu.ac.uk), ref: ER40773698
Health condition(s) or problem(s) studiedEnglish teaching in schools
InterventionCurrent intervention as of 21/07/2022:
The units of randomisation are schools.
Those allocated to the intervention group send their Y7 and Y8 English teachers to training provided by Ark English Mastery. These teachers then teach the relevant cohort (all Y7 pupils in 2022/23 and all Y8 pupils in 2023/24 for cohort 1, or all Y7 pupils in 2023/24 and all Y8 pupils in 2024/25 for cohort 2) using the English Mastery approach. Control schools teach on a 'business-as-usual' basis during this period.


Previous intervention:
The units of randomisation are schools.
Those allocated to the intervention group send their Y7 and Y8 English teachers to training provided by Ark English Mastery. These teachers then teach the relevant cohort (all Y7 pupils in 2022/23 and all Y8 pupils in 2023/24) using the English Mastery approach. Control schools teach on a 'business-as-usual' basis during this period.
Intervention typeBehavioural
Primary outcome measureCurrent primary outcome measure as of 21/07/2022:
Attainment in English, measured using KS2 Reading and GPS (combined) taken at end of Y6 (2022 for cohort 1, or 2023 for cohort 2) as a baseline and the GL Progress Test in English at end of Y8 (2024 for cohort 1, 2025 for cohort 2)


Previous primary outcome measure:
Attainment in English, measured using KS2 Reading and GPS (combined) taken at end of Y6 (2022) as a baseline and the GL Progress Test in English at end of Y8 (2024)
Secondary outcome measuresCurrent secondary outcome measures as of 21/07/2022:
Attainment in English, measured using KS2 Reading and GPS (separate) taken at end of Y6 (2022 for cohort 1, or 2023 for cohort 2) as a baseline and the GL Progress Test in English subscales (Reading; Spelling, punctuation and grammar) at end of Y8 (2024 for cohort 1, 2025 for cohort 2)


Previous secondary outcome measures:
Attainment in English, measured using KS2 Reading and GPS (separate) taken at end of Y6 (2022) as a baseline and the GL Progress Test in English subscales (Reading; Spelling, punctuation and grammar) at end of Y8 (2024)
Overall study start date01/01/2022
Completion date31/01/2026

Eligibility

Participant type(s)Other
Age groupChild
SexBoth
Target number of participants8640 pupils across 120 schools. 60 schools will be recruited in 2022 for cohort 1 and 60 schools will be recruited in 2023 for cohort 2.
Key inclusion criteriaCurrent participant inclusion criteria as of 21/07/2022:
1. Non-academically selective, state secondary schools
2. In the East Midlands and Humber, North or West Midlands regions of England
3. Not delivered English Mastery previously
4. Has three or more hours of timetabled English lessons for Year 7 in 2022-23 and for Year 8 in 2023-24 (cohort 1), or for Year 7 in 2023-24 and for Year 8 in 2024-25 (cohort 2)


Previous participant inclusion criteria:
1. Non-academically selective, state secondary schools
2. In the East Midlands and Humber, North or West Midlands regions of England
3. Not delivered English Mastery previously
4. Has three or more hours of timetabled English lessons for Year 7 in 2022-23 and for Year 8 in 2023-24
Key exclusion criteriaDoes not meet inclusion criteria
Date of first enrolment01/03/2022
Date of final enrolment30/09/2023

Locations

Countries of recruitment

  • England
  • United Kingdom

Study participating centre

Sheffield Institute of Education
Arundel Building
Sheffield
S1 1AY
United Kingdom

Sponsor information

Education Endowment Foundation
Charity

5th Floor, Millbank Tower
21 – 24 Millbank
London
SW1P 4QP
England
United Kingdom

Phone +44 204 536 3999
Email info@eefoundation.org.uk
Website https://educationendowmentfoundation.org.uk/
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Government

Department for Education, UK Government
Government organisation / National government
Alternative name(s)
Department for Education, educationgovuk, DfE
Location
United Kingdom

Results and Publications

Intention to publish date01/07/2026
Individual participant data (IPD) Intention to shareYes
IPD sharing plan summaryStored in non-publicly available repository, Available on request
Publication and dissemination planThe evaluation report will be published on the EEF website
IPD sharing planAt the end of the project, data on all participating pupils will be submitted to the EEF’s Data Archive. At this point, EEF and DfE will be data controllers and contractors appointed to manage the Data Archive will be data processors. The evaluation data will also be linked with information about the students from the National Pupil Database (NPD), and shared with Department for Education, the EEF’s archive manager and, in an anonymised form, with the Office for National Statistics, the UK Data Archive, and potentially other approved researchers.

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Protocol (other) 19/10/2022 No No

Editorial Notes

19/07/2023: The recruitment end date was changed from 31/07/2023 to 30/09/2023.
19/10/2022: Protocol uploaded (not peer reviewed).
21/07/2022: The following changes have been made:
1. The intervention has been updated.
2. The primary outcome measure has been updated.
3. The secondary outcome measures have been updated.
4. The participant inclusion criteria have been updated.
5. The target number of participants has been changed from "8640 pupils across 120 schools" to "8640 pupils across 120 schools. 60 schools will be recruited in 2022 for cohort 1 and 60 schools will be recruited in 2023 for cohort 2.".
20/07/2022: The following changes have been made:
1. The recruitment end date has been changed from 31/07/2022 to 31/07/2023.
2. The overall trial end date has been changed from 31/01/2025 to 31/01/2026 and the plain English summary has been updated to reflect this change.
3. The intention to publish date has been changed from 01/07/2025 to 01/07/2026.
05/04/2022: Trial's existence confirmed by Education Endowment Foundation.