KEEP Teaching is a programme that aims to improve the job satisfaction of physics newly qualified teachers by increasing their time teaching physics

ISRCTN ISRCTN25814325
DOI https://doi.org/10.1186/ISRCTN25814325
Submission date
08/09/2023
Registration date
25/09/2023
Last edited
21/01/2025
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data

Plain English summary of protocol

Background and study aims
KEEP Teaching is a programme that aims to improve the job satisfaction of Newly Qualified Teachers (NQTs) of physics by increasing the proportion of time they spend teaching physics. Guidance materials are provided to schools based on an initial assessment of their timetabling processes with an aim to increase the amount of time these NQTs spend teaching physics.

Who can participate?
Adult physics NQTs aged between 18 and 65 years old working at non-selective state schools in England

What does the study involve?
The unit of analysis is a school-NQT pairing. A pairing randomised to receive the programme will receive an email offering timetabling guidance. These materials may include guidance, example timetables and direct feedback upon timetables. All NQTs will complete a survey towards the end of their NQT year, which will include a series of questions that will allow us to create a validated measure of job satisfaction.

What are the possible benefits and risks of participating?
The possible benefits of participation are improved job satisfaction for NQTs and improved teacher retention for schools. No risks associated with participating are foreseen. Schools and NQTs can withdraw from the study at any time.

Where is the study run from?
The evaluation is being carried out by the University College London (UCL) Institute of Education (IOE) (UK). The KEEP Teaching programme is designed and delivered by the Institute of Physics (IOP) (UK)

When is the study starting and how long is it expected to run for?
June 2018 to June 2023

Who is funding the study?
The Education Endowment Foundation (UK)

Who is the main contact?
David Wilkinson, d.wilkinson@ucl.ac.uk (UK)

Study website

Contact information

Mr David Wilkinson
Principal Investigator

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

ORCiD logoORCID ID 0000-0001-5934-3540
Phone +44(0)2076126211
Email d.wilkinson@ucl.ac.uk
Mr David Wilkinson
Scientific

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Phone +44(0)2076126211
Email d.wilkinson@ucl.ac.uk
Mr David Wilkinson
Public

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Phone +44(0)2076126211
Email d.wilkinson@ucl.ac.uk

Study information

Study designTwo-arm randomized controlled trial with school (teacher)-level allocation
Primary study designInterventional
Secondary study designRandomised controlled trial
Study setting(s)School
Study typeQuality of life
Participant information sheet Not available in web format
Scientific titleA randomised trial of whether KEEP Teaching, an intervention designed to increase the proportion of time that Physics Newly Qualified Teachers spend teaching Physics, improves their job satisfaction.
Study acronymKEEP Teaching
Study objectives1. What is the size of the effect of the KEEP Teaching intervention on the job satisfaction of physics NQTs towards the end of their NQT year?
2. What is the size of the effect of the KEEP Teaching intervention on the retention within the teaching profession of physics NQTs three years after starting their NQT year at that school, compared to a business-as-usual control?
3. What is the size of the effect of the KEEP Teaching intervention on the retention within a school of physics NQTs three years after starting their NQT year at that school, compared to a business-as-usual control?
4. What is the association between the extent of ‘matchedness’ and job satisfaction, as well as ‘matchedness' and teacher retention?
Ethics approval(s)

Approved 13/06/2019, UCL Institute of Education Research Ethics Committee (20 Bedford Way, London, WC1H 0AL, United Kingdom; None provided; ioe.researchethics@ucl.ac.uk), ref: Z6364106 2019 05 102

Health condition(s) or problem(s) studiedPhysics teacher job satisfaction
InterventionThe unit of analysis for this trial will be non-selective state schools within England that have recruited a physics NQT. For the purposes of this project, a physics NQT is defined as someone with a physics or ‘maths with physics’ degree or mechanical, civil or electrical engineering degree; and/or someone with a physics or physics and maths Postgraduate Certificate in Education (PGCE) (or Qualified Teacher Status (QTS)-equivalent teaching certificate labelled as specialising in physics or physics and maths). Tailored guidance materials are provided to schools based on an initial assessment of their timetabling processes. These materials may include guidance, example timetables and direct feedback upon timetables.

Once a matched pair of physics NQT and eligible schools are allocated to a trial condition, the Institute of Physics (IOP) team will offer guidance to promote ‘matchedness’ of the timetable for the physics NQT, if they are a treatment school. A timetable is more matched if the physics NQT has a greater proportion of their lessons in physics. Once a draft timetable is produced, this will be shared with the IOP who may repeat the cycle of guidance and provide feedback to maximise ‘matchedness’.

Schools will be recruited into the trial over the course of three years with a target of 60 to 70 schools per year. Schools will be randomly allocated to treatment or control as soon as they join the trial using sequential treatment allocation, to maximise the amount of time the implementation team have to work with schools before schools finalise their timetable.

To allow sequential treatment allocation while also ensuring equal-size treatment and control groups, the following method will be adopted for randomisation:
1. A dataset is generated with two hundred rows labelled 1, 2, 3... 200.
2. Flip a coin (using the computer) for row 1. Row 1 is assigned to treatment if it is heads, or to control if it is tails.
3. The process repeats for the following 199 rows.
4. The number of heads is checked. If the number of heads is not 100, steps 1-4 are repeated until a dataset with exactly 100 heads is generated.
5. The first school recruited to the trial is assigned to treatment if row 1 is a treatment row, or to control if row 1 is a control row.
6. The process is repeated in step 5 for the next 199 schools recruited to the trial.
Sequential allocation is sometimes critiqued because it can introduce biases when the recruiter knows what the next allocation will be. In this study, this approach is acceptable because the evaluation team will conduct the randomisation and the recruiter will not know what the next allocation will be. The randomisation process will be recorded in the syntax and log files used to carry out the randomisation and included as an appendix in the evaluation report.
Intervention typeBehavioural
Primary outcome measureNQT job satisfaction measured using a short online survey in the summer term of the NQT year
Secondary outcome measuresThe following secondary outcome measures will be measured by matching the NQTs to the School Workforce Census for the three years following their NQT year:
1. NQT retention in the profession - whether the NQT remains in the teaching profession in the state sector
2. NQT retention in school - whether the NQT remains in the same school as they were for their NQT year
Overall study start date15/06/2018
Completion date01/06/2023

Eligibility

Participant type(s)Employee
Age groupAdult
Lower age limit18 Years
Upper age limit65 Years
SexBoth
Target number of participants200
Total final enrolment227
Key inclusion criteriaThe unit of analysis for this trial will be non-selective state schools within England that have recruited a physics NQT.

For the purposes of this project, a physics NQT is defined as:
1. Having a physics or ‘maths with physics’ degree or a mechanical, civil or electrical engineering degree
AND/OR
2. A physics or physics and maths Postgraduate Certificate in Education (PGCE) (or QTS-equivalent teaching certificate labelled as specialising in physics or physics and maths)
Key exclusion criteria1. Not participated in a requisite training course
2. Not agreed to Memorandum of Understanding
Date of first enrolment14/06/2019
Date of final enrolment31/05/2022

Locations

Countries of recruitment

  • England
  • United Kingdom

Study participating centre

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Sponsor information

Education Endowment Foundation
Charity

5th Floor, Millbank Tower
21-24 Millbank
London
SW1P 4QP
England
United Kingdom

Phone +44 (0)2045363999
Email info@eefoundation.org.uk
Website https://educationendowmentfoundation.org.uk/
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Charity

Education Endowment Foundation
Private sector organisation / Trusts, charities, foundations (both public and private)
Alternative name(s)
EducEndowFoundn, Education Endowment Foundation | London, EEF
Location
United Kingdom

Results and Publications

Intention to publish date
Individual participant data (IPD) Intention to shareYes
IPD sharing plan summaryStored in non-publicly available repository
Publication and dissemination planThe final report will be published on the following page: https://educationendowmentfoundation.org.uk/projects-and-evaluation/projects/keep-teaching
IPD sharing planThe datasets generated during and/or analysed during the current study will be stored in the non-publicly available EEF data repository

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Protocol file version 2.0 07/02/2022 11/09/2023 No No
Statistical Analysis Plan version 1.0 16/02/2023 11/09/2023 No No
Funder report results 01/08/2024 21/01/2025 No No

Additional files

44258_Protocol_v2.0_07February2022.pdf
44258_SAP_v1.0_16February2023.pdf

Editorial Notes

21/01/2025: Funder report added. The overall study end date was changed from 30/11/2026 to 01/06/2023.
25/09/2023: Study's existence confirmed by the UCL Institute of Education Research Ethics Committee (UK).