ISRCTN ISRCTN28630907
DOI https://doi.org/10.1186/ISRCTN28630907
Secondary identifying numbers P13232
Submission date
10/09/2019
Registration date
26/09/2019
Last edited
22/09/2021
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data
Record updated in last year

Plain English summary of protocol

Background and study aims
The University of Lincoln’s ASCENTS 121 support for science programme trains STEM undergraduates across five universities to provide one to one science tutoring to Year 11 pupils. Tutees are all eligible for pupil premium and predicted to achieve a level 3-5 in GCSE science. Primarily, pupils receive 23 one hour tutoring sessions (one hour per week for 23 weeks throughout Year 11). Delivered by trained undergraduates, these take place at school, outside of the school timetable and the topic of each session is determined by the Year 11 pupil. These sessions are also supplemented by a six hour revision session held at a university just before their GCSE exam. The University of Lincoln have previously carried out a small study to evaluate the ASCENTS programme in four schools with 86 Year 11 students. The study found that students who were tutored achieved better in their GCSE science examinations than those who were not, with an effect that equates to an additional 4 months of progress. This study will enable more rigorously evaluate the programme and find out whether it positively impacts pupils across a larger number of schools. More broadly, there is good evidence that tutoring is an effective way to improve attainment. However, due to high cost, disadvantaged pupils may struggle to access one to one tuition, while schools may find it difficult to fund tutoring interventions. Programmes like ASCENTS, directly targeting pupil premium pupils and provided by universities, could expand access.

Who can participate?
ASCENTS will be delivered by undergraduate students (mentors) in their 2nd or 3rd year of study for a degree in a science-related subject, to Year 11 pupils (mentees) eligible for pupil premium, predicted a grade 3 to 5 in GCSE combined double award science(foundation or higher)

What does the study involve?
Pupils are randomly allocated to receive 23 hours of one-to-one mentoring in science over 23 weeks plus a day-trip to visit a university, or to receive usual science teaching and support. The impact of the ASCENTS programme on GCSE science attainment is measured. The study also looks at how the programme is implemented across different schools and universities and the barriers and facilitators to implementation.


What are the possible benefits and risks of participating?
The expected benefits are higher attainment in science and greater interest in science. The main risk of participating is a displacement effect (i.e. higher attainment in science at the cost of a lower attainment in other subjects such as English or maths).

Where is the study run from?
1. National Centre for Social Research (NatCen) (UK)
2. Schools within the vicinity of the university partners in Lincoln, London, Leeds, Liverpool and York (UK)

When is the study starting and how long is it expected to run for?
August 2018 to July 2020

Who is funding the study?
Education Endowment Foundation (UK)

Who is the main contact?
Dr Arnaud Vaganay
arnaud.vaganay@natcen.ac.uk

Study website

Contact information

Dr Arnaud Vaganay
Public

35 Northampton Square
London
EC1V 0AX
United Kingdom

ORCiD logoORCID ID 0000-0001-5584-9050
Phone +44 (0)207 250 1866
Email arnaud.vaganay@natcen.ac.uk

Study information

Study designMulti-site efficacy trial with randomisation at the individual level
Primary study designInterventional
Secondary study designRandomised controlled trial
Study setting(s)School
Study typeOther
Participant information sheet http://www.natcen.ac.uk/taking-part/studies-in-field/evaluation-of-ascents-121-support-for-science/
Scientific titleEffect of one-to-one mentoring on attainment among Year 11 pupils in England: a randomised controlled trial
Study acronymASCENTS
Study objectives1. What is the impact of ASCENTS on the Science attainment of disadvantaged Year 11 pupils in England?
2. What is the impact of ASCENTS on the Maths attainment of disadvantaged Year 11 pupils in England?
3. What is the impact of ASCENTS on the English attainment of disadvantaged Year 11 pupils in England?
4. What is the impact of ASCENTS on enrolment in Science A- and AS-levels?
5. How does the impact of ASCENTS differ by prior levels of attainment?
Ethics approval(s)Approved 11/01/2019, NatCen’s Research Ethics Committee (35 Northampton Square, London EC1V 0AX, UK; Tel: +44 (0)20 7250 1866; Email: info@natcen.ac.uk), ref: P13232
Health condition(s) or problem(s) studiedInequalities in education
InterventionRandomisation was undertaken at the pupil level using Stata software.

Pupils in the treatment group are expected to receive 23 hours of one-to-one mentoring in science over 23 weeks plus a day-trip to visit a university. Pupils in the control group will receive usual science teaching and support.

ASCENTS 121 Support for Science (hereafter ‘ASCENTS’) trains STEM undergraduates to provide one-to-one science support to disadvantaged Year 11 pupils in local schools. STEM undergraduates from five different universities will be trained to deliver mentoring sessions. The programme will run in 35 schools from September 2019 to May 2020.

For the purpose of this study, mentoring is defined as the provision of intensive, individualised and subject-specific support by a teacher, teaching assistant or another adult, to a pupil. It is important to note that this definition usually refers to the activity of tutoring rather than mentoring. As ASCENTS was also developed with a view to building confidence and resilience among pupils, it was felt by the developers that the term tutoring was too restrictive. Throughout this protocol, the terms ‘mentoring’ and ‘tutoring’ will be taken to have broadly the same meaning.
Intervention typeBehavioural
Primary outcome measureScience attainment: the baseline measure will be science attainment at Key Stage 2 or maths attainment at Key Stage 2 or English attainment at Key Stage 2 (the researchers will choose the measure explaining the most variance in science attainment at GCSE. This will be confirmed in the statistical analysis plan). The endline measure will be the grade achieved in Full GCSE Double Award Science. All data will be derived from the National Pupil Database (NPD).
Secondary outcome measures1. Maths attainment: the baseline measure will be Maths attainment at Key Stage 2. The endline measurement will be the NPD variable that records the highest grade achieved in full GCSE Maths.
2. English attainment: the baseline measure will be English attainment at Key Stage 2. The endline measurement will be the NPD variable that records the highest grade achieved in full GCSE English.
3. Pupils’ progress to A- or AS- level science (Biology, Chemistry or Physics) two years after collection of GCSE attainment data in 2022. The researchers will create a binary variable to indicate whether pupils sat an A- or AS-level science exam, which will act as a proxy for whether pupils go on to study science at A-level. This will be based on NPD-derived A- or AS-level attainment grades in any of the three aforementioned science subjects. Any science outcome indicating a pupil was graded or ungraded (A-E and N, Q, U, or X) will be classified as ‘progression to A- or AS- level science’, while not enrolling for AS-or A-level science will be classified as ‘did not progress to A- or AS- level science’.
All data will be derived from the National Pupil Database (NPD)
Overall study start date01/08/2018
Completion date31/07/2020

Eligibility

Participant type(s)Mixed
Age groupMixed
SexBoth
Target number of participants770
Key inclusion criteriaASCENTS will be delivered by undergraduate students (mentors) to Year 11 pupils (mentees)

In order to be eligible to take part, mentors must meet the following criteria:
1. Be in their 2nd or 3rd year of study during the academic year of mentoring sessions (i.e. 2019/2020)
2. Studying for a degree in a science-related subject that confers a BSc degree or integrated master’s degree
3. Minimum of a C grade in GCSE English, Maths and Science
4. Minimum of one A-level in either Biology, Chemistry, Physics or Psychology at grade C or higher

In order to be eligible to take part, schools must meet the following criteria:
1. State, mixed-sex schools
2. Schools within the vicinity of the university partners in Lincoln, London, Leeds, Liverpool and York

In order to be eligible to take part, mentees must meet the following criteria:
1. Be in Year 11 during the academic year of mentoring sessions (i.e. 2019/20)
2. Eligible for pupil premium
3. Predicted a grade 3 to 5 in GCSE science
4. Studying combined double award science (foundation or higher)
Key exclusion criteriaDoes not meet inclusion criteria
Date of first enrolment07/01/2019
Date of final enrolment10/09/2019

Locations

Countries of recruitment

  • England
  • United Kingdom

Study participating centre

National Centre for Social Research (NatCen)
35 Northampton Square
London
EC1V 0AX
United Kingdom

Sponsor information

Education Endowment Foundation
Charity

5th Floor, Millbank Tower
21-24 Millbank
London
SW1P 4QP
United Kingdom

Phone +44 (0)207 802 1676
Email info@eefoundation.org.uk
Website https://educationendowmentfoundation.org.uk
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Charity

Education Endowment Foundation
Private sector organisation / Trusts, charities, foundations (both public and private)
Alternative name(s)
EducEndowFoundn, Education Endowment Foundation | London, EEF
Location
United Kingdom
Wellcome Trust
Private sector organisation / International organizations
Location
United Kingdom

Results and Publications

Intention to publish date30/05/2021
Individual participant data (IPD) Intention to shareNo
IPD sharing plan summaryStored in repository
Publication and dissemination planCurrent publication and dissemination plan as of 22/09/2021:
The impact evaluation of ASCENTS 121 Support for Science was cancelled due to the COVID-19 pandemic and consequent changes in GCSE grading. While almost all of the programme was delivered, the evaluation could not use 2020’s GCSE grading system to reliably estimate the impact of the intervention. A standalone implementation and process evaluation (IPE) was conducted, involving interviews with university project leads and school teachers, observations of mentor training, and surveys with teachers, mentors and mentees. The following publications can be found on the website of the Education Endowment Foundation :
1. The evaluation protocol (impact assessment and IPE)
2. The Statistical Analysis Plan
3. The evaluation report, including the findings from the IPE only

Previous publication and dissemination plan:
1. A protocol will be published on the website of the Education Endowment Foundation in September 2019
2. A Statistical Analysis Plan will be published on the same website in October 2019. See:
https://educationendowmentfoundation.org.uk/projects-and-evaluation/projects/ascents-121-support-for-science/
IPD sharing planThe dataset(s) used in the above-mentioned analyses will be anonymised and archived in a repository managed by FFT Education Datalab: https://ffteducationdatalab.org.uk/. Data and results will be available around November 2021.

Editorial Notes

22/09/2021: The publication and dissemination plan has been updated.
25/09/2019: Trial's existence confirmed by ethics committee.