Condition category
Not Applicable
Date applied
26/10/2017
Date assigned
02/11/2017
Last edited
02/11/2017
Prospective/Retrospective
Retrospectively registered
Overall trial status
Ongoing
Recruitment status
No longer recruiting

Plain English Summary

Background and study aims:
CREST is a nationwide extra-curricular award scheme. It aims to help students develop their Science, Technology, Engineering and Maths (STEM) skills through student-led project work. It is coordinated by the British Science Association (BSA). CREST has four levels – Discovery, Bronze, Silver and Gold. The aim of this study is to assess the difference that the CREST Silver Award makes to students' performance in STEM subjects, as well as the difference it makes to their confidence, attitudes to school and future aspirations.

Who can participate?
Year 9 pupils (aged 13-14) at participating schools

What does the study involve?
Participating schools are randomly allocated to one of two groups. Group 1 schools support the Year 9 students who have expressed an interest in taking part to carry out a student-led STEM project over the course of two academic terms. This involves at least 30 hours of student-led project work. Schools receive guidance from BSA on delivering the CREST Silver Award and have the flexibility to deliver CREST Silver during class, during a lunchtime/after school club, or a placement outside of school. Group 2 schools teach STEM subjects as they would do normally in Year 9.

What are the possible benefits and risks of participating?
The intervention is designed to improve confidence and attitudes to science, leading to higher aspirations and rates of attainment. There is relatively strong evidence that project work that requires students to solve a problem independently (rather than being presented with information by a teacher) has benefits for students. There are no risks for participating students.

Where is the study run from?
The project is being run in about 200 schools, recruited to take part by the British Science Association (BSA)

When is the study starting and how long is it expected to run for?
November 2016 to March 2021

Who is funding the study?
Education Endowment Foundation (EEF) (UK)

Who is the main contact?
Margaret Anderson
margaret.anderson@natcen.ac.uk

Trial website

http://www.natcen.ac.uk/taking-part/studies-in-field/evaluation-of-the-crest-silver-award-programme/what-is-the-crest-silver-award-programme/

Contact information

Type

Public

Primary contact

Ms Margaret Anderson

ORCID ID

Contact details

NatCen Social Research
35 Northampton Square
London
EC1V 0AX
United Kingdom
+44 (0)207 549 9549
margaret.anderson@natcen.ac.uk

Additional identifiers

EudraCT number

ClinicalTrials.gov number

Protocol/serial number

NatCen REF P12153

Study information

Scientific title

CREST Silver Award Scheme: a randomised controlled trial

Acronym

Study hypothesis

The CREST Award programme is an extra-curricular award scheme to help students build their Science Technology, Engineering and Maths (STEM) skills and demonstrate personal achievement through independent project work. The main hypothesis is that Year 9 pupils who participate in the CREST Silver Award scheme will have better attainment in science than equivalent pupils receiving a business-as-usual approach to the teaching of STEM. The secondary hypothesis is that pupils who participate in the CREST Silver Award scheme will have improved confidence, attitudes to school, self-efficacy in science and future aspirations in science, compared with the control.

Ethics approval

NatCen Social Research Ethics Committee, 21/04/2017

Study design

Randomised controlled trial

Primary study design

Interventional

Secondary study design

Randomised controlled trial

Trial setting

Schools

Trial type

Other

Patient information sheet

Not available in web format, please use contact details to request a participant information sheet

Condition

STEM knowledge

Intervention

Schools agreeing to take part in the trial will invite eligible students, whose parents have not opted them out, to express an interest in taking part. It is a two-arm cluster (school-level) randomised controlled effectiveness trial, so as soon as all baseline data has been collected, schools will be assigned to one of two groups. Randomisation will be stratified by the proportion of pupils who have everFSM status and prior attainment. On each dimension, recruited schools will be split into two equally-sized groups of high and low measures of the dimension’s scale. Assignment will take place within the combined groups.

The project involves schools being randomly allocated (50:50 chance) to one of two groups:
1. Group 1: Schools that deliver the CREST Silver Award to eligible Year 9 students who have expressed an interest in taking part
2. Group 2: Schools that teach STEM subjects as they would normally in Year 9

Those delivering the CREST Silver Award (Group 1) will support the Year 9 students taking part to carry out a student-led STEM project over the course of two academic terms. This involves at least 30 hours of student-led project work. Completed projects are submitted to the British Science Association for independent assessment against a set of 15 criteria. If few of these criteria are met, this is taken as an indication that insufficient time has been spent on the project. Pupils are supported in undertaking the CREST Award by an educator (e.g. a teacher, technician, club leader) and can undertake their project work in different settings (during class, during a lunchtime/after school club, or a placement outside of school). Implementation varies widely due to the flexibility of the CREST Award. This flexibility is necessary to facilitating inquiry-led learning, whereby students learn by solving a problem or answering a question. The aim is that inquiry-led learning will have a positive impact on students’ attainment in science.

Intervention type

Other

Phase

Drug names

Primary outcome measure

Science knowledge, measured using GL’s Progress Test in Science. It is an adaptive assessment covering physics, chemistry, biology and curriculum knowledge as well as knowledge of concepts that relate to working scientifically. This will be administered in May – June 2018 to all pupils that signed up.

Secondary outcome measures

1. GCSE science results, obtained from NPD after the end of Year 11 (January - March 2021)
2. Other secondary outcome measures will assess soft outcomes; this data will be collected through standardised measures in a pupil survey administered before and after the intervention. The soft outcomes of interest include:
2.1. Confidence
2.2. Attitudes to school
2.3. Young people’s self-efficacy in science
2.4. Young people’s future aspirations in science

Overall trial start date

28/11/2016

Overall trial end date

31/03/2021

Reason abandoned (if study stopped)

Eligibility

Participant inclusion criteria

A school is eligible to take part in the trial if:
1. Its proportion of pupils eligible for everFSM is at least as high as the England average
2. It has not participated in CREST Bronze, Silver or Gold in the academic year prior to the intervention (i.e. in 2016/17)
3. It is not in special measures
4. It agrees not to take part in CREST or Go4Set (a 10 week STEM project that incorporates CREST) with the same pupils if they are assigned to the control condition, if possible until the end of the GCSEs
5. It can recruit between six and 35 pupils, of whom 25% should be eligible for free school meals (under the everFSM category)

Participant type

Other

Age group

Child

Gender

Both

Target number of participants

c. 200 schools (estimated), which equates to between 1,720 and 2,400 pupils (estimated)

Participant exclusion criteria

All schools signed up to the trial will formalise their participation by signing a Memorandum of Understanding (MoU). As part of this they are agreeing that they can meet the eligibility criteria set out above. Before schools invite eligible pupils to express an interest in taking part (via the online pupil survey) they must conduct a parental/carer opt out exercise. Any opted out pupils will be excluded, but there are no characteristics as such that would otherwise exclude eligible pupils from taking part.

Recruitment start date

06/03/2017

Recruitment end date

16/06/2017

Locations

Countries of recruitment

Albania

Trial participating centre

British Science Association
SW7 5HD
United Kingdom

Sponsor information

Organisation

Education Endowment Foundation (EEF)

Sponsor details

9th Floor
Millbank Tower
21-24 Millbank
London
SW1P 4QP
United Kingdom
+44 (0)207 802 1676
info@eefoundation.org.uk

Sponsor type

Charity

Website

https://educationendowmentfoundation.org.uk/

Funders

Funder type

Charity

Funder name

Education Endowment Foundation (EEF)

Alternative name(s)

Funding Body Type

Funding Body Subtype

Location

Results and Publications

Publication and dissemination plan

Final protocol document to be published on the EEF website. The statistical analysis plan is in progress and will be available in Spring 2018. Possible publication of the results in peer-review journals and summary on the NatCen website/blogs.

IPD sharing statement
The datasets generated during and/or analysed during the current study will be stored in the Education Endowment Foundation’s archive (which is managed by the Fischer Family Trust). Type of data stored: Anonymised pupil level participant data (pupil month of birth; gender; FSM status; allocation to treatment or control group; post-intervention; pupil baseline data (i.e. Key Stage 2 outcomes in Science); GL Progress Test in Science test data, date and outcome), school level baseline data (i.e. Key Stage 2 outcomes in Science averaged at school level), and school level demographic info (on percentage of pupils with SEN, FSM status, school type (including whether single sex or co-ed), a deprivation indicator (Index of Multiple Deprivation 2015)). Timing for availability: Requests to the Education Endowment Foundation from Summer 2021 onwards. Parental consent was obtained. Dataset is anonymised.

Intention to publish date

28/02/2019

Participant level data

Stored in repository

Basic results (scientific)

Publication list

Publication citations

Additional files

Editorial Notes