Plain English Summary
Background and study aims
The Hallé SHINE on Manchester programme is delivered by funded host schools for pupils in those schools and other local primary schools along with the Hallé Orchestra. There has been some research over the last nine years looking at the impact of similar SHINE primary school programmes, which has been promising although limited in its design. This two-year study preceded by a one year pilot (initial) phase will provide a robust evaluation of the programme by using more rigorous research design and methods. We aim to find out whether the Hallé SHINE on Manchester programme helps to improve pupils reading and maths skills and whether it improves attitudes to school, learning and music.
Who can participate?
Pupils in a school which is running the Hallé SHINE on Manchester programme or in a local partner school. Pupils need to attend a school that is willing to agree to all research procedures. Pupils should be disadvantaged or underachieving as nominated by their class teachers. Pilot year of the study (2012/2013 academic year) Year 5 and Year 6 pupils. First year of the main study (2013/2014 academic year) Year 4, Year 5 and Year 6 pupils. Second year of the main study (2014/2015 academic year) Year 4 and Year 5 pupils. Schools in the pilot phase in the 2012/13 academic year will also participate in the main study in the 2013/14 academic year. Schools that join the project for the main study will participate in the 2013/14 and 2014/15 academic years.
What does the study involve?
Schools will run the programme for around 60 pupils in total from their own school and from other local partner schools. Each school involved in the study (both host schools and partner schools) will need to nominate a number of children (disadvantaged or underachieving) who would be eligible to attend the programme from both Year 5 and Year 6 pupils in their first year of participation and from both Year 4 and Year 5 in their second year of participation. Each year, after teachers have nominated eligible pupils from both year groups, all pupils in those year groups will complete the InCAS assessment of reading, maths and attitudes to learning. Each school will then be randomly allocated to sending the nominated pupils from one of the two year groups involved (either Year 5 or 6 nominated pupils in the first year and either Year 4 or 5 nominated pupils in the second year) to the SHINE programme. At the end of each school year all pupils in these year groups will again complete the InCAS assessment. For each year of the study the results of pupils who have attended the programme will then be compared to the results of pupils who were not in the allocated year group (and therefore did not attend the programme), in order to find out the effect that the programme had on pupils attainment. At the end of the study, the findings from all three years will be combined for more certainty about the effect.
What are the possible benefits and risks of participating?
Participating pupils who are in the selected year group in their school will have the opportunity to attend the Saturday School programme. The activities at the programme are designed to be interactive and fun and to engage pupils. The programme will give them extra support with academic work and may improve their literacy and numeracy skills, leading to better future outcomes. As the programme is for children who are disadvantaged or underachieving there may be a stigma attached to attending. However, eligible pupils will have the choice whether to attend the programme or not. The programme is designed to be different from school, fun and engaging, and pupils should enjoy attending. This has been the experience in other areas.
Where is the study run from?
The independent evaluation is being conducted by Durham University. The recruitment of schools and support for running the Hallé SHINE on Manchester programme is the responsibility of the SHINE Trust and the Hallé. The schools involved are in Manchester, UK.
When is the study starting and how long is it expected to run for?
This main study starts in June 2013 and runs until September 2015. There is a pilot element to the study that runs from June 2012 until September 2014.
Who is funding the study?
The Education Endowment Foundation (EEF) (UK)
Who is the main contact?
1. Principal Investigator: Professor Carole Torgerson (firstname.lastname@example.org)
2. Trial Manager: Victoria Menzies (email@example.com)
Prof Carole Torgerson
School of Education
+44 (0)191 334 8382
A pragmatic cluster randomised controlled trial evaluating the effectiveness of the Hallé SHINE on Manchester Saturday School programme at improving literacy and numeracy for children in upper primary school
1. What is the impact of the Hallé SHINE on Manchester Saturday School programme on academic attainment outcomes at post-test, specifically literacy and numeracy?
2. What is the impact of the SHINE programme on attitudes to school and learning at post-test?
3. What is the impact of the SHINE programme on music outcomes, specifically pupil attitudes towards music and self-assessed music ability at post-test?
Board of Ethics for the School of Education, Durham University, 22/08/2012
Pragmatic cluster randomised controlled trial
Primary study design
Secondary study design
Cluster randomised trial
Quality of life
Patient information sheet
Not available in web format. Please use the contact details to request a school and parent information letter.
Intervention: The Hallé SHINE on Manchester Saturday School programme runs for five hours per Saturday for 25 Saturdays over the school year. The programme is delivered by funded host schools in conjunction with the Hallé Orchestra and is supported by the SHINE Trust. The intervention includes interactive and creative lessons based around three music projects over the course of the year. Literacy and numeracy lessons should be based around the three themes selected by the Hallé. The programme will also involve visits to Hallé rehearsals and performances as well as other theme based activities and trips. At the programme children are grouped in small classes (up to twenty-four pupils) taught by a teacher, and supported by a teaching assistant and a peer mentor from a local secondary school. Eligible pupils will be expected to attend the majority of sessions.
Control: Business as usual pupils in control year groups will not be eligible to attend the SHINE programme.
Primary outcome measures
Children's scores on the Reading component of the centre for evaluation and monitoring (CEM) InCAS assessment at baseline and nine months in both years of the trial.
Secondary outcome measures
1. Children's scores on the Spelling component of the CEM InCAS assessment
2. Children's scores on the General Maths component of the CEM InCAS assessment
3. Children's scores on the Mental Arithmetic component of the CEM InCAS assessment
4. Children's scores on the Attitudes component of the CEM InCAS assessment
5. Children's scores on the Attitudes to Music and Music self-evaluation questionnaire
Measured at baseline and nine months in both years of the trial
Overall trial start date
Overall trial end date
Participant inclusion criteria
Pilot year of the trial (2012/2013 academic year) Year 5 and Year 6 pupils
First year of the main trial (2013/2014 academic year) Year 4, Year 5 and Year 6 pupils
Second year of the main trial (2014/2015 academic year) Year 4 and Year 5 pupils
1. Schools will be eligible to take part if they are willing to undertake all related research procedures and are either a school awarded funding by the SHINE Trust to run the Hallé SHINE on Manchester programme or are a local partner school of a school awarded funding.
2. Pupils will be eligible to be involved in the trial if they are in participating schools and
2.1. for schools in the pilot study: in Year 5 or Year 6 in the 2012/13 academic year or in Year 4 or Year 5 in the 2013/2014 academic year
2.2. for schools in the main study: in Year 5 or Year 6 in the 2013/14 academic year or in Year 4 or Year 5 in the 2014/2015 academic year.
3. Pupils will be nominated by teachers as eligible for the programme (disadvantaged or underachieving) before pre-testing and randomisation
Target number of participants
Participant exclusion criteria
Eligible children whose parents do not wish their child's data to be used
Recruitment start date
Recruitment end date
Countries of recruitment
Trial participating centre
Durham University (UK)
Education Endowment Foundation (UK)
Funding Body Type
Funding Body Subtype
Results and Publications
Publication and dissemination plan
Not provided at time of registration
Intention to publish date
Participant level data
Not provided at time of registration
Results - basic reporting