Using the Craft of Writing to improve pupil attainment in schools

ISRCTN ISRCTN10546365
DOI https://doi.org/10.1186/ISRCTN10546365
Secondary identifying numbers N/A
Submission date
17/07/2018
Registration date
25/07/2018
Last edited
04/10/2022
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data

Plain English summary of protocol

Background and study aims
The Craft of Writing (CoW) intervention provides trainings for teachers (known as a sustained ‘Arvon experience’) to develop teachers as writers. The goal is for them to bring this knowledge back into the classroom. The trainings are created with professional writers. Teachers learn about writing – the process of writing; linguistic choices; and narrative/poetic techniques – and are supported in integrating what they learn into their routine teaching of writing. The aim of this study is to use the CoW programme to improve pupils’ writing and idea generation through training their teachers in these respects.

Who can participate?
Approximately 96 state-funded primary schools in England. Within the schools, we focus on year 5.

What does the study involve?
Schools are randomly allocated to either the intervention or the control group.
Schools in the intervention group participate in the CoW programme. Teachers will receive writing training and development, and will bring this back into the classroom to improve children's writing skills and ability to generate ideas. One class from year 5 from each treatment school will be selected for participation in the evaluation.
The control group will receive no intervention and continue as usual.
Children will be asked to complete writing tests at the end of the school year.

What are the possible benefits and risks of participating?
The possible benefit to participants is that taking part in cultural learning programmes such as CoW can lead to higher levers of achievement in mathematics and literacy, and therefore can lead to improved test scores. There are no known risks to participants taking part in this study.

Where is the study run from?
Study run from Craft of Writing, Centre for Research in Writing, Exeter
Evaluation run by UCL Institute of Education (London) and Behavioural Insights Team (BIT) (London)
The schools participating in the study are based in the North-West and North-East with a small number from London.

When is the study starting and how long is it expected to run for?
April 2017 to December 2019

Who is funding the study?
Education Endowment Foundation (EEF) (UK)
Royal Society for the Arts (RSA) (UK)

Who is the main contact?
Dr Jake Anders
Senior Research Fellow
UCL Institute of Education
jake.anders@ucl.ac.uk

Study website

Contact information

Dr Jake Anders
Scientific

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Dr Nikki Shure
Scientific

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom

Study information

Study designInterventional two-armed clustered randomised trial with randomisation occurring at the level of the school
Primary study designInterventional
Secondary study designCluster randomised trial
Study setting(s)School
Study typeQuality of life
Participant information sheet Available from the trial website
Scientific titleUsing the Craft of Writing to improve pupil attainment: A randomised trial in schools
Study acronymCoW
Study objectivesParticipation by schools in the Craft of Writing programme, which trains teachers to develop their own writing skills and integrate this into their teaching practice, will improve pupils’ writing attainment and idea generation.
Ethics approval(s)University of Exeter, 04/07/2017, STF/17/18/01
University College London Institute of Education’s Research Ethics Committee, 14/12/2017, Z6364106/2017/11/69 REC 1010 Craft of Writing Evaluation
Health condition(s) or problem(s) studiedWriting attainment at the end of year 5
InterventionSchools will be randomised into either the intervention or the control group. Schools in the intervention group participate in the Craft of Writing (CoW) programme, whereas the control group will continue "business as usual". For the randomisation, blocking will be used to improve cross-arm comparability of schools and also to improve precision of estimates. There will be four blocks, defined on the basis of class composition by English as an Additional Language (EAL) (high vs. low) and class composition by eligibility for Free School Meals (FSM) (high vs. low). This approach will help to ensure that our treatment and control groups are well balanced in terms of these characteristics, which are likely to be correlated with our outcome measures (EEF, 2015b). High and low EAL and FSM in these definitions will be defined as above and below by the sample median to ensure that block sizes are approximately equal (which may not be the case if we used population, rather than sample, characteristics).
Randomisation will be designed to achieve an equal number of schools in each arm (i.e. 60 control and 60 treatment). Each school will be assigned a randomly generated number (setting a stable seed for the random number generation). Schools will be sorted by block and random number and will be assigned to the treatment arm and to the control arm in turn. Randomisation will be carried out by UCL in Stata and the code used to carry out the process will be recorded and reported in the final report.
Schools in the intervention group will participate in the Craft of Writing programme. One self-nominated year 5 teacher in each participating school participates in the training, which will be led by tutors who are professional authors selected by Arvon. This includes two weekend (Friday-Sunday) ‘Arvon Teachers as Writers’ residentials six months apart. These will comprise workshops and tutorials for teachers led by professional writers, with time and space for writing, plus structured sessions to consider pedagogical implications and establish clear expectations for follow-through. There will also be a programme of CPD days for teachers.
The control group will receive no intervention and continue as usual.
The intervention occurs over the course of one school year (year 5). Follow-up for the trial occurs at the end of the school year, when the outcome measures are collected from both study arms.
Intervention typeBehavioural
Primary outcome measureWriting attainment, assessed using the Writing Assessment Measure (WAM) at the end of the Year 5 school year in 2019.
Secondary outcome measuresWriting self-efficacy, assessed using the Self-Efficacy for Writing Scale (SEWS) (adapted to ensure age appropriateness) at the end of the Year 5 school year in 2019.
Overall study start date01/04/2017
Completion date01/12/2019

Eligibility

Participant type(s)Other
Age groupChild
SexBoth
Target number of participants96 schools (clusters) with 30 pupils per school
Total final enrolment2192
Key inclusion criteria1. Located in the North West and North East of England (with a small number from London)
2. Agree to provide student data in order that it is possible to apply for data from the National Pupil Database
3. Identify a lead teacher from Year 5 (all children in the teacher's class will participate in the trial)
4. Cooperate with the project and evaluation teams during the trial (further details of these requirements are outlined in the Memorandum of Understanding with Schools)

Where possible it will aim to recruit schools that have larger populations of individuals receiving Free School Meals (FSM) than the national average of 15.3 per cent of pupils aged 5-10 (DfE, 2016).
Key exclusion criteriaParents may choose for their child to not participate in the study; their data will not be collected or processed.
Date of first enrolment17/10/2017
Date of final enrolment31/03/2018

Locations

Countries of recruitment

  • England
  • United Kingdom

Study participating centres

UCL Institute of Education
20 Bedford Way
London
WC1H 0AL
United Kingdom
Behavioural Insights Team
4 Matthew Parker St
London
SW1H 9NP
United Kingdom
The University of Exeter
Exeter
EX4 4QD
United Kingdom

Sponsor information

Education Endowment Foundation
Charity

Millbank Tower
21-24 Millbank
Westminster
London
SW1P 4QP
United Kingdom

Phone 020 7802 1676
Email info@eefoundation.org.uk
Website https://educationendowmentfoundation.org.uk/
ROR logo "ROR" https://ror.org/03bhd6288

Funders

Funder type

Not defined

Education Endowment Foundation
Private sector organisation / Trusts, charities, foundations (both public and private)
Alternative name(s)
EducEndowFoundn, Education Endowment Foundation | London, EEF
Location
United Kingdom
The Royal Society for the Encouragement of Arts, Manufactures and Commerce

No information available

Results and Publications

Intention to publish date01/05/2021
Individual participant data (IPD) Intention to shareYes
IPD sharing plan summaryStored in non-publicly available repository
Publication and dissemination planWe will publish an Evaluation Report in May 2021, which will include the impact estimates for the primary and secondary outcomes. This will be published on the study page of the Education Endowment Foundation website.
IPD sharing planThe datasets generated and analysed during the current study have been archived in the Education Endowment Foundation (EEF)’s data archive, and will be available from this data archive in the future, on application to the EEF. Consent for this archiving and administrative data linkage was obtained from participants as part of the study. At the time of writing, access is not yet possible and the timing of access being made available is dependent upon the EEF, rather than the project team. The data archived includes all variables used as part of the analyses reported, named in line with a consistent data specification provided by the EEF (see appendix 3 of their policy on data archiving: https://d2tic4wvo1iusb.cloudfront.net/documents/evaluation/archiving-evaluation-data/Archiving-evaluation-data-analysed-in-the-SRS-Project-completion-and-archiving-form_v2.pdf). Application for access to the EEF data archive is contingent on providing detail of the public benefit of the research to be carried out, in line with the EEF data archive privacy notice: https://educationendowmentfoundation.org.uk/privacy-notices/privacy-notice-for-the-eef-data-archive; this will be assessed by the EEF as archive data owners, rather than the project team. Archive data are held and shared within a secure environment (UK Office for National Statistics Secure Research Service; ONS SRS), for which applicants must meet relevant requirements (including application for recognition as an accredited researcher from the ONS), as mitigation against potential identifiability risks.

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Funder report results 07/09/2021 13/09/2021 No No
Protocol file version 1.1 29/03/2019 04/10/2022 No No
Statistical Analysis Plan 18/10/2018 04/10/2022 No No

Additional files

35511 Protocol v1.1 29Mar2019.pdf
35511_SAP_1.1 18Oct2018.pdf

Editorial Notes

04/10/2022: The following changes were made to the trial record:
1. Uploaded protocol (not peer-reviewed) as an additional file.
2. The statistical analysis plan was uploaded as an additional file.
15/08/2022: IPD sharing statement added.
13/09/2021: The following changes have been made:
1. Funder report added.
2. The final enrolment number has been added from the report.
12/01/2021: The intention to publish date was changed from 31/12/2020 to 01/05/2021.
23/10/2018: The intention to publish date was updated from 31/01/2019 to 31/12/2020.