Background
The Medical Schools Council was commissioned by the Department of Health to lead a Project Group to carry out an option appraisal for the best approach for selection of applicants into the UK Foundation Programme and allocation to Foundation Schools. After considering all the evidence the Project Group decided to pilot two new selection methods: Educational Performance Measure and Situational Judgement Tests. These will be piloted during 2010 and 2011, with final recommendations made to the Department of Health in July 2011.
Background information
'The Next Stage Review: A High Quality Workforce' stated that 'new work needs to be undertaken to develop more reliable and valid selection tools for recruitment' to Foundation Programme Training. This was based, to some extent, on concerns about the current system which ranks applicants using a combined score derived from answers to a set of white space questions and an academic quartile ranking provided by the applicant's medical school. The concerns relate to reliability, validity, comparability, NHS consultation time required, possible plagiarism and longevity.
The following key issues with the current process were identified:
• Candidates answer white space questions in their own time, which makes
it harder to ensure that the work is their own
• Marking the white space questions is labour intensive
Option Appraisal
In response to this, the Medical Schools Council was commissioned by the Department of Health to lead a Project Group to carry out an option appraisal for the best approach for selection of applicants into the UK Foundation Programme and allocation to Foundation Schools. As part of the nine month Option Appraisal the Project Group commissioned three academic literature reviews, which were reviewed by an International Panel of Experts. There was extensive consultation with key stakeholders and an online survey. Academic evidence, expert advice and stakeholder feedback informed an independent Cost Benefit Analysis.
Recommendations
After considering all the evidence the Project Group made the following recommendations:
• Pilot two new selection methods: Educational Performance Measure (EPM) - to evolve from the current quartile rankings - and Situational Judgement Test (SJT) - to replace the current white space question
• To continue with the current method of selection unless the pilots show substantial and convincing evidence for change
More detailed information on the proposed selection methods can be found on the EPM and SJT page.
Proposed Selection Process
Applicants will continue to complete the online form specifying Foundation School preferences, but will take an invigilated SJT which will be added to the online system along with their EPM scores. The highest scoring applicants will continue to be selected and allocated to Foundation Schools using a national algorithm and then Foundation Schools will continue to allocate posts to applicants.
Please note: The 2011 and 2012 application rounds for the Foundation Programme beginning August 2011 and August 2012 will run as normal using the current system of white space questions and academic quartiles. Any pilots being run at any of the UK medical schools will not affect overall marks in any way.
Project Group
The Project Group is made up of representatives from organisations including the UK Foundation Programme Office, NHS Employers, the four Health Departments and the General Medical Council. This is a collaborative project between all the organisations represented on the Project Group.
Members
Paul O'Neill (Chair) - Medical Schools Council
Dinesh Bhugra - Academy of Medical Royal Colleges
Ian Curran - Educational Supervisors
Ashley Fraser - NHS Employers
Derek Gallen - UKFPO and COPMeD
Martin Hart - General Medical Council
Duncan Henderson - NHS Education for Scotland
Matthew Langdon - Department of Health (on behalf of England, Scotland, Wales and Northern Ireland)
Andrew Matthewman - Department of Health (on behalf of England, Scotland, Wales and Northern Ireland)
Jim McKillop - Scottish Board for Academic Medicine
Terry McMurray - NIMDTA
Katie Petty-Saphon - Medical Schools Council
Karin Purshouse - BMA Medical Students Committee
Kim Walker - Foundation School Directors
Tony Weetman - Medical Schools Council
2011 Meeting Dates
4 February
15 April
1 July
More information can be found on the Improving Selection to the Foundation Programme website.