Certification in reporting multiparametric magnetic resonance imaging of the prostate: recommendations of a UK consensus meeting

Multiparametric (mp) MRI of the prostate is now recommended as the initial investigation method for men with suspected prostate cancer within both UK and international guidelines. Potential benefits of this pathway include: (a) reductions in the number of men requiring biopsy; (b) reductions in the diagnoses of indolent cancers unlikely to cause harm, minimizing treatment-related complications; (c) improved detection of clinically significant prostate cancers, particularly for patients with prior negative systematic biopsy; and (d) improved risk-stratification of diagnosed cancers owing to greater precision in tumour grade and volume determinations.

A list of 13 UK panellists participated in the consensus meeting, encompassing 11 separate NHS centres, with representations from Scotland, Wales, and eight cancer alliances within England. An independent chair moderated the process, which followed the University of California at Los Angeles (UCLA)-Research and Development Corporation (RAND) appropriateness method (Data S1). In all, 211 statements related to oversight, applicant, validity period, and certification elements were rated for agreement on a 9-point scale. For a statement to reach 'consensus', a panel majority score was required. Agreement for a statement was calculated using the median score from all panellists, mirroring previous work [4]. A median score of 1-3 indicated 'disagreement' with a statement, 4-6 'uncertainty', and 7-9 'agreement'.
Consensus was reached in 141/211 questions (67%); including for 43/55 stem items (Data S2-S3). The panel agreed that there was a need for an evaluation process relating to the interpretation of prostate mpMRI performed in men with suspect prostate cancers and that this should be termed 'certification'. This process should be performed at an individual level, and there should be a re-evaluation after a specified time (Data S4). Three certification levels were agreed; Level 1 expectations are to have a working knowledge of the methods and diagnostic utility of MRI. It was agreed that Level 1 should be open to consultants and speciality registrars/trainees in Radiology, Urology or Oncology, and also to radiographers and medical physicists. Level 2 is the threshold for independent reporting of MRI; it was agreed that Level 2 should be available to speciality registrars/ trainees and consultants in radiology; however, other applicants may be considered on an individual basis in exceptional circumstances. Level 3 incorporates additional teaching and/or research experience and is appropriate for those running prostate MRI diagnostic services; it was agreed that this should only be available to consultants in radiology. Consensus was reached that attendance of at least one prostate MRI course in the preceding 3 years was mandatory at all levels, along with a variable number of continuing professional development (CPD) credits, attendance at prostate multidisciplinary team (MDT) meetings, and for a logbook of cases depending on the level of certification. An examination was only felt to be appropriate for entry to Level 2 certification, and that Level 3 entry required additional demonstration of teaching and/or research experience ( Table 1). The format of an examination is yet to be determined. Digital quality assurance systems that incorporate online case-based examinations are ideally suited for this purpose, but in the shorter term, written and image-based multiple choice questions examination are more likely to be used. CPD credits can be obtained from any national or international organisations and have to be prostate related, but not specifically limited to diagnostic prostate MRI.
Consensus was not achieved for the exact number of logbook cases required at any level; however, it was agreed that the logbook case mix should include ≥75% biopsy na€ ıve and/or prior negative biopsy cases and ≥50% dynamic contrastenhanced (DCE mpMRI) studies. There was consensus that applications should be assessed by an administrator followed by two panel members, and only requires review by the certification lead in cases of arbitration.
This process complements the European Society of Urogenital Radiology (ESUR)/European Association of Urology Section of Urologic Imaging (ESUI) consensus paper on MRI acquisition, interpretation, and training and provides more explicit detail on how interpretation standards should be met [5]. It is hoped that the three tiers of expertise proposed will help deliver in-breadth and in-depth the potential benefits of the pre-biopsy prostate MRI pathway [4]. The authors wish to stress that non-certification does not imply unsatisfactory MRI practice. Likewise, 'certification' does not hold any official or regulatory status and will be voluntary. The central purpose of the certification process will be to offer individuals a kite-mark of their MRI reporting quality demonstrating a minimum level of expertise has been obtained, which is comparable across similar practitioners in the UK, and providing supportive evidence within the UK framework of appraisal and re-validation. The expectation is that in seeking and obtaining certification, reporting quality will rise and over time ensure consistency and accuracy for the MRI pathway for suspected prostate cancer. The next steps in the process include developing administrative support towards a launch date, and the development of an online case repository that can potentially be used for training, logbook accrual, and examination purposes.
A key consideration in the certification process has been where to set competency bars for each level: too low, and the quality for service delivery is not attained or maintained; too high and the process may be seen as off-putting, limiting the available reporter pool at the time of increasing demand. Consensus was reached on several key components of the certification process including who can apply at different levels, prostate course attendance, MDT attendance, need for examination, the validity period, and, for Levels 1-2, the number of CPD credits required. A notable exception was the number of logbook cases required. This is an area of active debate in the literature, with evidence suggesting 200-300 cases should be reported in a realworld setting to achieve expertise [6,7], and 50-100 cases/year [4,5,8] to maintain competence.
A limitation of any consensus process is that the results only reflect the opinions of the panel and may be prone to biases, including potential for pre-selection bias in panel members invited to participate. Each panellist only had one vote, and an independent chair ensured balanced debates, with all viewpoints aired and without individual members dominating discussions. The number of panellists was relatively small; however, this was comparable to other UK and European consensus processes [4]. Furthermore, the inclusion of panellists from different specialities, working in different healthcare settings, and with a broad geographical spread, ensured that opinion was not based on a narrow scope of practice. Future work is required comparing reporters with certification vs those without to measure any potential improvements in patient-related outcomes.
In conclusion, consensus was reached on the need for credentialing in prostate-MRI reporting for directing biopsies, with criteria for three certification levels proposed. The Green = consensus agreement; orange = consensus achieved for a range of values; red = highest agreement scoring item is listed, with no consensus achieved. *Other applicants may be considered in exceptional circumstances. † CPD credits can be from any national or international organisation, but must be prostate-related. ‡ Should comprise ≥75% biopsy na€ ıve cases and ≥50% DCE studies. SpRs, specialist Registrars (trainees) within specialty.
© 2020 The Authors BJU International © 2020 BJU International 305 certification process should aid the uniform delivery of the MRI-directed pathway in men with suspected prostate cancer.