1. Probyn, L, Lang, C, Tomlinson, G, Bandiera, G. Multisource feedback and self-assessment of the communicator, collaborator, and professional CanMEDS roles for diagnostic radiology residents. Can Assoc Radiol J. 2014;65(4):379–384.
Google Scholar | SAGE Journals2. Jippes, E, van Engelen, JM, Brand, PL, Oudkerk, M. Competency-based (CanMEDS) residency training programme in radiology: systematic design procedure, curriculum and success factors. Eur Radiol. 2010;20(4):967–977.
Google Scholar | Crossref | Medline3. Harris, P, Bhanji, F, Topps, M, et al. Evolving concepts of assessment in a competency-based world. Med Teach. 2017;39(6):603–608.
Google Scholar | Crossref | Medline4. Frank, JR, Snell, LS, Cate, OT, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638–645.
Google Scholar | Crossref | Medline5. Kogan, JR, Holmboe, E. Realizing the promise and importance of performance-based assessment. Teach Learn Med. 2013;25(Suppl 1):S68–S74.
Google Scholar | Crossref | Medline6. Canada RCoPaSo . Competence by design. Canada’s model for competency-based medical education. 2020. Accessed October 5, 2020. https://www.royalcollege.ca/rcsite/cbd/competence-by-design-cbd-e
Google Scholar7. Canada RCoPaSo . EPAs and CanMEDS Milestones. 2020. Accessed October 5, 2020. https://www.royalcollege.ca/rcsite/cbd/implementation/cbd-milestones-epas-e
Google Scholar8. Kwan, BYM, Mbanwi, A, Cofie, N, et al. Creating a competency-based medical education curriculum for Canadian diagnostic radiology residency (Queen’s Fundamental Innovations in Residency Education)-Part 1: Transition to Discipline and Foundation of Discipline Stages. Can Assoc Radiol J. 2020:846537119894723.
Google Scholar | Medline9. McGaghie, WC, Miller, GE, Sajid, AW, Telder, TV. Competency-based curriculum development on medical education: an introduction. Public Health Pap. 1978;(68):11–91.
Google Scholar | Medline10. Powell, DE, Carraccio, C. Toward competency-based medical education. N Engl J Med. 2018;378(1):3–5.
Google Scholar | Crossref | Medline11. Schmitt, JE, Scanlon, MH, Servaes, S, Levin, D, Cook, TS. Milestones on a shoestring: a cost-effective, semi-automated implementation of the new ACGME requirements for radiology. Acad Radiol. 2015;22(10):1287–1293.
Google Scholar | Crossref | Medline12. Vydareny, KH, Amis, ES, Becker, GJ, et al. Diagnostic radiology milestones. J Grad Med Educ. 2013;5(1 Suppl 1):74–78.
Google Scholar | Crossref | Medline13. Nasca, TJ, Philibert, I, Brigham, T, Flynn, TC. The next GME accreditation system—rationale and benefits. N Engl J Med. 2012;366(11):1051–1056.
Google Scholar | Crossref | Medline14. Frank, JR, Danoff, D. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29(7):642–647.
Google Scholar | Crossref | Medline15. ten Cate, O, Scheele, F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–547.
Google Scholar | Crossref | Medline16. Collins, J, Hyde, C, Gray, L, et al. Radiology resident evaluation: a form that addresses the six competencies of the accreditation council for graduate medical education. Acad Radiol. 2002;9(7):815–816.
Google Scholar | Crossref | Medline17. Collins, J, de Christenson, MR, Gray, L, et al. General competencies in radiology residency training: definitions, skills, education and assessment. Acad Radiol. 2002;9(6):721–726.
Google Scholar | Crossref | Medline18. Isupov, I, McInnes, MD, Hamstra, SJ, et al. Development of RAD-Score: a tool to assess the procedural competence of diagnostic radiology residents. AJR Am J Roentgenol. 2017;208(4):820–826.
Google Scholar | Crossref | Medline19. Wood, J, Collins, J, Burnside, ES, et al. Patient, faculty, and self-assessment of radiology resident performance: a 360-degree method of measuring professionalism and interpersonal/communication skills. Acad Radiol. 2004;11(8):931–939.
Google Scholar | Crossref | Medline20. Collins, J, Herring, W, Kwakwa, F, et al. Current practices in evaluating radiology residents, faculty, and programs: results of a survey of radiology residency program directors. Acad Radiol. 2004;11(7):787–794.
Google Scholar | Crossref | Medline21. Epstein, RM . Assessment in medical education. N Engl J Med. 2007;356(4):387–396.
Google Scholar | Crossref | Medline22. Bari, V . Direct observation of procedural skills in radiology. AJR Am J Roentgenol. 2010;195(1):W14–W18.
Google Scholar | Crossref | Medline23. Holmboe, ES, Sherbino, J, Long, DM, Swing, SR, Frank, JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676–682.
Google Scholar | Crossref | Medline24. Harris, KA, Nousiainen, MT, Reznick, R. Competency-based resident education—The Canadian perspective. Surgery. 2020;167(4):681–684.
Google Scholar | Crossref | Medline25. Norcini, J, Anderson, B, Bollela, V, et al. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33(3):206–214.
Google Scholar | Crossref | Medline26. Beckman, TJ, Cook, DA, Mandrekar, JN. What is the validity evidence for assessments of clinical teaching? J Gen Intern Med. 2005;20(12):1159–1164.
Google Scholar | Crossref | Medline27. LeClaire, EL, Nihira, MA, Hardré, PL. Validity: applying current concepts and standards to gynecologic surgery performance assessments. Adv Health Sci Educ Theory Pract. 2015;20(3):817–828.
Google Scholar | Crossref | Medline28. Chuan, A, Wan, AS, Royse, CF, Forrest, K. Competency-based assessment tools for regional anaesthesia: a narrative review. Br J Anaesth. 2018;120(2):264–273.
Google Scholar | Crossref | Medline29. Kogan, JR, Holmboe, ES, Hauer, KE. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 2009;302(12):1316–1326.
Google Scholar | Crossref | Medline30. American Psychological Association, American Educational Research Association, National Council on Measurement in Education . Standards for Educational and Psychological Testing, Vol. viii. American Psychological Association; 1985:100.
Google Scholar31. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational and Psychological Testing (U.S.) . Standards for Educational and Psychological Testing, Vol. ix. American Educational Research Association; 2014:194.
Google Scholar32. Samuel, M . Validity. In: Linn, RL , ed. Educational Measurement. The American Council on Education/Macmillan Series on Higher Education. 3rd ed. American Council on Education; 1989:13–103.
Google Scholar33. Kane, M . Validation. In: Brennan, R , ed. Educational Measurement. 4th ed. Praeger Publishers; 2006:17–64.
Google Scholar34. Kane, MT . Current concerns in validity theory. J Educ Meas. 2001;38(4):319–342.
Google Scholar | Crossref35. Tricco, AC, Lillie, E, Zarin, W, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–473.
Google Scholar | Crossref | Medline36. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational and Psychological Testing (U.S.) . Standards for Educational and Psychological Testing, Vol. ix. American Educational Research Association; 1999:194.
Google Scholar37. Cook, DA, Beckman, TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):166.e7–16.
Google Scholar | Crossref38. Andreatta, PB, Marzano, DA, Curran, DS. Validity: what does it mean for competency-based assessment in obstetrics and gynecology? Am J Obstet Gynecol. 2011;204(5):384.e1–6.
Google Scholar | Crossref | Medline39. Wallis, A, Edey, A, Prothero, D, McCoubrie, P. The Bristol Radiology Report Assessment Tool (BRRAT): developing a workplace-based assessment tool for radiology reporting skills. Clin Radiol. 2013;68(11):1146–1154.
Google Scholar | Crossref | Medline40. Curtis, DJ, Amis, ES, Cruess, DF, Riordan, DD. Evaluation of radiology resident cognitive performance. Invest Radiol. 1985;20(6):640–642.
Google Scholar | Crossref | Medline41. Holmboe, ES . The Milestones Guidebook. Accreditation Council for Graduate Medical Education. 2020. Accessed December 10, 2020. http://www.acgme.org/Portals/0/MilestonesGuidebook.pdf
Google Scholar42. CanMEDS 2015 Physician Competency Framework. Royal College of Physicians and Surgeons of Canada; 2015.
Google Scholar43. Downing, SM . Validity: on meaningful interpretation of assessment data. Med Educ. 2003;37(9):830–837.
Google Scholar | Crossref | Medline44. Beckman, TJ, Ghosh, AK, Cook, DA, Erwin, PJ, Mandrekar, JN. How reliable are assessments of clinical teaching? A review of the published instruments. J Gen Intern Med. 2004;19(9):971–977.
Google Scholar | Crossref | Medline45. Messick, S . Standards of validity and the validity of standards in performance assessment. Edu Meas: Issues Prac. 1995;14(4):5–8.
Google Scholar | Crossref46. Messick, S . Meaning and values in test validation: the science and ethics of assessment. Edu Res. 1989;18(2):5–11.
Google Scholar | SAGE Journals