2019 HSC Section 2 - Practice Management

Simulation-based Clinical Performance Assessment

Competing Interests The authors declare no competing interests.

17. Henrichs BM, Avidan MS, Murray DJ, Boulet JR, Kras J, Krause B, Snider R, Evers AS: Performance of certified reg- istered nurse anesthetists and anesthesiologists in a simula- tion-based skills assessment. Anesth Analg 2009; 108:255–62 18. Khanduja PK, Bould MD, Naik VN, Hladkowicz E, Boet S: The role of simulation in continuing medical education for acute care physicians: A systematic review. Crit Care Med 2015; 43:186–93 19. Murray DJ, Boulet JR, Avidan M, Kras JF, Henrichs B, Woodhouse J, Evers AS: Performance of residents and anesthesiologists in a simulation-based skill assessment. A NESTHESIOLOGY 2007; 107:705–13 20. Fletcher GC, McGeorge P, Flin RH, Glavin RJ, Maran NJ: The role of non-technical skills in anaesthesia: A review of cur- rent literature. Br J Anaesth 2002; 88:418–29 21. Kohn LT, Corrigan J, Donaldson MS, Institute of Medicine (U.S.). Committee on Quality of Health Care in America: To err is human: Building a safer health system. Washington, D.C., National Academy Press, 1999 22. Weaver SJ, Dy SM, Rosen MA: Team-training in healthcare: A narrative synthesis of the literature. BMJ Qual Saf 2014; 23:359–72 23. Steadman RH: The American Society of Anesthesiologists’ national endorsement program for simulation centers. J Crit Care 2008; 23:203–6 24. McIvor WR, Banerjee A, Boulet JR, Bekhuis T, Tseytlin E, Torsher L, DeMaria S Jr, Rask JP, Shotwell MS, Burden A, Cooper JB, Gaba DM, Levine A, Park C, Sinz E, Steadman RH, Weinger MB: A taxonomy of delivery and documentation deviations during delivery of high-fidelity simulations. Simul Healthc 2017; 12:1–8 25. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R: Assessment of clinical performance during simulated crises using both technical and behavioral ratings. A NESTHESIOLOGY 1998; 89:8–18 26. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R: Anaesthetists’ Non-technical Skills (ANTS): Evaluation of a behavioural marker system. Br J Anaesth 2003; 90:580–8 27. Boulet JR, Murray DJ: Simulation-based assessment in anes- thesiology: Requirements for practical implementation. A NESTHESIOLOGY 2010; 112:1041–52 28. Boulet JR, Murray D, Kras J, Woodhouse J: Setting perfor- mance standards for mannequin-based acute-care scenarios: An examinee-centered approach. Simul Healthc 2008; 3:72–81 29. Kim J, Neilipovitz D, Cardinal P, Chiu M: A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbrevi- ated as “CRM simulator study IB”). Simul Healthc 2009; 4:6–16 30. Flin R, Patey R, Glavin R, Maran N: Anaesthetists’ non-techni- cal skills. Br J Anaesth 2010; 105:38–44 31. Weller JM, Bloch M, Young S, Maze M, Oyesola S, Wyner J, Dob D, Haire K, Durbridge J, Walker T, Newble D: Evaluation of high fidelity patient simulator in assessment of perfor- mance of anaesthetists. Br J Anaesth 2003; 90:43–7 32. Regehr G, MacRae H, Reznick RK, Szalay D: Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format exami- nation. Acad Med 1998; 73:993–7 33. Andreatta P, Saxton E, Thompson M, Annich G: Simulation- based mock codes significantly correlate with improved pediatric patient cardiopulmonary arrest survival rates. Pediatr Crit Care Med 2011; 12:33–8 34. Watkins SC, Roberts DA, Boulet JR, McEvoy MD, Weinger MB: Evaluation of a simpler tool to assess nontechnical skills dur- ing simulated critical events. Simulat Healthc 2017; 12:69–75 35. Stewart J, O’Halloran C, Harrigan P, Spencer JA, Barton JR, Singleton SJ: Identifying appropriate tasks for the preregistra- tion year: Modified Delphi technique. BMJ 1999; 319:224–9

Correspondence Address correspondence to Dr. Weinger: Center for Research and Innovation in Systems Safety, 1211 21 st Avenue South, Medical Arts Bldg. Suite 732, Nashville, Tennessee 37212. matt.weinger@vanderbilt.edu. This article may be accessed for personal use at no charge through the Journal Web site, www.anesthesiology.org. References 1. Ericsson KA: Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 2004; 79(10 suppl):S70–81 2. Smith KK, Gilcreast D, Pierce K: Evaluation of staff’s reten- tion of ACLS and BLS skills. Resuscitation 2008; 78:59–65 3. Weaver SJ, Lubomksi LH, Wilson RF, Pfoh ER, Martinez KA, Dy SM: Promoting a culture of safety as a patient safety strategy: A systematic review. Ann Intern Med 2013; 158(5 pt 2):369–74 4. McIvor W, Burden A, Weinger MB, Steadman R: Simulation for maintenance of certification in anesthesiology: The first two years. J Contin Educ Health Prof 2012; 32:236–42 5. Buscemi D, Wang H, Phy M, Nugent K: Maintenance of certi- fication in Internal Medicine: Participation rates and patient outcomes. J Community Hosp Intern Med Perspect 2012; 2 6. Counselman FL, Carius ML, Kowalenko T, Battaglioli N, Hobgood C, Jagoda AS, Lovell E, Oshva L, Patel A, Shayne P, Tabas JA, Reisdorff EJ: The American Board of Emergency Medicine Maintenance of Certification Summit. J Emerg Med 2015; 49:722–8 7. Holmboe ES, Wang Y, Meehan TP, Tate JP, Ho SY, Starkey KS, Lipner RS: Association between maintenance of certification examination scores and quality of care for medicare benefi- ciaries. Arch Intern Med 2008; 168:1396–403 8. Kempen PM: Maintenance of certification and licen- sure: Regulatory capture of medicine. Anesth Analg 2014; 118:1378–86 9. Henriksen K, Kaplan H: Hindsight bias, outcome knowledge and adaptive learning. Qual Saf Health Care 2003; 12(suppl 2):ii46–50 10. Scott IA, Phelps G, Brand C: Assessing individual clinical perfor- mance: A primer for physicians. Intern Med J 2011; 41:144–55 11. van der Vleuten CP, Schuwirth LW: Assessing professional competence: From methods to programmes. Med Educ 2005; 39:309–17 12. Gaba DM: The future vision of simulation in health care. Qual Saf Health Care 2004; 13(suppl 1):i2–10 13. Goldberg A, Silverman E, Samuelson S, Katz D, Lin HM, Levine A, DeMaria S: Learning through simulated indepen- dent practice leads to better future performance in a sim- ulated crisis than learning through simulated supervised practice. Br J Anaesth 2015; 114:794–800 14. Stevens LM, Cooper JB, Raemer DB, Schneider RC, Frankel AS, Berry WR, Agnihotri AK: Educational program in crisis management for cardiac surgery teams including high real- ism simulation. J Thorac Cardiovasc Surg 2012; 144:17–24 15. Weller J, Henderson R, Webster CS, Shulruf B, Torrie J, Davies E, Henderson K, Frampton C, Merry AF: Building the evi- dence on simulation validity: Comparison of anesthesiolo- gists’ communication patterns in real and simulated cases. A NESTHESIOLOGY 2014; 120:142–8 16. DeMaria S Jr, Samuelson ST, Schwartz AD, Sim AJ, Levine AI: Simulation-based assessment and retraining for the anesthe- siologist seeking reentry to clinical practice: A case series. A NESTHESIOLOGY 2013; 119:206–17

Weinger et al .

Anesthesiology 2017; 127:475-89

235