Newly Published
Original Investigations in Education  |   February 2017
Standard Setting for Clinical Performance of Basic Perioperative Transesophageal Echocardiography: Moving beyond the Written Test
Author Notes
  • From the Department of Anesthesiology (J.S.B., J.P.W., C.S.M., A.D.S., M.D.M.) and Departments of Anesthesiology and Biomedical Informatics (J.P.W.), Vanderbilt University Medical Center, Nashville, Tennessee.
  • Submitted for publication March 2, 2016. Accepted for publication December 27, 2016.
    Submitted for publication March 2, 2016. Accepted for publication December 27, 2016.×
  • Research Support: Supported by a Research in Education grant from the Foundation for Anesthesia Education and Research (FAER, Schaumburg, Illinois; to Dr. Bick) and by funding from FAER and from Anesthesia Quality Institute’s (Schaumburg, Illinois) Health Service Research Mentored Research Training Grant (to Dr. Wanderer).
    Research Support: Supported by a Research in Education grant from the Foundation for Anesthesia Education and Research (FAER, Schaumburg, Illinois; to Dr. Bick) and by funding from FAER and from Anesthesia Quality Institute’s (Schaumburg, Illinois) Health Service Research Mentored Research Training Grant (to Dr. Wanderer).×
  • Competing Interests: The authors declare no competing interests.
    Competing Interests: The authors declare no competing interests.×
  • Correspondence: Address correspondence to Dr. Bick: Department of Anesthesiology, Vanderbilt University Medical Center, 1215 21st Avenue S., Suite 5160 MCE NT, Office 5175, Nashville, Tennessee 37232-8274. julian.s.bick@vanderbilt.edu. Information on purchasing reprints may be found at www.anesthesiology.org or on the masthead page at the beginning of this issue. Anesthesiology’s articles are made freely accessible to all readers, for personal use only, 6 months from the cover date of the issue.
Article Information
Original Investigations in Education / Cardiovascular Anesthesia / Radiological and Other Imaging
Original Investigations in Education   |   February 2017
Standard Setting for Clinical Performance of Basic Perioperative Transesophageal Echocardiography: Moving beyond the Written Test
Anesthesiology Newly Published on February 9, 2017. doi:10.1097/ALN.0000000000001538
Anesthesiology Newly Published on February 9, 2017. doi:10.1097/ALN.0000000000001538
Abstract

Background: Credible methods for assessing competency in basic perioperative transesophageal echocardiography examinations have not been reported. The authors’ objective was to demonstrate the collection of real-world basic perioperative transesophageal examination performance data and establish passing scores for each component of the basic perioperative transesophageal examination, as well as a global passing score for clinical performance of the basic perioperative transesophageal examination using the Angoff method.

Methods: National Board of Echocardiography (Raleigh, North Carolina) advanced perioperative transesophageal echocardiography–certified anesthesiologists (n = 7) served as subject matter experts for two Angoff standard-setting sessions. The first session was held before data analysis, and the second session for calibration of passing scores was held 9 months later. The performance of 12 anesthesiology residents was assessed via the new passing score grading system.

Results: The first standard-setting procedure resulted in a global passing score of 63 ± 13% on a basic perioperative transesophageal examination. The global passing score from the second standard-setting session was 73 ± 9%. Three hundred seventy-one basic perioperative transesophageal examinations from 12 anesthesiology residents were included in the analysis and used to guide the second standard-setting session. All residents scored higher than the global passing score from both standard-setting sessions.

Conclusions: To the authors’ knowledge, this is the first demonstration that the collection of real-world anesthesia resident basic perioperative transesophageal examination clinical performance data is possible and that automated grading for competency assessment is feasible. The authors’ findings demonstrate at least minimal basic perioperative transesophageal examination clinical competency of the 12 residents.