Unsupported Browser
The American College of Surgeons website is not compatible with Internet Explorer 11, IE 11. For the best experience please update your browser.
Menu
Become a member and receive career-enhancing benefits

Our top priority is providing value to members. Your Member Services team is here to ensure you maximize your ACS member benefits, participate in College activities, and engage with your ACS colleagues. It's all here.

Become a Member
Become a member and receive career-enhancing benefits

Our top priority is providing value to members. Your Member Services team is here to ensure you maximize your ACS member benefits, participate in College activities, and engage with your ACS colleagues. It's all here.

Become a Member
ACS
Bulletin

COVID-19 was a Gamechanger for Surgical Education in Residency

Rebecca L. Williams-Karnesky, MD, PhD, MEdPsych, Elizabeth Carpenter, MD, Madhuri Nagaraj, MD, MS, Joyce H. Pang, MD, Brianna L. Spencer, MD, Erfan Faridmoayer, MD, Tayseer Shamaa, MD, and Rachel E. Hanke, MD

August 1, 2022

COVID-19 was a Gamechanger for Surgical Education in Residency

Highlights

  • Describes the pros and cons of virtual and hybrid platforms
  • Explains how COVID-19 restrictions on operative volumes and lack of access to simulation centers have led to novel approaches to providing technical skills education for trainees
  • Summarizes how the use of virtual platforms during board certification has decreased costs and stress for trainees
  • Outlines how limitations imposed by the pandemic on time spent in training and number of cases completed have accentuated the need for competency-based education
  • Explains how widespread use of virtual platforms may facilitate CME and continuous certification

The COVID-19 pandemic imposed many restrictions on surgical education. Social distancing mandates interfered with administration of in-person educational conferences, necessitating the transition to virtual platforms. Changes in workforce allocation to meet the demands of caring for COVID-19 patients and restrictions on operative volumes resulting from resource scarcity restricted access to technical skills acquisition. Administration of critical certifying exams were changed to virtual formats or canceled.

In the Resident and Associate Society of the American College of Surgeons (RAS-ACS) study referenced in the introduction to this issue of the Bulletin, 63.2% of respondents stated that modifications made during the COVID-19 pandemic negatively or extremely negatively affected their experience with didactic education, with only 13.4% of respondents reporting that these changes had a positive or extremely positive impact on their didactic educational experience (see Table 1).

Table 1. COVID-19 Pandemic impact on Surgical Education

Extremely Negative or Negative

No Impact

Extremely Positive or Positive

Clinical Teaching

Didactic educational program

63%

23%

13%

Clinic experience

46%

49%

5%

Technical Teaching

Elective operative experience

82%

16%

1%

Emergency operative experience

27%

68%

5%

Rotations outside primary site

51%

48%

2%

Responses are rounded to the nearest percent, and may not add up to 100%.

While COVID-19 was the source of a variety of stressors, 30% of respondents reported their biggest concern was caseload and 10% of respondents reported that it was their education; 82.3% of respondents said that COVID-19 negatively or extremely negatively affected their elective surgery experience, 46.1% indicated their overall clinic experience was either negatively or extremely negatively affected, and 26.4% stated that opportunities to receive feedback on their clinical performance were negatively or extremely negatively affected.

In response to this situation, the surgical education community rallied to create novel solutions and adaptations to ensure the continued advancement of surgical trainees. The RAS survey showed that 77% of respondents felt their institution implemented innovative education and training strategies to some (58.4%) or a great (18.6%) extent. This survey also showed that 75% of programs changed how they conduct morbidity and mortality (M&M) conferences and grand rounds, with more than half the programs changing methods for tumor board and research conferences. Unfortunately, approximately 60% of trainees felt these changes detracted from the learning environment and their educational experience. When asked if certain elements of education should continue to be virtual after the pandemic subsides, only one-third of trainees said M&M conferences, grand rounds, and tumor boards should remain remote.

As we reflect on the impact of the COVID-19 pandemic, it is important to take stock of these many transformations in surgical education and consider how it has changed a generation of trainees. Many adaptations during the pandemic have resulted in huge advances in surgical education for residents, fellows, and early career surgeons.1-3 However, not all these changes have been beneficial.

What lessons have we learned? What changes to the education and certification process should we keep? What should we continue to expand upon? In this article, the RAS-ACS Education Committee explores how the COVID-19 pandemic has affected the convenience, content, and culture of surgical education (see Table 2).

 

Table 2. Changes in Surgical Education Due to the COVID-19 Pandemic

Convenience

Content

Culture

Clinical Teaching

Virtual/hybrid platforms allow for increased flexibility in scheduling of meetings and methods of attendance

Virtual platforms allow for increased access to diverse educational content and facilitate broad collaboration 

Increased emphasis on equity in content delivery and access to educational content

Lack of training and discussion around appropriate use of virtual/hybrid platforms has led to a shift in etiquette standards

Technical teaching

New innovations and emphasis on novel simulation models allow trainees to acquire technical skills even without access to simulation centers 

Increased focus on development of robust simulation curricula and improved criteria for objective assessment of trainee proficiency

Just-in-time and independent learning opportunities have flourished

The increasing emphasis on trainee-driven skill acquisition

Certification

The virtual certifying exam eliminated the financial and physical stress of traveling for the exam

Change in focus to micro- feedback and competency-based education with the upcoming adoption of EPAs

Shift to focus on competency-based assessment and decreased reliance on time- and number-based metrics for graduating surgical residents

Education in practice

E-learning offers self-paced asynchronous resources and expert commentary videos for expansion of technical learning outside the OR

Virtual platforms allow expanded access to quality content, potentially leveraging international expertise 

Virtual platforms allow for increased access to mentoring and coaching 

E-learning has the potential to expand options for rural and international surgeons to maintain competency

Adaptations to Clinical Teaching

COVID-19 had a significant impact on how we teach clinical skills to residents and fellows. One of the earliest transitions during the pandemic was the adaptation of clinical meetings (such as didactics, M&M conferences, journal clubs, tumor boards, and preoperative conferences) to virtual and/or hybrid formats to comply with social distancing recommendations. These meetings were adaptable because of their discussion-based format. These changes, however, had advantages and disadvantages with respect to convenience, content, and culture. Benefits associated with this restructuring included increased options for meeting times and methods of attendance.4 Providers could access meetings from any location and interact with individuals from other departments and institutions, leading to improved interdisciplinary collaboration. However, virtual/hybrid platforms also led to a dramatic increase in the number of meetings and, as the pandemic continued, reports of overscheduling, conflicts, and meeting fatigue curtailed the benefits of increased accessibility.5

This transformation illustrates the maxim “quantity does not always equal quality.” The increase in offerings highlighted the importance of content quality, as well as concerns about active participation of learners in these virtual environments. Particularly for residents, issues arose regarding the ability to attend educational meetings while simultaneously meeting other clinical demands.4 Because it is far easier to multitask—answer pages, write notes, see a consult, discuss patient care with another provider—when on a computer in a remote space without oversight during a virtual meeting than while convening in-person, residents perceived this change as leading to a decrease in protected educational time.4 Junior residents shouldered much of this burden, as their initial introduction to direct patient care has been overshadowed by the COVID-19 pandemic.4

On a global scale, the pandemic revealed gaps in our healthcare system that led to the development of new curricula emphasizing health equity and access.6 Globally, there was a 48% increase in the use of video conferencing before the COVID-19 pandemic, but the medical field experienced an even more rapid transition after the pandemic struck.7 The benefits of flexibility and access to meetings were critically empowering for surgeons with busy schedules and in rural settings who previously were isolated from broad collaboration. The lack of training and discussion around appropriate use of virtual/hybrid platforms, nonetheless, led to a shift in etiquette. Meetings such as didactics and M&Ms, which previously maintained a culture of formality—attire, engagement, and protected time—are now less formal engagements. Attendees can take meetings outside the workplace such as in their car, outdoors, in public spaces, or at home.7 Although some studies tout the benefits of this flexibility on personal wellness, only time will tell how the informality affects educational outcomes.8

The RAS Education Committee proposes to combat the barriers to learning using methods that include instructor training for effective virtual teaching, agenda setting and meeting management, troubleshooting technology, and using novel tools on virtual platforms to improve interactivity.

Adaptations to Teaching Technical Skills

The pandemic has resulted in a significant reduction in operative opportunities for surgical trainees.9 Nationally, elective operations were suspended or delayed for several months at a time as rates of infection increased. Time away from operative practice took away the fundamental principle of surgical training, namely the daily practice of surgery.

A study comparing average general surgery monthly case logs from March to June 2020 revealed a 33.5% reduction in major operative cases compared with the same period in 2019, before the COVID-19 outbreak.10 The RAS survey of young surgeons showed that COVID-19-related reduction in surgical caseload was the primary concern of respondents (29.6%). This reduction also affected trainees in fellowships, which carries a significant impact given the short duration of subspecialized training. Thus, surgical educators must compensate for reduced operative volume with innovative approaches through surgical simulation. Growing evidence shows that simulation-based training for skin lesion excision and small bowel anastomosis on porcine tissue translate to decreased time to completion and increased proficiency in the operating room,11 demonstrating the positive role of simulation in reducing operative time, improving outcomes, and increasing resident autonomy. These adjuncts to technical teaching become critically important in the setting of decreased operative volumes or trainees.

One example of the novel approaches to using simulation as a tool to progress surgical technical skills despite lack of access to direct operative experience comes from the University of Toronto, ON.12 This institution has developed a lung transplant model for the surgical skills bootcamp in thoracic surgery, which contained equipment and supplies that were delivered to fellows’ homes. Senior trainees were provided instructions on how to use a vascular anastomosis model pertaining to lung transplantation operation. Trainees were required to practice at home and perform the anastomosis with timed testing. A video recording was made of an attempt. The fellows in this study self-reported improved surgical efficiency over time.12

To protect trainees from exposure to COVID-19 at the height of the pandemic, virtual surgical rotations also were implemented broadly, particularly in undergraduate medical education (UME). Virtual surgical rotations consisted of interactive, live-streamed operations, outpatient telehealth visits, and virtual small groups.1 One novel approach for surgical residents in the Netherlands involved the development of a national livestreamed surgical educational series.3 In this model, one training center conducted and livestreamed common surgical procedures on cadaveric models. Additional online resources were available for self-study before the livestream. Trainees found this hybrid model to be highly educational for technical learning and a plausible alternative given the absence of clinical rotations.3

As we move forward from the pandemic with a slow transition back to prepandemic operative volumes, programs should continue to capitalize on our collective experience with technical surgical education. With established virtual education resources and subsequent comparable outcomes in resident learning, these resources should be maintained as an adjunct to in-person didactic lectures. Many regions still experience periods of reduced surgical volume because of spikes in COVID-19 cases. Continued effort is necessary to establish standardized simulation-based modules to prepare trainees for operative technique early in residency and to increase preparedness for operative autonomy when the opportunity is presented.

Adaptations to the Certification Process

Along with multiple adaptations in both clinical and technical surgical education, shifts in certification also occurred in both UME and graduate medical education. In the US Medical Licensing Examination (USMLE), the major change in board certification was cancelation of Step 2 Clinical Skills.13 For surgical trainees, modifications were seen in training requirements for 2020 graduates, including nonvoluntary offsite time toward graduation requirements, a 10% decrease in required time spent in clinical training for surgical residents, a decrease in the total case numbers required for graduation, and entrustment of program directors to “make a decision about the readiness of the resident for independent practice” even if they failed to meet the decreased time and case requirements.14 In addition to these shifts, the American Board of Surgery (ABS) General Surgery Qualifying Exam (QE) and Certifying Exam (CE) went virtual in 2020.14

These changes brought both successes and failures. The virtual administration of the 2020 General Surgery QE was intended to be safer and more convenient for trainees, but the use of a remote proctoring service resulted in delays and interruptions, as well as security concerns that resulted in the complete cancelation of the July 2020 exam.14 Many of these early challenges were surmounted during the administration of the 2021 exam.

In contrast, the virtual administration of the General Surgery CE has been largely successful, with 78% of candidates preferring the virtual exam when surveyed following the first administration.15 Passing rates also were comparable to previous in-person CE.15 Additional advantages to the virtual CE include the benefit of testing in familiar surroundings—reducing the stress of taking a high-stakes exam in a unfamiliar environment—and the alleviation of travel-related stress and expense.15 Cited disadvantages to the virtual CE included exam security concerns, and the loss of camaraderie and social support before and after the exam for both candidates and faculty.15 Overall, however, most candidates surveyed agreed that the disadvantages of the virtual format of the exam did not seem to outweigh the numerous advantages,15 and it would appear that the virtual CE may be here to stay.

Other changes, including the cancelation of Step 2 CS and changes in residency graduation requirements, appear to be a preview of the transition of the future of medical education to a competency-based model. With the elimination of Step 2 CS, the responsibility of assessing clinical skills readiness falls on medical schools, emphasizing the need to advance competency-based education.13 Similarly, changes in the surgical learning environment created by the COVID-19 pandemic have accelerated the need for improved metrics to determine whether graduating surgical residents are ready for practice.

The limitations resulting from the pandemic on classic surrogates of competency—time spent in training and number of cases completed—has necessarily accelerated the shift to direct evaluation of competency. The concept of competency-based medical education is at the core of entrustable professional activities (EPAs). EPAs are observable and measurable units of work focused on actual healthcare delivery.16 Initially piloted in UME and pediatrics, EPAs now have been developed and piloted in general surgery, and are set to be adopted broadly by the ABS in July 2023.16,17

The aim of the ABS EPA project is to develop a full suite of approximately 19 EPAs representative of the core elements of general surgical practice with the goal of creating microassessments that can be used for improvement-oriented performance feedback.17 Although EPAs will not replace standardized assessments or case requirements, they do demonstrate a shift in the culture of surgical education, where learner outcomes and feedback, rather than case numbers, are emphasized.16 The pandemic accelerated the discussion around trainee competency and, as EPAs are implemented, will continue to be the focus of surgical education for years to come.

Changes to Education for Early Career Surgeons

Surgical residents were not the only ones affected by COVID-19-related shutdowns and changes. Early career surgeons faced the challenge of transitioning to independence in a time of unparalleled change. Important technological innovations that were brought about by the COVID-19 pandemic, as well as the more widespread use and comfort with e-learning and virtual meeting platforms, have had a meaningful impact on maintenance of certification and lifelong learning.

Many publicly available asynchronous resources created by surgical societies or residency programs allow self-paced viewing for the busy surgeon.4 Audio-only formats such as podcasts also are increasingly popular.18 Meanwhile, group viewing of operations from a surgical society video library, especially when expert commentary is available, offers a more interactive approach to recordings and has some evidence of improving technical proficiency outside the operating room.2,19

Like virtual or hybrid resident didactics, the concept of webinars and virtual conferences for CME and maintaining certification is attractive. E-learning is especially appealing to rural and international surgeons as a less costly option that is welcoming of a wider audience.5,19 Unfortunately, these formats have similar limitations to those previously discussed, including reduced engagement and loss of the socialization many appreciate when attending an in-person meeting.1,5 Moving forward, just as with residency education, it is likely that a hybrid model of conferences will predominate, one that incorporates the strengths of both virtual and in-person formats based on individual learner needs.

Finally, telementoring is a promising means not only of maintaining certification, but also gaining new skills by leveraging resources and expertise remotely. The pandemic has accelerated the expansion of existing technologies, including teleconferencing and development of novel telementoring methods, including telestration and augmented reality.20 During a time with limited travel or restrictions on personnel in the OR for trainees and staff alike, alternative approaches to carrying training forward are essential. Beyond the COVID-19 pandemic, these technologies carry great promise for the future of advanced surgical training.

Conclusion and Recommendations

The pandemic has irrefutably changed the face of surgical education. Adaptations to allow for resource scarcity, allocation of workforce, and social distancing accelerated the pace of development of virtual and e-learning technologies. As a result, access to educational content has increased exponentially. It has become increasingly convenient to access educational content and collaborations. Advances in surgical simulation have increased access to technical skills training. Opportunities for local, national, and global collaboration have expanded, and new opportunities for networking, professional development, and mentoring have arisen. The process of board certification has changed in response to pandemic-related restrictions, which have also highlighted the need for true competency-based assessment methods. The wealth of resources now available and the ease of access these novel platforms allow has led to changes in expectations and etiquette. As we move forward as a community of surgeons and educators, it is important to continue to examine the progress we have made and continue to make advances for the future.


References

  1. Chao TN, Frost AS, Brody RM, et al. Creation of an interactive virtual surgical rotation for undergraduate medical education during the COVID-19 pandemic. J Surg Educ. 2021;78(1):346-350.
  2. Chick RC, Clifton GT, Peace KM, et al. Using technology to maintain the education of residents during the COVID-19 pandemic. J Surg Educ. 2020;77(4):729-732.
  3. Feenstra TM, van Felius LP, Vriens MR, et al. Does livestreaming surgical education have the future? Development and participant evaluation of a national COVID-19 livestreaming initiative. Surg Endosc. Available at: https://link.springer.com/article/10.1007/s00464-021-08922-z. Accessed June 29, 2022.
  4. Nagaraj MB, Weis HB, Weis JJ, et al. The impact of COVID-19 on surgical education. J Surg Res. 2021;267:366-373.
  5. Ismail II, Abdelkarim A, Al-Hashel JY. Physicians’ attitude towards webinars and online education amid COVID-19 pandemic: When less is more. PLOS ONE. 2021;16(4):e0250241.
  6. Janeway M, Wilson S, Sanchez SE, et al. Citizenship and social responsibility in surgery: A review. JAMA Surg. 2022;157(6):532-539.
  7. Nagaraj MB, Wick N, AbdelFattah KR. Assessing videoconference etiquette in academia: Determining positive and negative associations with online interactions. J Surg Res. 2022;275:129-136.
  8. Dickinson KJ, Caldwell KE, Graviss EA, et al. Perceptions and behaviors of learner engagement with virtual educational platforms. Am J Surg. 2022;224(1 Pt B):371-374.
  9. Coleman JR, Abdelsattar JM, Glocker RJ, RAS-ACS COVID-19 Task Force. COVID-19 pandemic and the lived experience of surgical residents, fellows, and early-career surgeons in the American College of Surgeons. J Am Coll Surg. 2021;232(2):119-135.e20.
  10. Purdy AC, de Virgilio C, Kaji AH, et al. Factors associated with general surgery residents’ operative experience during the COVID-19 pandemic. JAMA Surg. 2021;156(8):767-774.
  11. Jensen AR, Wright AS, McIntyre LK, et al. Laboratory-based instruction for skin closure and bowel anastomosis for surgical residents. Arch Surg. 2008;143(9):852-858; discussion 858-859.
  12. Chan JCY, Waddell TK, Yasufuku K, et al. Maintaining technical proficiency in senior surgical fellows during the COVID-19 pandemic through virtual teaching. JTCVS Open. 2021;8:679-687.
  13. Murphy B. USMLE Step 2 CS canceled: What it means for medical students. American Medical Association. Available at: https://www.ama-assn.org/residents-students/usmle/usmle-step-2-cs-canceled-what-it-means-medical-students. Accessed April 24, 2022.
  14. American Board of Surgery. American Board of Surgery COVID-19 Updates. Published March 26, 2021. Available at: https://www.absurgery.org/default.jsp?news_covid19updates. Accessed April 24, 2022.
  15. Chen H, Tseng JF, Chaer R, et al. Outcomes of the first virtual general surgery certifying exam of the American Board of Surgery. Ann Surg. 2021;274(3):467-472.
  16. Brasel KJ, Klingensmith ME, Englander R, et al. Entrustable professional activities in general surgery: Development and implementation. J Surg Educ. 2019;76(5):1174-1186.
  17. American Board of Surgery. ABS announces transition to entrustable professional activities for general surgery resident evaluation. Available at: https://www.absurgery.org/default.jsp?news_epas0222. Accessed April 24, 2022.
  18. Dedeilia A, Sotiropoulos MG, Hanrahan JG, et al. Medical and surgical education challenges and innovations in the COVID-19 era: A systematic review. In Vivo. 2020;34(3 Suppl):1603-1611.
  19. Jayakumar N, Brunckhorst O, Dasgupta P, et al. E-learning in surgical education: A systematic review. J Surg Educ. 2015;72(6):1145-1157.
  20. Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: An invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170.

Dr. Rebecca Williams-Karnesky is a recent graduate of the general surgery residency program at the University of New Mexico, Albuquerque, and recently began an endocrine surgery fellowship at the University of Wisconsin, Madison. She is Chair, RAS-ACS Education Committee, and RAS-ACS liaison to the ACS Committee on Medical Student Education.