In Situ Debriefing in Medical Simulation


Introduction

First described in the anesthesia literature in the late 1980s, medical simulation has become an essential part of training in medical education at the undergraduate and graduate levels and in nursing and pharmacy education.[1][2] Traditionally, simulation occurs in dedicated simulation centers. This center-based simulation offers the benefit of being separate from patients and focusing on learning for the individual and the team.[3] Dedicated time is scheduled to participate in this educational activity, and debriefing of the simulation can take part without the competing demands of the clinical work environment.

In situ simulation differs from a center-based simulation in that it occurs in the actual clinical environment, often using providers and staff currently on shift. Because it occurs in the real working environment, it also provides opportunities for learning on the unit and organizational level.[3] In situ simulation has been used to improve teamwork and communication and to help identify system issues and latent patient safety threats.[4][5][6][7] In situ simulations like mock codes may ultimately improve patient outcomes.[8]

Function

Experiential learning is the pillar of adult learning theory, which posits that learners gain knowledge from participating in and reflecting upon real-life experiences.[9] A medical simulation provides a concrete experience as a starting point, but analysis and reflection are required steps in the learning cycle. Debriefing, an analysis of an event that allows learners to reflect on their experience and make meaning of it, is a frequently used tool in medical simulation, as self-directed reflection may be unsystematic or absent.[10] Instead, a facilitated debriefing is often needed to guide participants through this reflective process.[10]

Many models of debriefing have been described in the literature.[11] Some focus on understanding the participants' frames of reference.[12] Others address participant emotions before entering into an analysis phase.[11] One theme common among all methods is that facilitated reflection takes time. While time may be more plentiful in scheduled, center-based simulation debriefing, it is often more limited in situ.

Curriculum Development

No gold standard exists for conducting a postsimulation debriefing in center-based or in situ settings. A review of trends for in situ simulations suggests the majority of in situ simulation debriefings use postsimulation facilitated debriefings (55%) or facilitated debriefings combined with a review of video taken during the simulation (31%).[3]

Some authors recommend learner self-assessment or directive feedback as the primary method for in situ simulation debriefing; this allows facilitators to address more topics with limited time.[13] Due to the constraints of a natural working environment, the times allotted to in situ debriefings may be less than in center-based environments. Nevertheless, the minimum time needed for a debriefing equals the scenario length.[14] 

Learner Self-Assessment

A common learner self-assessment model of debriefing is the plus-delta model.[10][15] In this method, the debriefer encourages participants to actively perform their self-assessments, identifying things that went well (the "plus") or things that could have been better (the "delta").[13] Using open-ended questions, the facilitator may probe participants to identify potential alternatives or solutions to issues raised in the simulation. This plus-delta method may be effective when the primary focus of the debriefing is addressing communication or systems issues that arose during the simulation. 

Another form of learner self-assessment is the SHARP method.[16] Initially created to debrief events in the operating room, in this model, participants describe what went well (or not) and why. The acronym "SHARP" stands for:

  1. Set learning objectives: Determine what learners want to obtain from participating in the case and what the educator's goals are
  2. Ask, "How did it go?": Ask students to self-identify areas of strength and weakness. 
  3. Address concerns: Discuss with students where improvements are possible.
  4. Review specific teaching points: This can include basic science and pathophysiology to students' communication and teamwork.
  5. Plan: Have students identify what they will take away from the case and incorporate it into their practice.[16]

Because the SHARP method includes opportunities for teaching and incorporation into clinical practice, it may be a valuable tool for in situ simulation debriefs.

Directive Feedback

Directive feedback is a form of feedback that does not depend on the assessment learners make of their performance.[10][17] Instead, it is unidirectional, with the facilitator sharing their assessment. This may be useful when the primary focus of the debriefing is to address a knowledge gap or performance gap, such as in procedural skills training.[17] It may also clarify key learning objectives or with more novice learners.[13][18] Directive feedback does not rely on introspection or self-reflection and is inappropriate when the primary simulation objectives are teamwork-based.[19]

Conversational Models

Despite time constraints, facilitators are not limited to these learner self-assessment or directive feedback models. Conversational models of debriefing have been successful with in situ simulations. Facilitators have successfully used the "debriefing with good judgment" model during in situ debriefings while maintaining a short simulation-to-debriefing time ratio.[4] In this model, facilitators conduct a phased conversation with learners, analyzing and discussing events and then intentionally moving to a summary phase where participants discuss the application of what the student learned.

The advocacy-inquiry model (AIM) is another conversational debriefing model that seeks to understand a participant's thought process. Though not specific to the in situ setting, this form of debriefing is preferred by learners who are farther along in their training. Thus, it may be more applicable to the varied experience levels in the in situ team.[18] It also encourages participants to challenge their own decision-making and underlying beliefs.[18] In this method, the debriefer begins with a statement representing the advocacy portion: "I noticed that you did [specific action]. I am concerned that this may cause [specific outcome]." By linking the specific action to its resulting outcome, feedback may be more precise, and learners may better associate the consequences of particular actions.[18] The debriefer then seeks to understand the participant's frame with the inquiry portion, asking, "Can you help me understand where you were coming from?"

Multiple other conversational models exist, as do blended models. The "Promoting Excellence And Reflective Learning in Simulation" (PEARLS) method is an example of a blended model, which combines learner self-assessment with focused facilitated discussion and directive feedback.[20]

Clinical Clerkships

All debriefing methods are appropriate for learners across various levels of training and specialties. 

Continuing Education

Several tools exist to aid in the evaluation of the debriefing itself. These include the Debriefing Assessment for Simulation in Healthcare (DASH) and the Objective Structured Assessment of Debriefing (OSAD).[21][22] These tools are not specific to either center-based or in situ debriefing.

Clinical Significance

The popularity of simulation as an experiential learning model that adult learners prefer continuously increases. Debriefing is an intrinsic component of the simulation exercise to ensure meaningful teaching points. The approaches to debriefing are variable and can be adapted depending on the environment and the needs of the learners. 

Written tools, such as the PEARLS debriefing tool, attempt to structure the debriefing process as a script and a guide.[20] The TEAM Debrief Tool has been shown to increase the amount of learner self-assessment and decrease the amount of directive feedback during debriefings.[19] Novice facilitators may benefit more from formal tools or scripts for their debriefings.[23]

Pearls and Other Issues

Key facts to keep in mind about in situ debriefing in medical simulation are as follows:

  • Debriefing needs to occur following simulation exercises to be effective. 
  • The scheduled debriefing time should be for at least the anticipated duration of the simulation exercise. For example, a 10-minute simulation will need at least a 10-minute debriefing. 
  • Learner self-assessment, facilitator-directed feedback, and conversational feedback are 3 options that facilitators can use to address their feedback. These methods can be blended to best suit the needs of the simulation. 
  • Reflective observation allows simulation participants to reflect upon and evaluate their performance. 
  • The AIM seeks to understand why a simulation participant performed a particular action. 
  • Directive feedback is a valuable technique when addressing a gap in procedural knowledge, but it may be less preferred by learners than other models.
  • Novice facilitators will need support to be proficient at debriefing simulation exercises. Written tools or formal training can provide a framework for a debriefing for novice facilitators. 

Enhancing Healthcare Team Outcomes

In situ simulation has been shown to improve teamwork[4][5] and communication.[6] Essential to successful simulation is quality debriefing. An ineffective debriefing may fail to help learners close a knowledge or performance gap.[24] When debriefing is done poorly or perceived as critical instead of constructive can lower self-esteem.[25] It may also create anger or resistance, which can undermine the teamwork aspect of healthcare.[25]


Details

Editor:

Laryssa Patti

Updated:

9/19/2022 11:56:47 AM

References


[1]

Gaba DM, DeAnda A. A comprehensive anesthesia simulation environment: re-creating the operating room for research and training. Anesthesiology. 1988 Sep:69(3):387-94     [PubMed PMID: 3415018]


[2]

Alt-Gehrman P. Nursing Simulation and Transfer of Knowledge in Undergraduate Nursing Programs: A Literature Review. Nursing education perspectives. 2019 Mar/Apr:40(2):95-98. doi: 10.1097/01.NEP.0000000000000398. Epub     [PubMed PMID: 30148759]

Level 3 (low-level) evidence

[3]

Rosen MA, Hunt EA, Pronovost PJ, Federowicz MA, Weaver SJ. In situ simulation in continuing education for the health care professions: a systematic review. The Journal of continuing education in the health professions. 2012 Fall:32(4):243-54. doi: 10.1002/chp.21152. Epub     [PubMed PMID: 23280527]

Level 1 (high-level) evidence

[4]

Auerbach M,Roney L,Aysseh A,Gawel M,Koziel J,Barre K,Caty MG,Santucci K, In situ pediatric trauma simulation: assessing the impact and feasibility of an interdisciplinary pediatric in situ trauma care quality improvement simulation program. Pediatric emergency care. 2014 Dec;     [PubMed PMID: 25407035]

Level 2 (mid-level) evidence

[5]

Miller D, Crandall C, Washington C 3rd, McLaughlin S. Improving teamwork and communication in trauma care through in situ simulations. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2012 May:19(5):608-12. doi: 10.1111/j.1553-2712.2012.01354.x. Epub     [PubMed PMID: 22594369]


[6]

Daniels K, Auguste T. Moving forward in patient safety: multidisciplinary team training. Seminars in perinatology. 2013 Jun:37(3):146-50. doi: 10.1053/j.semperi.2013.02.004. Epub     [PubMed PMID: 23721769]


[7]

Couto TB, Barreto JKS, Marcon FC, Mafra ACCN, Accorsi TAD. Detecting latent safety threats in an interprofessional training that combines in situ simulation with task training in an emergency department. Advances in simulation (London, England). 2018:3():23. doi: 10.1186/s41077-018-0083-4. Epub 2018 Nov 23     [PubMed PMID: 30505467]

Level 3 (low-level) evidence

[8]

Josey K,Smith ML,Kayani AS,Young G,Kasperski MD,Farrer P,Gerkin R,Theodorou A,Raschke RA, Hospitals with more-active participation in conducting standardized in-situ mock codes have improved survival after in-hospital cardiopulmonary arrest. Resuscitation. 2018 Dec;     [PubMed PMID: 30261220]


[9]

Yardley S, Teunissen PW, Dornan T. Experiential learning: transforming theory into practice. Medical teacher. 2012:34(2):161-4. doi: 10.3109/0142159X.2012.643264. Epub     [PubMed PMID: 22288996]


[10]

Fanning RM, Gaba DM. The role of debriefing in simulation-based learning. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2007 Summer:2(2):115-25. doi: 10.1097/SIH.0b013e3180315539. Epub     [PubMed PMID: 19088616]


[11]

Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More Than One Way to Debrief: A Critical Review of Healthcare Simulation Debriefing Methods. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2016 Jun:11(3):209-17. doi: 10.1097/SIH.0000000000000148. Epub     [PubMed PMID: 27254527]


[12]

Rudolph JW,Simon R,Dufresne RL,Raemer DB, There's no such thing as     [PubMed PMID: 19088574]


[13]

Cheng A, Grant V, Dieckmann P, Arora S, Robinson T, Eppich W. Faculty Development for Simulation Programs: Five Issues for the Future of Debriefing Training. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2015 Aug:10(4):217-22. doi: 10.1097/SIH.0000000000000090. Epub     [PubMed PMID: 26098492]


[14]

Abatzis VT, Littlewood KE. Debriefing in Simulation and Beyond. International anesthesiology clinics. 2015 Fall:53(4):151-62. doi: 10.1097/AIA.0000000000000070. Epub     [PubMed PMID: 26397791]


[15]

Eppich WJ, Hunt EA, Duval-Arnould JM, Siddall VJ, Cheng A. Structuring feedback and debriefing to achieve mastery learning goals. Academic medicine : journal of the Association of American Medical Colleges. 2015 Nov:90(11):1501-8. doi: 10.1097/ACM.0000000000000934. Epub     [PubMed PMID: 26375272]


[16]

Ahmed M,Arora S,Russ S,Darzi A,Vincent C,Sevdalis N, Operation debrief: a SHARP improvement in performance feedback in the operating room. Annals of surgery. 2013 Dec;     [PubMed PMID: 23478533]


[17]

Hatala R, Cook DA, Zendejas B, Hamstra SJ, Brydges R. Feedback for simulation-based procedural skills training: a meta-analysis and critical narrative synthesis. Advances in health sciences education : theory and practice. 2014 May:19(2):251-72. doi: 10.1007/s10459-013-9462-8. Epub 2013 May 28     [PubMed PMID: 23712700]

Level 3 (low-level) evidence

[18]

Timmis C, Speirs K. Student perspectives on post-simulation debriefing. The clinical teacher. 2015 Dec:12(6):418-22. doi: 10.1111/tct.12369. Epub 2015 May 29     [PubMed PMID: 26032755]

Level 3 (low-level) evidence

[19]

Thompson R, Sullivan S, Campbell K, Osman I, Statz B, Jung HS. Does a Written Tool to Guide Structured Debriefing Improve Discourse? Implications for Interprofessional Team Simulation. Journal of surgical education. 2018 Nov:75(6):e240-e245. doi: 10.1016/j.jsurg.2018.07.001. Epub 2018 Aug 6     [PubMed PMID: 30093336]


[20]

Eppich W, Cheng A. Promoting Excellence and Reflective Learning in Simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2015 Apr:10(2):106-15. doi: 10.1097/SIH.0000000000000072. Epub     [PubMed PMID: 25710312]


[21]

Brett-Fleegler M, Rudolph J, Eppich W, Monuteaux M, Fleegler E, Cheng A, Simon R. Debriefing assessment for simulation in healthcare: development and psychometric properties. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2012 Oct:7(5):288-94. doi: 10.1097/SIH.0b013e3182620228. Epub     [PubMed PMID: 22902606]


[22]

Arora S, Ahmed M, Paige J, Nestel D, Runnacles J, Hull L, Darzi A, Sevdalis N. Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery. Annals of surgery. 2012 Dec:256(6):982-8. doi: 10.1097/SLA.0b013e3182610c91. Epub     [PubMed PMID: 22895396]


[23]

Cheng A, Hunt EA, Donoghue A, Nelson-McMillan K, Nishisaki A, Leflore J, Eppich W, Moyer M, Brett-Fleegler M, Kleinman M, Anderson J, Adler M, Braga M, Kost S, Stryjewski G, Min S, Podraza J, Lopreiato J, Hamilton MF, Stone K, Reid J, Hopkins J, Manos J, Duff J, Richard M, Nadkarni VM, EXPRESS Investigators. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. JAMA pediatrics. 2013 Jun:167(6):528-36. doi: 10.1001/jamapediatrics.2013.1389. Epub     [PubMed PMID: 23608924]

Level 1 (high-level) evidence

[24]

Rudolph JW, Simon R, Raemer DB, Eppich WJ. Debriefing as formative assessment: closing performance gaps in medical education. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2008 Nov:15(11):1010-6. doi: 10.1111/j.1553-2712.2008.00248.x. Epub 2008 Oct 20     [PubMed PMID: 18945231]


[25]

Baron RA. Negative effects of destructive criticism: impact on conflict, self-efficacy, and task performance. The Journal of applied psychology. 1988 May:73(2):199-207     [PubMed PMID: 3384772]