Академический Документы
Профессиональный Документы
Культура Документы
Adah Chung, M.Ed, University of Colorado School of Medicine Center for Advancing Professional Excellence, USA
Agenda
Welcome and Introductions Objectives Background and challenges Brief literature review What we did Reflective feedback Discussion Concluding remarks
Lets talk
None an area were interested in Objective Structured Clinical Examinations Communications training Small group teaching Formative assessment with feedback
Objectives
Participants will understand how using reflective feedback with standardized patients in graduate medical education can help to meet the ACGME requirements. Participants will learn about the benefits of using verbal feedback for residents. Participants will learn about a subjective written patient perception tool to guide discussion with residents Participants will learn how a formative assessment using immediate reflective feedback is implemented.
A little history
ACGME Outcomes Project emphasis on educational outcomes assessment based on (6) competencies:
ACGME Toolbox:
Patient care Medical knowledge Practice based learning Communication Professionalism System Based practice
Checklist evaluation Global rating of live or recorded performance SP exam OSCEs Patient Surveys
Resident competencies (skills, knowledge and attitudes) must be translated into a set of complex behaviors that result in the delivery of high-quality medical care (Whitcomb, 2002)
Allows reflection from residents (meets complexity/professional competence concerns) Non-threatening environment for learning (meets attitudes towards SPs) Trained SPs can provide more specific behavioral feedback than patients (meets patient survey concerns)
The outcomes of assessment should foster learning, inspire confidence in the learner, enhance the learners ability to self-monitor and drive institutional selfassessment and curricular change.
Epstein, R.M. & Hundert, E.M. (2002) Defining and assessing professional competence, JAMA, 287(2):226235.
Professional competency
Professional competence developmental, impermanent and context dependent More than demonstration of isolated competencies A competent physician possesses the integrative ability to think, feel and act like a physician
Dimensions of competence
Knows that knows how reflective knowing Reflective knowing: focus on dialog and argument for better practical understanding
Definition of reflection
Reflection: 6: A thought, idea or opinion formed or a remark made as a result of meditation, 7: consideration of some subject matter, idea or purpose
Merriam-Webster Dictionary
Reflection
Reflection-on-action reflecting on experiences Adds to professional repertoire Difference between effective and noneffective practitioners
Reflection contd
Reflection as a way to help professionals integrate skills, knowledge, behavior and attitudes Reflection as a higher level cognitive and personal process as one develops professionally
My question:
If reflection is the key to the difference in learning & it promotes integration of skills and behaviors that residents should possess, then can it be facilitated?
Students who responded favorably to SP experience more likely to have received feedback from SPs Students agreed strongly that feedback from SPs are clear, non judgmental, specific and provided them with patients perspective of the encounter
Even brief feedback encounters (2 minutes) can have significant influence on clinical competency
Efficacy of feedback:
students who receive feedback regarding clinical performance report more positive attitudes towards the clinical experience
Howley, LD & Martindale, J. (2004). The efficacy of standardized patient feedback in clinical teaching. A mixed methods analysis. Med Educ Online, 9(18): 1-10.
Questions?
What we did
Logistics
4 stations:
Checklists were in the form of patient perception questionnaires helped to guide discussion with resident Cases: Bad news, Smoking cessation, Diabetes management, Urological exam (TA)
Logistics contd
Feedback session:
Invite resident to self assess Provide a positive statement Provide an area to improve End with an overall positive statement Use the PPQ as a tool to guide discussion Describing feelings from patients perspective
Reflective Feedback
Promotes reflection as part of a dialog (both parties involved) Focuses on observed behavior Descriptive vs. judgemental Specific vs. general Sharing information vs. advice giving
Training of SPs
Purpose of feedback Characteristics of feedback Tips for success Methods for giving feedback (the sandwich, I statements) Examples and practice scenarios Appendices
PPQ
Terminology and categories following (3) ACGME competencies Yes/No provide more useful, reproducible results (ACGME Toolbox, 2000) Room for comments of specific behaviors for performance improvement
PPQ guide
Understanding items Examples for things that could be written under HOW? Ie. Effective communication
An example
Hi thanks for coming in. How did you think things went? It really is uncomfortable to talk to someone when shes crying I didnt know what to do. When you put your hand on my shoulder, I felt reassured. I also liked that you gave me space to cry rather than trying to talk through my tears. Oh Im glad I actually just didnt know what to say Saying nothing at all was very comforting to me What else could I have done? Several times you tapped your foot on the floor and looked at your notes rather than me that made me feel like I was taking up too much of your time. I didnt even notice that I was doing that! Overall, your gentle demeanor and touch helped me to understand the news you were giving me. Thank you.
Resident response
Receiving feedback from standardized patients was very helpful Direct feedback Great food Good learning tool. I felt most of the feedback was useful, but there was no criticism The topics are relevant to practice Ability to ask afterward how they thought I did Immediate feedback Good feedback/Good cases. Immediate feedback was very helpful Excellent specific feedback Helpful feedback. It helps me to see my weak points. I think focusing on communication is best Very low pressure atmosphere. Real life 20 min appts
Uses ACGME recommended toolbox ideas: combining SP encounters with patient surveys Provides structured observation Allows for professional self reflection (reflection-on-action) Checklist data for residency directors Direct feedback for residents from trained standardized patients (changing attitudes)
The outcomes of assessment should foster learning, inspire confidence in the learner, enhance the learners ability to self-monitor and drive institutional selfassessment and curricular change.
Epstein, R.M. & Hundert, E.M. (2002) Defining and assessing professional competence, JAMA, 287(2):226235.
Discussion
What are the advantages and disadvantages of using a reflective, narrative, verbal discussion with standardized patients? What strengths and/or weaknesses do standardized patients bring to this kind of formative assessment?
Conclusion
A direct feedback method with a subjective written tool can help to demonstrate competencies while appreciating the complex learning interaction that happens as one becomes a professional
Future considerations
An added written self reflection exercise? Research on the efficacy of SP feedback to promote reflection
Final thoughts
Recognition of SP strengths and weaknesses and how to meet the needs of the residents and residency programs Challenge to think about ways we can assist residency programs in creative ways, other than our usual OSCE and SP exams Be intentional rather than accidental!
Thank you!
Please contact Adah Chung, MEd. at adah.chung@uchsc.edu or (303) 724-1209 for more information