Education Research: Teaching and assessing communication and professionalism in neurology residency with simulation
Citation Manager Formats
Make Comment
See Comments

In medical education, professionalism and interpersonal communication skills are considered to be equally important to the mastery of medical fund of knowledge.1,2 The American Association of Medical Colleges states that “medical schools should articulate and defend the importance of professional values,” and suggests tools for developing and assessing these skills, such as 360-degree evaluations, simulations, clinical vignettes, retreats, and focus groups.1 The Accreditation Council for Graduate Medical Education includes interpersonal communication and professionalism as core competencies; trainees must achieve these before practicing independently.2
This emphasis on professionalism and communication competencies may be related to data showing a link between excellence in communication skills and improved medical outcomes. Such outcomes include increased patient satisfaction and trust, increased patient adherence with treatments, increased likelihood patients will stay with a physician, fewer patient complaints, and reductions in the frequency of litigation.3 Furthermore, unprofessional behavior is associated with reduced productivity among colleagues, high physician turnover, and propensity for physician burnout.4
Despite their importance, the best methods for teaching professionalism and communication skills remain unclear. We sought to (1) assess the self-reported comfort level of neurology residents with professionalism and communication tasks; (2) identify how neurology residents feel that they learn best; (3) explore faculty's perception of teaching residents about professionalism and communication; and (4) pilot a novel educational initiative to improve professionalism and communication skills for our residents.
Methods
Anonymous electronic surveys were distributed to neurology residents and faculty in the Department of Neurology at our institution in October 2017. Surveys were designed to assess perceptions regarding resident education on interpersonal communication and professionalism tasks, including specific scenarios such as breaking bad news, delivering a sensitive diagnosis, discussing prognosis, leading a goals-of-care discussion, disclosing a medical error, reviewing risks and benefits of IV tissue plasminogen activator (tPA), and communicating with members of the care team (see supplemental data, links.lww.com/WNL/B39). After review of the survey results, a committee of faculty members and residents discussed how to improve resident education about communication and professionalism. Due to the study's design, review by the institutional review board was waived.
Based on survey results (discussed in the following section), we designed a program of performance-based assessment to augment our existing didactic on professionalism and communication that takes place during summer orientation to our program. A simulation curriculum including observation and feedback of 8 objective structured clinical examinations (OSCEs) to be conducted over the course of neurology training at our New York Simulation Center was developed. The curriculum included cases addressing the following tasks: performing a handoff with a coresident, consenting a patient for IV tPA, working with a difficult colleague, identifying an impaired coresident, disclosing a medical error to a patient, discussing prognosis with a patient's family member, giving and receiving feedback from a medical student, and informing a patient that he or she has a functional neurologic problem. A neurology faculty member worked with experienced medical education simulation faculty to develop a script and case-specific checklist items. The core communication behavioral anchored checklist aligned with other graduate medical education programs at our institution. For each case, a standardized professional (SP) was trained to play the role of a colleague, senior faculty member, medical student, patient, or patient's family member.
During the OSCEs, residents are told about their role and the task for each case through a document posted on the door of the simulation rooms. After entering the room, residents are given 10 minutes to complete the task. A neurology faculty member observes each OSCE, then provides 5 minutes of verbal feedback. Each SP completes a behavioral anchored checklist for each resident documenting professionalism and interpersonal communication skills. At the end of the OSCEs, faculty members lead a 30-minute debriefing session during which residents discuss their experience and review take-away pearls.
Results
Survey results
The survey was completed by 20 out of 42 residents and 73 out of 125 faculty members. Of the 20 residents, 50% were female; 80% were adult neurology residents, 15% were neurology/psychiatry residents, and 5% were child neurology residents; 45% were postgraduate year 4, 30% were postgraduate year 2, and 25% were postgraduate year 3. Of the 73 faculty, 47% were female; 37% attended for 0–3 weeks of inpatient consult/service time annually, 36% attended 4–8 weeks annually, 17% attended 9–15 weeks annually, and 10% attended more than 15 weeks annually; 50% were faculty at our institution for less than 5 years, 21% were faculty at our institution for 5–10 years, and 29% were faculty at our institution for 11 or more years.
Although no residents endorsed being very uncomfortable performing any of the interpersonal communication and professionalism tasks assessed in the survey, only 1 resident (5%) endorsed feeling very comfortable performing all the tasks. Fewer than 50% of residents noted that a faculty member had observed them performing the majority of these tasks, and fewer than 30% of residents reported that they had ever been given feedback on their performance of each of these tasks (figure, A and B).
(A) Resident and faculty report of observation while performing interpersonal communication and professionalism tasks during clinical rotations. (B) Resident and faculty report of feedback to residents regarding interpersonal communication and professionalism tasks during clinical rotations. tPA = tissue plasminogen activator.
Although only 6% of faculty reported they never taught residents about any of the interpersonal communication and professionalism tasks listed in the survey, for every task included in the survey, fewer than 50% of faculty indicated that they had observed residents performing the task and fewer than 50% indicated that they had provided feedback to residents about the task (figure, A and B).
When asked about the perceived effectiveness of different modes of teaching, 100% of residents indicated that doing a task was an effective means of learning extremely often/very often and 95% of residents reported that observing an attending perform a task is an effective means of learning extremely often/very often. A total of 65% reported that didactics were an effective means of learning extremely often/very often and 40% said reading a textbook about a task was effective extremely often/very often.
Programmatic evaluation of performance-based assessment
As of March 2018, we have run each set of OSCEs twice. Based on feedback from anonymous surveys, the 57 residents who participated in the OSCEs agreed the OSCE cases were similar to real-life encounters (mean score 4.1/5 [with 5 being strongly agree and 1 being strongly disagree]), but were neutral about whether their performance on OSCEs adequately reflected their performance in practice (mean 3.4/5). The residents believed the OSCEs were very useful (mean score 4.7/5, with 5 being most useful). When asked if each OSCE should be repeated for future classes, with the exception of 1 resident who said maybe for 1 OSCE, 100% of residents indicated yes for every OSCE.
Discussion
Building a comprehensive simulation curriculum to address interpersonal communication skills and professionalism is feasible and beneficial to neurology residents and faculty. There are many known benefits to incorporating simulation into residency education. Simulations provide a safe environment for practicing skills, enable a uniform experience for all, allow residents to interact with reliable and readily available “patients,” and help build a culture of safety.5 Over the last 10 years, neurology residencies have been utilizing simulation to enforce principles for managing acute stroke,6 to train residents to perform lumbar punctures,7 and to teach residents about direct ophthalmoscopy.8 There is a dearth of literature suggesting use of a simulation center for developing professionalism and interpersonal communication skills, particularly in neurology residency. Nonetheless, simulation can positively affect physician performance and clinical outcomes, as has been demonstrated with screening for high-risk behaviors,9 safer opioid prescribing practices,10 and assessing pain.11
Our survey results demonstrate that the traditional method of teaching through apprenticeship, a format whereby we hope that faculty exhibit professional behavior with good communication and that trainees model this behavior, may not be adequate. Furthermore, this method does not provide a standardized, uniform experience for each resident, especially when there is a large number of trainees and faculty.
Our residents desired more frequent feedback than our faculty appreciated. Through the simulation curriculum we implemented, professionalism and communication skills can be observed and assessed in real time followed by immediate, specific feedback for improvement. Residents believed, on the whole, that the OSCEs were useful, and should be repeated for future training classes.
We hope that describing this intervention will be beneficial for neurology resident education at other institutions. We recognize that it will not be feasible for all residency programs to implement this type of curriculum, as it requires both access to and the financial means to work with a simulation center and faculty availability to create and observe the OSCEs.
We acknowledge that surveys have limitations due to their subjective nature. Further study of this curriculum is needed to assess potential effect on resident performance and clinical outcomes over time. Many residents in our program have anecdotally reported utilizing skills developed during the OSCEs during their clinical rotations. We plan to survey our residents more formally on perceived effect of the OSCEs on their skills. Continued implementation of the simulation curriculum and assessment of its effect is needed to create a standardized approach to interpersonal communication and professionalism education in neurology residency programs.
Author contributions
A. M. Kurzweil: drafting/revising the manuscript, data acquisition, study concept or design, analysis or interpretation of data, accepts responsibility for conduct of research and final approval, acquisition of data, statistical analysis, study supervision. A. Lewis: drafting/revising the manuscript, data acquisition, study concept or design, accepts responsibility for conduct of research and final approval. P. Pleninger: drafting/revising the manuscript, study concept or design, accepts responsibility for conduct of research and final approval, acquisition of data, study supervision. Sara Kate Rostanski: drafting/revising the manuscript, accepts responsibility for conduct of research and final approval, acquisition of data. A. Nelson: drafting/revising the manuscript, data acquisition, study concept or design, analysis or interpretation of data, accepts responsibility for conduct of research and final approval, acquisition of data, statistical analysis, study supervision. C. Zhang: drafting/revising the manuscript, data acquisition, study concept or design, accepts responsibility for conduct of research and final approval. S. Zabar: drafting/revising the manuscript, study concept or design, analysis or interpretation of data, accepts responsibility for conduct of research and final approval, acquisition of data. K. Ishida: drafting/revising the manuscript, data acquisition, accepts responsibility for conduct of research and final approval, acquisition of data. L. J. Balcer: drafting/revising the manuscript, analysis or interpretation of data, accepts responsibility for conduct of research and final approval. Steven Galetta: drafting/revising the manuscript, study concept or design, analysis or interpretation of data, accepts responsibility for conduct of research and final approval.
Study funding
No targeted funding reported.
Disclosure
The authors report no disclosures relevant to the manuscript. Go to Neurology.org/N for full disclosures.
Footnotes
Go to Neurology.org/N for full disclosures. Funding information and disclosures deemed relevant by the authors, if any, are provided at the end of the article.
- © 2020 American Academy of Neurology
References
- 1.↵AAMC. Assessment of Professionalism Project [online]. Available at: aamc.org/download/77168/data/professionalism.pdf. Accessed March 15, 2019.
- 2.↵ACGME. ACGME Milestones Guidebook [online]. Available at: acgme.org/Portals/0/PDFs/Milestones/MilestonesGuidebookforResidentsFellows.pdf. Accessed March 15, 2019.
- 3.↵
- 4.↵
- 5.↵
- Issenberg SB,
- Scalese RJ
- 6.↵
- Mehta T,
- Strauss S,
- Beland D,
- Fortunato G,
- Staff I,
- Lee N
- 7.↵
- Sun C,
- Qi X
- 8.↵
- Gupta DK,
- Khandker N,
- Stacy K,
- Tatsuoka CM,
- Preston DC
- 9.↵
- 10.↵
- Roy P,
- Jackson AH,
- Baxter J, et al
- 11.↵
Disputes & Debates: Rapid online correspondence
REQUIREMENTS
If you are uploading a letter concerning an article:
You must have updated your disclosures within six months: http://submit.neurology.org
Your co-authors must send a completed Publishing Agreement Form to Neurology Staff (not necessary for the lead/corresponding author as the form below will suffice) before you upload your comment.
If you are responding to a comment that was written about an article you originally authored:
You (and co-authors) do not need to fill out forms or check disclosures as author forms are still valid
and apply to letter.
Submission specifications:
- Submissions must be < 200 words with < 5 references. Reference 1 must be the article on which you are commenting.
- Submissions should not have more than 5 authors. (Exception: original author replies can include all original authors of the article)
- Submit only on articles published within 6 months of issue date.
- Do not be redundant. Read any comments already posted on the article prior to submission.
- Submitted comments are subject to editing and editor review prior to posting.