Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • COVID-19
    • Inclusion, Diversity, Equity, Anti-racism, & Social Justice (IDEAS)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • Topics A-Z
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • COVID-19
    • Inclusion, Diversity, Equity, Anti-racism, & Social Justice (IDEAS)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • Topics A-Z
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

User menu

  • Subscribe
  • My Alerts
  • Log in

Search

  • Advanced search
Neurology
Home
The most widely read and highly cited peer-reviewed neurology journal
  • Subscribe
  • My Alerts
  • Log in
Site Logo
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

Share

January 01, 2019; 92 (1) Resident & Fellow Section

Education Research: Electronic patient portal enrollment and no-show rates within a neurology resident clinic

View ORCID ProfileKavit Shah, Abdullah Alshammaa, Muhammad Affan, Lonni Schultz, Tobias Walbert, Iram Zaman
First published December 24, 2018, DOI: https://doi.org/10.1212/WNL.0000000000006685
Kavit Shah
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kavit Shah
Abdullah Alshammaa
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Muhammad Affan
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lonni Schultz
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tobias Walbert
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Iram Zaman
From the Departments of Neurology (K.S., A.A., M.A., T.W., I.Z.), Public Health Sciences (L.S.), and Neurosurgery (T.W.), Henry Ford Hospital, Detroit, MI.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Full PDF
Citation
Education Research: Electronic patient portal enrollment and no-show rates within a neurology resident clinic
Kavit Shah, Abdullah Alshammaa, Muhammad Affan, Lonni Schultz, Tobias Walbert, Iram Zaman
Neurology Jan 2019, 92 (1) 50-54; DOI: 10.1212/WNL.0000000000006685

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
665

Share

  • Article
  • Figures & Data
  • Info & Disclosures
Loading

Abstract

Objective To identify factors that affect appointment adherence and investigate the association of electronic patient portal (ePP) enrollment and patient adherence rates to appointments in the Neurology Resident Clinic (NRC).

Methods Patients scheduled for an appointment during the months of October 2015, February 2016, and June 2016 in the NRC were included. ePP enrollment, date of clinic appointment, method of referral to the clinic, and key demographic criteria were collected. χ2 tests were performed to assess the association of appointment status (i.e., no-show, showed, and canceled) with demographic, comorbidity, and visit information.

Results Patients with ePP enrollment had significantly lower rates of no-show (19% vs 27%) and higher rates of showed (59% vs 48%) compared to patients without ePP enrollment. Younger patients (18–49) had the highest rates of no-show (28%), while older patients (65+) had the lowest rates of no-show (17%). Caucasian patients had significantly lower rates of no-show compared to non-Caucasian patients (14% vs 24%). Non-English-speaking patients had high rates of no-show (34%). Patients with a physician referral had significantly lower rates of no-show (20% vs 28%) and higher rates of showed (61% vs 44%) compared to patients with a self-referral.

Conclusions Our study indicates that ePP enrollment, age, race, and physician referral might be associated with reduced no-show rates in the NRC.

Glossary

EMR=
electronic medical record;
ePP=
electronic patient portal;
IRB=
institutional review board;
NRC=
neurology resident clinic

Introduction

A nationwide increase in the adoption of electronic medical records (EMRs) by office-based physicians occurred from 2001 to 2015 (18.2% to 86.9%, respectively).1,–,3 A majority of EMRs use an electronic patient portal (ePP), which allows patients to securely communicate with health care providers.4,–,6 Thus far, implementing ePPs has yielded mixed results regarding clinic visit attendance; however, considerable variability exists in the methodology and scope of these studies.4,–,7

During academic year 2016–2017, 14,100 patients were seen in our neurology department's outpatient clinic. Currently, a 2-month waiting list exists for new patient visits, which is predicted to lengthen with increased demand. Anecdotally, there have been frequent no-shows to clinic, predominantly in the neurology resident clinic (NRC). This leads to unfilled patient slots and prevents those on an extended waitlist from being seen expeditiously. The effect of ePP electronic reminders upon patient adherence rates to clinic appointments remains unclear. In this study, we investigate how ePP enrollment, key demographic factors, and referral methods are associated with patient adherence rates to NRC appointments.

Methods

Our health system's EMR is Epic (Epic Systems Corporation, Verona, WI), which has been used in our outpatient clinics since 2013. MyChart is its accompanying ePP, and similar to other ePPs, delivers automatic appointment reminders. We reviewed patients scheduled in the NRC, which consists of a patient population scheduled with 18 neurology residents, during the months of October 2015, February 2016, and June 2016. These months were chosen to capture different time points during the academic calendar. We conducted a retrospective chart review of the following data: date of scheduled clinic visit, appointment status, MyChart enrollment, sex, age, race, preferred language, and method of referral to the clinic. Patients were defined as (1) no-shows (did not appear for or canceled the appointment <24 business hours from the appointment time), (2) showed (attended the scheduled visit), and (3) canceled (canceled ≥24 business hours prior to appointment).

Standard protocol approvals, registration, and patient consent

This retrospective study was approved by our institutional review board (IRB #10780). Given the nature of the study, the informed consent requirement was waived by the IRB. No experiments on live vertebrates or higher invertebrates were performed. No photographs, videos, or other recognizable information regarding participating patients has been submitted for publication.

Statistical analysis

We performed χ2 tests to assess the association of appointment status (no-show, showed, and canceled) with MyChart enrollment, as well as predefined demographic, comorbidity, and visit information. We also used χ2 tests to assess the association of MyChart enrollment with the predefined demographic, comorbidity, and visit information. Multinomial logistic regression analysis was performed to assess the association of appointment status with MyChart enrollment, after adjusting for other information. The testing level was set at 0.05. All analyses were done using SAS version 9.4 (SAS Institute Inc., Cary, NC).

Results

There were 1,113 total visits by 998 individual patients during the 3 selected months. Of these 998 patients, 897 had one visit, 87 had 2 visits, and 14 had 3 visits. In the 998 patients, 673 (67%) were female, 569 (57%) were African American, 919 (92%) spoke English, and the average age was 53.9 years (±18.9; range 18–100). The distribution of the appointment status was 230 (23%) no-show, 536 (54%) showed, and 232 (21%) canceled. Fifty-four percent (n = 540) were new visits, 67% (n = 670) were physician referrals, 50% (n = 501) had MyChart enrollment, and the visits were equally distributed over the 3 months (35% October, 31% February, and 34% June) (table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1

Comparison of appointment status for MyChart enrollment and demographic, comorbidity, and visit information

Demographic associations

We found that appointment status is significantly associated with MyChart enrollment and age (table 1). Patients with MyChart enrollment had lower rates of no-show (19% vs 27%) and higher rates of showed (59% vs 48%) compared to patients without MyChart enrollment. Rates of cancellation were similar between the 2 groups (22% vs 25%). Younger patients (18–35 and 36–49) had the highest rates of no-show (29% and 27%, respectively), while older patients (65–79 and 80+) had the lowest rates of no-show (17% and 18%, respectively). Older patients (65–79 and 80+) had the highest rates of canceled appointments (26% and 34%, respectively).

In addition, we found significant associations of appointment status with race, language, and method of referral (table 1). This remained true when patients with unknown race, language, and method of referral were excluded (table 1). When considering patients with known race, Caucasian patients had the lowest rate of no-show (14%) and highest rate of canceled (27%), African American patients had the highest rate of no-show (25%) and lowest rate of showed (54%), and patients of other race—Hispanic, Asian, American Indian, and Native American/Pacific Islander—had the highest rate of showed (61%) and lowest rate of canceled (17%). Patients with unknown race had low rates of showed (28%) and high rates of no-show (40%) and canceled (31%).

Our non-English-speaking patients listed Spanish, Arabic, Chaldean, or Bengali as their preferred language. Despite this small sample size, they had high rates of no-show (34%) and low rates of canceled (8%). English-speaking patients had similar rates of no-show (22%) and canceled (24%).

Patients with a physician referral had lower rates of no-show (20% vs 28%) and canceled visits (19% vs 28%) and higher rates of showed (61% vs 44%) compared to self-referral.

The associations of appointment status with appointment type, month of appointment, sex, and the comorbidities diabetes mellitus, coronary artery disease, chronic obstructive pulmonary disease, and chronic kidney disease were not significant (table 1).

In the multivariate analyses, the association between appointment status and MyChart enrollment remained significant after adjusting for the other demographic, comorbidity, and visit information (table 1). The associations of appointment status with age, race, language, referral status, and coronary artery disease were also significant.

We assessed the associations of MyChart enrollment with demographic, comorbidity, and visit information and found that patients with MyChart enrollment were more likely to be female, younger, Caucasian, and referred by a physician (table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2

Comparing patients with and without MyChart enrollment

Discussion

Our study investigated and determined an associative relationship between ePP enrollment and no-show rates within an NRC. Characteristics such as geographic location, insurance status, and the duration of time between the date an appointment was made and the date of the actual appointment have been shown to increase the likelihood of no-shows.8,–,12 In addition, the demographic of younger age—a small subset of the overall patient population—paradoxically may overwhelmingly contribute to the total no-shows within a clinic.9 Prior to EMR implementation, various interventions (i.e., mailed reminders, telephone calls, text messages, automated reminders) to reduce no-shows have been studied.13,–,16

The concept of no-shows takes particular importance when considering the impact upon the resident clinic, where trainees have a relatively reduced number of patient encounters compared to attending physicians. As Sir William Osler said, “He who studies medicine without books sails an uncharted sea, but he who studies medicine without patients does not go to sea at all.”17 From our findings, residents miss out on seeing almost one quarter of patient volume (approximate 23% no-show rate), or approximately 4 missed patient encounters per resident per month. Furthermore, we observed that enrollment in the ePP correlated with lower no-show rates, which has been demonstrated by several other groups.6,13 It may seem intuitive that a younger generation would tend to be higher portal adopters; however, we determined that patients who were female, Caucasian, and referred by a physician also adopted portals at a higher rate. These demographic findings are consistent with those previously seen in a variety of practice settings; however, in addition, preferred language, type of insurance, and economic status contributed to portal adoption.5,7,13,18 Given there is no singular factor contributing to portal adoption, there have been several modalities and suggestions to encourage utilization of this resource.19,20 It remains uncertain how this translates into an NRC; thus further investigation and validation will be necessary.

Limitations

Our study has several limitations, mainly those inherent to retrospective investigations such as being prone to certain biases and unforeseen confounders. In addition, we sampled only 3 months to capture different time points within the academic year and seasons, and we were only able to determine if a patient enrolled in MyChart but not the rate of ePP utilization. Also, we did not capture the gap between the date when the appointment was scheduled and the date of the actual appointment. Relying solely on the ePP may be feasible for certain populations; however, it likely should serve as a supplement to additional modalities. Furthermore, how no-shows are defined by different institutions may influence the generalizability of our data. Overall, no-shows are of great detriment to the education of trainees and to the stability of our fragile health care system. Further investigation is necessary to determine the most effective approach to decreasing no-shows and increasing patient adherence to clinic appointments, which will ultimately benefit patient well-being, resident education, and provider satisfaction.

Author contributions

K. Shah: study design, study concept, data collection, drafting and revising the manuscript. A. Alshammaa: study design, data collection. M. Affan: data collection. L. Schultz: data analysis. T. Walbert: study design, manuscript revision. I. Zaman: study concept, manuscript revision. All authors reviewed the final submitted manuscript.

Study funding

No targeted funding reported.

Disclosure

K. Shah, A. Alshammaa, M. Affan, and L. Schultz report no disclosures relevant to the manuscript. T. Walbert is an advisory board member for AbbVie and Tocagen and receives travel support from Novocure and Tocagen. I. Zaman reports no disclosures relevant to the manuscript. Go to Neurology.org/N for full disclosures.

Acknowledgment

Susan MacPhee (Henry Ford Hospital, Department of Neurosurgery) and Stephanie Stebens (Henry Ford Hospital, Sladen Library) edited the manuscript for non-intellectual content.

Footnotes

  • Go to Neurology.org/N for full disclosures. Funding information and disclosures deemed relevant by the authors, if any, are provided at the end of the article.

  • © 2018 American Academy of Neurology

References

  1. 1.↵
    1. Wright A,
    2. Feblowitz J,
    3. Samal L,
    4. McCoy AB,
    5. Sittig DF
    . The Medicare electronic health record incentive program: provider performance on core and menu measures. Health Serv Res 2014;49:325–346.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Hsiao CJ,
    2. Hing E,
    3. Socey TC,
    4. Cai B
    . Electronic health record systems and intent to apply for meaningful use incentives among office-based physician practices: United States, 2001–2011. NCHS Data Brief 2011:1–8.
  3. 3.↵
    1. Jamoom E,
    2. Yang N
    . National electronic health records survey: 2015 State and National electronic health record adoption summary tables. Available at: cdc.gov/nchs/data/ahcd/nehrs/2015_nehrs_web_table.pdf. Accessed January 11, 2018.
  4. 4.↵
    1. Jhamb M,
    2. Cavanaugh KL,
    3. Bian A, et al
    . Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol 2015;10:2013–2022.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Goldzweig CL,
    2. Orshansky G,
    3. Paige NM, et al
    . Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med 2013;159:677–687.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Kipping S,
    2. Stuckey MI,
    3. Hernandez A,
    4. Nguyen T,
    5. Riahi S
    . A web-based patient portal for mental health care: benefits evaluation. J Med Internet Res 2016;18:e294.
    OpenUrl
  7. 7.↵
    1. Girault A,
    2. Ferrua M,
    3. Lalloué B, et al
    . Internet-based technologies to improve cancer care coordination: current use and attitudes among cancer patients. Eur J Cancer 2015;51:551–557.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Neal RD,
    2. Lawlor DA,
    3. Allgar V, et al
    . Missed appointments in general practice: retrospective data analysis from four practices. Br J Gen Pract 2001;51:830–832.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Majeroni BA,
    2. Cowan T,
    3. Osborne J,
    4. Graham RP
    . Missed appointments and Medicaid managed care. Arch Fam Med 1996;5:507–511.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Whittle J,
    2. Schectman G,
    3. Lu N,
    4. Baar B,
    5. Mayo-Smith MF
    . Relationship of scheduling interval to missed and cancelled clinic appointments. J Ambul Care Manage 2008;31:290–302.
    OpenUrlPubMed
  11. 11.↵
    1. Bean AG,
    2. Talaga J
    . Predicting appointment breaking. J Health Care Mark 1995;15:29–34.
    OpenUrlPubMed
  12. 12.↵
    1. Izard T
    . Managing the habitual no-show patient. Fam Pract Manag 2005;12:65–66.
    OpenUrlPubMed
  13. 13.↵
    1. Horvath M,
    2. Levy J,
    3. L'Engle P,
    4. Carlson B,
    5. Ahmad A,
    6. Ferranti J
    . Impact of health portal enrollment with email reminders on adherence to clinic appointments: a pilot study. J Med Internet Res 2011;13:e41.
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Fairhurst K,
    2. Sheikh A
    . Texting appointment reminders to repeated non-attenders in primary care: randomised controlled study. Qual Saf Health Care 2008;17:373–376.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    1. Parikh A,
    2. Gupta K,
    3. Wilson AC,
    4. Fields K,
    5. Cosgrove NM,
    6. Kostis JB
    . The effectiveness of outpatient appointment reminder systems in reducing no-show rates. Am J Med 2010;123:542–548.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Macharia WM,
    2. Leon G,
    3. Rowe BH,
    4. Stephenson BJ,
    5. Haynes RB
    . An overview of interventions to improve compliance with appointment keeping for medical services. JAMA 1992;267:1813–1817.
    OpenUrlCrossRefPubMed
  17. 17.↵
    Johns Hopkins Medicine. The four founding physicians [online]. Available at: hopkinsmedicine.org/about/history/history5.html. Accessed January 6, 2018.
  18. 18.↵
    1. Wallace LS,
    2. Angier H,
    3. Huguet N, et al
    . Patterns of electronic portal use among vulnerable patients in a nationwide practice-based research network: from the OCHIN practice-based research network (PBRN). J Am Board Fam Med 2016;29:592–603.
    OpenUrlAbstract/FREE Full Text
  19. 19.↵
    1. Baldwin JL,
    2. Singh H,
    3. Sittig DF,
    4. Giardina TD
    . Patient portals and health apps: pitfalls, promises, and what one might learn from the other. Healthcare 2017;5:81–85.
    OpenUrl
  20. 20.↵
    Health IT Playbook. Available at: healthit.gov/playbook/pe/introduction/. Accessed July 3, 2018.

Disputes & Debates: Rapid online correspondence

No comments have been published for this article.
Comment

REQUIREMENTS

If you are uploading a letter concerning an article:
You must have updated your disclosures within six months: http://submit.neurology.org

Your co-authors must send a completed Publishing Agreement Form to Neurology Staff (not necessary for the lead/corresponding author as the form below will suffice) before you upload your comment.

If you are responding to a comment that was written about an article you originally authored:
You (and co-authors) do not need to fill out forms or check disclosures as author forms are still valid
and apply to letter.

Submission specifications:

  • Submissions must be < 200 words with < 5 references. Reference 1 must be the article on which you are commenting.
  • Submissions should not have more than 5 authors. (Exception: original author replies can include all original authors of the article)
  • Submit only on articles published within 6 months of issue date.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Publishing Agreement Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
    • Abstract
    • Glossary
    • Introduction
    • Methods
    • Results
    • Discussion
    • Author contributions
    • Study funding
    • Disclosure
    • Acknowledgment
    • Footnotes
    • References
  • Figures & Data
  • Info & Disclosures
Advertisement

Related Articles

  • No related articles found.

Topics Discussed

  • All Practice Management
  • All Education
  • Electronic medical records
  • Computer use in education

Alert Me

  • Alert me when eletters are published
Neurology: 98 (9)

Articles

  • Ahead of Print
  • Current Issue
  • Past Issues
  • Popular Articles
  • Translations

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Activate a Subscription
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology | Print ISSN:0028-3878
Online ISSN:1526-632X

© 2022 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise