Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Diversity, Equity, & Inclusion (DEI)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Neurology Future Forecasting Series
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit New Manuscript
    • Submit Revised Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Diversity, Equity, & Inclusion (DEI)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Neurology Future Forecasting Series
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit New Manuscript
    • Submit Revised Manuscript
    • Author Center
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Neurology Video Journal Club
  • Residents & Fellows

User menu

  • Subscribe
  • My Alerts
  • Log in

Search

  • Advanced search
Neurology
Home
The most widely read and highly cited peer-reviewed neurology journal
  • Subscribe
  • My Alerts
  • Log in
Site Logo
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Neurology Video Journal Club
  • Residents & Fellows

Share

March 30, 2021; 96 (13) Article

Machine Learning–Based Automatic Rating for Cardinal Symptoms of Parkinson Disease

View ORCID ProfileKye Won Park, Eun-Jae Lee, Jun Seong Lee, Jinhoon Jeong, Nari Choi, Sungyang Jo, Mina Jung, Ja Yeon Do, Dong-Wha Kang, June-Goo Lee, Sun Ju Chung
First published February 10, 2021, DOI: https://doi.org/10.1212/WNL.0000000000011654
Kye Won Park
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kye Won Park
Eun-Jae Lee
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jun Seong Lee
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jinhoon Jeong
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nari Choi
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sungyang Jo
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mina Jung
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ja Yeon Do
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dong-Wha Kang
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
June-Goo Lee
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sun Ju Chung
From the Departments of Neurology (K.W.P., E.-J.L., S.J., M.J., J.Y.D., D.-W.K., S.J.C.) and Convergence Medicine (J.S.L., J.J., J.-G.L.), Asan Medical Center, University of Ulsan College of Medicine, Seoul; Electronics and Telecommunications Research Institute (J.S.L.), Gwangju; Promedius Inc (J.J.), Seoul; and Department of Neurology (N.C.), Heavenly Hospital, Goyang, Korea.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Full PDF
Short Form
Citation
Machine Learning–Based Automatic Rating for Cardinal Symptoms of Parkinson Disease
Kye Won Park, Eun-Jae Lee, Jun Seong Lee, Jinhoon Jeong, Nari Choi, Sungyang Jo, Mina Jung, Ja Yeon Do, Dong-Wha Kang, June-Goo Lee, Sun Ju Chung
Neurology Mar 2021, 96 (13) e1761-e1769; DOI: 10.1212/WNL.0000000000011654

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
291

Share

  • Article
  • Figures & Data
  • Info & Disclosures
Loading

This article requires a subscription to view the full text. If you have a subscription you may use the login form below to view the article. Access to this article can also be purchased.

Abstract

Objective We developed and investigated the feasibility of a machine learning–based automated rating for the 2 cardinal symptoms of Parkinson disease (PD): resting tremor and bradykinesia.

Methods Using OpenPose, a deep learning–based human pose estimation program, we analyzed video clips for resting tremor and finger tapping of the bilateral upper limbs of 55 patients with PD (110 arms). Key motion parameters, including resting tremor amplitude and finger tapping speed, amplitude, and fatigue, were extracted to develop a machine learning–based automatic Unified Parkinson's Disease Rating Scale (UPDRS) rating using support vector machine (SVM) method. To evaluate the performance of this model, we calculated weighted κ and intraclass correlation coefficients (ICCs) between the model and the gold standard rating by a movement disorder specialist who is trained and certified by the Movement Disorder Society for UPDRS rating. These values were compared to weighted κ and ICC between a nontrained human rater and the gold standard rating.

Results For resting tremors, the SVM model showed a very good to excellent reliability range with the gold standard rating (κ 0.791; ICC 0.927), with both values higher than that of nontrained human rater (κ 0.662; ICC 0.861). For finger tapping, the SVM model showed a very good reliability range with the gold standard rating (κ 0.700 and ICC 0.793), which was comparable to that for nontrained human raters (κ 0.627; ICC 0.797).

Conclusion Machine learning–based algorithms that automatically rate PD cardinal symptoms are feasible, with more accurate results than nontrained human ratings.

Classification of Evidence This study provides Class II evidence that machine learning–based automated rating of resting tremor and bradykinesia in people with PD has very good reliability compared to a rating by a movement disorder specialist.

Glossary

CI=
confidence interval;
ICC=
intraclass correlation coefficient;
MDS=
Movement Disorder Society;
PD=
Parkinson disease;
SVM=
support vector machine;
UPDRS=
Unified Parkinson's Disease Rating Scale

Footnotes

  • Go to Neurology.org/N for full disclosures. Funding information and disclosures deemed relevant by the authors, if any, are provided at the end of the article.

  • ↵* These authors contributed equally to this work.

  • Class of Evidence: NPub.org/coe

  • Received July 28, 2020.
  • Accepted in final form December 18, 2020.
  • © 2021 American Academy of Neurology
View Full Text

AAN Members

We have changed the login procedure to improve access between AAN.com and the Neurology journals. If you are experiencing issues, please log out of AAN.com and clear history and cookies. (For instructions by browser, please click the instruction pages below). After clearing, choose preferred Journal and select login for AAN Members. You will be redirected to a login page where you can log in with your AAN ID number and password. When you are returned to the Journal, your name should appear at the top right of the page.

Google Safari Microsoft Edge Firefox

Click here to login

AAN Non-Member Subscribers

Click here to login

Purchase access

For assistance, please contact:
AAN Members (800) 879-1960 or (612) 928-6000 (International)
Non-AAN Member subscribers (800) 638-3030 or (301) 223-2300 option 3, select 1 (international)

Sign Up
Information on how to subscribe to Neurology and Neurology: Clinical Practice can be found here 

Purchase
Individual access to articles is available through the Add to Cart option on the article page.  Access for 1 day (from the computer you are currently using) is US$ 39.00.  Pay-per-view content is for the use of the payee only, and content may not be further distributed by print or electronic means.  The payee may view, download, and/or print the article for his/her personal, scholarly, research, and educational use.  Distributing copies (electronic or otherwise) of the article is not allowed.

Letters: Rapid online correspondence

No comments have been published for this article.
Comment

REQUIREMENTS

If you are uploading a letter concerning an article:
You must have updated your disclosures within six months: http://submit.neurology.org

Your co-authors must send a completed Publishing Agreement Form to Neurology Staff (not necessary for the lead/corresponding author as the form below will suffice) before you upload your comment.

If you are responding to a comment that was written about an article you originally authored:
You (and co-authors) do not need to fill out forms or check disclosures as author forms are still valid
and apply to letter.

Submission specifications:

  • Submissions must be < 200 words with < 5 references. Reference 1 must be the article on which you are commenting.
  • Submissions should not have more than 5 authors. (Exception: original author replies can include all original authors of the article)
  • Submit only on articles published within 6 months of issue date.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Publishing Agreement Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
    • Abstract
    • Glossary
    • Methods
    • Results
    • Discussion
    • Study Funding
    • Disclosure
    • Appendix Authors
    • Footnotes
    • References
  • Figures & Data
  • Info & Disclosures
Advertisement

SARS-CoV-2 Vaccination Safety in Guillain-Barré Syndrome, Chronic Inflammatory Demyelinating Polyneuropathy, and Multifocal Motor Neuropathy

Dr. Jeffrey Allen and Dr. Nicholas Purcell

► Watch

Related Articles

  • No related articles found.

Topics Discussed

  • Class II
  • Parkinson's disease/Parkinsonism
  • Tremor

Alert Me

  • Alert me when eletters are published

Recommended articles

  • Article
    Association of metabolic syndrome and change in Unified Parkinson's Disease Rating Scale scores
    Maureen Leehey, Sheng Luo, Saloni Sharma et al.
    Neurology, September 29, 2017
  • Articles
    Metric properties of nurses' ratings of parkinsonian signs with a modified Unified Parkinson's Disease Rating Scale
    D. A. Bennett, K. M. Shannon, L. A. Beckett et al.
    Neurology, December 01, 1997
  • Article
    Longitudinal follow-up of SWEDD subjects in the PRECEPT Study
    Kenneth Marek, John Seibyl, Shirley Eberly et al.
    Neurology, April 23, 2014
  • Articles
    Clinical correlates of levodopa-induced dopamine release in Parkinson disease
    A PET study
    N. Pavese, A. H. Evans, Y. F. Tai et al.
    Neurology, November 13, 2006
Neurology: 100 (13)

Articles

  • Ahead of Print
  • Current Issue
  • Past Issues
  • Popular Articles
  • Translations

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Activate a Subscription
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Education
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology | Print ISSN:0028-3878
Online ISSN:1526-632X

© 2023 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise