Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Specialty Sites
    • COVID-19
    • Practice Current
    • Practice Buzz
    • Without Borders
    • Equity, Diversity and Inclusion
    • Innovations in Care Delivery
  • Collections
    • Topics A-Z
    • Residents & Fellows
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Specialty Sites
    • COVID-19
    • Practice Current
    • Practice Buzz
    • Without Borders
    • Equity, Diversity and Inclusion
    • Innovations in Care Delivery
  • Collections
    • Topics A-Z
    • Residents & Fellows
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

User menu

  • Subscribe
  • My Alerts
  • Log in

Search

  • Advanced search
Neurology
Home
The most widely read and highly cited peer-reviewed neurology journal
  • Subscribe
  • My Alerts
  • Log in
Site Logo
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

Share

February 10, 2021Article

Machine Learning Based Automatic Rating for Cardinal Symptoms of Parkinson

View ORCID ProfileKye Won Park, Eun-Jae Lee, Jun Seong Lee, Jinhoon Jeong, Nari Choi, Sungyang Jo, Mina Jung, Ja Yeon Do, Dong-Wha Kang, June-Goo Lee, Sun Ju Chung
First published February 10, 2021, DOI: https://doi.org/10.1212/WNL.0000000000011654
Kye Won Park
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kye Won Park
Eun-Jae Lee
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jun Seong Lee
2Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, , Korea
3Electronics and Telecommunications Research Institute,, Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jinhoon Jeong
2Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, , Korea
4Promedius Inc., , Korea;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nari Choi
5Department of Neurology, Heavenly hospital, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sungyang Jo
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mina Jung
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ja Yeon Do
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dong-Wha Kang
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
June-Goo Lee
2Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sun Ju Chung
1Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, , Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Full PDF
Citation
Machine Learning Based Automatic Rating for Cardinal Symptoms of Parkinson
Kye Won Park, Eun-Jae Lee, Jun Seong Lee, Jinhoon Jeong, Nari Choi, Sungyang Jo, Mina Jung, Ja Yeon Do, Dong-Wha Kang, June-Goo Lee, Sun Ju Chung
Neurology Feb 2021, 10.1212/WNL.0000000000011654; DOI: 10.1212/WNL.0000000000011654

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
18

Share

  • Article
  • Info & Disclosures
Loading

Abstract

Objective: We developed and investigated the feasibility of a machine learning-based automated rating for the two cardinal symptoms of Parkinson’s disease (PD); resting tremor and bradykinesia.

Methods: Using Openpose, a deep-learning-based human pose estimation program, we analyzed video-clips for resting tremor and finger tapping of the bilateral upper limbs of 55 patients with PD (110 arms). Key motion parameters, including resting tremor amplitude and finger tapping speed, amplitude, and fatigue, were extracted to develop a machine learning-based automatic Unified Parkinson’s Disease Rating Scale (UPDRS) rating using support vector machine (SVM) method. To evaluate the performance of this model, we calculated weighted kappa and intra-class correlation coefficients (ICC) between the model and the gold standard rating by a movement disorder specialist who is trained and certified by the movement disorder society (MDS) for UPDRS rating. These values were compared to weighted kappa and ICC between a non-trained human rater and the gold standard rating.

Results: For resting tremors, the SVM model showed a very good to excellent reliability range with the gold standard rating (kappa 0.791; ICC 0.927), with both values higher than that of non-trained human rater (kappa 0.662; ICC 0.861). For finger tapping, the SVM model showed a very good reliability range with the gold standard rating (kappa 0.700 and ICC 0.793), which was comparable to non-trained human raters (kappa 0.627; ICC 0.797).

Conclusion: Machine learning-based algorithms that automatically rate PD cardinal symptoms are feasible, with more accurate results than non-trained human rating results.

Classification of Evidence: This study provides Class II evidence that machine learning-based automated rating of resting tremor and bradykinesia in people with PD has very good reliability compared to a rating by a movement disorder specialist.

  • Received July 28, 2020.
  • Accepted in final form December 18, 2020.
  • © 2021 American Academy of Neurology

AAN Members

We have changed the login procedure to improve access between AAN.com and the Neurology journals. If you are experiencing issues, please log out of AAN.com and clear history and cookies. (For instructions by browser, please click the instruction pages below). After clearing, choose preferred Journal and select login for AAN Members. You will be redirected to a login page where you can log in with your AAN ID number and password. When you are returned to the Journal, your name should appear at the top right of the page.

Google Safari Microsoft Edge Firefox

Click here to login

AAN Non-Member Subscribers

Click here to login

Purchase access

For assistance, please contact:
AAN Members (800) 879-1960 or (612) 928-6000 (International)
Non-AAN Member subscribers (800) 638-3030 or (301) 223-2300 option 3, select 1 (international)

Sign Up
Information on how to subscribe to Neurology and Neurology: Clinical Practice can be found here 

Purchase
Individual access to articles is available through the Add to Cart option on the article page.  Access for 1 day (from the computer you are currently using) is US$ 39.00.  Pay-per-view content is for the use of the payee only, and content may not be further distributed by print or electronic means.  The payee may view, download, and/or print the article for his/her personal, scholarly, research, and educational use.  Distributing copies (electronic or otherwise) of the article is not allowed.

Disputes & Debates: Rapid online correspondence

No comments have been published for this article.
Comment

NOTE: All authors' disclosures must be entered and current in our database before comments can be posted. Enter and update disclosures at http://submit.neurology.org. Exception: replies to comments concerning an article you originally authored do not require updated disclosures.

  • Stay timely. Submit only on articles published within the last 8 weeks.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • 200 words maximum.
  • 5 references maximum. Reference 1 must be the article on which you are commenting.
  • 5 authors maximum. Exception: replies can include all original authors of the article.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Disputes & Debates Submission Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
  • Info & Disclosures
Advertisement

Related Articles

  • No related articles found.

Topics Discussed

  • Class II
  • Parkinson's disease/Parkinsonism
  • Tremor

Alert Me

  • Alert me when eletters are published
Neurology: 96 (9)

Articles

  • Ahead of Print
  • Current Issue
  • Past Issues
  • Popular Articles
  • Translations

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Activate a Subscription
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology | Print ISSN:0028-3878
Online ISSN:1526-632X

© 2021 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise