Edgar A. Bernal, Shu Yang, Konnor Herbst, Charles S. Venuto
{"title":"比较机器学习和深度学习模型,预测帕金森病的认知进展。","authors":"Edgar A. Bernal, Shu Yang, Konnor Herbst, Charles S. Venuto","doi":"10.1111/cts.70066","DOIUrl":null,"url":null,"abstract":"<p>Cognitive decline in Parkinson's disease (PD) varies widely. While models to predict cognitive progression exist, comparing traditional probabilistic models to deep learning methods remains understudied. This study compares sequential modeling techniques to identify cognitive progression in individuals with and without PD. Using data from the Parkinson's Progression Marker Initiative, shallow Markov, deep recurrent (long short-term memory [LSTM]), and nonrecurrent (temporal fusion transformer [TFT]) models were compared to predict cognitive status over time. Cognitive status was categorized into normal cognition (NC), mild cognitive impairment (MCI), and dementia. Predictions were made annually for up to 3 years using clinical data, including demographics, cognitive assessments, PD severity, and medical history. Each approach was evaluated using inverse probability weighted (IPW-) F1 scores. An ensemble method combined outputs from the Markov, LSTM, and TFT models. The dataset included 917 individuals (53% PD; 30% at risk for PD; 17% Healthy Controls). The TFT model outperformed others across all annual periods (IPW-F1 = 0.468) compared to the Markov (IPW-F1 = 0.349) and LSTM (IPW-F1 = 0.414) models, with improved performance using an ensemble approach (IPW-F1 = 0.502). For MCI and dementia predictions, which were rarer occurrences compared to NC status (ratios: 50:8:1), the TFT model consistently outperformed competing models, achieving IPW-F1 scores of 0.496 and 0.533 for MCI and dementia, respectively. In conclusion, sequential deep learning models like TFT, which mitigate long-term memory loss and can interpret complex, high-dimensional data, perform best overall in predicting clinically important cognitive transitions. These methods should be further explored for predicting degenerative conditions.</p>","PeriodicalId":50610,"journal":{"name":"Cts-Clinical and Translational Science","volume":"17 11","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11544638/pdf/","citationCount":"0","resultStr":"{\"title\":\"Comparing machine learning and deep learning models to predict cognition progression in Parkinson's disease\",\"authors\":\"Edgar A. Bernal, Shu Yang, Konnor Herbst, Charles S. Venuto\",\"doi\":\"10.1111/cts.70066\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Cognitive decline in Parkinson's disease (PD) varies widely. While models to predict cognitive progression exist, comparing traditional probabilistic models to deep learning methods remains understudied. This study compares sequential modeling techniques to identify cognitive progression in individuals with and without PD. Using data from the Parkinson's Progression Marker Initiative, shallow Markov, deep recurrent (long short-term memory [LSTM]), and nonrecurrent (temporal fusion transformer [TFT]) models were compared to predict cognitive status over time. Cognitive status was categorized into normal cognition (NC), mild cognitive impairment (MCI), and dementia. Predictions were made annually for up to 3 years using clinical data, including demographics, cognitive assessments, PD severity, and medical history. Each approach was evaluated using inverse probability weighted (IPW-) F1 scores. An ensemble method combined outputs from the Markov, LSTM, and TFT models. The dataset included 917 individuals (53% PD; 30% at risk for PD; 17% Healthy Controls). The TFT model outperformed others across all annual periods (IPW-F1 = 0.468) compared to the Markov (IPW-F1 = 0.349) and LSTM (IPW-F1 = 0.414) models, with improved performance using an ensemble approach (IPW-F1 = 0.502). For MCI and dementia predictions, which were rarer occurrences compared to NC status (ratios: 50:8:1), the TFT model consistently outperformed competing models, achieving IPW-F1 scores of 0.496 and 0.533 for MCI and dementia, respectively. In conclusion, sequential deep learning models like TFT, which mitigate long-term memory loss and can interpret complex, high-dimensional data, perform best overall in predicting clinically important cognitive transitions. These methods should be further explored for predicting degenerative conditions.</p>\",\"PeriodicalId\":50610,\"journal\":{\"name\":\"Cts-Clinical and Translational Science\",\"volume\":\"17 11\",\"pages\":\"\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-11-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11544638/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cts-Clinical and Translational Science\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/cts.70066\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MEDICINE, RESEARCH & EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cts-Clinical and Translational Science","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/cts.70066","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
Comparing machine learning and deep learning models to predict cognition progression in Parkinson's disease
Cognitive decline in Parkinson's disease (PD) varies widely. While models to predict cognitive progression exist, comparing traditional probabilistic models to deep learning methods remains understudied. This study compares sequential modeling techniques to identify cognitive progression in individuals with and without PD. Using data from the Parkinson's Progression Marker Initiative, shallow Markov, deep recurrent (long short-term memory [LSTM]), and nonrecurrent (temporal fusion transformer [TFT]) models were compared to predict cognitive status over time. Cognitive status was categorized into normal cognition (NC), mild cognitive impairment (MCI), and dementia. Predictions were made annually for up to 3 years using clinical data, including demographics, cognitive assessments, PD severity, and medical history. Each approach was evaluated using inverse probability weighted (IPW-) F1 scores. An ensemble method combined outputs from the Markov, LSTM, and TFT models. The dataset included 917 individuals (53% PD; 30% at risk for PD; 17% Healthy Controls). The TFT model outperformed others across all annual periods (IPW-F1 = 0.468) compared to the Markov (IPW-F1 = 0.349) and LSTM (IPW-F1 = 0.414) models, with improved performance using an ensemble approach (IPW-F1 = 0.502). For MCI and dementia predictions, which were rarer occurrences compared to NC status (ratios: 50:8:1), the TFT model consistently outperformed competing models, achieving IPW-F1 scores of 0.496 and 0.533 for MCI and dementia, respectively. In conclusion, sequential deep learning models like TFT, which mitigate long-term memory loss and can interpret complex, high-dimensional data, perform best overall in predicting clinically important cognitive transitions. These methods should be further explored for predicting degenerative conditions.
期刊介绍:
Clinical and Translational Science (CTS), an official journal of the American Society for Clinical Pharmacology and Therapeutics, highlights original translational medicine research that helps bridge laboratory discoveries with the diagnosis and treatment of human disease. Translational medicine is a multi-faceted discipline with a focus on translational therapeutics. In a broad sense, translational medicine bridges across the discovery, development, regulation, and utilization spectrum. Research may appear as Full Articles, Brief Reports, Commentaries, Phase Forwards (clinical trials), Reviews, or Tutorials. CTS also includes invited didactic content that covers the connections between clinical pharmacology and translational medicine. Best-in-class methodologies and best practices are also welcomed as Tutorials. These additional features provide context for research articles and facilitate understanding for a wide array of individuals interested in clinical and translational science. CTS welcomes high quality, scientifically sound, original manuscripts focused on clinical pharmacology and translational science, including animal, in vitro, in silico, and clinical studies supporting the breadth of drug discovery, development, regulation and clinical use of both traditional drugs and innovative modalities.