Enhanced Parkinson's Disease Detection Through Multimodal Feature Fusion of Speech and Gait Signals Using an Optimized Ensemble Learning Framework
DOI:
https://doi.org/10.66108/mna.v5i02.106Keywords:
Parkinson’s disease, Multi-modal learning, Voice analysis, Gait analysis, Ensemble machine learning, Medical DiagnosisAbstract
Parkinson's disease (PD) is a progressive disease affecting motor and non-motor skills, making primary and correct diagnosis critical in its clinical organization. The current diagnostic techniques have shown limited success, leading to the development of a proposed multimodal machine learning-based method to correct the issue of diagnosing PD. In order to train our proposed model, two openly available benchmark datasets were used, namely, the UCI Parkinson’s Voice Dataset (195 audio recordings obtained from 31 PD patients and 23 controls) and PhysioNet Gait in Parkinson’s Disease Dataset (wearable inertial sensor data). A thorough preprocessing technique was used separately on both modalities. Features obtained from both modalities include voice features like jitter, shimmer, harmonics-to-noise ratio (HNR), and MFCC, and gait features such as stride, cadence, accelerations, and symmetries. PCA was performed for both modalities while considering 95% of the variance. The feature-level fusion process was next adopted for the purpose of combining the low-dimensional representations into one coherent feature vector. In this regard, the classification process was performed using an ensemble learning architecture that uses the three mentioned classifiers (RF, GB, and XGB) in conjunction with a majority vote scheme. From the investigational outcomes, it is obvious that a classification accuracy rate of 93% has been achieved along with other metrics, including precision (94.2%), recall (92.1%) and F1 score (93.1%). These outcomes show that the suggested solution is able to outperform any single-modality as well as individual classifier solutions.
Downloads
References
Zhang, Juntao, et al. “Applications of Machine Learning for Computer-Aided Diagnosis of Parkinson’s Disease: Progress and Benchmark Case Study.” Artificial Intelligence Review, edited by , vol. 58, no. 11, Aug. 2025. https://doi.org/10.1007/s10462-025-11347-y.
Li, A., & Li, C. (2022). Detecting Parkinson’s Disease through Gait Measures Using Machine Learning. Diagnostics, 12(10), 2404. https://doi.org/10.3390/diagnostics12102404
Postuma, R. B., Berg, D., Stern, M., Poewe, W., Olanow, C. W., Oertel, W., Obeso, J., Marek, K., Litvan, I., Lang, A. E., Halliday, G., Goetz, C. G., Gasser, T., Dubois, B., Chan, P., Bloem, B. R., Adler, C. H., & Deuschl, G. (2015). MDS clinical diagnostic criteria for Parkinson’s disease. Movement Disorders, 30(12), 1591–1601. Portico. https://doi.org/10.1002/mds.26424
Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in neural information processing systems, 30.
Sharma, P., Pahuja, S., & Veer, K. (2022). A Systematic Review of Machine Learning Based Gait Characteristics in Parkinson’s Disease. Mini-Reviews in Medicinal Chemistry, 22(8), 1216–1229. https://doi.org/10.2174/138955752166621092715155
Ribeiro, M., Singh, S., & Guestrin, C. (2016). “Why Should I Trust You?”: Explaining the Predictions of Any Classifier. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 97–101. https://doi.org/10.18653/v1/n16-3020
Chen, T., & Guestrin, C. (2016). XGBoost. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 785–794. https://doi.org/10.1145/2939672.2939785
di Biase, L., Pecoraro, P. M., Pecoraro, G., Shah, S. A., & Di Lazzaro, V. (2024). Machine learning and wearable sensors for automated Parkinson’s disease diagnosis aid: a systematic review. Journal of Neurology, 271(10), 6452–6470. https://doi.org/10.1007/s00415-024-12611-x
Breiman, L. (2001). Random Forests. Machine Learning, 45(1), 5–32.
https://doi.org/10.1023/a:1010933404324
Jolliffe, I. T., & Cadima, J. (2016). Principal component analysis: a review and recent developments. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2065), 20150202. https://doi.org/10.1098/rsta.2015.0202
Goetz, C. G., Tilley, B. C., Shaftman, S. R., Stebbins, G. T., Fahn, S., Martinez‐Martin, P., Poewe, W., Sampaio, C., Stern, M. B., Dodel, R., Dubois, B., Holloway, R., Jankovic, J., Kulisevsky, J., Lang, A. E., Lees, A., Leurgans, S., LeWitt, P. A., Nyenhuis, D., et al. (2008). Movement Disorder Society‐sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results. Movement Disorders, 23(15), 2129–2170. Portico. https://doi.org/10.1002/mds.22340
Pereira, C. R., Pereira, D. R., Silva, F. A., Masieiro, J. P., Weber, S. A. T., Hook, C., & Papa, J. P. (2016). A new computer vision-based approach to aid the diagnosis of Parkinson’s disease. Computer Methods and Programs in Biomedicine, 136, 79–88. https://doi.org/10.1016/j.cmpb.2016.08.005
Ayesha, H., Iqbal, S., Tariq, M., Alaulamie, A., & Ahmad, A. (2025). Explainable Artificial Intelligence Techniques in Healthcare Applications. Explainable Artificial Intelligence in Medical Imaging, 58–78. https://doi.org/10.1201/9781032626345-4
Tariq, M., Iqbal, S., Ayesha, H., Abbas, I., Ahmad, K. T., & Niazi, M. F. K. (2021). Medical image based breast cancer diagnosis: State of the art and future directions. Expert Systems with Applications, 167, 114095. https://doi.org/10.1016/j.eswa.2020.114095
Little, M., McSharry, P., Hunter, E., Spielman, J., & Ramig, L. (2008). Suitability of dysphonia measurements for telemonitoring of Parkinson’s disease. Nature Precedings. https://doi.org/10.1038/npre.2008.2298.1
Tsanas, A., Little, M., McSharry, P., & Ramig, L. (2009). Accurate telemonitoring of Parkinson’s disease progression by non-invasive speech tests. Nature Precedings. https://doi.org/10.1038/npre.2009.3920.1
Alshammri, R., Alharbi, G., Alharbi, E., & Almubark, I. (2023). Machine learning approaches to identify Parkinson’s disease using voice signal features. Frontiers in Artificial Intelligence, 6. https://doi.org/10.3389/frai.2023.1084001
Karabayir, I., Goldman, S. M., Pappu, S., & Akbilgic, O. (2020). Gradient boosting for Parkinson’s disease diagnosis from voice recordings. BMC Medical Informatics and Decision Making, 20(1). https://doi.org/10.1186/s12911-020-01250-7
Nogales, A., Garcia-Tejedor, A. J., Maitin, A. M., Perez-Morales, A., Castillo, M. D. D., & Romero, J. P. (2022). BERT Learns From Electroencephalograms About Parkinson’s Disease: Transformer-Based Models for Aid Diagnosis. IEEE Access, 10, 101672–101682. https://doi.org/10.1109/access.2022.3201843
Rangel-Cascajosa, C., Luna-Perejón, F., Vicente-Diaz, S., & Domínguez-Morales, M. (2025). Gait-Based Parkinson’s Disease Detection Using Recurrent Neural Networks for Wearable Systems. Big Data and Cognitive Computing, 9(7), 183. https://doi.org/10.3390/bdcc9070183
Li, A., Lian, J., & Vardhanabhuti, V. (2025). Multi-modal machine learning approach for early detection of neurodegenerative diseases leveraging brain MRI and wearable sensor data. PLOS Digital Health, 4(4), e0000795. https://doi.org/10.1371/journal.pdig.0000795
Skaramagkas, V., Pentari, A., Kefalopoulou, Z., & Tsiknakis, M. (2023). Multi-Modal Deep Learning Diagnosis of Parkinson’s Disease—A Systematic Review. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 31, 2399–2423. https://doi.org/10.1109/tnsre.2023.3277749
Additional Files
Published
How to Cite
License
Copyright (c) 2026 Aleena Jamil, Adeen Amjad, Shafiq Hussain, Muhammad Azhar, Muhammad Arman, Ali Salman
This work is licensed under a Creative Commons Attribution 4.0 International License.
© This work is published by Machines and Algorithms and licensed under the terms of Creative Commons Attribution 4.0 International License (CC BY 4.0).
