Pub Date : 2021-11-24DOI: 10.1109/CITISIA53721.2021.9719922
Aman Arora, S. Panda, J. Raheja, Dimple Nagpal
Unprecedented level of autonomy and highly efficient interpersonal communications amongst crewmembers are compulsorily norms for astronauts in all LDSE missions, again testing the psycho-emotional limits for the astronauts. The present communication reviews & outlines the role of social robots and HRI, and the recent advances in haptics and gesture-controlled systems, as well as their unique effectiveness and interventions in increasing the effectiveness of future LDSE missions. Multimodal Media Systems are used for Human Robot Interactions (HRI), including, facial & hand movements, speech, sounds, AV clips, physical touch and haptics. Various systems have been explored and evaluated, including ESAS, AAR, CIMON, PSA, Haptics and joystick modules and others. An HRI system needs to be developed ensuring all prerequisites of standardizes interactions including multi-spacial ranges, interaction architecture (task manager, interaction manager, resource manager, dialogue agent and robot agents), and constrained interfaces. Social HRI (sHRI) offers a fast evolving field and extensive work is being done on SSD, DSSD, multimodal systems, novel gesture control systems, humanoids and other options. The fast integration of sHRI with LDSE will definitely aid in advancing the efficacy of such missions.
{"title":"Development Approaches To Intuitive, SSD & Haptics Integrated HRI & Social HRI systems for Assisting Space Exploration","authors":"Aman Arora, S. Panda, J. Raheja, Dimple Nagpal","doi":"10.1109/CITISIA53721.2021.9719922","DOIUrl":"https://doi.org/10.1109/CITISIA53721.2021.9719922","url":null,"abstract":"Unprecedented level of autonomy and highly efficient interpersonal communications amongst crewmembers are compulsorily norms for astronauts in all LDSE missions, again testing the psycho-emotional limits for the astronauts. The present communication reviews & outlines the role of social robots and HRI, and the recent advances in haptics and gesture-controlled systems, as well as their unique effectiveness and interventions in increasing the effectiveness of future LDSE missions. Multimodal Media Systems are used for Human Robot Interactions (HRI), including, facial & hand movements, speech, sounds, AV clips, physical touch and haptics. Various systems have been explored and evaluated, including ESAS, AAR, CIMON, PSA, Haptics and joystick modules and others. An HRI system needs to be developed ensuring all prerequisites of standardizes interactions including multi-spacial ranges, interaction architecture (task manager, interaction manager, resource manager, dialogue agent and robot agents), and constrained interfaces. Social HRI (sHRI) offers a fast evolving field and extensive work is being done on SSD, DSSD, multimodal systems, novel gesture control systems, humanoids and other options. The fast integration of sHRI with LDSE will definitely aid in advancing the efficacy of such missions.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130255963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719982
Samriddha Adikari, Jinfeng Su, Kamini (Simi) Bajaj,
The growth in the number of systems based on Internet of Things (IoT), real-time service and automation that can be provided to users is enormous in the last decade. One of the major obstacles in securing IoT based network is tracking and tracing cyber-attack events and their sources. The aim of this study is to analyze current research on deep learning-based network forensic optimization techniques using secondary research. Major findings are that deep learning technology can effectively identify attacks during data communication in IoT systems than the state-of-the-art methods. In this study, major components of the systems proposed by researchers were identified, presented in a table format and classified based on methodology which revealed that deep learning technology can identify attacks in IoT devices.
{"title":"Review of network-forensic analysis optimization using deep learning against attacks on IoT devices","authors":"Samriddha Adikari, Jinfeng Su, Kamini (Simi) Bajaj,","doi":"10.1109/citisia53721.2021.9719982","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719982","url":null,"abstract":"The growth in the number of systems based on Internet of Things (IoT), real-time service and automation that can be provided to users is enormous in the last decade. One of the major obstacles in securing IoT based network is tracking and tracing cyber-attack events and their sources. The aim of this study is to analyze current research on deep learning-based network forensic optimization techniques using secondary research. Major findings are that deep learning technology can effectively identify attacks during data communication in IoT systems than the state-of-the-art methods. In this study, major components of the systems proposed by researchers were identified, presented in a table format and classified based on methodology which revealed that deep learning technology can identify attacks in IoT devices.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121090295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/CITISIA53721.2021.9719928
Gowind Misra, Kamini Bajaj
Supply chain management is the approach applied to track products, including the transformation process. Real-time tracing techniques are considered to enhance the accuracy and performance rate of the tracing process.The main contribution of this work consists of a review of real-time tracing techniques in supply management with focus on cloud computing, Information extracted supports the development of a taxonomy of evaluation and classification processes , process stages and the role blockchain technology plays in improving tracing and data handling. This work is based on secondary research into articles related to real-time tracing techniques and supply chain management.We contribute to the body of knowledge for tracing in supply chain management through an up-to-date snapshot of the extent and breadth of research in the field and through clear identification of remaining challenges to guide future research.
{"title":"Real-time supply chain tracing using blockchain from cloud-based computing portal","authors":"Gowind Misra, Kamini Bajaj","doi":"10.1109/CITISIA53721.2021.9719928","DOIUrl":"https://doi.org/10.1109/CITISIA53721.2021.9719928","url":null,"abstract":"Supply chain management is the approach applied to track products, including the transformation process. Real-time tracing techniques are considered to enhance the accuracy and performance rate of the tracing process.The main contribution of this work consists of a review of real-time tracing techniques in supply management with focus on cloud computing, Information extracted supports the development of a taxonomy of evaluation and classification processes , process stages and the role blockchain technology plays in improving tracing and data handling. This work is based on secondary research into articles related to real-time tracing techniques and supply chain management.We contribute to the body of knowledge for tracing in supply chain management through an up-to-date snapshot of the extent and breadth of research in the field and through clear identification of remaining challenges to guide future research.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127116784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719936
Rekha Sharma, A. B. M. Mehedi Hasan, Jinfeng Su, Moshiur Bhuiyan
This This paper aims to increase the farmers’ income and enhance the productivity of farming day-by-day so that the agriculture industry can develop at a large scale. The objective of this research is to increase the farming and seed production for the farmers in agriculture by monitoring and computer network system with reliable servers. It is crucial to solve or minimize or avoid this problem to ensure the best farming and animal husbandry across the agriculture sector to maintain seed growth for the farmers and customers without any error and monitoring. The background for this study is to provide the best services of monitoring and computer networks globally for the production and growing sectors to be involved in emerging activities to reduce the errors using computer network monitoring. Even after dealing with these difficulties, ranchers need sizeable, stable business sectors for their harvests. Appropriately, in the last and present century, people groups have begun investigating the conceivable outcomes by embracing distinctive current procedures in agribusiness. The proposed solution will address the current challenges of computer network monitoring data across the agriculture sector to understand the actual outcomes.
{"title":"Improving Weeds Identification with a Repository of Agricultural Pre-trained Deep Neural Networks","authors":"Rekha Sharma, A. B. M. Mehedi Hasan, Jinfeng Su, Moshiur Bhuiyan","doi":"10.1109/citisia53721.2021.9719936","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719936","url":null,"abstract":"This This paper aims to increase the farmers’ income and enhance the productivity of farming day-by-day so that the agriculture industry can develop at a large scale. The objective of this research is to increase the farming and seed production for the farmers in agriculture by monitoring and computer network system with reliable servers. It is crucial to solve or minimize or avoid this problem to ensure the best farming and animal husbandry across the agriculture sector to maintain seed growth for the farmers and customers without any error and monitoring. The background for this study is to provide the best services of monitoring and computer networks globally for the production and growing sectors to be involved in emerging activities to reduce the errors using computer network monitoring. Even after dealing with these difficulties, ranchers need sizeable, stable business sectors for their harvests. Appropriately, in the last and present century, people groups have begun investigating the conceivable outcomes by embracing distinctive current procedures in agribusiness. The proposed solution will address the current challenges of computer network monitoring data across the agriculture sector to understand the actual outcomes.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132917517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719940
Minh Nguyen, Phuong-Thai Nguyen, V. Nguyen, Quang-Minh Nguyen
Research on automatically generating descriptions for e-commerce products is gaining increasing attention in recent years. However, the generated descriptions of their systems are often less informative and attractive because of lacking training datasets or the limitation of these approaches, which often use templates or statistical methods. In this paper, we explore a method to generate production descriptions by using the GPT-2 model. In addition, we apply text paraphrasing and task-adaptive pretraining techniques to improve the quality of descriptions generated from the GPT-2 model. Experiment results show that our models outperform the baseline model through automatic evaluation and human evaluation. Especially, our methods achieve a promising result not only on the seen test set but also in the unseen test set.
{"title":"Generating Product Description with Generative Pre-trained Transformer 2","authors":"Minh Nguyen, Phuong-Thai Nguyen, V. Nguyen, Quang-Minh Nguyen","doi":"10.1109/citisia53721.2021.9719940","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719940","url":null,"abstract":"Research on automatically generating descriptions for e-commerce products is gaining increasing attention in recent years. However, the generated descriptions of their systems are often less informative and attractive because of lacking training datasets or the limitation of these approaches, which often use templates or statistical methods. In this paper, we explore a method to generate production descriptions by using the GPT-2 model. In addition, we apply text paraphrasing and task-adaptive pretraining techniques to improve the quality of descriptions generated from the GPT-2 model. Experiment results show that our models outperform the baseline model through automatic evaluation and human evaluation. Especially, our methods achieve a promising result not only on the seen test set but also in the unseen test set.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129371327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719900
{"title":"IEEE CSU Student Branch Committee (2021)","authors":"","doi":"10.1109/citisia53721.2021.9719900","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719900","url":null,"abstract":"","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134033367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719974
M. Thi, Le Hoang Son, Nguyen Tran Quoc Vinh, Nguyen Thi Huong Quynh
The study reviews current computing infrastructure of Internet-of-Things based applications in smart agriculture. The purpose is to identify key areas of state-of-arts computing technologies, data architecture, network technologies, and artificial intelligence, as well as ongoing challenges in these fields. To deliver the best of our knowledge, we review the latest research published in peer-reviewed journals and conferences from 2019 to 2021 depending on a four-step selection process of identification, screening, eligibility, and inclusion exclusion criteria. To examine these documents, a systematic review is conducted, and two main questions are answered. The output indicates that the improvements of computing infrastructure of IoT create exciting opportunities for real-world smart agriculture applications for evaluating, monitoring, enhancing the resource quality of nature such as soil, water, crop, etc. We conclude by summarizing that they are most commonly used in terms of network technologies, computing technologies, and data storage technologies of IoT. It could be considered like the kickoff point for the other forthcoming multi-disciplinary examination in smart applications and especially smart agriculture.
{"title":"Computing Infrastructure Of IoT Applications In Smart Agriculture: A Systematical Review","authors":"M. Thi, Le Hoang Son, Nguyen Tran Quoc Vinh, Nguyen Thi Huong Quynh","doi":"10.1109/citisia53721.2021.9719974","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719974","url":null,"abstract":"The study reviews current computing infrastructure of Internet-of-Things based applications in smart agriculture. The purpose is to identify key areas of state-of-arts computing technologies, data architecture, network technologies, and artificial intelligence, as well as ongoing challenges in these fields. To deliver the best of our knowledge, we review the latest research published in peer-reviewed journals and conferences from 2019 to 2021 depending on a four-step selection process of identification, screening, eligibility, and inclusion exclusion criteria. To examine these documents, a systematic review is conducted, and two main questions are answered. The output indicates that the improvements of computing infrastructure of IoT create exciting opportunities for real-world smart agriculture applications for evaluating, monitoring, enhancing the resource quality of nature such as soil, water, crop, etc. We conclude by summarizing that they are most commonly used in terms of network technologies, computing technologies, and data storage technologies of IoT. It could be considered like the kickoff point for the other forthcoming multi-disciplinary examination in smart applications and especially smart agriculture.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130481761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/CITISIA53721.2021.9719960
Dary Zhafran, Putri Wulandari
Second order filter is a voltage source amplifier circuit that uses an op-amp component. Has a very important function in designing a higher oder filter with a steep roll-off. HPF and LPF are types of filter designs that have a roll-off of 40-dB per decade. The difference between the two circuits is the different positions of the resistor and capacitor. HPF and LPF can be given the same input resulting in a different frequency signal response. In accordance with the theory of the graph signal output on the Bode Plotter display for HPF the direction is upward, while for LPF the direction of the graph signal is downward. The signal graph is displayed on a component called a Bode Plotter in Multisim applying input and output. In this paper, two designs of HPF and LPF circuits are made and discuss the analysis of the results of differences in frequency signals. As well as comparing the shape of the wave signal on the oscilloscope display in Multisim and the result lies in the magnitude of the amplitude.
{"title":"Design Analysis of HPF and LPF with Bode Plotter in Multisim","authors":"Dary Zhafran, Putri Wulandari","doi":"10.1109/CITISIA53721.2021.9719960","DOIUrl":"https://doi.org/10.1109/CITISIA53721.2021.9719960","url":null,"abstract":"Second order filter is a voltage source amplifier circuit that uses an op-amp component. Has a very important function in designing a higher oder filter with a steep roll-off. HPF and LPF are types of filter designs that have a roll-off of 40-dB per decade. The difference between the two circuits is the different positions of the resistor and capacitor. HPF and LPF can be given the same input resulting in a different frequency signal response. In accordance with the theory of the graph signal output on the Bode Plotter display for HPF the direction is upward, while for LPF the direction of the graph signal is downward. The signal graph is displayed on a component called a Bode Plotter in Multisim applying input and output. In this paper, two designs of HPF and LPF circuits are made and discuss the analysis of the results of differences in frequency signals. As well as comparing the shape of the wave signal on the oscilloscope display in Multisim and the result lies in the magnitude of the amplitude.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126171267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719897
Ira Nath, P. Biswas, Kankana Ganguly, Dharmpal Singh, S. M. Islam, Ton Quang Cuong, Souvik Pal
India is a highly densely populated country. India is facing a very serious challenge due to the novel COVID-I9 outbreak. In this situation, the economic state of the people is very unstable. Blockchain technology proves helpful to subdue the situation. A voting system with ballot papers is quite tuff now. It is very costly for the government. The pandemic may also spread very quickly. The system of developing ledger serves the idea of developments of a new e-voting system that is economical, easy to use, and highly secure. This paper proposes ways and solutions to design an e-voting system using blockchain technology. The paper's primary goal is to develop a highly secure e-voting technique using which people can cast their valuable votes from their home, working place - anywhere from the world. This e-voting technique is least costly, highly secure, and able to prevent further spreading of any infectious disease in the near future. In this paper, an e-voting system using blockchain has been designed to overcome all these difficulties mentioned above during traditional voting using ballot. The significance of the proposed work is to design of a highly safe and least costly e- voting system using blockchain. Using this system the people can cast their vote easily, securely and without wasting any time. Casting vote will be now just from few clicks away and from any place with a stable internet connection.
{"title":"A Heuristic Approach using Block Chain to Fight Novel COVID-19 During an Election","authors":"Ira Nath, P. Biswas, Kankana Ganguly, Dharmpal Singh, S. M. Islam, Ton Quang Cuong, Souvik Pal","doi":"10.1109/citisia53721.2021.9719897","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719897","url":null,"abstract":"India is a highly densely populated country. India is facing a very serious challenge due to the novel COVID-I9 outbreak. In this situation, the economic state of the people is very unstable. Blockchain technology proves helpful to subdue the situation. A voting system with ballot papers is quite tuff now. It is very costly for the government. The pandemic may also spread very quickly. The system of developing ledger serves the idea of developments of a new e-voting system that is economical, easy to use, and highly secure. This paper proposes ways and solutions to design an e-voting system using blockchain technology. The paper's primary goal is to develop a highly secure e-voting technique using which people can cast their valuable votes from their home, working place - anywhere from the world. This e-voting technique is least costly, highly secure, and able to prevent further spreading of any infectious disease in the near future. In this paper, an e-voting system using blockchain has been designed to overcome all these difficulties mentioned above during traditional voting using ballot. The significance of the proposed work is to design of a highly safe and least costly e- voting system using blockchain. Using this system the people can cast their vote easily, securely and without wasting any time. Casting vote will be now just from few clicks away and from any place with a stable internet connection.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115358643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-24DOI: 10.1109/citisia53721.2021.9719945
Mahsa Mohaghegh, Jaya Gascon
Parkinson’s disease is a progressive neurological disease resulting in motor impairments that decrease patients’ quality of life. It is a condition currently without a cure. This study proposes an approach to Parkinson’s disease detection using multimodal analysis, combining handwriting and voice data. We introduce the use of image transformer architectures to classify Parkinson’s disease patients from healthy subjects, as early diagnosis of Parkinson’s disease contributes to the management of motor symptoms. Data-efficient image transformer with self-supervised learning on DINO obtained an accuracy of above 90% on a combination of spiral and meander drawings from the NewHandPD dataset. In comparison, an audio spectrogram transformer obtained an accuracy of above 80% on the sustained vowel phonations of /a/ and /o/ from the PC-GITA corpus. This work considers using a multimodal approach in identifying Parkinson’s disease and the usability of transformer architectures in image and audio spectrogram classification tasks.
{"title":"Identifying Parkinson’s Disease using Multimodal Approach and Deep Learning","authors":"Mahsa Mohaghegh, Jaya Gascon","doi":"10.1109/citisia53721.2021.9719945","DOIUrl":"https://doi.org/10.1109/citisia53721.2021.9719945","url":null,"abstract":"Parkinson’s disease is a progressive neurological disease resulting in motor impairments that decrease patients’ quality of life. It is a condition currently without a cure. This study proposes an approach to Parkinson’s disease detection using multimodal analysis, combining handwriting and voice data. We introduce the use of image transformer architectures to classify Parkinson’s disease patients from healthy subjects, as early diagnosis of Parkinson’s disease contributes to the management of motor symptoms. Data-efficient image transformer with self-supervised learning on DINO obtained an accuracy of above 90% on a combination of spiral and meander drawings from the NewHandPD dataset. In comparison, an audio spectrogram transformer obtained an accuracy of above 80% on the sustained vowel phonations of /a/ and /o/ from the PC-GITA corpus. This work considers using a multimodal approach in identifying Parkinson’s disease and the usability of transformer architectures in image and audio spectrogram classification tasks.","PeriodicalId":252063,"journal":{"name":"2021 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications (CITISIA)","volume":"304 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116604579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：