首页 > 最新文献

Applied AI letters最新文献

英文 中文
An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry 三维视觉变形与可解释人工智能在牙科修复中的应用
Pub Date : 2024-09-03 DOI: 10.1002/ail2.101
Faisal Ahmed Sifat, Md Sahadul Hasan Arian, Saif Ahmed, Taseef Hasan Farook, Nabeel Mohammed, James Dudley

To create and validate a transformer-based deep neural network architecture for classifying 3D scans of teeth for computer-assisted manufacturing and dental prosthetic rehabilitation surpassing previously reported validation accuracies obtained with convolutional neural networks (CNNs). Voxel-based representation and encoding input data in a high-dimensional space forms of preprocessing were investigated using 34 3D models of teeth obtained from intraoral scanning. Independent CNNs and vision transformers (ViTs), and their combination (CNN and ViT hybrid model) were implemented to classify the 3D scans directly from standard tessellation language (.stl) files and an Explainable AI (ExAI) model was generated to qualitatively explore the deterministic patterns that influenced the outcomes of the automation process. The results demonstrate that the CNN and ViT hybrid model architecture surpasses conventional supervised CNN, achieving a consistent validation accuracy of 90% through three-fold cross-validation. This process validated our initial findings, where each instance had the opportunity to be part of the validation set, ensuring it remained unseen during training. Furthermore, employing high-dimensional encoding of input data solely with 3DCNN yields a validation accuracy of 80%. When voxel data preprocessing is utilized, ViT outperforms CNN, achieving validation accuracies of 80% and 50%, respectively. The study also highlighted the saliency map's ability to identify areas of tooth cavity preparation of restorative importance, that can theoretically enable more accurate 3D printed prosthetic outputs. The investigation introduced a CNN and ViT hybrid model for classification of 3D tooth models in digital dentistry, and it was the first to employ ExAI in the efforts to automate the process of dental computer-assisted manufacturing.

创建并验证基于变压器的深度神经网络架构,用于对牙齿3D扫描进行分类,用于计算机辅助制造和牙科假肢康复,超过先前报道的卷积神经网络(cnn)获得的验证精度。利用口腔内扫描获得的34个牙齿三维模型,研究了基于体素的高维空间表示和编码输入数据的预处理形式。实现了独立的CNN和视觉转换器(ViT)及其组合(CNN和ViT混合模型),直接从标准细分语言(.stl)文件中对3D扫描进行分类,并生成了可解释的AI (ExAI)模型,以定性地探索影响自动化过程结果的确定性模式。结果表明,CNN和ViT混合模型架构优于传统的有监督CNN,通过三次交叉验证,验证准确率达到90%。这个过程验证了我们最初的发现,其中每个实例都有机会成为验证集的一部分,确保它在训练期间不可见。此外,仅使用3DCNN对输入数据进行高维编码,验证准确率达到80%。当使用体素数据预处理时,ViT优于CNN,验证准确率分别达到80%和50%。该研究还强调了显著性图识别牙腔准备修复重要性区域的能力,理论上可以实现更精确的3D打印假体输出。该研究引入了CNN和ViT混合模型,用于数字牙科中3D牙齿模型的分类,并且首次使用ExAI来实现牙科计算机辅助制造过程的自动化。
{"title":"An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry","authors":"Faisal Ahmed Sifat,&nbsp;Md Sahadul Hasan Arian,&nbsp;Saif Ahmed,&nbsp;Taseef Hasan Farook,&nbsp;Nabeel Mohammed,&nbsp;James Dudley","doi":"10.1002/ail2.101","DOIUrl":"https://doi.org/10.1002/ail2.101","url":null,"abstract":"<p>To create and validate a transformer-based deep neural network architecture for classifying 3D scans of teeth for computer-assisted manufacturing and dental prosthetic rehabilitation surpassing previously reported validation accuracies obtained with convolutional neural networks (CNNs). Voxel-based representation and encoding input data in a high-dimensional space forms of preprocessing were investigated using 34 3D models of teeth obtained from intraoral scanning. Independent CNNs and vision transformers (ViTs), and their combination (CNN and ViT hybrid model) were implemented to classify the 3D scans directly from standard tessellation language (.stl) files and an Explainable AI (ExAI) model was generated to qualitatively explore the deterministic patterns that influenced the outcomes of the automation process. The results demonstrate that the CNN and ViT hybrid model architecture surpasses conventional supervised CNN, achieving a consistent validation accuracy of 90% through three-fold cross-validation. This process validated our initial findings, where each instance had the opportunity to be part of the validation set, ensuring it remained unseen during training. Furthermore, employing high-dimensional encoding of input data solely with 3DCNN yields a validation accuracy of 80%. When voxel data preprocessing is utilized, ViT outperforms CNN, achieving validation accuracies of 80% and 50%, respectively. The study also highlighted the saliency map's ability to identify areas of tooth cavity preparation of restorative importance, that can theoretically enable more accurate 3D printed prosthetic outputs. The investigation introduced a CNN and ViT hybrid model for classification of 3D tooth models in digital dentistry, and it was the first to employ ExAI in the efforts to automate the process of dental computer-assisted manufacturing.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.101","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142859877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
History Matching Reservoir Models With Many Objective Bayesian Optimization 用多目标贝叶斯优化法匹配历史储层模型
Pub Date : 2024-08-27 DOI: 10.1002/ail2.99
Steven Samoil, Clyde Fare, Kirk E. Jordan, Zhangxin Chen

Reservoir models for predicting subsurface fluid and rock behaviors can now include upwards of billions (and potentially trillions) of grid cells and are pushing the limits of computational resources. History matching, where models are updated to match existing historical data more closely, is conducted to reduce the number of simulation runs and is one of the primary time-consuming tasks. As models get larger the number of parameters to match increases, and the number of objective functions increases, and traditional methods start to reach their limitations. To solve this, we propose the use of Bayesian optimization (BO) in a hybrid cloud framework. BO iteratively searches for an optimal solution in the simulations campaign through the refinement of a set of priors initialized with a set of simulation results. The current simulation platform implements grid management and a suite of linear solvers to perform the simulation on large scale distributed-memory systems. Our early results using the hybrid cloud implementation shown here are encouraging on tasks requiring over 100 objective functions, and we propose integrating BO as a built-in module to efficiently iterate to find an optimal history match of production data in a single package platform. This paper reports on the development of the hybrid cloud BO based history matching framework and the initial results of the application to reservoir history matching.

用于预测地下流体和岩石行为的油藏模型现在可以包含数十亿(甚至可能数万亿)网格单元,并且正在突破计算资源的极限。历史匹配(更新模型以更紧密地匹配现有历史数据)是为了减少模拟运行的次数,也是主要的耗时任务之一。随着模型的不断扩大,需要匹配的参数也越来越多,目标函数也越来越多,传统的方法开始达到其局限性。为了解决这个问题,我们提出在混合云框架中使用贝叶斯优化(BO)。BO通过对一组模拟结果初始化的一组先验进行细化,迭代地搜索模拟运动中的最优解。目前的仿真平台实现了网格管理和一套线性求解器,可以在大规模分布式存储系统上进行仿真。我们使用混合云实现的早期结果在需要超过100个目标函数的任务上令人鼓舞,我们建议将BO集成为内置模块,以有效地迭代,在单个软件包平台中找到生产数据的最佳历史匹配。本文报道了基于混合云BO的历史匹配框架的开发及其在储层历史匹配中的初步应用成果。
{"title":"History Matching Reservoir Models With Many Objective Bayesian Optimization","authors":"Steven Samoil,&nbsp;Clyde Fare,&nbsp;Kirk E. Jordan,&nbsp;Zhangxin Chen","doi":"10.1002/ail2.99","DOIUrl":"https://doi.org/10.1002/ail2.99","url":null,"abstract":"<p>Reservoir models for predicting subsurface fluid and rock behaviors can now include upwards of billions (and potentially trillions) of grid cells and are pushing the limits of computational resources. History matching, where models are updated to match existing historical data more closely, is conducted to reduce the number of simulation runs and is one of the primary time-consuming tasks. As models get larger the number of parameters to match increases, and the number of objective functions increases, and traditional methods start to reach their limitations. To solve this, we propose the use of Bayesian optimization (BO) in a hybrid cloud framework. BO iteratively searches for an optimal solution in the simulations campaign through the refinement of a set of priors initialized with a set of simulation results. The current simulation platform implements grid management and a suite of linear solvers to perform the simulation on large scale distributed-memory systems. Our early results using the hybrid cloud implementation shown here are encouraging on tasks requiring over 100 objective functions, and we propose integrating BO as a built-in module to efficiently iterate to find an optimal history match of production data in a single package platform. This paper reports on the development of the hybrid cloud BO based history matching framework and the initial results of the application to reservoir history matching.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.99","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing and Deploying End-to-End Machine Learning Systems for Social Impact: A Rubric and Practical Artificial Intelligence Case Studies From African Contexts 开发和部署端到端机器学习系统以产生社会影响:来自非洲的评分标准和实用人工智能案例研究
Pub Date : 2024-08-27 DOI: 10.1002/ail2.100
Engineer Bainomugisha, Joyce Nakatumba-Nabende

Artificial intelligence (AI) and machine learning have demonstrated the potential to provide solutions to societal challenges, for example, automated crop diagnostics for smallholder farmers, environmental pollution modelling and prediction for cities and machine translation systems for languages that enable information access and communication for segments of the population who are unable to speak or write official languages, among others. Despite the potential of AI, the practical and technical issues related to its development and deployment in the African context are the least documented and understood. The development and deployment of AI for social impact systems in the developing world present new intricacies and requirements emanating from the unique technology and social ecosystems in these settings. This paper provides a rubric for developing and deploying AI systems for social impact with a focus on the African context. The rubric is derived from the analysis of a series of selected real-world case studies of AI applications in Africa. We assessed the selected AI case studies against the proposed rubric. The rubric and examples of AI applications presented in this paper are expected to contribute to the development and application of AI systems in other African contexts.

人工智能(AI)和机器学习已经证明了为社会挑战提供解决方案的潜力,例如,为小农提供作物自动诊断,为城市提供环境污染建模和预测,以及为无法说或写官方语言的人群提供信息获取和交流的语言机器翻译系统等。尽管人工智能具有潜力,但与人工智能在非洲的发展和部署有关的实际和技术问题是记录和理解最少的。在发展中国家,为社会影响系统开发和部署人工智能带来了新的复杂性和需求,这些复杂性和需求来自于这些环境中独特的技术和社会生态系统。本文为开发和部署人工智能系统的社会影响提供了一个框架,重点是非洲背景。该标题源自对非洲人工智能应用的一系列精选现实案例研究的分析。我们根据建议的标题评估了选定的人工智能案例研究。本文中提出的人工智能应用的标题和示例预计将有助于在其他非洲环境中开发和应用人工智能系统。
{"title":"Developing and Deploying End-to-End Machine Learning Systems for Social Impact: A Rubric and Practical Artificial Intelligence Case Studies From African Contexts","authors":"Engineer Bainomugisha,&nbsp;Joyce Nakatumba-Nabende","doi":"10.1002/ail2.100","DOIUrl":"https://doi.org/10.1002/ail2.100","url":null,"abstract":"<p>Artificial intelligence (AI) and machine learning have demonstrated the potential to provide solutions to societal challenges, for example, automated crop diagnostics for smallholder farmers, environmental pollution modelling and prediction for cities and machine translation systems for languages that enable information access and communication for segments of the population who are unable to speak or write official languages, among others. Despite the potential of AI, the practical and technical issues related to its development and deployment in the African context are the least documented and understood. The development and deployment of AI for social impact systems in the developing world present new intricacies and requirements emanating from the unique technology and social ecosystems in these settings. This paper provides a rubric for developing and deploying AI systems for social impact with a focus on the African context. The rubric is derived from the analysis of a series of selected real-world case studies of AI applications in Africa. We assessed the selected AI case studies against the proposed rubric. The rubric and examples of AI applications presented in this paper are expected to contribute to the development and application of AI systems in other African contexts.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.100","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fine-Tuned Pretrained Transformer for Amharic News Headline Generation 针对阿姆哈拉语新闻标题生成的微调预训练变换器
Pub Date : 2024-07-19 DOI: 10.1002/ail2.98
Mizanu Zelalem Degu, Million Meshesha

Amharic is one of the under-resourced languages, making news headline generation particularly challenging due to the scarcity of high-quality linguistic datasets necessary for training effective natural language processing models. In this study, we fine-tuned the small check point of the T5v1.1 model (t5-small) to perform Amharic news headline generation with an Amharic dataset that is comprised of over 70k news articles along with their headline. Fine-tuning the model involves dataset collection from Amharic news websites, text cleaning, news article size optimization using the TF-IDF algorithm, and tokenization. In addition, a tokenizer model is developed using the byte pair encoding (BPE) algorithm prior to feeding the dataset for feature extraction and summarization. Metrics including Rouge-L, BLEU, and Meteor were used to evaluate the performance of the model and a score of 0.5, 0.24, and 0.71, respectively, was achieved on the test partition of the dataset that contains 7230 instances. The results were good relative to result of the t5 model without fine-tuning, which are 0.1, 0.03, and 0.14, respectively. A postprocessing technique using a rule-based approach was used for further improving summaries generated by the model. The addition of the postprocessing helped the system to achieve Rouge-L, BLEU, and Meteor scores of 0.72, 0.52, and 0.81, respectively. The result value is relatively better than the result achieved by the nonfine-tuned T5v1.1 model and the result of previous studies report on abstractive-based text summarization for Amharic language, which had a 0.27 Rouge-L score. This contributes a valuable insight for practical application and further improvement of the model in the future by increasing the article length, using more training data, using machine learning–based adaptive postprocessing techniques, and fine-tuning other available pretrained models for text summarization.

阿姆哈拉语是一种资源不足的语言,由于缺乏训练有效自然语言处理模型所需的高质量语言数据集,新闻标题的生成尤其具有挑战性。在本研究中,我们对 T5v1.1 模型(t5-small)的小型检查点进行了微调,以便使用由超过 70k 篇新闻文章及其标题组成的阿姆哈拉语数据集生成阿姆哈拉语新闻标题。对模型的微调包括从阿姆哈拉语新闻网站收集数据集、文本清理、使用 TF-IDF 算法优化新闻文章大小以及标记化。此外,在将数据集输入特征提取和摘要之前,还使用字节对编码(BPE)算法开发了一个标记化模型。该模型在包含 7230 个实例的数据集测试分区上分别获得了 0.5、0.24 和 0.71 分。与未进行微调的 t5 模型的结果(分别为 0.1、0.03 和 0.14)相比,结果很好。为进一步改进模型生成的摘要,使用了基于规则的后处理技术。增加后处理后,系统的 Rouge-L、BLEU 和 Meteor 分数分别达到 0.72、0.52 和 0.81。该结果值相对优于未经微调的 T5v1.1 模型所取得的结果,也优于之前关于基于抽象的阿姆哈拉语文本摘要的研究报告所取得的结果,后者的 Rouge-L 分数为 0.27。这为实际应用提供了宝贵的启示,并有助于今后通过增加文章长度、使用更多训练数据、使用基于机器学习的自适应后处理技术以及微调其他可用的文本摘要预训练模型来进一步改进该模型。
{"title":"Fine-Tuned Pretrained Transformer for Amharic News Headline Generation","authors":"Mizanu Zelalem Degu,&nbsp;Million Meshesha","doi":"10.1002/ail2.98","DOIUrl":"10.1002/ail2.98","url":null,"abstract":"<p>Amharic is one of the under-resourced languages, making news headline generation particularly challenging due to the scarcity of high-quality linguistic datasets necessary for training effective natural language processing models. In this study, we fine-tuned the small check point of the T5v1.1 model (t5-small) to perform Amharic news headline generation with an Amharic dataset that is comprised of over 70k news articles along with their headline. Fine-tuning the model involves dataset collection from Amharic news websites, text cleaning, news article size optimization using the TF-IDF algorithm, and tokenization. In addition, a tokenizer model is developed using the byte pair encoding (BPE) algorithm prior to feeding the dataset for feature extraction and summarization. Metrics including Rouge-L, BLEU, and Meteor were used to evaluate the performance of the model and a score of 0.5, 0.24, and 0.71, respectively, was achieved on the test partition of the dataset that contains 7230 instances. The results were good relative to result of the t5 model without fine-tuning, which are 0.1, 0.03, and 0.14, respectively. A postprocessing technique using a rule-based approach was used for further improving summaries generated by the model. The addition of the postprocessing helped the system to achieve Rouge-L, BLEU, and Meteor scores of 0.72, 0.52, and 0.81, respectively. The result value is relatively better than the result achieved by the nonfine-tuned T5v1.1 model and the result of previous studies report on abstractive-based text summarization for Amharic language, which had a 0.27 Rouge-L score. This contributes a valuable insight for practical application and further improvement of the model in the future by increasing the article length, using more training data, using machine learning–based adaptive postprocessing techniques, and fine-tuning other available pretrained models for text summarization.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.98","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141822582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TL-GNN: Android Malware Detection Using Transfer Learning TL-GNN:利用迁移学习检测安卓恶意软件
Pub Date : 2024-05-10 DOI: 10.1002/ail2.94
Ali Raza, Zahid Hussain Qaisar, Naeem Aslam, Muhammad Faheem, Muhammad Waqar Ashraf, Muhammad Naman Chaudhry

Malware growth has accelerated due to the widespread use of Android applications. Android smartphone attacks have increased due to the widespread use of these devices. While deep learning models offer high efficiency and accuracy, training them on large and complex datasets is computationally expensive. Hence, a method that effectively detects new malware variants at a low computational cost is required. A transfer learning method to detect Android malware is proposed in this research. Because of transferring known features from a source model that has been trained to a target model, the transfer learning approach reduces the need for new training data and minimizes the need for huge amounts of computational power. We performed many experiments on 1.2 million Android application samples for performance evaluation. In addition, we evaluated how well our framework performed in comparison with traditional deep learning and standard machine learning models. In comparison with state-of-the-art Android malware detection methods, the proposed framework offers improved classification accuracy of 98.87%, a precision of 99.55%, recall of 97.30%, F1-measure of 99.42%, and a quicker detection rate of 5.14 ms using the transfer learning strategy.

由于 Android 应用程序的广泛使用,恶意软件增长速度加快。由于安卓智能手机的广泛使用,这些设备受到的攻击也在增加。虽然深度学习模型具有很高的效率和准确性,但在大型复杂数据集上训练这些模型的计算成本很高。因此,需要一种能以低计算成本有效检测新恶意软件变种的方法。本研究提出了一种检测安卓恶意软件的迁移学习方法。由于将已知特征从已训练的源模型转移到目标模型,转移学习方法减少了对新训练数据的需求,并最大限度地降低了对大量计算能力的需求。我们在 120 万个安卓应用样本上进行了多次实验,以评估性能。此外,我们还评估了我们的框架与传统深度学习和标准机器学习模型的性能对比。与最先进的安卓恶意软件检测方法相比,拟议框架的分类准确率提高了 98.87%,精确度提高了 99.55%,召回率提高了 97.30%,F1-measure 提高了 99.42%,使用迁移学习策略的快速检测率提高了 5.14 毫秒。
{"title":"TL-GNN: Android Malware Detection Using Transfer Learning","authors":"Ali Raza,&nbsp;Zahid Hussain Qaisar,&nbsp;Naeem Aslam,&nbsp;Muhammad Faheem,&nbsp;Muhammad Waqar Ashraf,&nbsp;Muhammad Naman Chaudhry","doi":"10.1002/ail2.94","DOIUrl":"10.1002/ail2.94","url":null,"abstract":"<p>Malware growth has accelerated due to the widespread use of Android applications. Android smartphone attacks have increased due to the widespread use of these devices. While deep learning models offer high efficiency and accuracy, training them on large and complex datasets is computationally expensive. Hence, a method that effectively detects new malware variants at a low computational cost is required. A transfer learning method to detect Android malware is proposed in this research. Because of transferring known features from a source model that has been trained to a target model, the transfer learning approach reduces the need for new training data and minimizes the need for huge amounts of computational power. We performed many experiments on 1.2 million Android application samples for performance evaluation. In addition, we evaluated how well our framework performed in comparison with traditional deep learning and standard machine learning models. In comparison with state-of-the-art Android malware detection methods, the proposed framework offers improved classification accuracy of 98.87%, a precision of 99.55%, recall of 97.30%, <i>F</i>1-measure of 99.42%, and a quicker detection rate of 5.14 ms using the transfer learning strategy.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.94","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140990897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Building Text and Speech Benchmark Datasets and Models for Low-Resourced East African Languages: Experiences and Lessons 为资源匮乏的东非语言建立文本和语音基准数据集和模型:经验与教训
Pub Date : 2024-03-26 DOI: 10.1002/ail2.92
Joyce Nakatumba-Nabende, Claire Babirye, Peter Nabende, Jeremy Francis Tusubira, Jonathan Mukiibi, Eric Peter Wairagala, Chodrine Mutebi, Tobius Saul Bateesa, Alvin Nahabwe, Hewitt Tusiime, Andrew Katumba

Africa has over 2000 languages; however, those languages are not well represented in the existing natural language processing ecosystem. African languages lack essential digital resources to effectively engage in advancing language technologies. There is a need to generate high-quality natural language processing resources for low-resourced African languages. Obtaining high-quality speech and text data is expensive and tedious because it can involve manual sourcing and verification of data sources. This paper discusses the process taken to curate and annotate text and speech datasets for five East African languages: Luganda, Runyankore-Rukiga, Acholi, Lumasaba, and Swahili. We also present results obtained from baseline models for machine translation, topic modeling and classification, sentiment classification, and automatic speech recognition tasks. Finally, we discuss the experiences, challenges, and lessons learned in creating the text and speech datasets.

非洲有 2000 多种语言,但这些语言在现有的自然语言处理生态系统中并没有得到很好的体现。非洲语言缺乏必要的数字资源,无法有效地参与先进的语言技术。有必要为资源匮乏的非洲语言生成高质量的自然语言处理资源。获取高质量的语音和文本数据既昂贵又繁琐,因为这可能涉及数据源的人工采购和验证。本文讨论了为五种东非语言整理和注释文本和语音数据集的过程:这五种东非语言是:卢干达语、Runyankore-Rukiga 语、阿乔利语、卢马萨巴语和斯瓦希里语。我们还介绍了基线模型在机器翻译、主题建模和分类、情感分类以及自动语音识别任务中取得的成果。最后,我们讨论了创建文本和语音数据集的经验、挑战和教训。
{"title":"Building Text and Speech Benchmark Datasets and Models for Low-Resourced East African Languages: Experiences and Lessons","authors":"Joyce Nakatumba-Nabende,&nbsp;Claire Babirye,&nbsp;Peter Nabende,&nbsp;Jeremy Francis Tusubira,&nbsp;Jonathan Mukiibi,&nbsp;Eric Peter Wairagala,&nbsp;Chodrine Mutebi,&nbsp;Tobius Saul Bateesa,&nbsp;Alvin Nahabwe,&nbsp;Hewitt Tusiime,&nbsp;Andrew Katumba","doi":"10.1002/ail2.92","DOIUrl":"10.1002/ail2.92","url":null,"abstract":"<p>Africa has over 2000 languages; however, those languages are not well represented in the existing natural language processing ecosystem. African languages lack essential digital resources to effectively engage in advancing language technologies. There is a need to generate high-quality natural language processing resources for low-resourced African languages. Obtaining high-quality speech and text data is expensive and tedious because it can involve manual sourcing and verification of data sources. This paper discusses the process taken to curate and annotate text and speech datasets for five East African languages: Luganda, Runyankore-Rukiga, Acholi, Lumasaba, and Swahili. We also present results obtained from baseline models for machine translation, topic modeling and classification, sentiment classification, and automatic speech recognition tasks. Finally, we discuss the experiences, challenges, and lessons learned in creating the text and speech datasets.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.92","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140378695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CMD + V for chemistry: Image to chemical structure conversion directly done in the clipboard CMD + V 用于化学:在剪贴板中直接完成图像到化学结构的转换
Pub Date : 2024-01-25 DOI: 10.1002/ail2.91
Oliver Tobias Schilter, Teodoro Laino, Philippe Schwaller

We present Clipboard-to-SMILES Converter (C2SC), a macOS application that directly converts molecular structures from the clipboard. The app focuses on seamlessly converting screenshots of molecules into a desired molecular representation. It supports a wide range of molecular representations, such as SMILES, SELFIES, InChI's, IUPAC names, RDKit Mol's, and CAS numbers, allowing effortless conversion between these formats within the clipboard. C2SC automatically saves converted molecules to a local history file and displays the last 10 entries for quick access. Additionally, it incorporates several SMILES operations, including canonicalization, augmentation, as well price-searching molecules on chemical vendors for the cost-effective purchasing option. Beyond the one-click conversion from clipboard to molecular structures, the app offers continuous monitoring of the clipboard which automatically converts any supported representations or images detected into SMILES. The convenient interface, directly in the status bar, as well as availability as macOS application, makes C2SC useful for a broad community not requiring any programming expertise. Most conversions are performed locally, notably the image-to-SMILES conversion, with internet access only necessary for specific tasks like price lookups. In summary, C2SC provides a user-friendly and efficient solution for converting molecular structures directly from the clipboard, offering seamless conversions between comprehensive chemical representations and can be directly downloaded from https://github.com/O-Schilter/Clipboard-to-SMILES-Converter.

我们推出的剪贴板到分子结构转换器(Clipboard-to-SMILES Converter,简称 C2SC)是一款 macOS 应用程序,可直接从剪贴板转换分子结构。该应用程序的重点是将分子截图无缝转换为所需的分子表示法。它支持多种分子表示法,如 SMILES、SELFIES、InChI、IUPAC 名称、RDKit Mol 和 CAS 号码,可在剪贴板内轻松实现这些格式之间的转换。C2SC 会自动将转换后的分子保存到本地历史文件中,并显示最近 10 个条目,以便快速访问。此外,它还集成了多种 SMILES 操作,包括规范化、扩增以及在化学供应商上搜索分子价格,以实现经济高效的购买选择。除了从剪贴板到分子结构的一键转换外,该程序还提供对剪贴板的持续监控,可自动将检测到的任何支持的表示法或图像转换为 SMILES。C2SC 的界面非常方便,可直接在状态栏中显示,还可作为 macOS 应用程序使用,这使得 C2SC 能够在不需要任何编程专业知识的情况下为广大用户所用。大多数转换都在本地完成,尤其是图像到 SMILES 的转换,只有在执行价格查询等特定任务时才需要访问互联网。总之,C2SC 为直接从剪贴板转换分子结构提供了一个用户友好的高效解决方案,可在全面的化学表示法之间进行无缝转换,并可直接从 https://github.com/O-Schilter/Clipboard-to-SMILES-Converter 下载。
{"title":"CMD + V for chemistry: Image to chemical structure conversion directly done in the clipboard","authors":"Oliver Tobias Schilter,&nbsp;Teodoro Laino,&nbsp;Philippe Schwaller","doi":"10.1002/ail2.91","DOIUrl":"10.1002/ail2.91","url":null,"abstract":"<p>We present Clipboard-to-SMILES Converter (C2SC), a macOS application that directly converts molecular structures from the clipboard. The app focuses on seamlessly converting screenshots of molecules into a desired molecular representation. It supports a wide range of molecular representations, such as SMILES, SELFIES, InChI's, IUPAC names, RDKit Mol's, and CAS numbers, allowing effortless conversion between these formats within the clipboard. C2SC automatically saves converted molecules to a local history file and displays the last 10 entries for quick access. Additionally, it incorporates several SMILES operations, including canonicalization, augmentation, as well price-searching molecules on chemical vendors for the cost-effective purchasing option. Beyond the one-click conversion from clipboard to molecular structures, the app offers continuous monitoring of the clipboard which automatically converts any supported representations or images detected into SMILES. The convenient interface, directly in the status bar, as well as availability as macOS application, makes C2SC useful for a broad community not requiring any programming expertise. Most conversions are performed locally, notably the image-to-SMILES conversion, with internet access only necessary for specific tasks like price lookups. In summary, C2SC provides a user-friendly and efficient solution for converting molecular structures directly from the clipboard, offering seamless conversions between comprehensive chemical representations and can be directly downloaded from https://github.com/O-Schilter/Clipboard-to-SMILES-Converter.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.91","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139597018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Featured Cover
Pub Date : 2024-01-02 DOI: 10.1002/ail2.90
Robert Tracey, Vadim Elisseev, Michalis Smyrnakis, Lan Hoang, Mark Fellows, Michael Ackers, Andrew Laughton, Stephen Hill, Phillip Folkes, John Whittle

The cover image is based on the Letter Towards bespoke optimizations of energy efficiency in HPC environments by Robert Tracey et al., https://doi.org/10.1002/ail2.87.

{"title":"Featured Cover","authors":"Robert Tracey,&nbsp;Vadim Elisseev,&nbsp;Michalis Smyrnakis,&nbsp;Lan Hoang,&nbsp;Mark Fellows,&nbsp;Michael Ackers,&nbsp;Andrew Laughton,&nbsp;Stephen Hill,&nbsp;Phillip Folkes,&nbsp;John Whittle","doi":"10.1002/ail2.90","DOIUrl":"https://doi.org/10.1002/ail2.90","url":null,"abstract":"<p>The cover image is based on the Letter T<i>owards bespoke optimizations of energy efficiency in HPC environments</i> by Robert Tracey et al., https://doi.org/10.1002/ail2.87.\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"4 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.90","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143248245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Flood susceptibility mapping at the country scale using machine learning approaches 利用机器学习方法绘制国家级洪水易感性地图
Pub Date : 2023-12-15 DOI: 10.1002/ail2.88
Geoffrey Dawson, Junaid Butt, Anne Jones, Paolo Fraccaro

River (fluvial), surface water (pluvial) and coastal flooding pose a significant risk to the United Kingdom. Therefore, it is important to assess flood risk particularly as the impacts of flooding are projected to increase due to climate change. Here we present a high resolution combined fluvial and pluvial flood susceptibility map of England. This flood susceptibility model is created by using past flood events and a series of meaningful hydrological parameters to a training machine learning model. We tested the relative performance of different machine learning algorithms, including Classification and Regression Trees, Random Forest and XGBoost and found the XGBoost performed the best, with an area under the receiver operating characteristic ROC Curve (AUC) of 0.93. We also found the model performed well on unseen areas, and we discuss the possibility of extending to regions that has no information on past flood events. Additionally, to aid in understanding what factors may impact flood risk to a particular area, we used Shapley additive explanations which allowed us to investigate the sensitivity of the predicted flood probability to flood factors at a given location.

河水(河流)、地表水(冲积水)和沿海洪水给英国带来了巨大风险。因此,对洪水风险进行评估非常重要,尤其是预计气候变化将导致洪水影响加剧。在此,我们展示了一张高分辨率的英格兰河流和冲积洪水易发性综合地图。该洪水易发性模型是通过使用过去的洪水事件和一系列有意义的水文参数来训练机器学习模型而创建的。我们测试了不同机器学习算法的相对性能,包括分类树和回归树、随机森林和 XGBoost,发现 XGBoost 性能最佳,接收器工作特征 ROC 曲线下面积 (AUC) 为 0.93。我们还发现该模型在未见过的地区表现良好,并讨论了将其扩展到没有过去洪水事件信息的地区的可能性。此外,为了帮助了解哪些因素可能会影响特定地区的洪水风险,我们使用了夏普利加法解释,这使我们能够研究特定地点的预测洪水概率对洪水因素的敏感性。
{"title":"Flood susceptibility mapping at the country scale using machine learning approaches","authors":"Geoffrey Dawson,&nbsp;Junaid Butt,&nbsp;Anne Jones,&nbsp;Paolo Fraccaro","doi":"10.1002/ail2.88","DOIUrl":"10.1002/ail2.88","url":null,"abstract":"<p>River (fluvial), surface water (pluvial) and coastal flooding pose a significant risk to the United Kingdom. Therefore, it is important to assess flood risk particularly as the impacts of flooding are projected to increase due to climate change. Here we present a high resolution combined fluvial and pluvial flood susceptibility map of England. This flood susceptibility model is created by using past flood events and a series of meaningful hydrological parameters to a training machine learning model. We tested the relative performance of different machine learning algorithms, including Classification and Regression Trees, Random Forest and XGBoost and found the XGBoost performed the best, with an area under the receiver operating characteristic ROC Curve (AUC) of 0.93. We also found the model performed well on unseen areas, and we discuss the possibility of extending to regions that has no information on past flood events. Additionally, to aid in understanding what factors may impact flood risk to a particular area, we used Shapley additive explanations which allowed us to investigate the sensitivity of the predicted flood probability to flood factors at a given location.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"4 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.88","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138997858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards bespoke optimizations of energy efficiency in HPC environments 在高性能计算环境中实现能源效率的定制优化
Pub Date : 2023-12-13 DOI: 10.1002/ail2.87
Robert Tracey, Vadim Elisseev, Michalis Smyrnakis, Lan Hoang, Mark Fellows, Michael Ackers, Andrew Laughton, Stephen Hill, Phillip Folkes, John Whittle

We present bespoke energy efficiency optimizations in high performance computing (HPC) environments using holistic approach to data collection, analysis and proactive management of resources and workloads. Our solution has three major components: (i) platform for collecting, storing and processing data from multiple sources across hardware and software stacks, (ii) collections of regression machine learning (ML) algorithms for making workloads classifications and energy usage predictions, (iii) agent-based decision-making framework for delivering control decisions to middle-ware and infrastructure thus supporting real time or near real energy efficiency optimizations. We will provide some concrete examples of using our proposed approach in HPC environment.

我们采用数据收集、分析以及资源和工作负载主动管理的整体方法,为高性能计算(HPC)环境提供定制的能效优化方案。我们的解决方案由三个主要部分组成:(i) 用于收集、存储和处理来自硬件和软件堆栈的多源数据的平台;(ii) 用于进行工作负载分类和能源使用预测的回归机器学习(ML)算法集合;(iii) 基于代理的决策框架,用于向中间件和基础设施提供控制决策,从而支持实时或接近实时的能效优化。我们将提供一些在高性能计算环境中使用我们提出的方法的具体实例。
{"title":"Towards bespoke optimizations of energy efficiency in HPC environments","authors":"Robert Tracey,&nbsp;Vadim Elisseev,&nbsp;Michalis Smyrnakis,&nbsp;Lan Hoang,&nbsp;Mark Fellows,&nbsp;Michael Ackers,&nbsp;Andrew Laughton,&nbsp;Stephen Hill,&nbsp;Phillip Folkes,&nbsp;John Whittle","doi":"10.1002/ail2.87","DOIUrl":"10.1002/ail2.87","url":null,"abstract":"<p>We present bespoke energy efficiency optimizations in high performance computing (HPC) environments using holistic approach to data collection, analysis and proactive management of resources and workloads. Our solution has three major components: (i) platform for collecting, storing and processing data from multiple sources across hardware and software stacks, (ii) collections of regression machine learning (ML) algorithms for making workloads classifications and energy usage predictions, (iii) agent-based decision-making framework for delivering control decisions to middle-ware and infrastructure thus supporting real time or near real energy efficiency optimizations. We will provide some concrete examples of using our proposed approach in HPC environment.</p>","PeriodicalId":72253,"journal":{"name":"Applied AI letters","volume":"4 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ail2.87","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139005506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied AI letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1