Muhammad Hanif Tunio , Jian ping Li , Xiaoyang Zeng , Awais Ahmed , Syed Attique Shah , Hisam-Uddin Shaikh , Ghulam Ali Mallah , Imam Abdullahi Yahya
{"title":"推进植物病害分类:利用变压器融合卷积和瓦瑟斯坦域自适应的稳健通用方法","authors":"Muhammad Hanif Tunio , Jian ping Li , Xiaoyang Zeng , Awais Ahmed , Syed Attique Shah , Hisam-Uddin Shaikh , Ghulam Ali Mallah , Imam Abdullahi Yahya","doi":"10.1016/j.compag.2024.109574","DOIUrl":null,"url":null,"abstract":"<div><div>Plant diseases pose significant threats to agricultural productivity and food security. Owing to a scarcity of field environment datasets, the prevailing plant disease classification approaches, trained on laboratory-controlled datasets, often grapple with achieving optimal performance in real-world environments. We proposed a novel and robust framework for Unsupervised Domain Adaptation (UDA), employing an adversarial learning approach with a Wasserstein distance-informed algorithm to learn domain invariant feature representations capable of generalizing more diverse features. This approach incorporates insights from a labeled source domain and adopts an unlabeled target domain by minimizing the distribution discrepancies between domains. Recently, mobile vision transformer (MViT)-based methods have been applied to UDA due to their ability to capture long-distance feature dependencies. However, these methods overlook the fact that MViT lacks effectiveness in extracting local feature details. The proposed framework combines the advantages of convolutional neural networks (CNNs) and MViTs, integrating local features extracted by CNNs with global features captured by MViTs. This fusion of local and global representations enhances transferability and feature discriminability within the domains. Furthermore, we incorporate a feature-fusing method to align channel dimensions and enhance the local details of the global representation. Extensive experiments using three plant disease datasets demonstrate the effectiveness and efficiency of our approach, yielding significant improvements in classification performance with 13.67%, compared to state-of-the-art (SOTA) and baseline methods. Our framework offers a promising solution for robust and efficient plant disease classification, providing valuable insights for sustainable agriculture and crop management.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109574"},"PeriodicalIF":7.7000,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Advancing plant disease classification: A robust and generalized approach with transformer-fused convolution and Wasserstein domain adaptation\",\"authors\":\"Muhammad Hanif Tunio , Jian ping Li , Xiaoyang Zeng , Awais Ahmed , Syed Attique Shah , Hisam-Uddin Shaikh , Ghulam Ali Mallah , Imam Abdullahi Yahya\",\"doi\":\"10.1016/j.compag.2024.109574\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Plant diseases pose significant threats to agricultural productivity and food security. Owing to a scarcity of field environment datasets, the prevailing plant disease classification approaches, trained on laboratory-controlled datasets, often grapple with achieving optimal performance in real-world environments. We proposed a novel and robust framework for Unsupervised Domain Adaptation (UDA), employing an adversarial learning approach with a Wasserstein distance-informed algorithm to learn domain invariant feature representations capable of generalizing more diverse features. This approach incorporates insights from a labeled source domain and adopts an unlabeled target domain by minimizing the distribution discrepancies between domains. Recently, mobile vision transformer (MViT)-based methods have been applied to UDA due to their ability to capture long-distance feature dependencies. However, these methods overlook the fact that MViT lacks effectiveness in extracting local feature details. The proposed framework combines the advantages of convolutional neural networks (CNNs) and MViTs, integrating local features extracted by CNNs with global features captured by MViTs. This fusion of local and global representations enhances transferability and feature discriminability within the domains. Furthermore, we incorporate a feature-fusing method to align channel dimensions and enhance the local details of the global representation. Extensive experiments using three plant disease datasets demonstrate the effectiveness and efficiency of our approach, yielding significant improvements in classification performance with 13.67%, compared to state-of-the-art (SOTA) and baseline methods. Our framework offers a promising solution for robust and efficient plant disease classification, providing valuable insights for sustainable agriculture and crop management.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"227 \",\"pages\":\"Article 109574\"},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2024-11-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169924009657\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924009657","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Advancing plant disease classification: A robust and generalized approach with transformer-fused convolution and Wasserstein domain adaptation
Plant diseases pose significant threats to agricultural productivity and food security. Owing to a scarcity of field environment datasets, the prevailing plant disease classification approaches, trained on laboratory-controlled datasets, often grapple with achieving optimal performance in real-world environments. We proposed a novel and robust framework for Unsupervised Domain Adaptation (UDA), employing an adversarial learning approach with a Wasserstein distance-informed algorithm to learn domain invariant feature representations capable of generalizing more diverse features. This approach incorporates insights from a labeled source domain and adopts an unlabeled target domain by minimizing the distribution discrepancies between domains. Recently, mobile vision transformer (MViT)-based methods have been applied to UDA due to their ability to capture long-distance feature dependencies. However, these methods overlook the fact that MViT lacks effectiveness in extracting local feature details. The proposed framework combines the advantages of convolutional neural networks (CNNs) and MViTs, integrating local features extracted by CNNs with global features captured by MViTs. This fusion of local and global representations enhances transferability and feature discriminability within the domains. Furthermore, we incorporate a feature-fusing method to align channel dimensions and enhance the local details of the global representation. Extensive experiments using three plant disease datasets demonstrate the effectiveness and efficiency of our approach, yielding significant improvements in classification performance with 13.67%, compared to state-of-the-art (SOTA) and baseline methods. Our framework offers a promising solution for robust and efficient plant disease classification, providing valuable insights for sustainable agriculture and crop management.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.