{"title":"PlantView: Integrating deep learning with 3D modeling for indoor plant augmentation","authors":"Sitara Afzal, Haseeb Ali Khan, Jong Weon Lee","doi":"10.1016/j.ecoinf.2024.102899","DOIUrl":null,"url":null,"abstract":"<div><div>Indoor plant recognition poses significant challenges due to the variability in lighting conditions, plant species, and growth stages. Despite the growing interest in applying deep learning techniques to plant data, there still needs to be more research focused on the automatic recognition of indoor plant species, highlighting the need for real-time, automated solutions. To address this gap, this study introduces a novel approach for real-time identification and visualization of indoor plants using a Convolutional Neural Network (CNN)-based model called PlantView, integrated with Augmented Reality (AR) for enhanced user interaction. The proposed PlantView model not only accurately classifies the plant species but also visualizes them in a 3D AR environment, allowing users to interact with virtual plant models seamlessly integrated into their real-world surroundings. We developed a custom dataset comprising over 28,000 images of 48 different plant species at various growth stages, captured under diverse lighting conditions and camera settings. Our proposed approach achieves an impressive accuracy of 98.20 %. To validate the effectiveness of PlantView model, we conduct extensive experiments and compared its performance against state-of-the-art methods, demonstrating its superior accuracy and processing speed. The results indicate that our method is not only highly effective for real-time indoor plant recognition but also offers practical applications for enhancing indoor plant care and visualization. This research offers a comprehensive solution for indoor plant enthusiasts and professionals, combining advanced computer vision techniques with immersive AR visualization to revolutionize the way indoor plants are identified, visualized, and integrated into living spaces.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102899"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004412","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Indoor plant recognition poses significant challenges due to the variability in lighting conditions, plant species, and growth stages. Despite the growing interest in applying deep learning techniques to plant data, there still needs to be more research focused on the automatic recognition of indoor plant species, highlighting the need for real-time, automated solutions. To address this gap, this study introduces a novel approach for real-time identification and visualization of indoor plants using a Convolutional Neural Network (CNN)-based model called PlantView, integrated with Augmented Reality (AR) for enhanced user interaction. The proposed PlantView model not only accurately classifies the plant species but also visualizes them in a 3D AR environment, allowing users to interact with virtual plant models seamlessly integrated into their real-world surroundings. We developed a custom dataset comprising over 28,000 images of 48 different plant species at various growth stages, captured under diverse lighting conditions and camera settings. Our proposed approach achieves an impressive accuracy of 98.20 %. To validate the effectiveness of PlantView model, we conduct extensive experiments and compared its performance against state-of-the-art methods, demonstrating its superior accuracy and processing speed. The results indicate that our method is not only highly effective for real-time indoor plant recognition but also offers practical applications for enhancing indoor plant care and visualization. This research offers a comprehensive solution for indoor plant enthusiasts and professionals, combining advanced computer vision techniques with immersive AR visualization to revolutionize the way indoor plants are identified, visualized, and integrated into living spaces.
期刊介绍:
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.