Computational Intelligence最新文献

Labeling fine-grained objects manually is extremely challenging, as it is not only label-intensive but also requires professional knowledge. Accordingly, robust learning methods for fine-grained recognition with web images collected from Internet of Things have drawn significant attention. However, training deep fine-grained models directly using untrusted web images is confronted by two primary obstacles: (1) label noise in web images and (2) domain variance between the online sources and test datasets. To this end, in this study, we mainly focus on addressing these two pivotal problems associated with untrusted web images. To be specific, we introduce an end-to-end network that collaboratively addresses these concerns in the process of separating trusted data from untrusted web images. To validate the efficacy of our proposed model, untrusted web images are first collected by utilizing the text category labels found within fine-grained datasets. Subsequently, we employ the designed deep model to eliminate label noise and ameliorate domain mismatch. And the chosen trusted web data are utilized for model training. Comprehensive experiments and ablation studies validate that our method consistently surpasses other state-of-the-art approaches for fine-grained recognition tasks in real-world scenarios, demonstrating a significant improvement margin (2.51% on CUB200-2011 and 2.92% on Stanford Dogs). The source code and models can be accessed at: https://github.com/Codeczh/FGVC-IoT.

With the proliferation of digital devices in internet of things (IoT) environment featuring advanced visual capabilities, the task of Image Source Identification (ISI) has become increasingly vital for legal purposes, ensuring the verification of image authenticity and integrity, as well as identifying the device responsible for capturing the original scene. Over the past few decades, researchers have employed both traditional and machine-learning methods to classify image sources. In the current landscape, data-driven approaches leveraging deep learning models have emerged as powerful tools for achieving higher accuracy and precision in source prediction. The primary focus of this research is to address the complexities arising from diverse image sources and variable quality in IoT-generated multimedia data. To achieve this, a Hybrid Data Fusion Approach is introduced, leveraging multiple sources of information to bolster the accuracy and robustness of ISI. This fusion methodology integrates diverse data streams from IoT devices, including metadata, sensor information, and contextual data, amalgamating them into a comprehensive data set for analysis. This study introduces an innovative approach to ISI through the implementation of a Twin Convolutional Neural Network Architecture (TCA) aimed at enhancing the efficacy of source classification. In TCA, the first CNN architecture, referred to as DnCNN, is employed to eliminate noise from the original data set, generating 256 × 256 patches for both training and testing. Subsequently, the second CNN architecture is employed to classify images based on features extracted from various convolutional layers using a 3 × 3 filter, thereby enhancing prediction efficiency. The proposed model demonstrates exceptional accuracy in effectively classifying image sources, showcasing its potential as a robust solution in the realm of ISI.

The analysis of sentiments and mining of opinions have become more and more important in years because of the development of social media technologies. The methods that utilize natural language processing and lexicon-based sentiment analysis techniques to analyze people's opinions in texts require the proper extraction of sentiment words to ensure accuracy. The current issue is tackled with a novel perspective in this paper by introducing a hybrid sentiment analysis technique. This technique brings together Convolutional Neural Network (CNN) and Hidden Markov Models (HMMs), to accurately categorize text data and pinpoint feelings. The proposed method involves 1D convolutional-layer CNN to extract hidden features from comments and applying HMMs on a feature-sentence matrix, allowing for the utilization of word sequences in extracting opinions. The method effectively captures diverse text patterns by extracting a range of features from texts using CNN. Text patterns are learned using text HMM by calculating the probabilities between sequences of feature vectors and clustering feature vectors. The paper's experimental evaluation employs benchmark datasets such as CR, MR, Subj, and SST2, demonstrating that the proposed method surpasses existing sentiment analysis techniques and traditional HMMs. One of its strengths is to analyze a range of text patterns and identify crucial features that recognize the emotion of different pieces of a sentence. Additionally, the research findings highlight the improved performance of sentiment analysis tasks through the strategic use of zero padding in conjunction with the masking technique.

The existing YOLOv5-based framework has achieved great success in the field of target detection. However, in forest fire detection tasks, there are few high-quality forest fire images available, and the performance of the YOLO model has suffered a serious decline in detecting small-scale forest fires. Making full use of context information can effectively improve the performance of small target detection. To this end, this paper proposes a new graph-embedded YOLOv5 forest fire detection framework, which can improve the performance of small-scale forest fire detection using different scales of context information. To mine local context information, we design a spatial graph convolution operation based on the message passing neural network (MPNN) mechanism. To utilize global context information, we introduce a multi-head self-attention (MSA) module before each YOLO head. The experimental results on FLAME and our self-built fire dataset show that our proposed model improves the accuracy of small-scale forest fire detection. The proposed model achieves high performance in real-time performance by fully utilizing the advantages of the YOLOv5 framework.

In recent years, the application of traditional deep learning methods in the agricultural field using remote sensing techniques, such as crop area and growth monitoring, crop classification, and agricultural disaster monitoring, has been greatly facilitated by advancements in deep learning. The accuracy of image classification plays a crucial role in these applications. Although traditional deep learning methods have achieved significant success in remote sensing image classification, they often involve convolutional neural networks with a large number of parameters that require extensive optimization using numerous remote sensing images for training purposes. To address these challenges, we propose a novel approach called multiscale attention network (MAN) for sample-based remote sensing image classification. This method consists primarily of feature extractors and attention modules to effectively utilize different scale features through multiscale feature training during the training phase. We evaluate our proposed method on three datasets comprising agricultural remote sensing images and observe superior performance compared to existing approaches. Furthermore, we validate its generalizability by testing it on an oil well indicator diagram specifically designed for classification tasks.

Power line inspection is an important means to eliminate hidden dangers of power lines. It is a difficult research problem how to solve the low accuracy of power line inspection based on deep neural network (DNN) due to the problems of multi-view-shape, small-size object. In this paper, an automatic detection model based on Feature visual clustering network (FVCNet) for power line inspection is established. First, an unsupervised clustering method for power line inspection is proposed, and applied to construct a detection model which can recognize multi-view-shape objects and enhanced object features. Then, the bilinear interpolation method is used to Feature enhancement method, and the enhanced high-level semantics and low-level semantics are fused to solve the problems of small object size and single sample. In this paper, FVCNet is applied to the MS-COCO 2017 data set and self-made power line inspection data set, and the test accuracy is increased to 61.2% and 82.0%, respectively. Compared with other models, especially for the categories that are greatly affected by multi-view-shape, the test accuracy has been improved significantly.

Visual question answering (VQA) is a challenging task in computer vision. Recently, there has been a growing interest in text-based VQA tasks, emphasizing the important role of textual information for better understanding of images. Effectively utilizing text information within the image is crucial for achieving success in this task. However, existing approaches often overlook the contextual information and neglect to utilize the relationships between scene-text tokens and image objects. They simply incorporate the scene-text tokens mined from the image into the VQA model without considering these important factors. In this paper, the proposed model initially analyzes the image to extract text and identify scene objects. It then comprehends the question and mines relationships among the question, OCRed text, and scene objects, ultimately generating an answer through relational reasoning by conducting semantic and positional attention. Our decoder with attention map loss enables prediction of complex answers and handles dynamic vocabularies, reducing decoding space. It outperforms softmax-based cross entropy loss in accuracy and efficiency by accommodating varying vocabulary sizes. We evaluated our model's performance on the TextVQA dataset and achieved an accuracy of 53.91% on the validation set and 53.98% on the test set. Moreover, on the ST-VQA dataset, our model obtained ANLS scores of 0.699 on the validation set and 0.692 on the test set.

Recently, graph neural networks (GNNs) have attracted much attention in the field of machine learning due to their remarkable success in learning from graph-structured data. However, implementing GNNs in practice faces a critical bottleneck from the high complexity of communication and computation, which arises from the frequent exchange of graphic data during model training, especially in limited communication scenarios. To address this issue, we propose a novel framework of federated graph neural networks, where multiple mobile users collaboratively train the global model of graph neural networks in a federated way. The utilization of federated learning into the training of graph neural networks can help reduce the communication overhead of the system and protect the data privacy of local users. In addition, the federated training can help reduce the system computational complexity significantly. We further introduce a greedy-based user selection for the federated graph neural networks, where the wireless bandwidth is dynamically allocated among users to encourage more users to attend the federated training of neural networks. We perform the convergence analysis on the federated training of neural networks, in order to obtain some more insights on the impact of critical parameters on the system design. Finally, we perform the simulations on the coriolis ocean for reAnalysis (CORA) dataset and show the advantages of the proposed method in this paper.

In this paper, a hybrid blockchain-based authentication scheme is proposed that provides the mechanism to authenticate the randomly distributed sensor IoTs. These nodes are divided into three types: ordinary nodes, cluster heads and sink nodes. For authentication of these nodes in a Wireless Sensor IoTs (WSIoTs), a hybrid blockchain model is introduced. It consists of both private and public blockchains, which are used to authenticate ordinary nodes and cluster heads, respectively. Moreover, to handle the issue of cluster head failure due to inefficient energy consumption, Improved Heterogeneous Gateway-based Energy-Aware Multi-hop Routing (I-HMGEAR) protocol is proposed in combination with blockchain. It provides a mechanism to efficiently use the overall energy of the network. Besides, the processed data of subnetworks is stored on blockchain that causes the issue of increased monetary cost. To solve this issue, an external platform known as InterPlanetary File System (IPFS) is used, which distributively stores the data on different devices. The simulation results show that our proposed model outperforms existing clustering scheme in terms of network lifetime and data storage cost of the WSIoTs. Our proposed scheme increases the lifetime of the network as compared to existing trust management model, intrusion prevention and multi WSN authentication schemes by 17.5%, 24.2% and 19.6%, respectively.

Although the Internet of Things (IoT) has been considered one of the most promising technologies to automate various daily life activities, that is, monitoring and prediction, it has become extremely useful for problem solving with the introduction and integration of artificial intelligence (AI)-enabled smart learning methodologies. Therefore, due to their overwhelming characteristics, AI-enabled IoTs have been used in different application environments, such as agriculture, where detection, prevention (if possible), and prediction of crop diseases, especially at the earliest possible stage, are desperately required. Bacterial stalk root is a common disease of tomatoes that severely affects its production and yield if necessary measures are not taken. In this article, AI and an IoT-enabled decision support system (DSS) have been developed to predict the possible occurrence of bacterial stalk root diseases through a sophisticated technological infrastructure. For this purpose, Arduino agricultural boards, preferably with necessary embedded sensors, are deployed in the agricultural field of maize crops to capture valuable data at a certain time interval and send it to a centralized module where AI-based DSS, which is trained on an equally similar data set, is implemented to thoroughly examine captured data values for the possible occurrence of the disease. Additionally, the proposed AI- and IoT-enabled DSS has been tested on benchmark data sets, that is, freely available online, along with real-time captured data sets. Both experimental and simulation results show that the proposed scheme has achieved the highest accuracy level in timely prediction of the underlined disease. Finally, maize crop plots with the proposed system have significantly increased the yield (production) ratio of crops.