Big Data Research最新文献

Anomaly-based Intrusion Detection is a key research topic in network security due to its ability to face unknown attacks and new security threats. For this reason, many works on the topic have been proposed in the last decade. Nonetheless, an ultimate solution, able to provide a high detection rate with an acceptable false alarm rate, has still to be identified. In the last years big research efforts have focused on the application of Deep Learning techniques to the field, but no work has been able, so far, to propose a system achieving good detection performance, while processing raw network traffic in real time. For this reason in the paper we propose an Intrusion Detection System that, leveraging on probabilistic data structures and Deep Learning techniques, is able to process in real time the traffic collected in a backbone network, offering excellent detection performance and low false alarm rate. Indeed, the extensive experimental tests, run to validate our system and compare different Deep Learning techniques, confirm that, with a proper parameter setting, we can achieve about 92% of detection rate, with an accuracy of 0.899. Finally, with minimal changes, the proposed system can provide some information about the kind of anomaly, although in the multi-class scenario the detection rate is slightly lower (around 86%).

This paper presents an integration visual navigation algorithm called PnP-ORBSLAM for UAV position estimation in Urban Air Mobility (UAM). ORBSLAM is a popular and benchmark algorithm for vision based navigation applications. The proposed method improve the performance of ORBSLAM by adding a post-processing marker recognition phase to the model. Based on the features extracted from the markers, PnP algorithm is introduced to estimate the position of the monocular camera. The position estimation accuracy of the UAV is supposed to be improved by adding the position information of the camera to the model. Experiment is carried out based on Airsim simulation platform. Results show that the PnP-ORBSLAM algorithm can improve the three-dimensional accuracy by a margin of 5.38 % compared with ORBSLAM. In addition, the process speed of the proposed method can reach about 28 frames per second. It means that the PnP-ORBSLAM algorithm can work in real-time.

The title (name) is the primary information related to a mobile (smartphone) application, as it describes its functions and services. An eye-catching title can entice customers to choose a certain application over others. Application development companies are well aware of this phenomenon and invest significant efforts in crafting their application titles with compelling keywords, phrases and topics in pursuit of higher installs. However, to the best of our knowledge, traditional literature that investigates the impact of application titles on success is limited. There may be only a few instances where scientific (data-analytical) approaches have been used to examine application titles. Moreover, these investigations of titles are dominated by supervised learning and traditional literature may lack any unsupervised (cluster) data analysis techniques to measure the impact of titles on application success. Therefore, this research work proposes an unsupervised data analysis approach based on multiple layers and algorithms. The initial layer clusters the application titles, the subsequent layer extracts various textual features from these clusters and the final layer refines the extracted attributes. In general, certain textual features in the titles are proven to be positively and negatively linked with the application installs. Verification of the results has confirmed that this proposed approach can successfully detect the most prominent features from application titles (textual data) that correlate with success.

The phenomenon of scholars switching their careers from academia to industry has become more prevalent nowadays. This paper proposes a combination approach of bibliometrics analysis and data mining to study the phenomenon from the perspective of Science of Science (SciSci). Based on the proposed methods, this paper first provides an overview of frequent companies and frequent universities as well as the exponentially increasing number of scholars under the scenario. And then, this study uncovers the excessively single patterns in South Korean scholars switches using frequent pattern mining from their papers. This paper studies the knowledge and technology transfer (KTT) and the research change of scholars by using the language model, the result of which illustrates that the research difference between industry and academia gradually decreases and reaches a steady state in recent years. In exploring the driving factors of the phenomenon, deep preliminary cooperation may be an essential reason, and the career switches will not promote the published amounts of papers but may benefit its academic influence. This study should, therefore, be of value to researchers wishing to study the academia-industry career switches more intensely.

A self supervised convolutional neural network-parallel extreme learning machine classification model based on big data is proposed to address the subjectivity and inaccuracy of traditional methods for identifying vegetation pests and diseases that rely on manual observation and empirical judgment. This model is constructed using convolutional neural networks and parallel extreme learning machines, and integrates feature extraction networks with dual attention mechanisms to improve the accuracy of identifying pests and diseases. The model utilized a large amount of big data for training, achieving a recall rate of 98.42 % on multispectral datasets, and an overall classification accuracy of 99.04 %. After optimizing the residual network, the overall accuracy of identifying vegetation pest and disease areas has been further improved to 99.77 %, and the recall rate has also reached 98.91 %. These results indicate that the method proposed in this study has high accuracy and efficiency in the application of big data, can meet the needs of disease and pest identification, and provides effective technical support for the monitoring and prevention of crop diseases and pests, which has important practical significance.

In the big data era, characterized by vast volumes of complex data, the efficiency of machine learning models is of utmost importance, particularly in the context of intelligent agriculture. Knowledge distillation (KD), a technique aimed at both model compression and performance enhancement, serves as a pivotal solution by distilling the knowledge from an elaborate model (teacher) to a lightweight, compact counterpart (student). However, the true potential of KD has not been fully explored. Existing approaches primarily focus on transferring instance-level information by big data technologies, overlooking the valuable information embedded in token-level relationships, which may be particularly affected by the long-tail effects. To address the above limitations, we propose a novel method called Knowledge Distillation with Token-level Relationship Graph (TRG) that leverages token-wise relationships to enhance the performance of knowledge distillation. By employing TRG, the student model can effectively emulate higher-level semantic information from the teacher model, resulting in improved performance and mobile-friendly efficiency. To further enhance the learning process, we introduce a dynamic temperature adjustment strategy, which encourages the student model to capture the topology structure of the teacher model more effectively. We conduct experiments to evaluate the effectiveness of the proposed method against several state-of-the-art approaches. Empirical results demonstrate the superiority of TRG across various visual tasks, including those involving imbalanced data. Our method consistently outperforms the existing baselines, establishing a new state-of-the-art performance in the field of KD based on big data technologies.

The event-based social network (EBSN) is a new type of social network that combines online and offline networks, and its primary goal is to recommend appropriate events to users. Most studies do not model event recommendations on the EBSN platform as graph representation learning, nor do they consider the implicit relationship between events, resulting in recommendations that are not accepted by users. Thus, we study graph representation learning, which integrates implicit relationships between social networks and events. First, we propose an algorithm that integrates implicit relationships between social networks and events based on a multiple attention model. The graph structure that integrates implicit relationships between social networks and events is divided into user modeling and event modeling: modeling the interactive information of user events, user social relationships, and implicit relationships between users in user modeling; modeling user information and implicit relationships between events in event modeling; and deeply mining high-level transfer relationships between users and events. Then, the user modeling and event modeling models are fused using a multiattention joint learning mechanism to capture the different impacts of social and implicit relationships on user preferences, improving the recommendation quality of the recommendation system. Finally, the effectiveness of the proposed algorithm is verified in real datasets.

This study extensively explores the intricate dynamics of the Bohai Sea ecosystem, a semi-closed marginal sea in China, influenced by both environmental complexity and human activities. By utilizing chlorophyll-a as an indicator, we closely examine how phytoplankton responds to coastal environmental conditions and stressors. The temporal analysis conducted over the 23-year period from 1998 to 2020 reveals a distinctive "bell-shaped" variation in chlorophyll-a concentration. Spatially, a declining trend is observed from coastal to central regions, characterized by widespread low-value areas. Employing M-K and slope trend analyses, we observe a 42.13 % decline in the northern Bohai Sea, contrasting with a significant 57.87 % increase in the central and southern regions. The innovative aspects of this research lie in identifying the complex interplay between chlorophyll-a concentration, human pollution controls, and nutrient inputs. Factors contributing to chlorophyll-a concentration, ranked by significance, include sea surface temperature, photosynthetically available radiation (PAR), and wind speed. Remarkably, the negligible impact of the "2015 Tianjin explosion" underscores the robustness of the Bohai Sea's chlorophyll-a dynamics. Furthermore, the positive correlation between phosphorus input and chlorophyll classifies Bohai Bay as a phosphorus-limited aquatic ecosystem. In conclusion, this study provides crucial insights for the preservation of the Bohai Sea ecosystem, emphasizing the necessity for ongoing monitoring and management strategies in the face of evolving environmental and anthropogenic influences.

The accurate and timely prediction of tropical cyclones is of paramount importance in mitigating the impact of these catastrophic meteorological events. Presently, methods for predicting tropical cyclones based on satellite remote sensing images encounter notable challenges, including the inadequate extraction of three-dimensional spatial features and limitations in long-term forecasting. As a response to these challenges, this study introduces the Temporal Attention Mechanism ConvLSTM (TAM-CL) model, designed to conduct thorough spatiotemporal feature extraction on three-dimensional atmospheric reanalysis data of tropical cyclones. By leveraging ConvLSTM with three-dimensional convolution kernels, our model enhances the extraction of three-dimensional spatiotemporal features. Furthermore, an attention mechanism is integrated to bolster long-term prediction accuracy by emphasizing crucial temporal nodes. In the evaluation of tropical cyclone track and intensity forecasts across 24, 48, and 72 h, TAM-CL demonstrates a notable reduction in prediction errors, thereby underscoring its efficacy in forecasting both cyclone tracks and intensities. This contributes to an effective exploration of the application of deep networks in conjunction with atmospheric reanalysis data.