Pub Date : 2026-08-05DOI: 10.1109/TNNLS.2026.3718595
Yuanjing Wang, Yuhan Xie, Shuyu Chang, Haiping Huang, Minghui Yang
Accurate segmentation of intracranial arteries in digital subtraction angiography (DSA) sequences is critical for cerebrovascular diagnosis but remains challenging due to limited annotations and complex vascular structures. We propose the temporal-adaptive fusion (TAF)-Net, a semisupervised dual-path framework that integrates a vision foundation model, MedSAM, and a task-specific UNet to leverage anatomical priors and fine-grained vascular features. To address interframe inconsistency and vessel discontinuity, we introduce a TAF strategy that dynamically fuses model predictions based on framewise confidence and temporal priors. In addition, we design a spatiotemporal topology-aware loss to enforce structural continuity by penalizing critical disconnection components across frames. Extensive experiments on two public multiframe DSA datasets (DIAS and DSCA) demonstrate that the TAF-Net consistently outperforms state-of-the-art methods in both overlap accuracy (DSC, IoU) and topological integrity (Cost, 95HD), especially under low-label regimes.
{"title":"TAF-Net: Temporal-Adaptive Fusion Framework for Semisupervised Segmentation of Intracranial Arteries in DSA Sequences.","authors":"Yuanjing Wang, Yuhan Xie, Shuyu Chang, Haiping Huang, Minghui Yang","doi":"10.1109/TNNLS.2026.3718595","DOIUrl":"https://doi.org/10.1109/TNNLS.2026.3718595","url":null,"abstract":"<p><p>Accurate segmentation of intracranial arteries in digital subtraction angiography (DSA) sequences is critical for cerebrovascular diagnosis but remains challenging due to limited annotations and complex vascular structures. We propose the temporal-adaptive fusion (TAF)-Net, a semisupervised dual-path framework that integrates a vision foundation model, MedSAM, and a task-specific UNet to leverage anatomical priors and fine-grained vascular features. To address interframe inconsistency and vessel discontinuity, we introduce a TAF strategy that dynamically fuses model predictions based on framewise confidence and temporal priors. In addition, we design a spatiotemporal topology-aware loss to enforce structural continuity by penalizing critical disconnection components across frames. Extensive experiments on two public multiframe DSA datasets (DIAS and DSCA) demonstrate that the TAF-Net consistently outperforms state-of-the-art methods in both overlap accuracy (DSC, IoU) and topological integrity (Cost, 95HD), especially under low-label regimes.</p>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"PP ","pages":""},"PeriodicalIF":9.7,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148678556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Although existing bipartite graph-based multiview clustering (MVC) methods effectively exploit the structural relationships within multiview data, they exhibit three major limitations: 1) they primarily focus on direct similarities between data points and anchors, neglecting underlying neighborhood structures; 2) most existing methods fail to capture high-order correlations across bipartite graphs from different views; and 3) they overlook the relationships among anchor points, limiting the discriminative power of the learned graph. To address these challenges, we propose a unified framework, termed enhanced multiorder bipartite graph learning (EMOBGL) for MVC. The proposed EMOBGL method first constructs a second-order bipartite graph (SOBG) to capture both local and neighboring structural relationships between data points and anchors through first-order similarity (FOS) and second-order similarity (SOS). Then, the tensor Schatten- $p$ regularizer is incorporated to construct a multiorder bipartite graph (MOBG) to capture third-order similarity (TOS) across views. Meanwhile, the anchor structure regularization (ASR) is introduced to model anchor-anchor interactions, further enhancing the structural expressiveness and discriminability of the bipartite graph. The resulting EMOBGL model effectively integrates multiorder and multiview relationships within a unified framework, achieving robust and discriminative clustering performance. An efficient alternating direction method of multipliers (ADMMs) is developed to optimize the model, and we theoretically prove that the solution converges to a Karush-Kuhn-Tucker (KKT) stationary point. Extensive comparative experiments on 13 benchmark datasets demonstrate that the proposed EMOBGL consistently outperforms 13 state-of-the-art methods in both clustering accuracy and robustness. The source code is available at https://github.com/DongHuangTaiYi871/EMOBGL.
{"title":"Multiview Clustering via Enhanced Multiorder Bipartite Graph Learning.","authors":"Yang-Jun Deng, Wenhao Deng, Longfei Ren, Chenfeng Long, Leyuan Fang, Qian Du","doi":"10.1109/TNNLS.2026.3718273","DOIUrl":"https://doi.org/10.1109/TNNLS.2026.3718273","url":null,"abstract":"<p><p>Although existing bipartite graph-based multiview clustering (MVC) methods effectively exploit the structural relationships within multiview data, they exhibit three major limitations: 1) they primarily focus on direct similarities between data points and anchors, neglecting underlying neighborhood structures; 2) most existing methods fail to capture high-order correlations across bipartite graphs from different views; and 3) they overlook the relationships among anchor points, limiting the discriminative power of the learned graph. To address these challenges, we propose a unified framework, termed enhanced multiorder bipartite graph learning (EMOBGL) for MVC. The proposed EMOBGL method first constructs a second-order bipartite graph (SOBG) to capture both local and neighboring structural relationships between data points and anchors through first-order similarity (FOS) and second-order similarity (SOS). Then, the tensor Schatten- $p$ regularizer is incorporated to construct a multiorder bipartite graph (MOBG) to capture third-order similarity (TOS) across views. Meanwhile, the anchor structure regularization (ASR) is introduced to model anchor-anchor interactions, further enhancing the structural expressiveness and discriminability of the bipartite graph. The resulting EMOBGL model effectively integrates multiorder and multiview relationships within a unified framework, achieving robust and discriminative clustering performance. An efficient alternating direction method of multipliers (ADMMs) is developed to optimize the model, and we theoretically prove that the solution converges to a Karush-Kuhn-Tucker (KKT) stationary point. Extensive comparative experiments on 13 benchmark datasets demonstrate that the proposed EMOBGL consistently outperforms 13 state-of-the-art methods in both clustering accuracy and robustness. The source code is available at https://github.com/DongHuangTaiYi871/EMOBGL.</p>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"PP ","pages":""},"PeriodicalIF":9.7,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148678523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-04DOI: 10.1109/tnnls.2026.3717964
Qihai Jiang, Liangming Chen, Dalin Chen, Xiang Bai, Long Jin
{"title":"Minimizing Time Derivative of Loss for Efficient Generalization Enhancement With Applications to Nickel–Cobalt Alloy Defect Detection","authors":"Qihai Jiang, Liangming Chen, Dalin Chen, Xiang Bai, Long Jin","doi":"10.1109/tnnls.2026.3717964","DOIUrl":"https://doi.org/10.1109/tnnls.2026.3717964","url":null,"abstract":"","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"58 1","pages":""},"PeriodicalIF":10.4,"publicationDate":"2026-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148682293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-03DOI: 10.1109/TNNLS.2026.3696938
Dong Huang, Sheng-Yu Liu, Haiyan Wang
Multi-view clustering (MVC) has attracted significant attention in recent years due to its ability to leverage heterogeneous features from multiple views. However, existing methods often lack the ability to jointly model first-order and topological relationships, which is crucial for capturing a more comprehensive clustering structure. In this article, we propose a novel multi-view clustering method with hybrid-order similarity learning (MCHL), which integrates multiple view-specific graphs while considering their first-order and topological correlations, and iteratively learns the view weights and the consensus graph within a unified framework. In addition, we impose a connectivity constraint on the consensus graph to ensure that data points belonging to the same cluster are properly connected within the same component. Extensive experiments on multiple benchmark datasets demonstrate the superior clustering performance of MCHL over the state-of-the-art methods.
{"title":"Multi-View Clustering With Hybrid-Order Similarity Learning.","authors":"Dong Huang, Sheng-Yu Liu, Haiyan Wang","doi":"10.1109/TNNLS.2026.3696938","DOIUrl":"https://doi.org/10.1109/TNNLS.2026.3696938","url":null,"abstract":"<p><p>Multi-view clustering (MVC) has attracted significant attention in recent years due to its ability to leverage heterogeneous features from multiple views. However, existing methods often lack the ability to jointly model first-order and topological relationships, which is crucial for capturing a more comprehensive clustering structure. In this article, we propose a novel multi-view clustering method with hybrid-order similarity learning (MCHL), which integrates multiple view-specific graphs while considering their first-order and topological correlations, and iteratively learns the view weights and the consensus graph within a unified framework. In addition, we impose a connectivity constraint on the consensus graph to ensure that data points belonging to the same cluster are properly connected within the same component. Extensive experiments on multiple benchmark datasets demonstrate the superior clustering performance of MCHL over the state-of-the-art methods.</p>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"PP ","pages":""},"PeriodicalIF":9.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148669338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-03DOI: 10.1109/TNNLS.2026.3715245
Xihang Meng, Hao Peng, Guangjie Zeng, Li Sun, Zhifeng Hao, Philip S Yu
Directed hypergraphs have gained increasing attention for modeling group interactions while preserving directionality. However, link prediction in directed hypergraphs has rarely been studied despite its practical significance in complex systems analysis. Existing models perform poorly due to three major challenges in directed hypergraphs: 1) lacking effective feature initialization methods; 2) neglecting to detect higher order substructures; and 3) failing to capture long-range dependencies among vertices. To address these challenges, we propose a novel directed hypergraph motif-based neural network (DHMNN) for directed hyperlink prediction, which simultaneously captures higher order structural and connectivity information from the directed hypergraph topology. First, we introduce directed hypergraph motifs (DH-motifs) to explore higher order neighborhoods, analyzing vertex structural equivalence and generating structural features. Secondly, we utilize hypergraph incidence matrices to measure local connectivity, quantifying vertex co-occurrences and producing connectivity features. Then, we employ hypergraph attention to refine the vertex features at both global and local levels, further capturing long- and short-range dependencies. Finally, a new scoring layer is designed to assess the reliability of each link, considering its local properties, feature variance, and directionality. Extensive experiments on seven metabolic networks and three social networks demonstrate that DHMNN significantly and consistently outperforms state-of-the-art models, achieving a 3.40%-9.90% increase in accuracy. Our code is available at: https://github.com/XihangMeng/DHMNN.
{"title":"DHMNN: A Hypergraph Motif-Based Framework for Directed Hyperlink Prediction.","authors":"Xihang Meng, Hao Peng, Guangjie Zeng, Li Sun, Zhifeng Hao, Philip S Yu","doi":"10.1109/TNNLS.2026.3715245","DOIUrl":"https://doi.org/10.1109/TNNLS.2026.3715245","url":null,"abstract":"<p><p>Directed hypergraphs have gained increasing attention for modeling group interactions while preserving directionality. However, link prediction in directed hypergraphs has rarely been studied despite its practical significance in complex systems analysis. Existing models perform poorly due to three major challenges in directed hypergraphs: 1) lacking effective feature initialization methods; 2) neglecting to detect higher order substructures; and 3) failing to capture long-range dependencies among vertices. To address these challenges, we propose a novel directed hypergraph motif-based neural network (DHMNN) for directed hyperlink prediction, which simultaneously captures higher order structural and connectivity information from the directed hypergraph topology. First, we introduce directed hypergraph motifs (DH-motifs) to explore higher order neighborhoods, analyzing vertex structural equivalence and generating structural features. Secondly, we utilize hypergraph incidence matrices to measure local connectivity, quantifying vertex co-occurrences and producing connectivity features. Then, we employ hypergraph attention to refine the vertex features at both global and local levels, further capturing long- and short-range dependencies. Finally, a new scoring layer is designed to assess the reliability of each link, considering its local properties, feature variance, and directionality. Extensive experiments on seven metabolic networks and three social networks demonstrate that DHMNN significantly and consistently outperforms state-of-the-art models, achieving a 3.40%-9.90% increase in accuracy. Our code is available at: https://github.com/XihangMeng/DHMNN.</p>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"PP ","pages":""},"PeriodicalIF":9.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148669401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-03DOI: 10.1109/TNNLS.2026.3718377
Matteo Pinna, Andrea Ceni, Claudio Gallicchio
Echo state networks (ESNs) are a particular type of untrained recurrent neural networks (RNNs) within the reservoir computing (RC) framework, popular for their fast and efficient learning. However, traditional ESNs often struggle with long-term information processing. In this article, we introduce a novel class of deep untrained RNNs based on temporal residual connections, called deep residual ESNs (DeepResESNs). We show that leveraging a hierarchy of untrained residual recurrent layers significantly boosts memory capacity and long-term temporal modeling. For the temporal residual connections, we consider different orthogonal configurations, including randomly generated and fixed-structure, and study their effect on network dynamics. Athorough mathematical analysis outlines necessary and sufficient conditions to ensure stable dynamics within DeepResESN. Empirically, the proposed approach consistently outperforms traditional shallow and deep RC on a variety of time-series tasks. Overall, DeepResESN offers a promising approach for designing hierarchical ESNs with better prediction accuracy on long sequences, without sacrificing the computational advantages that make RC attractive.
{"title":"Deep Residual Echo State Networks: Exploring Residual Orthogonal Connections in Untrained Recurrent Neural Networks.","authors":"Matteo Pinna, Andrea Ceni, Claudio Gallicchio","doi":"10.1109/TNNLS.2026.3718377","DOIUrl":"https://doi.org/10.1109/TNNLS.2026.3718377","url":null,"abstract":"<p><p>Echo state networks (ESNs) are a particular type of untrained recurrent neural networks (RNNs) within the reservoir computing (RC) framework, popular for their fast and efficient learning. However, traditional ESNs often struggle with long-term information processing. In this article, we introduce a novel class of deep untrained RNNs based on temporal residual connections, called deep residual ESNs (DeepResESNs). We show that leveraging a hierarchy of untrained residual recurrent layers significantly boosts memory capacity and long-term temporal modeling. For the temporal residual connections, we consider different orthogonal configurations, including randomly generated and fixed-structure, and study their effect on network dynamics. Athorough mathematical analysis outlines necessary and sufficient conditions to ensure stable dynamics within DeepResESN. Empirically, the proposed approach consistently outperforms traditional shallow and deep RC on a variety of time-series tasks. Overall, DeepResESN offers a promising approach for designing hierarchical ESNs with better prediction accuracy on long sequences, without sacrificing the computational advantages that make RC attractive.</p>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"PP ","pages":""},"PeriodicalIF":9.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148669404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-01Epub Date: 2026-01-13DOI: 10.1109/TNNLS.2026.3651563
Junzhe Dang;Chengwang Guo;Mengmeng Zhang;Yuxiang Zhang;Wen Jia;Wei Li
To overcome the challenges posed by domain shift in hyperspectral image (HSI) classification, methods based on domain adaptation (DA) have been widely used. Currently, most HSI DA methods focus on designing complex strategies to align the distributions of the source domain (SD) and the target domain (TD) in the feature space after feature extraction, yielding promising results. However, when there exists a large domain shift between SD and TD, it becomes challenging to map them into the same feature space. In this article, we propose the bidirectional mamba and domain mixing network (BMDMnet). Since pure CNN architectures are constrained in local feature extraction, while transformer-based models improve global feature capturing capability at the cost of high computational complexity, we propose the bidirectional mamba module (BMM) as an efficient solution for capturing long-range dependencies. In addition, a self-distillation strategy is employed during training. By utilizing a more stable teacher model, reliable predictions can be obtained in the TD. Subsequently, a domain mixing supervised learning (DMSL) module is designed, which creates a mixed domain by selecting low-entropy sample-pseudo-label pairs from the TD and randomly combining them with sample-label pairs from the SD. DMSL aims to introduce mixed domain to mitigate the inter-domain gap in the data space, thereby enabling the model to learn TD representations more effectively. Experiments demonstrate that BMDMnet outperforms state-of-the-art algorithms across three cross-scene datasets.
{"title":"Cross-Scene Hyperspectral Image Classification via Bidirectional Mamba and Domain Mixing Network","authors":"Junzhe Dang;Chengwang Guo;Mengmeng Zhang;Yuxiang Zhang;Wen Jia;Wei Li","doi":"10.1109/TNNLS.2026.3651563","DOIUrl":"10.1109/TNNLS.2026.3651563","url":null,"abstract":"To overcome the challenges posed by domain shift in hyperspectral image (HSI) classification, methods based on domain adaptation (DA) have been widely used. Currently, most HSI DA methods focus on designing complex strategies to align the distributions of the source domain (SD) and the target domain (TD) in the feature space after feature extraction, yielding promising results. However, when there exists a large domain shift between SD and TD, it becomes challenging to map them into the same feature space. In this article, we propose the bidirectional mamba and domain mixing network (BMDMnet). Since pure CNN architectures are constrained in local feature extraction, while transformer-based models improve global feature capturing capability at the cost of high computational complexity, we propose the bidirectional mamba module (BMM) as an efficient solution for capturing long-range dependencies. In addition, a self-distillation strategy is employed during training. By utilizing a more stable teacher model, reliable predictions can be obtained in the TD. Subsequently, a domain mixing supervised learning (DMSL) module is designed, which creates a mixed domain by selecting low-entropy sample-pseudo-label pairs from the TD and randomly combining them with sample-label pairs from the SD. DMSL aims to introduce mixed domain to mitigate the inter-domain gap in the data space, thereby enabling the model to learn TD representations more effectively. Experiments demonstrate that BMDMnet outperforms state-of-the-art algorithms across three cross-scene datasets.","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"37 8","pages":"3618-3631"},"PeriodicalIF":9.7,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145961423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-01Epub Date: 2026-02-09DOI: 10.1109/TNNLS.2026.3656687
Zugang Chen;Haodong Wang;Jing Li;Guoqing Li;Shaohua Wang
Head direction perception is a fundamental ability that enables humans and animals to navigate and orient themselves effectively in natural environments. In the era of embodied intelligence and agent research, head direction perception has broad applications in robots, drones, autonomous vehicles, spacecraft, and so on. However, to the best of our knowledge, no models for head direction sensing, encoding, and perception have been developed so far. In this article, we proposed a new neural network system with a sensor–encoder– processor framework for the head direction perception task based on the findings of neuroscience research. The system contains a new signal perception (sensor) component which is an adaptive ring attractor network (RAN) that updates its synaptic weights via Hebbian learning rules, a new signal encoder that converts nerve impulse to sparse distributed representation vectors, and an central information processor which is a brain-inspired and low-energy consumption neural network—hierarchical temporal memory (HTM) model to receive the encoding and predict the head direction of the agent. At last, a simulated robot is created which is equipped with our sensing, encoding, and perception systems. After training the HTM network, our system achieves a prediction accuracy of 94.4% with a mean error of just 0.062—an order-of-magnitude improvement over existing models. The codes will be available from the website: https://github.com/czgbjy/HeadDirectionEncoding.git
{"title":"Egocentric Head Direction Encoding and Perception Model Based on an Adaptive Ring Attractor Network","authors":"Zugang Chen;Haodong Wang;Jing Li;Guoqing Li;Shaohua Wang","doi":"10.1109/TNNLS.2026.3656687","DOIUrl":"10.1109/TNNLS.2026.3656687","url":null,"abstract":"Head direction perception is a fundamental ability that enables humans and animals to navigate and orient themselves effectively in natural environments. In the era of embodied intelligence and agent research, head direction perception has broad applications in robots, drones, autonomous vehicles, spacecraft, and so on. However, to the best of our knowledge, no models for head direction sensing, encoding, and perception have been developed so far. In this article, we proposed a new neural network system with a sensor–encoder– processor framework for the head direction perception task based on the findings of neuroscience research. The system contains a new signal perception (sensor) component which is an adaptive ring attractor network (RAN) that updates its synaptic weights via Hebbian learning rules, a new signal encoder that converts nerve impulse to sparse distributed representation vectors, and an central information processor which is a brain-inspired and low-energy consumption neural network—hierarchical temporal memory (HTM) model to receive the encoding and predict the head direction of the agent. At last, a simulated robot is created which is equipped with our sensing, encoding, and perception systems. After training the HTM network, our system achieves a prediction accuracy of 94.4% with a mean error of just 0.062—an order-of-magnitude improvement over existing models. The codes will be available from the website: <uri>https://github.com/czgbjy/HeadDirectionEncoding.git</uri>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"37 8","pages":"3900-3912"},"PeriodicalIF":9.7,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11382033","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146149409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The importance of precise long-term forecasting in practical applications continues to rise. Extensive scenarios, including parking resource prediction and environmental quality monitoring, rely significantly on LSTF’s accurate spatio-temporal forecasting capabilities. This technology strengthens prediction effectiveness by combining interaction relationships between spatial-temporal dimensions with contextual data integration. Over time, graph neural networks (GNNs) have proven highly effective in capturing spatial interdependencies. Recent advances have introduced multi-GNNs (MGNNs), which incorporate more contextual insights to improve predictive accuracy. However, when MGNNs are applied to long-term spatio-temporal forecasting (LSTF), they encounter challenges such as limited generality, under-utilization of context, static graph merging methods, and overlooking dynamic interrelations. To address these issues, we propose novel graph structures that encode each node’s contextual information while fully exploiting long-term spatio-temporal dependencies. Furthermore, this research designs a dynamic multigraph fusion architecture that integrates spatial dimensions, temporal features, and graph attention mechanisms to simultaneously capture intragraph node correlations and cross-graph interactions. To strengthen relational analysis, trainable weight tensors are employed for quantitative evaluation of node importance across graphs. Systematic experiments on three large-scale benchmark datasets confirm that this approach achieves significant performance enhancement for existing GNNs in LSTF tasks.
{"title":"Heuristic Knowledge-Driven Spatio-Temporal Forecasting via Multigraph","authors":"Xiao Xiao;Xufeng Xiang;Xinyue Yang;Zhiling Jin;Jing Xu;Shuo Wang;Guoqiang Mao;Wei Shao","doi":"10.1109/TNNLS.2026.3656372","DOIUrl":"10.1109/TNNLS.2026.3656372","url":null,"abstract":"The importance of precise long-term forecasting in practical applications continues to rise. Extensive scenarios, including parking resource prediction and environmental quality monitoring, rely significantly on LSTF’s accurate spatio-temporal forecasting capabilities. This technology strengthens prediction effectiveness by combining interaction relationships between spatial-temporal dimensions with contextual data integration. Over time, graph neural networks (GNNs) have proven highly effective in capturing spatial interdependencies. Recent advances have introduced multi-GNNs (MGNNs), which incorporate more contextual insights to improve predictive accuracy. However, when MGNNs are applied to long-term spatio-temporal forecasting (LSTF), they encounter challenges such as limited generality, under-utilization of context, static graph merging methods, and overlooking dynamic interrelations. To address these issues, we propose novel graph structures that encode each node’s contextual information while fully exploiting long-term spatio-temporal dependencies. Furthermore, this research designs a dynamic multigraph fusion architecture that integrates spatial dimensions, temporal features, and graph attention mechanisms to simultaneously capture intragraph node correlations and cross-graph interactions. To strengthen relational analysis, trainable weight tensors are employed for quantitative evaluation of node importance across graphs. Systematic experiments on three large-scale benchmark datasets confirm that this approach achieves significant performance enhancement for existing GNNs in LSTF tasks.","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"37 8","pages":"3857-3871"},"PeriodicalIF":9.7,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147316697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-08-01Epub Date: 2026-02-06DOI: 10.1109/TNNLS.2026.3655172
Yiming Shi;Yujia Wu;Jiwei Wei;Ran Ran;Chengwei Sun;Shiyuan He;Yang Yang
The rapid growth of model scale has necessitated substantial computational resources for fine-tuning. Existing approach such as low-rank adaptation (LoRA) has sought to address the problem of handling the large updated parameters in full fine-tuning (FT). However, LoRA utilize random initialization and optimization of low-rank matrices to approximate updated weights, which can result in suboptimal convergence and an accuracy gap compared to full fine-tuning (FT). To address these issues, we propose low-rank LDU (LoLDU), a parameter-efficient fine-tuning (PEFT) approach that significantly reduces trainable parameters by 2600 times compared to regular PEFT methods while maintaining comparable performance. LoLDU leverages lower-diag-upper (LDU) decomposition to initialize low-rank matrices for faster convergence and nonsingularity. We focus on optimizing the diagonal matrix for scaling transformations. To the best of our knowledge, LoLDU has the fewest parameters among all PEFT approaches. We conducted extensive experiments across 4 instruction-following datasets, six natural language understanding (NLU) datasets, eight image classification datasets, and image generation datasets with multiple model types [LLaMA2, RoBERTa, ViT, and stable diffusion (SD)], providing a comprehensive and detailed analysis. Our open-source code can be accessed at https://anonymous.4open.science/r/LoLDU-B5A6
{"title":"LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning","authors":"Yiming Shi;Yujia Wu;Jiwei Wei;Ran Ran;Chengwei Sun;Shiyuan He;Yang Yang","doi":"10.1109/TNNLS.2026.3655172","DOIUrl":"10.1109/TNNLS.2026.3655172","url":null,"abstract":"The rapid growth of model scale has necessitated substantial computational resources for fine-tuning. Existing approach such as low-rank adaptation (LoRA) has sought to address the problem of handling the large updated parameters in full fine-tuning (FT). However, LoRA utilize random initialization and optimization of low-rank matrices to approximate updated weights, which can result in suboptimal convergence and an accuracy gap compared to full fine-tuning (FT). To address these issues, we propose low-rank LDU (LoLDU), a parameter-efficient fine-tuning (PEFT) approach that significantly reduces trainable parameters by 2600 times compared to regular PEFT methods while maintaining comparable performance. LoLDU leverages lower-diag-upper (LDU) decomposition to initialize low-rank matrices for faster convergence and nonsingularity. We focus on optimizing the diagonal matrix for scaling transformations. To the best of our knowledge, LoLDU has the fewest parameters among all PEFT approaches. We conducted extensive experiments across 4 instruction-following datasets, six natural language understanding (NLU) datasets, eight image classification datasets, and image generation datasets with multiple model types [LLaMA2, RoBERTa, ViT, and stable diffusion (SD)], providing a comprehensive and detailed analysis. Our open-source code can be accessed at <uri>https://anonymous.4open.science/r/LoLDU-B5A6</uri>","PeriodicalId":13303,"journal":{"name":"IEEE transactions on neural networks and learning systems","volume":"37 8","pages":"3755-3768"},"PeriodicalIF":9.7,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146131834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}