This paper presents a novel algorithm for parameter estimation specifically designed for non-Gaussian structured discrete data, aiming to construct accurate and generalizable representations of spatially intelligent information. Traditional approaches for such data typically rely on the maximum likelihood criterion or its equivalent Kullback–Leibler divergence criterion to form the objective function. However, these methods do not provide an explicit generalization mechanism to effectively guide parameter estimation. Furthermore, gradient-based methods commonly employ stochastic gradient descent, which requires inverse function reparameterization when handling complex functional distributions such as the Dirichlet distribution, resulting in high computational complexity. To address these challenges, the proposed algorithm introduces an iterative framework that alternates between free energy optimization and likelihood maximization, while simultaneously incorporating mutual information to enhance robustness and prevent overfitting. In the updating strategy, a differential method is employed to reparameterize the gradient directly, thereby avoiding inverse function calculations and reducing iteration time. Experimental validation is conducted on both discrete text datasets and synthetic datasets, with performance evaluated through clustering accuracy, comparative analyses with alternative algorithms, and ablation studies. Results demonstrate that the proposed method achieves superior generalization ability and more efficient parameter iteration compared with conventional techniques.
扫码关注我们
求助内容:
应助结果提醒方式:
