Generating Gradients in the Energy Landscape Using Rectified Linear Type Cost Functions for Efficiently Solving 0/1 Matrix Factorization in Simulated Annealing
{"title":"Generating Gradients in the Energy Landscape Using Rectified Linear Type Cost Functions for Efficiently Solving 0/1 Matrix Factorization in Simulated Annealing","authors":"Makiko Konoshima, Hirotaka Tamura, Yoshiyuki Kabashima","doi":"10.7566/jpsj.93.044002","DOIUrl":null,"url":null,"abstract":"The 0/1 matrix factorization defines matrix products using logical AND and OR as product-sum operators, revealing the factors influencing various decision processes. Instances and their characteristics are arranged in rows and columns. Formulating matrix factorization as an energy minimization problem and exploring it with Simulated Annealing (SA) theoretically enables finding a minimum solution in sufficient time. However, searching for the optimal solution in practical time becomes problematic when the energy landscape has many plateaus with flat slopes. In this work, we propose a method to facilitate the solution process by applying a gradient to the energy landscape, using a rectified linear type cost function readily available in modern annealing machines. We also propose a method to quickly obtain a solution by updating the cost function’s gradient during the search process. Numerical experiments were conducted, confirming the method’s effectiveness with both noise-free artificial and real data.","PeriodicalId":17304,"journal":{"name":"Journal of the Physical Society of Japan","volume":"83 1","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Physical Society of Japan","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.7566/jpsj.93.044002","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The 0/1 matrix factorization defines matrix products using logical AND and OR as product-sum operators, revealing the factors influencing various decision processes. Instances and their characteristics are arranged in rows and columns. Formulating matrix factorization as an energy minimization problem and exploring it with Simulated Annealing (SA) theoretically enables finding a minimum solution in sufficient time. However, searching for the optimal solution in practical time becomes problematic when the energy landscape has many plateaus with flat slopes. In this work, we propose a method to facilitate the solution process by applying a gradient to the energy landscape, using a rectified linear type cost function readily available in modern annealing machines. We also propose a method to quickly obtain a solution by updating the cost function’s gradient during the search process. Numerical experiments were conducted, confirming the method’s effectiveness with both noise-free artificial and real data.
0/1 矩阵因式分解使用逻辑 AND 和 OR 作为乘积和运算符定义矩阵乘积,揭示影响各种决策过程的因素。实例及其特征按行和列排列。将矩阵因式分解表述为能量最小化问题,并用模拟退火(SA)进行探索,理论上可以在足够的时间内找到最小解。然而,当能量景观中存在许多具有平缓斜坡的高原时,在实际时间内寻找最优解就成了问题。在这项工作中,我们提出了一种方法,利用现代退火机器中易于获得的整顿线性成本函数,通过对能量景观应用梯度来促进求解过程。我们还提出了一种方法,通过在搜索过程中更新代价函数的梯度来快速获得解。我们进行了数值实验,通过无噪声人工数据和真实数据证实了该方法的有效性。
期刊介绍:
The papers published in JPSJ should treat fundamental and novel problems of physics scientifically and logically, and contribute to the development in the understanding of physics. The concrete objects are listed below.
Subjects Covered
JPSJ covers all the fields of physics including (but not restricted to)
Elementary particles and fields
Nuclear physics
Atomic and Molecular Physics
Fluid Dynamics
Plasma physics
Physics of Condensed Matter
Metal, Superconductor, Semiconductor, Magnetic Materials, Dielectric Materials
Physics of Nanoscale Materials
Optics and Quantum Electronics
Physics of Complex Systems
Mathematical Physics
Chemical physics
Biophysics
Geophysics
Astrophysics.