{"title":"GFML:用于度量学习的重力函数","authors":"Hoyoon Byun , Sungjun Lim , Kyungwoo Song","doi":"10.1016/j.engappai.2024.109463","DOIUrl":null,"url":null,"abstract":"<div><div>Diverse machine learning algorithms rely on the distance metric to compare and aggregate the information. A metric learning algorithm that captures the relevance between two vectors plays a critical role in machine learning. Metric learning may become biased toward the major classes and not be robust to the minor ones, i.e., metric learning may be vulnerable in an imbalanced dataset. We propose a gravity function-based metric learning (GFML) that captures the relationship between vectors based on the gravity function. We formulate GFML with two terms, (1) mass of the given vectors and (2) distance between the query and key vector. Mass learns the importance of the object itself, enabling robust metric learning on imbalanced datasets. GFML is simple and scalable; therefore, it can be adopted in diverse tasks. We validate that GFML improves the recommender system and image classification.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GFML: Gravity function for metric learning\",\"authors\":\"Hoyoon Byun , Sungjun Lim , Kyungwoo Song\",\"doi\":\"10.1016/j.engappai.2024.109463\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Diverse machine learning algorithms rely on the distance metric to compare and aggregate the information. A metric learning algorithm that captures the relevance between two vectors plays a critical role in machine learning. Metric learning may become biased toward the major classes and not be robust to the minor ones, i.e., metric learning may be vulnerable in an imbalanced dataset. We propose a gravity function-based metric learning (GFML) that captures the relationship between vectors based on the gravity function. We formulate GFML with two terms, (1) mass of the given vectors and (2) distance between the query and key vector. Mass learns the importance of the object itself, enabling robust metric learning on imbalanced datasets. GFML is simple and scalable; therefore, it can be adopted in diverse tasks. We validate that GFML improves the recommender system and image classification.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S095219762401621X\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S095219762401621X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Diverse machine learning algorithms rely on the distance metric to compare and aggregate the information. A metric learning algorithm that captures the relevance between two vectors plays a critical role in machine learning. Metric learning may become biased toward the major classes and not be robust to the minor ones, i.e., metric learning may be vulnerable in an imbalanced dataset. We propose a gravity function-based metric learning (GFML) that captures the relationship between vectors based on the gravity function. We formulate GFML with two terms, (1) mass of the given vectors and (2) distance between the query and key vector. Mass learns the importance of the object itself, enabling robust metric learning on imbalanced datasets. GFML is simple and scalable; therefore, it can be adopted in diverse tasks. We validate that GFML improves the recommender system and image classification.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.