Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang
{"title":"迈向零射频放大器建模:通过音调嵌入控制进行一对多放大器建模","authors":"Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang","doi":"arxiv-2407.10646","DOIUrl":null,"url":null,"abstract":"Replicating analog device circuits through neural audio effect modeling has\ngarnered increasing interest in recent years. Existing work has predominantly\nfocused on a one-to-one emulation strategy, modeling specific devices\nindividually. In this paper, we tackle the less-explored scenario of\none-to-many emulation, utilizing conditioning mechanisms to emulate multiple\nguitar amplifiers through a single neural model. For condition representation,\nwe use contrastive learning to build a tone embedding encoder that extracts\nstyle-related features of various amplifiers, leveraging a dataset of\ncomprehensive amplifier settings. Targeting zero-shot application scenarios, we\nalso examine various strategies for tone embedding representation, evaluating\nreferenced tone embedding against two retrieval-based embedding methods for\namplifiers unseen in the training time. Our findings showcase the efficacy and\npotential of the proposed methods in achieving versatile one-to-many amplifier\nmodeling, contributing a foundational step towards zero-shot audio modeling\napplications.","PeriodicalId":501178,"journal":{"name":"arXiv - CS - Sound","volume":"30 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control\",\"authors\":\"Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang\",\"doi\":\"arxiv-2407.10646\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Replicating analog device circuits through neural audio effect modeling has\\ngarnered increasing interest in recent years. Existing work has predominantly\\nfocused on a one-to-one emulation strategy, modeling specific devices\\nindividually. In this paper, we tackle the less-explored scenario of\\none-to-many emulation, utilizing conditioning mechanisms to emulate multiple\\nguitar amplifiers through a single neural model. For condition representation,\\nwe use contrastive learning to build a tone embedding encoder that extracts\\nstyle-related features of various amplifiers, leveraging a dataset of\\ncomprehensive amplifier settings. Targeting zero-shot application scenarios, we\\nalso examine various strategies for tone embedding representation, evaluating\\nreferenced tone embedding against two retrieval-based embedding methods for\\namplifiers unseen in the training time. Our findings showcase the efficacy and\\npotential of the proposed methods in achieving versatile one-to-many amplifier\\nmodeling, contributing a foundational step towards zero-shot audio modeling\\napplications.\",\"PeriodicalId\":501178,\"journal\":{\"name\":\"arXiv - CS - Sound\",\"volume\":\"30 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Sound\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.10646\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Sound","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.10646","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control
Replicating analog device circuits through neural audio effect modeling has
garnered increasing interest in recent years. Existing work has predominantly
focused on a one-to-one emulation strategy, modeling specific devices
individually. In this paper, we tackle the less-explored scenario of
one-to-many emulation, utilizing conditioning mechanisms to emulate multiple
guitar amplifiers through a single neural model. For condition representation,
we use contrastive learning to build a tone embedding encoder that extracts
style-related features of various amplifiers, leveraging a dataset of
comprehensive amplifier settings. Targeting zero-shot application scenarios, we
also examine various strategies for tone embedding representation, evaluating
referenced tone embedding against two retrieval-based embedding methods for
amplifiers unseen in the training time. Our findings showcase the efficacy and
potential of the proposed methods in achieving versatile one-to-many amplifier
modeling, contributing a foundational step towards zero-shot audio modeling
applications.