J. Carruth, Maximilian F. Eggl, C. Fefferman, C. Rowley, Melanie Weber
{"title":"有界乘法后悔控制未知线性动力学","authors":"J. Carruth, Maximilian F. Eggl, C. Fefferman, C. Rowley, Melanie Weber","doi":"10.4171/rmi/1377","DOIUrl":null,"url":null,"abstract":"We consider a simple control problem in which the underlying dynamics depend on a parameter that is unknown and must be learned. We exhibit a control strategy which is optimal to within a multiplicative constant. While most authors find strategies which are successful as the time horizon tends to infinity, our strategy achieves lowest expected cost up to a constant factor for a fixed time horizon.","PeriodicalId":49604,"journal":{"name":"Revista Matematica Iberoamericana","volume":" ","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2021-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Controlling unknown linear dynamics with bounded multiplicative regret\",\"authors\":\"J. Carruth, Maximilian F. Eggl, C. Fefferman, C. Rowley, Melanie Weber\",\"doi\":\"10.4171/rmi/1377\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We consider a simple control problem in which the underlying dynamics depend on a parameter that is unknown and must be learned. We exhibit a control strategy which is optimal to within a multiplicative constant. While most authors find strategies which are successful as the time horizon tends to infinity, our strategy achieves lowest expected cost up to a constant factor for a fixed time horizon.\",\"PeriodicalId\":49604,\"journal\":{\"name\":\"Revista Matematica Iberoamericana\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2021-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Revista Matematica Iberoamericana\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.4171/rmi/1377\",\"RegionNum\":2,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Revista Matematica Iberoamericana","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.4171/rmi/1377","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS","Score":null,"Total":0}
Controlling unknown linear dynamics with bounded multiplicative regret
We consider a simple control problem in which the underlying dynamics depend on a parameter that is unknown and must be learned. We exhibit a control strategy which is optimal to within a multiplicative constant. While most authors find strategies which are successful as the time horizon tends to infinity, our strategy achieves lowest expected cost up to a constant factor for a fixed time horizon.
期刊介绍:
Revista Matemática Iberoamericana publishes original research articles on all areas of mathematics. Its distinguished Editorial Board selects papers according to the highest standards. Founded in 1985, Revista is a scientific journal of Real Sociedad Matemática Española.