{"title":"Stochastic complexities of hidden Markov models","authors":"Keisuke Yamazaki, Sumio Watanabe","doi":"10.1109/NNSP.2003.1318017","DOIUrl":null,"url":null,"abstract":"Hidden Markov models are now used in many fields, for example, speech recognition, natural language processing etc. However, the mathematical foundation of analysis for the models has not yet been constructed, since the HMMs are non-identifiable. In recent years, we have developed the algebraic geometrical method that allows us to analyze the non-regular and non-identifiable models. In this paper, we apply this method to the HMM and reveal the asymptotic order of its stochastic complexity in the mathematically rigorous way.","PeriodicalId":315958,"journal":{"name":"2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718)","volume":"398 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2003-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"16","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NNSP.2003.1318017","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 16
Abstract
Hidden Markov models are now used in many fields, for example, speech recognition, natural language processing etc. However, the mathematical foundation of analysis for the models has not yet been constructed, since the HMMs are non-identifiable. In recent years, we have developed the algebraic geometrical method that allows us to analyze the non-regular and non-identifiable models. In this paper, we apply this method to the HMM and reveal the asymptotic order of its stochastic complexity in the mathematically rigorous way.