基于Jensen-Shannon散度的连续范围序列分析方法

IF 1.2 Q3 PHYSICS, MULTIDISCIPLINARY Papers in Physics Pub Date : 2021-02-05 DOI:10.4279/PIP.130001

M. Ré, G. G. A. Varela

{"title":"基于Jensen-Shannon散度的连续范围序列分析方法","authors":"M. Ré, G. G. A. Varela","doi":"10.4279/PIP.130001","DOIUrl":null,"url":null,"abstract":"Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the continuous type. However, MI estimation between a discrete range data set and a continuous range data set has not received so much attention. We therefore present here a method for the estimation of MI for this case, based on the kernel density approximation. This calculation may be of interest in diverse contexts. Since MI is closely related to the Jensen Shannon divergence, the method developed here is of particular interest in the problems of sequence segmentation and set comparisons.","PeriodicalId":19791,"journal":{"name":"Papers in Physics","volume":null,"pages":null},"PeriodicalIF":1.2000,"publicationDate":"2021-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A method for continuous-range sequence analysis with Jensen-Shannon divergence\",\"authors\":\"M. Ré, G. G. A. Varela\",\"doi\":\"10.4279/PIP.130001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the continuous type. However, MI estimation between a discrete range data set and a continuous range data set has not received so much attention. We therefore present here a method for the estimation of MI for this case, based on the kernel density approximation. This calculation may be of interest in diverse contexts. Since MI is closely related to the Jensen Shannon divergence, the method developed here is of particular interest in the problems of sequence segmentation and set comparisons.\",\"PeriodicalId\":19791,\"journal\":{\"name\":\"Papers in Physics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2021-02-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Papers in Physics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4279/PIP.130001\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"PHYSICS, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Papers in Physics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4279/PIP.130001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

摘要

互信息(MI)是一种有用的信息理论工具，用于识别数据集之间的相互依赖性。当两个数据集都是离散类型或两个数据集都是连续类型时，已经开发了几种估计MI的方法。然而，离散距离数据集和连续距离数据集之间的MI估计并没有受到如此多的关注。因此，我们在这里提出了一种基于核密度近似的估计这种情况下MI的方法。这种计算在不同的背景下可能会引起人们的兴趣。由于MI与Jensen Shannon散度密切相关，因此这里开发的方法对序列分割和集合比较问题特别感兴趣。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

A method for continuous-range sequence analysis with Jensen-Shannon divergence

Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the continuous type. However, MI estimation between a discrete range data set and a continuous range data set has not received so much attention. We therefore present here a method for the estimation of MI for this case, based on the kernel density approximation. This calculation may be of interest in diverse contexts. Since MI is closely related to the Jensen Shannon divergence, the method developed here is of particular interest in the problems of sequence segmentation and set comparisons.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Papers in Physics PHYSICS, MULTIDISCIPLINARY-

CiteScore

1.90

自引率

0.00%

发文量

期刊介绍： Papers in Physics publishes original research in all areas of physics and its interface with other subjects. The scope includes, but is not limited to, physics of particles and fields, condensed matter, relativity and gravitation, nuclear physics, physics of fluids, biophysics, econophysics, chemical physics, statistical mechanics, soft condensed matter, materials science, mathematical physics and general physics. Contributions in the areas of foundations of physics, history of physics and physics education are not considered for publication. Articles published in Papers in Physics contain substantial new results and ideas that advance the state of physics in a non-trivial way. Articles are strictly reviewed by specialists prior to publication. Papers in Physics highlights outstanding articles published in the journal through the Editors'' choice section. Papers in Physics offers two distinct editorial treatments to articles from which authors can choose. In Traditional Review, manuscripts are submitted to anonymous reviewers seeking constructive criticism and editors make a decision on whether publication is appropriate. In Open Review, manuscripts are sent to reviewers. If the paper is considered original and technically sound, the article, the reviewer''s comments and the author''s reply are published alongside the names of all involved. This way, Papers in Physics promotes the open discussion of controversies among specialists that are of help to the reader and to the transparency of the editorial process. Moreover, our reviewers receive their due recognition by publishing a recorded citable report. Papers in Physics publishes Commentaries from the reviewer(s) if major disagreements remain after exchange with the authors or if a different insight proposed is considered valuable for the readers.