首页 > 最新文献

Entropy最新文献

英文 中文
Advanced Exergy-Based Analysis of an Organic Rankine Cycle (ORC) for Waste Heat Recovery. 用于废热回收的有机朗肯循环(ORC)的高级基于火用的分析。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-23 DOI: 10.3390/e25101475
Zineb Fergani, Tatiana Morosuk

In this study, advanced exergy and exergoeconomic analysis are applied to an Organic Rankine Cycle (ORC) for waste heat recovery to identify the potential for thermodynamic and economic improvement of the system (splitting the decision variables into avoidable/unavoidable parts) and the interdependencies between the components (endogenous and exogenous parts). For the first time, the advanced analysis has been applied under different conditions: constant heat rate supplied to the ORC or constant power generated by the ORC. The system simulation was performed in Matlab. The results show that the interactions among components of the ORC system are not strong; therefore, the approach of component-by-component optimization can be applied. The evaporator and condenser are important components to be improved from both thermodynamic and cost perspectives. The advanced exergoeconomic (graphical) optimization of these components indicates that the minimum temperature difference in the evaporator should be increased while the minimum temperature difference in the condenser should be decreased. The optimization results show that the exergetic efficiency of the ORC system can be improved from 27.1% to 27.7%, while the cost of generated electricity decreased from 18.14 USD/GJ to 18.09 USD/GJ.

在本研究中,将先进的(火用)和消耗经济分析应用于废热回收的有机朗肯循环(ORC),以确定系统热力学和经济改进的潜力(将决策变量划分为可避免/不可避免的部分)以及各组成部分(内生和外生部分)之间的相互依赖性。高级分析首次在不同条件下应用:向ORC提供恒定的热耗率或ORC产生的恒定功率。在Matlab中进行了系统仿真。结果表明,ORC系统各组成部分之间的相互作用不强;因此,可以应用逐部件优化的方法。从热力学和成本角度来看,蒸发器和冷凝器都是需要改进的重要部件。这些部件的先进的经济性(图形)优化表明,蒸发器中的最小温差应该增加,而冷凝器中的最小温度差应该减小。优化结果表明,ORC系统的运行效率从27.1%提高到27.7%,发电成本从18.14美元/吉焦降低到18.09美元/吉吉焦。
{"title":"Advanced Exergy-Based Analysis of an Organic Rankine Cycle (ORC) for Waste Heat Recovery.","authors":"Zineb Fergani,&nbsp;Tatiana Morosuk","doi":"10.3390/e25101475","DOIUrl":"10.3390/e25101475","url":null,"abstract":"<p><p>In this study, advanced exergy and exergoeconomic analysis are applied to an Organic Rankine Cycle (ORC) for waste heat recovery to identify the potential for thermodynamic and economic improvement of the system (splitting the decision variables into avoidable/unavoidable parts) and the interdependencies between the components (endogenous and exogenous parts). For the first time, the advanced analysis has been applied under different conditions: constant heat rate supplied to the ORC or constant power generated by the ORC. The system simulation was performed in Matlab. The results show that the interactions among components of the ORC system are not strong; therefore, the approach of component-by-component optimization can be applied. The evaporator and condenser are important components to be improved from both thermodynamic and cost perspectives. The advanced exergoeconomic (graphical) optimization of these components indicates that the minimum temperature difference in the evaporator should be increased while the minimum temperature difference in the condenser should be decreased. The optimization results show that the exergetic efficiency of the ORC system can be improved from 27.1% to 27.7%, while the cost of generated electricity decreased from 18.14 USD/GJ to 18.09 USD/GJ.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606046/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gaussian and Lerch Models for Unimodal Time Series Forcasting. 用于单模态时间序列预测的高斯和Lerch模型。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-22 DOI: 10.3390/e25101474
Azzouz Dermoune, Daoud Ounaissi, Yousri Slaoui
We consider unimodal time series forecasting. We propose Gaussian and Lerch models for this forecasting problem. The Gaussian model depends on three parameters and the Lerch model depends on four parameters. We estimate the unknown parameters by minimizing the sum of the absolute values of the residuals. We solve these minimizations with and without a weighted median and we compare both approaches. As a numerical application, we consider the daily infections of COVID-19 in China using the Gaussian and Lerch models. We derive a confident interval for the daily infections from each local minima.
我们考虑单峰时间序列预测。我们为这个预测问题提出了高斯和勒奇模型。高斯模型依赖于三个参数,勒奇模型依赖于四个参数。我们通过最小化残差的绝对值之和来估计未知参数。我们在有加权中值和没有加权中值的情况下求解这些极小值,并比较这两种方法。作为一个数值应用,我们使用高斯和勒奇模型来考虑中国新冠肺炎的每日感染。我们从每个局部极小值推导出每日感染的置信区间。
{"title":"Gaussian and Lerch Models for Unimodal Time Series Forcasting.","authors":"Azzouz Dermoune,&nbsp;Daoud Ounaissi,&nbsp;Yousri Slaoui","doi":"10.3390/e25101474","DOIUrl":"10.3390/e25101474","url":null,"abstract":"We consider unimodal time series forecasting. We propose Gaussian and Lerch models for this forecasting problem. The Gaussian model depends on three parameters and the Lerch model depends on four parameters. We estimate the unknown parameters by minimizing the sum of the absolute values of the residuals. We solve these minimizations with and without a weighted median and we compare both approaches. As a numerical application, we consider the daily infections of COVID-19 in China using the Gaussian and Lerch models. We derive a confident interval for the daily infections from each local minima.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606826/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
New Construction of Asynchronous Channel Hopping Sequences in Cognitive Radio Networks. 认知无线电网络中异步信道跳变序列的新构造。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-22 DOI: 10.3390/e25101473
Yaoxuan Wang, Xianhua Niu, Chao Qi, Zhihang He, Bosen Zeng

The channel-hopping-based rendezvous is essential to alleviate the problem of under-utilization and scarcity of the spectrum in cognitive radio networks. It dynamically allows unlicensed secondary users to schedule rendezvous channels using the assigned hopping sequence to guarantee the self-organization property in a limited time. In this paper, we use the interleaving technique to cleverly construct a set of asynchronous channel-hopping sequences consisting of d sequences of period xN2 with flexible parameters, which can generate sequences of different lengths. By this advantage, the new designed CHSs can be used to adapt to the demands of various communication scenarios. Furthermore, we focus on the improved maximum-time-to-rendezvous and maximum-first-time-to-rendezvous performance of the new construction compared to the prior research at the same sequence length. The new channel-hopping sequences ensure that rendezvous occurs between any two sequences and the rendezvous times are random and unpredictable when using licensed channels under asynchronous access, although the full degree-of-rendezvous is not satisfied. Our simulation results show that the new construction is more balanced and unpredictable between the maximum-time-to-rendezvous and the mean and variance of time-to-rendezvous.

基于信道跳变的交会对于缓解认知无线电网络中频谱利用不足和稀缺的问题至关重要。它动态地允许未授权的二次用户使用指定的跳变序列来调度会合信道,以保证在有限的时间内的自组织特性。在本文中,我们使用交织技术巧妙地构造了一组异步跳频序列,该序列由具有灵活参数的周期为xN2的d个序列组成,可以生成不同长度的序列。利用这一优势,新设计的CHS可以适应各种通信场景的需求。此外,我们还重点研究了在相同序列长度下,与先前的研究相比,新结构的最大交会时间和最大首次交会时间性能的改进。新的信道跳变序列确保了在任意两个序列之间发生交会,并且在异步接入下使用许可信道时,尽管不能满足完全的交会度,但交会时间是随机和不可预测的。我们的仿真结果表明,新结构在最大交会时间与交会时间的平均值和方差之间更加平衡和不可预测。
{"title":"New Construction of Asynchronous Channel Hopping Sequences in Cognitive Radio Networks.","authors":"Yaoxuan Wang,&nbsp;Xianhua Niu,&nbsp;Chao Qi,&nbsp;Zhihang He,&nbsp;Bosen Zeng","doi":"10.3390/e25101473","DOIUrl":"10.3390/e25101473","url":null,"abstract":"<p><p>The channel-hopping-based rendezvous is essential to alleviate the problem of under-utilization and scarcity of the spectrum in cognitive radio networks. It dynamically allows unlicensed secondary users to schedule rendezvous channels using the assigned hopping sequence to guarantee the self-organization property in a limited time. In this paper, we use the interleaving technique to cleverly construct a set of asynchronous channel-hopping sequences consisting of <i>d</i> sequences of period xN2 with flexible parameters, which can generate sequences of different lengths. By this advantage, the new designed CHSs can be used to adapt to the demands of various communication scenarios. Furthermore, we focus on the improved maximum-time-to-rendezvous and maximum-first-time-to-rendezvous performance of the new construction compared to the prior research at the same sequence length. The new channel-hopping sequences ensure that rendezvous occurs between any two sequences and the rendezvous times are random and unpredictable when using licensed channels under asynchronous access, although the full degree-of-rendezvous is not satisfied. Our simulation results show that the new construction is more balanced and unpredictable between the maximum-time-to-rendezvous and the mean and variance of time-to-rendezvous.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606140/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TURBO: The Swiss Knife of Auto-Encoders. TURBO:自动编码器的瑞士刀。
IF 2.1 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-21 DOI: 10.3390/e25101471
Guillaume Quétant, Yury Belousov, Vitaliy Kinakh, Slava Voloshynovskiy

We present a novel information-theoretic framework, termed as TURBO, designed to systematically analyse and generalise auto-encoding methods. We start by examining the principles of information bottleneck and bottleneck-based networks in the auto-encoding setting and identifying their inherent limitations, which become more prominent for data with multiple relevant, physics-related representations. The TURBO framework is then introduced, providing a comprehensive derivation of its core concept consisting of the maximisation of mutual information between various data representations expressed in two directions reflecting the information flows. We illustrate that numerous prevalent neural network models are encompassed within this framework. The paper underscores the insufficiency of the information bottleneck concept in elucidating all such models, thereby establishing TURBO as a preferable theoretical reference. The introduction of TURBO contributes to a richer understanding of data representation and the structure of neural network models, enabling more efficient and versatile applications.

我们提出了一个新的信息论框架,称为TURBO,旨在系统地分析和推广自动编码方法。我们首先研究了自动编码设置中的信息瓶颈和基于瓶颈的网络的原理,并确定了它们的固有局限性,这些局限性对于具有多个相关物理相关表示的数据来说变得更加突出。然后引入了TURBO框架,对其核心概念进行了全面的推导,包括在反映信息流的两个方向上表达的各种数据表示之间的相互信息的最大化。我们说明了许多流行的神经网络模型包含在这个框架中。本文强调了信息瓶颈概念在阐明所有这些模型方面的不足,从而将TURBO作为一个较好的理论参考。TURBO的引入有助于更丰富地理解数据表示和神经网络模型的结构,从而实现更高效、更通用的应用。
{"title":"TURBO: The Swiss Knife of Auto-Encoders.","authors":"Guillaume Quétant, Yury Belousov, Vitaliy Kinakh, Slava Voloshynovskiy","doi":"10.3390/e25101471","DOIUrl":"10.3390/e25101471","url":null,"abstract":"<p><p>We present a novel information-theoretic framework, termed as TURBO, designed to systematically analyse and generalise auto-encoding methods. We start by examining the principles of information bottleneck and bottleneck-based networks in the auto-encoding setting and identifying their inherent limitations, which become more prominent for data with multiple relevant, physics-related representations. The TURBO framework is then introduced, providing a comprehensive derivation of its core concept consisting of the maximisation of mutual information between various data representations expressed in two directions reflecting the information flows. We illustrate that numerous prevalent neural network models are encompassed within this framework. The paper underscores the insufficiency of the information bottleneck concept in elucidating all such models, thereby establishing TURBO as a preferable theoretical reference. The introduction of TURBO contributes to a richer understanding of data representation and the structure of neural network models, enabling more efficient and versatile applications.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.1,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606332/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561680","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Convolutional Models with Multi-Feature Fusion for Effective Link Prediction in Knowledge Graph Embedding. 知识图嵌入中用于有效链接预测的多特征融合卷积模型。
IF 2.1 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-21 DOI: 10.3390/e25101472
Qinglang Guo, Yong Liao, Zhe Li, Hui Lin, Shenglin Liang

Link prediction remains paramount in knowledge graph embedding (KGE), aiming to discern obscured or non-manifest relationships within a given knowledge graph (KG). Despite the critical nature of this endeavor, contemporary methodologies grapple with notable constraints, predominantly in terms of computational overhead and the intricacy of encapsulating multifaceted relationships. This paper introduces a sophisticated approach that amalgamates convolutional operators with pertinent graph structural information. By meticulously integrating information pertinent to entities and their immediate relational neighbors, we enhance the performance of the convolutional model, culminating in an averaged embedding ensuing from the convolution across entities and their proximal nodes. Significantly, our methodology presents a distinctive avenue, facilitating the inclusion of edge-specific data into the convolutional model's input, thus endowing users with the latitude to calibrate the model's architecture and parameters congruent with their specific dataset. Empirical evaluations underscore the ascendancy of our proposition over extant convolution-based link prediction benchmarks, particularly evident across the FB15k, WN18, and YAGO3-10 datasets. The primary objective of this research lies in forging KGE link prediction methodologies imbued with heightened efficiency and adeptness, thereby addressing salient challenges inherent to real-world applications.

链接预测在知识图嵌入(KGE)中仍然至关重要,旨在识别给定知识图(KG)中模糊或不明显的关系。尽管这项工作具有关键性,但当代方法论仍在努力克服显著的限制,主要是在计算开销和封装多方面关系的复杂性方面。本文介绍了一种复杂的方法,将卷积算子与相关的图结构信息相结合。通过仔细集成与实体及其直接关系邻居相关的信息,我们增强了卷积模型的性能,最终实现了实体及其近端节点之间卷积的平均嵌入。值得注意的是,我们的方法提供了一种独特的途径,有助于将边缘特定数据纳入卷积模型的输入,从而赋予用户校准与其特定数据集一致的模型架构和参数的自由度。经验评估强调了我们的主张相对于现有的基于卷积的链接预测基准的优势,在FB15k、WN18和YAGO3-10数据集中尤为明显。这项研究的主要目标是打造高效和熟练的KGE链路预测方法,从而解决现实应用中固有的突出挑战。
{"title":"Convolutional Models with Multi-Feature Fusion for Effective Link Prediction in Knowledge Graph Embedding.","authors":"Qinglang Guo, Yong Liao, Zhe Li, Hui Lin, Shenglin Liang","doi":"10.3390/e25101472","DOIUrl":"10.3390/e25101472","url":null,"abstract":"<p><p>Link prediction remains paramount in knowledge graph embedding (KGE), aiming to discern obscured or non-manifest relationships within a given knowledge graph (KG). Despite the critical nature of this endeavor, contemporary methodologies grapple with notable constraints, predominantly in terms of computational overhead and the intricacy of encapsulating multifaceted relationships. This paper introduces a sophisticated approach that amalgamates convolutional operators with pertinent graph structural information. By meticulously integrating information pertinent to entities and their immediate relational neighbors, we enhance the performance of the convolutional model, culminating in an averaged embedding ensuing from the convolution across entities and their proximal nodes. Significantly, our methodology presents a distinctive avenue, facilitating the inclusion of edge-specific data into the convolutional model's input, thus endowing users with the latitude to calibrate the model's architecture and parameters congruent with their specific dataset. Empirical evaluations underscore the ascendancy of our proposition over extant convolution-based link prediction benchmarks, particularly evident across the FB15k, WN18, and YAGO3-10 datasets. The primary objective of this research lies in forging KGE link prediction methodologies imbued with heightened efficiency and adeptness, thereby addressing salient challenges inherent to real-world applications.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.1,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606879/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic Semi-Supervised Federated Learning Fault Diagnosis Method Based on an Attention Mechanism. 基于注意力机制的动态半监督联合学习故障诊断方法。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-21 DOI: 10.3390/e25101470
Shun Liu, Funa Zhou, Shanjie Tang, Xiong Hu, Chaoge Wang, Tianzhen Wang

In cases where a client suffers from completely unlabeled data, unsupervised learning has difficulty achieving an accurate fault diagnosis. Semi-supervised federated learning with the ability for interaction between a labeled client and an unlabeled client has been developed to overcome this difficulty. However, the existing semi-supervised federated learning methods may lead to a negative transfer problem since they fail to filter out unreliable model information from the unlabeled client. Therefore, in this study, a dynamic semi-supervised federated learning fault diagnosis method with an attention mechanism (SSFL-ATT) is proposed to prevent the federation model from experiencing negative transfer. A federation strategy driven by an attention mechanism was designed to filter out the unreliable information hidden in the local model. SSFL-ATT can ensure the federation model's performance as well as render the unlabeled client capable of fault classification. In cases where there is an unlabeled client, compared to the existing semi-supervised federated learning methods, SSFL-ATT can achieve increments of 9.06% and 12.53% in fault diagnosis accuracy when datasets provided by Case Western Reserve University and Shanghai Maritime University, respectively, are used for verification.

在客户端遭受完全未标记数据的情况下,无监督学习难以实现准确的故障诊断。为了克服这一困难,已经开发了具有标记客户端和未标记客户端之间交互能力的半监督联合学习。然而,现有的半监督联合学习方法可能会导致负迁移问题,因为它们无法从未标记的客户端中过滤出不可靠的模型信息。因此,在本研究中,提出了一种具有注意力机制的动态半监督联邦学习故障诊断方法(SSFL-ATT),以防止联邦模型经历负迁移。设计了一种由注意力机制驱动的联邦策略来过滤隐藏在局部模型中的不可靠信息。SSLL-ATT可以确保联邦模型的性能,并使未标记的客户端能够进行故障分类。在存在未标记客户端的情况下,与现有的半监督联合学习方法相比,当分别使用凯斯西储大学和上海海事大学提供的数据集进行验证时,SSLL-ATT可以实现9.06%和12.53%的故障诊断准确率增量。
{"title":"Dynamic Semi-Supervised Federated Learning Fault Diagnosis Method Based on an Attention Mechanism.","authors":"Shun Liu,&nbsp;Funa Zhou,&nbsp;Shanjie Tang,&nbsp;Xiong Hu,&nbsp;Chaoge Wang,&nbsp;Tianzhen Wang","doi":"10.3390/e25101470","DOIUrl":"10.3390/e25101470","url":null,"abstract":"<p><p>In cases where a client suffers from completely unlabeled data, unsupervised learning has difficulty achieving an accurate fault diagnosis. Semi-supervised federated learning with the ability for interaction between a labeled client and an unlabeled client has been developed to overcome this difficulty. However, the existing semi-supervised federated learning methods may lead to a negative transfer problem since they fail to filter out unreliable model information from the unlabeled client. Therefore, in this study, a dynamic semi-supervised federated learning fault diagnosis method with an attention mechanism (SSFL-ATT) is proposed to prevent the federation model from experiencing negative transfer. A federation strategy driven by an attention mechanism was designed to filter out the unreliable information hidden in the local model. SSFL-ATT can ensure the federation model's performance as well as render the unlabeled client capable of fault classification. In cases where there is an unlabeled client, compared to the existing semi-supervised federated learning methods, SSFL-ATT can achieve increments of 9.06% and 12.53% in fault diagnosis accuracy when datasets provided by Case Western Reserve University and Shanghai Maritime University, respectively, are used for verification.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606357/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Diffusion Probabilistic Modeling for Video Generation. 视频生成的扩散概率建模。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-20 DOI: 10.3390/e25101469
Ruihan Yang, Prakhar Srivastava, Stephan Mandt

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual and probabilistic forecasting metrics. We propose an autoregressive, end-to-end optimized video diffusion model inspired by recent advances in neural video compression. The model successively generates future frames by correcting a deterministic next-frame prediction using a stochastic residual generated by an inverse diffusion process. We compare this approach against six baselines on four datasets involving natural and simulation-based videos. We find significant improvements in terms of perceptual quality and probabilistic frame forecasting ability for all datasets.

去噪扩散概率模型是一类很有前途的新生成模型,它标志着高质量图像生成的一个里程碑。本文展示了他们顺序生成视频的能力,在感知和概率预测指标方面超过了以前的方法。受神经视频压缩最新进展的启发,我们提出了一种自回归、端到端优化的视频扩散模型。该模型通过使用由逆扩散过程生成的随机残差来校正确定性下一帧预测,从而连续地生成未来帧。我们将这种方法与四个数据集上的六个基线进行了比较,这些数据集涉及自然和基于模拟的视频。我们发现所有数据集在感知质量和概率帧预测能力方面都有显著改进。
{"title":"Diffusion Probabilistic Modeling for Video Generation.","authors":"Ruihan Yang,&nbsp;Prakhar Srivastava,&nbsp;Stephan Mandt","doi":"10.3390/e25101469","DOIUrl":"10.3390/e25101469","url":null,"abstract":"<p><p>Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual and probabilistic forecasting metrics. We propose an autoregressive, end-to-end optimized video diffusion model inspired by recent advances in neural video compression. The model successively generates future frames by correcting a deterministic next-frame prediction using a stochastic residual generated by an inverse diffusion process. We compare this approach against six baselines on four datasets involving natural and simulation-based videos. We find significant improvements in terms of perceptual quality and probabilistic frame forecasting ability for all datasets.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606505/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 114
Variational Inference via Rényi Bound Optimization and Multiple-Source Adaptation. 基于Rényi界优化和多源自适应的变分推理。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-20 DOI: 10.3390/e25101468
Dana Zalman Oshri, Shai Fine

Variational inference provides a way to approximate probability densities through optimization. It does so by optimizing an upper or a lower bound of the likelihood of the observed data (the evidence). The classic variational inference approach suggests maximizing the Evidence Lower Bound (ELBO). Recent studies proposed to optimize the variational Rényi bound (VR) and the χ upper bound. However, these estimates, which are based on the Monte Carlo (MC) approximation, either underestimate the bound or exhibit a high variance. In this work, we introduce a new upper bound, termed the Variational Rényi Log Upper bound (VRLU), which is based on the existing VR bound. In contrast to the existing VR bound, the MC approximation of the VRLU bound maintains the upper bound property. Furthermore, we devise a (sandwiched) upper-lower bound variational inference method, termed the Variational Rényi Sandwich (VRS), to jointly optimize the upper and lower bounds. We present a set of experiments, designed to evaluate the new VRLU bound and to compare the VRS method with the classic Variational Autoencoder (VAE) and the VR methods. Next, we apply the VRS approximation to the Multiple-Source Adaptation problem (MSA). MSA is a real-world scenario where data are collected from multiple sources that differ from one another by their probability distribution over the input space. The main aim is to combine fairly accurate predictive models from these sources and create an accurate model for new, mixed target domains. However, many domain adaptation methods assume prior knowledge of the data distribution in the source domains. In this work, we apply the suggested VRS density estimate to the Multiple-Source Adaptation problem (MSA) and show, both theoretically and empirically, that it provides tighter error bounds and improved performance, compared to leading MSA methods.

变分推理提供了一种通过优化来近似概率密度的方法。它通过优化观测数据(证据)的可能性的上限或下限来做到这一点。经典的变分推理方法建议最大化证据下界(ELBO)。最近的研究提出优化变分Rényi界(VR)和χ上界。然而,这些基于蒙特卡罗(MC)近似的估计要么低估了界,要么表现出高方差。在这项工作中,我们引入了一个新的上界,称为变分Rényi对数上界(VRLU),它是基于现有的VR界。与现有的VR界相比,VRLU界的MC近似保持了上界性质。此外,我们设计了一种(夹层)上下界变分推理方法,称为变分Rényi三明治(VRS),以联合优化上下界。我们提出了一组实验,旨在评估新的VRLU界,并将VRS方法与经典的变分自动编码器(VAE)和VR方法进行比较。接下来,我们将VRS近似应用于多源自适应问题(MSA)。MSA是一种真实世界的场景,其中数据是从多个源收集的,这些源在输入空间上的概率分布彼此不同。主要目的是将这些来源的相当准确的预测模型结合起来,为新的混合目标领域创建一个准确的模型。然而,许多领域自适应方法都假定对源领域中的数据分布有先验知识。在这项工作中,我们将建议的VRS密度估计应用于多源自适应问题(MSA),并从理论和经验上表明,与领先的MSA方法相比,它提供了更严格的误差边界和改进的性能。
{"title":"Variational Inference via Rényi Bound Optimization and Multiple-Source Adaptation.","authors":"Dana Zalman Oshri,&nbsp;Shai Fine","doi":"10.3390/e25101468","DOIUrl":"10.3390/e25101468","url":null,"abstract":"<p><p>Variational inference provides a way to approximate probability densities through optimization. It does so by optimizing an upper or a lower bound of the likelihood of the observed data (the evidence). The classic variational inference approach suggests maximizing the Evidence Lower Bound (ELBO). Recent studies proposed to optimize the variational Rényi bound (VR) and the χ upper bound. However, these estimates, which are based on the Monte Carlo (MC) approximation, either underestimate the bound or exhibit a high variance. In this work, we introduce a new upper bound, termed the Variational Rényi Log Upper bound (VRLU), which is based on the existing VR bound. In contrast to the existing VR bound, the MC approximation of the VRLU bound maintains the upper bound property. Furthermore, we devise a (sandwiched) upper-lower bound variational inference method, termed the Variational Rényi Sandwich (VRS), to jointly optimize the upper and lower bounds. We present a set of experiments, designed to evaluate the new VRLU bound and to compare the VRS method with the classic Variational Autoencoder (VAE) and the VR methods. Next, we apply the VRS approximation to the Multiple-Source Adaptation problem (MSA). MSA is a real-world scenario where data are collected from multiple sources that differ from one another by their probability distribution over the input space. The main aim is to combine fairly accurate predictive models from these sources and create an accurate model for new, mixed target domains. However, many domain adaptation methods assume prior knowledge of the data distribution in the source domains. In this work, we apply the suggested VRS density estimate to the Multiple-Source Adaptation problem (MSA) and show, both theoretically and empirically, that it provides tighter error bounds and improved performance, compared to leading MSA methods.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606691/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Denoising Vanilla Autoencoder for RGB and GS Images with Gaussian Noise. 高斯噪声下RGB和GS图像去噪香草自动编码器。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-20 DOI: 10.3390/e25101467
Armando Adrián Miranda-González, Alberto Jorge Rosales-Silva, Dante Mújica-Vargas, Ponciano Jorge Escamilla-Ambrosio, Francisco Javier Gallegos-Funes, Jean Marie Vianney-Kinani, Erick Velázquez-Lozada, Luis Manuel Pérez-Hernández, Lucero Verónica Lozano-Vázquez

Noise suppression algorithms have been used in various tasks such as computer vision, industrial inspection, and video surveillance, among others. The robust image processing systems need to be fed with images closer to a real scene; however, sometimes, due to external factors, the data that represent the image captured are altered, which is translated into a loss of information. In this way, there are required procedures to recover data information closest to the real scene. This research project proposes a Denoising Vanilla Autoencoding (DVA) architecture by means of unsupervised neural networks for Gaussian denoising in color and grayscale images. The methodology improves other state-of-the-art architectures by means of objective numerical results. Additionally, a validation set and a high-resolution noisy image set are used, which reveal that our proposal outperforms other types of neural networks responsible for suppressing noise in images.

噪声抑制算法已被用于各种任务,如计算机视觉、工业检测和视频监控等。鲁棒的图像处理系统需要提供更接近真实场景的图像;然而,有时,由于外部因素,表示所捕获图像的数据会发生更改,这会转化为信息丢失。通过这种方式,需要恢复最接近真实场景的数据信息的过程。该研究项目通过无监督神经网络提出了一种去噪香草自动编码(DVA)架构,用于彩色和灰度图像的高斯去噪。该方法通过客观的数值结果改进了其他最先进的体系结构。此外,使用了一个验证集和一个高分辨率噪声图像集,这表明我们的建议优于其他类型的负责抑制图像中噪声的神经网络。
{"title":"Denoising Vanilla Autoencoder for RGB and GS Images with Gaussian Noise.","authors":"Armando Adrián Miranda-González,&nbsp;Alberto Jorge Rosales-Silva,&nbsp;Dante Mújica-Vargas,&nbsp;Ponciano Jorge Escamilla-Ambrosio,&nbsp;Francisco Javier Gallegos-Funes,&nbsp;Jean Marie Vianney-Kinani,&nbsp;Erick Velázquez-Lozada,&nbsp;Luis Manuel Pérez-Hernández,&nbsp;Lucero Verónica Lozano-Vázquez","doi":"10.3390/e25101467","DOIUrl":"10.3390/e25101467","url":null,"abstract":"<p><p>Noise suppression algorithms have been used in various tasks such as computer vision, industrial inspection, and video surveillance, among others. The robust image processing systems need to be fed with images closer to a real scene; however, sometimes, due to external factors, the data that represent the image captured are altered, which is translated into a loss of information. In this way, there are required procedures to recover data information closest to the real scene. This research project proposes a Denoising Vanilla Autoencoding (<i>DVA</i>) architecture by means of unsupervised neural networks for Gaussian denoising in color and grayscale images. The methodology improves other state-of-the-art architectures by means of objective numerical results. Additionally, a validation set and a high-resolution noisy image set are used, which reveal that our proposal outperforms other types of neural networks responsible for suppressing noise in images.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606544/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantifying Soil Complexity Using Fisher Shannon Method on 3D X-ray Computed Tomography Scans. 在三维X射线计算机断层扫描中使用Fisher Shannon方法量化土壤复杂性。
IF 2.7 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY Pub Date : 2023-10-19 DOI: 10.3390/e25101465
Domingos Aguiar, Rômulo Simões Cezar Menezes, Antonio Celso Dantas Antonino, Tatijana Stosic, Ana M Tarquis, Borko Stosic

The conversion of native forest into agricultural land, which is common in many parts of the world, poses important questions regarding soil degradation, demanding further efforts to better understand the effect of land use change on soil functions. With the advent of 3D computed tomography techniques and computing power, new methods are becoming available to address this question. In this direction, in the current work we implement a modification of the Fisher-Shannon method, borrowed from information theory, to quantify the complexity of twelve 3D CT soil samples from a sugarcane plantation and twelve samples from a nearby native Atlantic forest in northeastern Brazil. The distinction found between the samples from the sugar plantation and the Atlantic forest site is quite pronounced. The results at the level of 91.7% accuracy were obtained considering the complexity in the Fisher-Shannon plane. Atlantic forest samples are found to be generally more complex than those from the sugar plantation.

将原生森林转变为农业用地在世界许多地方很常见,这对土壤退化提出了重要问题,要求进一步努力更好地了解土地利用变化对土壤功能的影响。随着3D计算机断层扫描技术和计算能力的出现,解决这个问题的新方法正在变得可用。在这个方向上,在目前的工作中,我们借鉴信息理论,对Fisher Shannon方法进行了修改,以量化来自甘蔗种植园的12个3D CT土壤样本和来自巴西东北部附近大西洋原生森林的12个样本的复杂性。在甘蔗种植园和大西洋森林遗址的样本之间发现的差异非常明显。考虑到费雪-香农平面的复杂性,获得了91.7%准确率的结果。大西洋森林样本通常比甘蔗种植园的样本更复杂。
{"title":"Quantifying Soil Complexity Using Fisher Shannon Method on 3D X-ray Computed Tomography Scans.","authors":"Domingos Aguiar,&nbsp;Rômulo Simões Cezar Menezes,&nbsp;Antonio Celso Dantas Antonino,&nbsp;Tatijana Stosic,&nbsp;Ana M Tarquis,&nbsp;Borko Stosic","doi":"10.3390/e25101465","DOIUrl":"10.3390/e25101465","url":null,"abstract":"<p><p>The conversion of native forest into agricultural land, which is common in many parts of the world, poses important questions regarding soil degradation, demanding further efforts to better understand the effect of land use change on soil functions. With the advent of 3D computed tomography techniques and computing power, new methods are becoming available to address this question. In this direction, in the current work we implement a modification of the Fisher-Shannon method, borrowed from information theory, to quantify the complexity of twelve 3D CT soil samples from a sugarcane plantation and twelve samples from a nearby native Atlantic forest in northeastern Brazil. The distinction found between the samples from the sugar plantation and the Atlantic forest site is quite pronounced. The results at the level of 91.7% accuracy were obtained considering the complexity in the Fisher-Shannon plane. Atlantic forest samples are found to be generally more complex than those from the sugar plantation.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"25 10","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10606068/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61561656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Entropy
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1