Bartosz Biczuk, Sebastian Żurek, Szymon Jurga, Elżbieta Turska, Przemysław Guzik, Jarosław Piskorski
This study investigates whether heart rate asymmetry (HRA) parameters offer insights into sleep stages beyond those provided by conventional heart rate variability (HRV) and complexity measures. Utilizing 31 polysomnographic recordings, we focused exclusively on electrocardiogram (ECG) data, specifically the RR interval time series, to explore heart rate dynamics associated with different sleep stages. Employing both statistical techniques and machine learning models, with the Generalized Estimating Equation model as the foundational approach, we assessed the effectiveness of HRA in identifying and differentiating sleep stages and transitions. The models including asymmetric variables for detecting deep sleep stages, N2 and N3, achieved AUCs of 0.85 and 0.89, respectively, those for transitions N2-R, R-N2, i.e., falling in and out of REM sleep, achieved AUCs of 0.85 and 0.80, and those for W-N1, i.e., falling asleep, an AUC of 0.83. All these models were highly statistically significant. The findings demonstrate that HRA parameters provide significant, independent information about sleep stages that is not captured by HRV and complexity measures alone. This additional insight into sleep physiology potentially leads to a better understanding of hearth rhythm during sleep and devising more precise diagnostic tools, including cheap portable devices, for identifying sleep-related disorders.
{"title":"Sleep Stage Classification Through HRV, Complexity Measures, and Heart Rate Asymmetry Using Generalized Estimating Equations Models.","authors":"Bartosz Biczuk, Sebastian Żurek, Szymon Jurga, Elżbieta Turska, Przemysław Guzik, Jarosław Piskorski","doi":"10.3390/e26121100","DOIUrl":"https://doi.org/10.3390/e26121100","url":null,"abstract":"<p><p>This study investigates whether heart rate asymmetry (HRA) parameters offer insights into sleep stages beyond those provided by conventional heart rate variability (HRV) and complexity measures. Utilizing 31 polysomnographic recordings, we focused exclusively on electrocardiogram (ECG) data, specifically the RR interval time series, to explore heart rate dynamics associated with different sleep stages. Employing both statistical techniques and machine learning models, with the Generalized Estimating Equation model as the foundational approach, we assessed the effectiveness of HRA in identifying and differentiating sleep stages and transitions. The models including asymmetric variables for detecting deep sleep stages, N2 and N3, achieved AUCs of 0.85 and 0.89, respectively, those for transitions N2-R, R-N2, i.e., falling in and out of REM sleep, achieved AUCs of 0.85 and 0.80, and those for W-N1, i.e., falling asleep, an AUC of 0.83. All these models were highly statistically significant. The findings demonstrate that HRA parameters provide significant, independent information about sleep stages that is not captured by HRV and complexity measures alone. This additional insight into sleep physiology potentially leads to a better understanding of hearth rhythm during sleep and devising more precise diagnostic tools, including cheap portable devices, for identifying sleep-related disorders.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675681/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Correlations play a pivotal role in various fields of science, particularly in quantum mechanics, yet their proper quantification remains a subject of debate. In this work, we aimed to discuss the challenge of defining a reliable measure of total correlations. We first outlined the essential properties that an effective correlation measure should satisfy and reviewed existing measures, including quantum mutual information, the p-norm of the correlation matrix, and the recently defined quantum Pearson correlation coefficient. Additionally, we introduced new measures based on Rényi and Tsallis relative entropies, as well as the Kullback-Leibler divergence. Our analysis revealed that while quantum mutual information, the p-norm, and the Pearson measure exhibit equivalence for two-qubit systems, they all suffer from an ordering problem. Despite criticisms regarding its reliability, we argued that QMI remains a valid measure of total correlations.
{"title":"Axiomatic Approach to Measures of Total Correlations.","authors":"Gabriel L Moraes, Renato M Angelo, Ana C S Costa","doi":"10.3390/e26121098","DOIUrl":"https://doi.org/10.3390/e26121098","url":null,"abstract":"<p><p>Correlations play a pivotal role in various fields of science, particularly in quantum mechanics, yet their proper quantification remains a subject of debate. In this work, we aimed to discuss the challenge of defining a reliable measure of total correlations. We first outlined the essential properties that an effective correlation measure should satisfy and reviewed existing measures, including quantum mutual information, the <i>p</i>-norm of the correlation matrix, and the recently defined quantum Pearson correlation coefficient. Additionally, we introduced new measures based on Rényi and Tsallis relative entropies, as well as the Kullback-Leibler divergence. Our analysis revealed that while quantum mutual information, the <i>p</i>-norm, and the Pearson measure exhibit equivalence for two-qubit systems, they all suffer from an ordering problem. Despite criticisms regarding its reliability, we argued that QMI remains a valid measure of total correlations.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675452/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Attempts to mitigate the computational cost of fully resolved large-eddy simulation (LES) in the near-wall region include both the hybrid Reynolds-averaged Navier-Stokes/LES (HRL) and wall-modeled LES (WMLES) approaches. This paper presents an LES wall treatment method that combines key attributes of the two, in which the boundary layer mesh is sized in the streamwise and spanwise directions comparable to WMLES, and the wall-normal mesh is comparable to a RANS simulation without wall functions. A mixing length model is used to prescribe an eddy viscosity in the near-wall region, with the mixing length scale limited based on local mesh size. The RANS and LES regions are smoothly blended using the dynamic hybrid RANS-LES (DHRL) framework. The results are presented for the turbulent channel flow at two Reynolds numbers, and comparison to the DNS results shows that the mean and fluctuating quantities are reasonably well predicted with no apparent log-layer mismatch. A detailed near-wall meshing strategy for the proposed method is presented, and estimates indicate that it can be implemented with approximately twice the number of grid points as traditional WMLES, while avoiding the difficulties associated with analytical or numerical wall functions and modified wall boundary conditions.
{"title":"A Near-Wall Methodology for Large-Eddy Simulation Based on Dynamic Hybrid RANS-LES.","authors":"Michael Tullis, D Keith Walters","doi":"10.3390/e26121095","DOIUrl":"https://doi.org/10.3390/e26121095","url":null,"abstract":"<p><p>Attempts to mitigate the computational cost of fully resolved large-eddy simulation (LES) in the near-wall region include both the hybrid Reynolds-averaged Navier-Stokes/LES (HRL) and wall-modeled LES (WMLES) approaches. This paper presents an LES wall treatment method that combines key attributes of the two, in which the boundary layer mesh is sized in the streamwise and spanwise directions comparable to WMLES, and the wall-normal mesh is comparable to a RANS simulation without wall functions. A mixing length model is used to prescribe an eddy viscosity in the near-wall region, with the mixing length scale limited based on local mesh size. The RANS and LES regions are smoothly blended using the dynamic hybrid RANS-LES (DHRL) framework. The results are presented for the turbulent channel flow at two Reynolds numbers, and comparison to the DNS results shows that the mean and fluctuating quantities are reasonably well predicted with no apparent log-layer mismatch. A detailed near-wall meshing strategy for the proposed method is presented, and estimates indicate that it can be implemented with approximately twice the number of grid points as traditional WMLES, while avoiding the difficulties associated with analytical or numerical wall functions and modified wall boundary conditions.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675691/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Heywood cases and other improper solutions occur frequently in latent variable models, e.g., factor analysis, item response theory, latent class analysis, multilevel models, or structural equation models, all of which are models with response variables taken from an exponential family. They have important consequences for scoring with the latent variable model and are indicative of issues in a model, such as poor identification or model misspecification. In the context of the 2PL and 3PL models in IRT, they are more frequently known as Guttman items and are identified by having a discrimination parameter that is deemed excessively large. Other IRT models, such as the newer asymmetric item response theory (AsymIRT) or polytomous IRT models often have parameters that are not easy to interpret directly, so scanning parameter estimates are not necessarily indicative of the presence of problematic values. The graphical examination of the IRF can be useful but is necessarily subjective and highly dependent on choices of graphical defaults. We propose using the derivatives of the IRF, item Fisher information functions, and our proposed Item Fraction of Total Information (IFTI) decomposition metric to bypass the parameters, allowing for the more concrete and consistent identification of Heywood cases. We illustrate the approach by using empirical examples by using AsymIRT and nominal response models.
{"title":"A Definition of a Heywood Case in Item Response Theory Based on Fisher Information.","authors":"Jay Verkuilen, Peter J Johnson","doi":"10.3390/e26121096","DOIUrl":"https://doi.org/10.3390/e26121096","url":null,"abstract":"<p><p>Heywood cases and other improper solutions occur frequently in latent variable models, e.g., factor analysis, item response theory, latent class analysis, multilevel models, or structural equation models, all of which are models with response variables taken from an exponential family. They have important consequences for scoring with the latent variable model and are indicative of issues in a model, such as poor identification or model misspecification. In the context of the 2PL and 3PL models in IRT, they are more frequently known as Guttman items and are identified by having a discrimination parameter that is deemed excessively large. Other IRT models, such as the newer asymmetric item response theory (AsymIRT) or polytomous IRT models often have parameters that are not easy to interpret directly, so scanning parameter estimates are not necessarily indicative of the presence of problematic values. The graphical examination of the IRF can be useful but is necessarily subjective and highly dependent on choices of graphical defaults. We propose using the derivatives of the IRF, item Fisher information functions, and our proposed Item Fraction of Total Information (IFTI) decomposition metric to bypass the parameters, allowing for the more concrete and consistent identification of Heywood cases. We illustrate the approach by using empirical examples by using AsymIRT and nominal response models.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675695/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Angelo Sanfelice, Luigi Costanzo, Alessandro Lo Schiavo, Alessandro Sarracino, Massimo Vitelli
We present an experimental and numerical study of a piezoelectric energy harvester driven by broadband vibrations. This device can extract power from random fluctuations and can be described by a stochastic model, based on an underdamped Langevin equation with white noise, which mimics the dynamics of the piezoelectric material. A crucial point in the modelisation is represented by the appropriate description of the coupled load circuit that is necessary to harvest electrical energy. We consider a linear load (resistance) and a nonlinear load (diode bridge rectifier connected to the parallel of a capacitance and a load resistance), and focus on the characteristic curve of the extracted power as a function of the load resistance, in order to estimate the optimal values of the parameters that maximise the collected energy. In both cases, we find good agreement between the numerical simulations of the theoretical model and the results obtained in experiments. In particular, we observe a non-monotonic behaviour of the characteristic curve which signals the presence of an optimal value for the load resistance at which the extracted power is maximised. We also address a more theoretical issue, related to the inference of the non-equilibrium features of the system from data: we show that the analysis of high-order correlation functions of the relevant variables, when in the presence of nonlinearities, can represent a simple and effective tool to check the irreversible dynamics.
{"title":"Stochastic Model for a Piezoelectric Energy Harvester Driven by Broadband Vibrations.","authors":"Angelo Sanfelice, Luigi Costanzo, Alessandro Lo Schiavo, Alessandro Sarracino, Massimo Vitelli","doi":"10.3390/e26121097","DOIUrl":"https://doi.org/10.3390/e26121097","url":null,"abstract":"<p><p>We present an experimental and numerical study of a piezoelectric energy harvester driven by broadband vibrations. This device can extract power from random fluctuations and can be described by a stochastic model, based on an underdamped Langevin equation with white noise, which mimics the dynamics of the piezoelectric material. A crucial point in the modelisation is represented by the appropriate description of the coupled load circuit that is necessary to harvest electrical energy. We consider a linear load (resistance) and a nonlinear load (diode bridge rectifier connected to the parallel of a capacitance and a load resistance), and focus on the characteristic curve of the extracted power as a function of the load resistance, in order to estimate the optimal values of the parameters that maximise the collected energy. In both cases, we find good agreement between the numerical simulations of the theoretical model and the results obtained in experiments. In particular, we observe a non-monotonic behaviour of the characteristic curve which signals the presence of an optimal value for the load resistance at which the extracted power is maximised. We also address a more theoretical issue, related to the inference of the non-equilibrium features of the system from data: we show that the analysis of high-order correlation functions of the relevant variables, when in the presence of nonlinearities, can represent a simple and effective tool to check the irreversible dynamics.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675380/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946609","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study investigates the effect of incorporating heavy dopant atoms on the topological transitions in the energy spectrum of graphene, as well as on its thermodynamic properties. A tight-binding model is employed that incorporates a lattice composition parameter associated with the dopant's effect to obtain the electronic spectrum of graphene. Thus, the substitutional atoms in the lattice impact the electronic structure of graphene by altering the connectivity of the Dirac cones and the symmetry of the energy surface in their spectrum. The Gibbs entropy is numerically calculated from the energy surface of the electronic spectrum, and other thermodynamic properties, such as temperature, specific heat, and Helmholtz free energy, are derived from theoretical principles. The results show that topological changes induced by the heavy dopant atoms in the graphene lattice significantly affect its electronic structure and thermodynamic properties, leading to observable changes in the distances between Dirac cones, the range of the energy spectrum, entropy, positive and negative temperatures, divergences in specific heat, and instabilities within the system.
{"title":"Thermodynamic Behavior of Doped Graphene: Impact of Heavy Dopant Atoms.","authors":"L Palma-Chilla, Juan A Lazzús","doi":"10.3390/e26121093","DOIUrl":"https://doi.org/10.3390/e26121093","url":null,"abstract":"<p><p>This study investigates the effect of incorporating heavy dopant atoms on the topological transitions in the energy spectrum of graphene, as well as on its thermodynamic properties. A tight-binding model is employed that incorporates a lattice composition parameter associated with the dopant's effect to obtain the electronic spectrum of graphene. Thus, the substitutional atoms in the lattice impact the electronic structure of graphene by altering the connectivity of the Dirac cones and the symmetry of the energy surface in their spectrum. The Gibbs entropy is numerically calculated from the energy surface of the electronic spectrum, and other thermodynamic properties, such as temperature, specific heat, and Helmholtz free energy, are derived from theoretical principles. The results show that topological changes induced by the heavy dopant atoms in the graphene lattice significantly affect its electronic structure and thermodynamic properties, leading to observable changes in the distances between Dirac cones, the range of the energy spectrum, entropy, positive and negative temperatures, divergences in specific heat, and instabilities within the system.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675787/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This work presents a perturbational decomposition method for simulating quantum evolution under the one-dimensional Ising model with both longitudinal and transverse fields. By treating the transverse field terms as perturbations in the expansion, our approach is particularly effective in systems with moderate longitudinal fields and weak to moderate transverse fields relative to the coupling strength. Through systematic numerical exploration, we characterize parameter regimes and evolution time windows where the decomposition achieves measurable improvements over conventional Trotter decomposition methods. The developed perturbational approach and its characterized parameter space may provide practical guidance for choosing appropriate simulation strategies in different parameter regimes of the one-dimensional Ising model.
{"title":"Perturbational Decomposition Analysis for Quantum Ising Model with Weak Transverse Fields.","authors":"Youning Li, Junfeng Huang, Chao Zhang, Jun Li","doi":"10.3390/e26121094","DOIUrl":"https://doi.org/10.3390/e26121094","url":null,"abstract":"<p><p>This work presents a perturbational decomposition method for simulating quantum evolution under the one-dimensional Ising model with both longitudinal and transverse fields. By treating the transverse field terms as perturbations in the expansion, our approach is particularly effective in systems with moderate longitudinal fields and weak to moderate transverse fields relative to the coupling strength. Through systematic numerical exploration, we characterize parameter regimes and evolution time windows where the decomposition achieves measurable improvements over conventional Trotter decomposition methods. The developed perturbational approach and its characterized parameter space may provide practical guidance for choosing appropriate simulation strategies in different parameter regimes of the one-dimensional Ising model.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675516/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Qing Qin, Kaiyue Zhang, Yanqiu Che, Chunxiao Han, Yingmei Qin, Shanshan Li
Acupuncturing the ST36 acupoint can evoke a responding activity in the spinal dorsal root ganglia and generate spikes. In order to identify the responding mechanism of different acupuncture manipulations, in this paper the spike history of neurons is taken as the starting point and the coupling generalized linear model is adopted to encode the neuronal spiking activity evoked by different acupuncture manipulations. Then, maximum likelihood estimation is used to fit the model parameters and estimate the coupling parameters of stimulus, the self-coupling parameters of the neuron's own spike history and the cross-coupling parameters of other neurons' spike history. We use simulation data to test the estimation algorithm's effectiveness and analyze the main factors that evoke neuronal responding activity. Finally, we use the coupling generalized linear model to encode neuronal spiking activity evoked by two acupuncture manipulations, and estimate the coupling parameters of stimulus, the self-coupling parameters and the cross-coupling parameters. The results show that in acupuncture experiments, acupuncture stimulus is the inducing factor of neuronal spiking activity, and the cross-coupling of other neurons' spike history is the main factor of neuronal spiking activity. Additionally, the higher the amplitude of the neuronal spiking waveform, the greater the cross-coupling parameter. This lays a theoretical foundation for the scientific application of acupuncture therapy.
{"title":"Charactering Neural Spiking Activity Evoked by Acupuncture Through Coupling Generalized Linear Model.","authors":"Qing Qin, Kaiyue Zhang, Yanqiu Che, Chunxiao Han, Yingmei Qin, Shanshan Li","doi":"10.3390/e26121088","DOIUrl":"https://doi.org/10.3390/e26121088","url":null,"abstract":"<p><p>Acupuncturing the ST36 acupoint can evoke a responding activity in the spinal dorsal root ganglia and generate spikes. In order to identify the responding mechanism of different acupuncture manipulations, in this paper the spike history of neurons is taken as the starting point and the coupling generalized linear model is adopted to encode the neuronal spiking activity evoked by different acupuncture manipulations. Then, maximum likelihood estimation is used to fit the model parameters and estimate the coupling parameters of stimulus, the self-coupling parameters of the neuron's own spike history and the cross-coupling parameters of other neurons' spike history. We use simulation data to test the estimation algorithm's effectiveness and analyze the main factors that evoke neuronal responding activity. Finally, we use the coupling generalized linear model to encode neuronal spiking activity evoked by two acupuncture manipulations, and estimate the coupling parameters of stimulus, the self-coupling parameters and the cross-coupling parameters. The results show that in acupuncture experiments, acupuncture stimulus is the inducing factor of neuronal spiking activity, and the cross-coupling of other neurons' spike history is the main factor of neuronal spiking activity. Additionally, the higher the amplitude of the neuronal spiking waveform, the greater the cross-coupling parameter. This lays a theoretical foundation for the scientific application of acupuncture therapy.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675705/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We study the emergence of agency from scratch by using Large Language Model (LLM)-based agents. In previous studies of LLM-based agents, each agent's characteristics, including personality and memory, have traditionally been predefined. We focused on how individuality, such as behavior, personality, and memory, can be differentiated from an undifferentiated state. The present LLM agents engage in cooperative communication within a group simulation, exchanging context-based messages in natural language. By analyzing this multi-agent simulation, we report valuable new insights into how social norms, cooperation, and personality traits can emerge spontaneously. This paper demonstrates that autonomously interacting LLM-powered agents generate hallucinations and hashtags to sustain communication, which, in turn, increases the diversity of words within their interactions. Each agent's emotions shift through communication, and as they form communities, the personalities of the agents emerge and evolve accordingly. This computational modeling approach and its findings will provide a new method for analyzing collective artificial intelligence.
{"title":"Spontaneous Emergence of Agent Individuality Through Social Interactions in Large Language Model-Based Communities.","authors":"Ryosuke Takata, Atsushi Masumori, Takashi Ikegami","doi":"10.3390/e26121092","DOIUrl":"https://doi.org/10.3390/e26121092","url":null,"abstract":"<p><p>We study the emergence of agency from scratch by using Large Language Model (LLM)-based agents. In previous studies of LLM-based agents, each agent's characteristics, including personality and memory, have traditionally been predefined. We focused on how individuality, such as behavior, personality, and memory, can be differentiated from an undifferentiated state. The present LLM agents engage in cooperative communication within a group simulation, exchanging context-based messages in natural language. By analyzing this multi-agent simulation, we report valuable new insights into how social norms, cooperation, and personality traits can emerge spontaneously. This paper demonstrates that autonomously interacting LLM-powered agents generate hallucinations and hashtags to sustain communication, which, in turn, increases the diversity of words within their interactions. Each agent's emotions shift through communication, and as they form communities, the personalities of the agents emerge and evolve accordingly. This computational modeling approach and its findings will provide a new method for analyzing collective artificial intelligence.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675631/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Statistical counting ad infinitum is the holographic observable to a statistical dynamics with finite states under independent and identically distributed N sampling. Entropy provides the infinitesimal probability for an observed empirical frequency ν^ with respect to a probability prior p, when ν^≠p as N→∞. Following Callen's postulate and through Legendre-Fenchel transform, without help from mechanics, we show that an internal energy u emerges; it provides a linear representation of real-valued observables with full or partial information. Gibbs' fundamental thermodynamic relation and theory of ensembles follow mathematically. u is to ν^ what chemical potential μ is to particle number N in Gibbs' chemical thermodynamics, what β=T-1 is to internal energy U in classical thermodynamics, and what ω is to t in Fourier analysis.
{"title":"Internal Energy, Fundamental Thermodynamic Relation, and Gibbs' Ensemble Theory as Emergent Laws of Statistical Counting.","authors":"Hong Qian","doi":"10.3390/e26121091","DOIUrl":"https://doi.org/10.3390/e26121091","url":null,"abstract":"<p><p>Statistical counting <i>ad infinitum</i> is the holographic observable to a statistical dynamics with finite states under independent and identically distributed <i>N</i> sampling. Entropy provides the infinitesimal probability for an observed empirical frequency ν^ with respect to a probability prior p, when ν^≠p as N→∞. Following Callen's postulate and through Legendre-Fenchel transform, without help from mechanics, we show that an internal energy u emerges; it provides a linear representation of real-valued observables with full or partial information. Gibbs' fundamental thermodynamic relation and theory of ensembles follow mathematically. u is to ν^ what chemical potential μ is to particle number <i>N</i> in Gibbs' chemical thermodynamics, what β=T-1 is to internal energy <i>U</i> in classical thermodynamics, and what ω is to <i>t</i> in Fourier analysis.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675108/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142946803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}