{"title":"深度神经网络中的 1/f 噪声自组织。","authors":"Nicholas Jia Le Chong, Ling Feng","doi":"10.1063/5.0224138","DOIUrl":null,"url":null,"abstract":"<p><p>In biological neural networks, it has been well recognized that a healthy brain exhibits 1/f noise patterns. However, in artificial neural networks that are increasingly matching or even out-performing human cognition, this phenomenon has yet to be established. In this work, we found that similar to that of their biological counterparts, 1/f noise exists in artificial neural networks when trained on time series classification tasks. Additionally, we found that the activations of the neurons are the closest to 1/f noise when the neurons are highly utilized. Conversely, if the network is too large and many neurons are underutilized, the neuron activations deviate from 1/f noise patterns toward that of white noise.</p>","PeriodicalId":9974,"journal":{"name":"Chaos","volume":null,"pages":null},"PeriodicalIF":2.7000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Self-organization toward 1/f noise in deep neural networks.\",\"authors\":\"Nicholas Jia Le Chong, Ling Feng\",\"doi\":\"10.1063/5.0224138\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In biological neural networks, it has been well recognized that a healthy brain exhibits 1/f noise patterns. However, in artificial neural networks that are increasingly matching or even out-performing human cognition, this phenomenon has yet to be established. In this work, we found that similar to that of their biological counterparts, 1/f noise exists in artificial neural networks when trained on time series classification tasks. Additionally, we found that the activations of the neurons are the closest to 1/f noise when the neurons are highly utilized. Conversely, if the network is too large and many neurons are underutilized, the neuron activations deviate from 1/f noise patterns toward that of white noise.</p>\",\"PeriodicalId\":9974,\"journal\":{\"name\":\"Chaos\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chaos\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1063/5.0224138\",\"RegionNum\":2,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chaos","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1063/5.0224138","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
Self-organization toward 1/f noise in deep neural networks.
In biological neural networks, it has been well recognized that a healthy brain exhibits 1/f noise patterns. However, in artificial neural networks that are increasingly matching or even out-performing human cognition, this phenomenon has yet to be established. In this work, we found that similar to that of their biological counterparts, 1/f noise exists in artificial neural networks when trained on time series classification tasks. Additionally, we found that the activations of the neurons are the closest to 1/f noise when the neurons are highly utilized. Conversely, if the network is too large and many neurons are underutilized, the neuron activations deviate from 1/f noise patterns toward that of white noise.
期刊介绍:
Chaos: An Interdisciplinary Journal of Nonlinear Science is a peer-reviewed journal devoted to increasing the understanding of nonlinear phenomena and describing the manifestations in a manner comprehensible to researchers from a broad spectrum of disciplines.