首页 > 最新文献

International Conference on Conceptual Structures最新文献

英文 中文
Parameter Tuning of the Firefly Algorithm by Standard Monte Carlo and Quasi-Monte Carlo Methods 用标准蒙特卡洛和准蒙特卡洛方法调整萤火虫算法参数
Pub Date : 2024-07-01 DOI: 10.1007/978-3-031-63775-9_17
Geethu Joy, Christian Huyck, Xin-She Yang
{"title":"Parameter Tuning of the Firefly Algorithm by Standard Monte Carlo and Quasi-Monte Carlo Methods","authors":"Geethu Joy, Christian Huyck, Xin-She Yang","doi":"10.1007/978-3-031-63775-9_17","DOIUrl":"https://doi.org/10.1007/978-3-031-63775-9_17","url":null,"abstract":"","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"79 1","pages":"242-253"},"PeriodicalIF":0.0,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141696021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Streaming Detection of Significant Delay Changes in Public Transport Systems 公共交通系统重大延误变化的流式检测
Pub Date : 2024-04-11 DOI: 10.1007/978-3-031-08760-8_41
Przemyslaw Wrona, M. Grzenda, Marcin Luckner
{"title":"Streaming Detection of Significant Delay Changes in Public Transport Systems","authors":"Przemyslaw Wrona, M. Grzenda, Marcin Luckner","doi":"10.1007/978-3-031-08760-8_41","DOIUrl":"https://doi.org/10.1007/978-3-031-08760-8_41","url":null,"abstract":"","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"14 8","pages":"486-499"},"PeriodicalIF":0.0,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140714520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Graph Extraction for Assisting Crash Simulation Data Analysis 辅助碰撞模拟数据分析的图提取
Pub Date : 2023-06-15 DOI: 10.48550/arXiv.2306.09538
Anahita Pakiman, J. Garcke, A. Schumacher
In this work, we establish a method for abstracting information from Computer Aided Engineering (CAE) into graphs. Such graph representations of CAE data can improve design guidelines and support recommendation systems by enabling the comparison of simulations, highlighting unexplored experimental designs, and correlating different designs. We focus on the load-path in crashworthiness analysis, a complex sub-discipline in vehicle design. The load-path is the sequence of parts that absorb most of the energy caused by the impact. To detect the load-path, we generate a directed weighted graph from the CAE data. The vertices represent the vehicle's parts, and the edges are an abstraction of the connectivity of the parts. The edge direction follows the temporal occurrence of the collision, where the edge weights reflect aspects of the energy absorption. We introduce and assess three methods for graph extraction and an additional method for further updating each graph with the sequences of absorption. Based on longest-path calculations, we introduce an automated detection of the load-path, which we analyse for the different graph extraction methods and weights. Finally, we show how our method for the detection of load-paths helps in the classification and labelling of CAE simulations.
在这项工作中,我们建立了一种将计算机辅助工程(CAE)中的信息抽象成图的方法。CAE数据的这种图形表示可以通过比较模拟、突出未探索的实验设计和关联不同的设计来改进设计指南和支持推荐系统。耐撞性分析是汽车设计中一个复杂的分支学科,本文主要研究耐撞性分析中的载荷路径。载荷路径是吸收冲击产生的大部分能量的部件的顺序。为了检测载荷路径,我们从CAE数据中生成一个有向加权图。顶点表示车辆的部件,边缘是部件连接的抽象。边缘方向跟随碰撞发生的时间,其中边缘权值反映了能量吸收的各个方面。我们介绍和评估了三种图提取方法,以及一种用吸收序列进一步更新每个图的方法。基于最长路径计算,我们引入了负载路径的自动检测,并对不同的图提取方法和权重进行了分析。最后,我们展示了我们的检测负载路径的方法如何有助于CAE模拟的分类和标记。
{"title":"Graph Extraction for Assisting Crash Simulation Data Analysis","authors":"Anahita Pakiman, J. Garcke, A. Schumacher","doi":"10.48550/arXiv.2306.09538","DOIUrl":"https://doi.org/10.48550/arXiv.2306.09538","url":null,"abstract":"In this work, we establish a method for abstracting information from Computer Aided Engineering (CAE) into graphs. Such graph representations of CAE data can improve design guidelines and support recommendation systems by enabling the comparison of simulations, highlighting unexplored experimental designs, and correlating different designs. We focus on the load-path in crashworthiness analysis, a complex sub-discipline in vehicle design. The load-path is the sequence of parts that absorb most of the energy caused by the impact. To detect the load-path, we generate a directed weighted graph from the CAE data. The vertices represent the vehicle's parts, and the edges are an abstraction of the connectivity of the parts. The edge direction follows the temporal occurrence of the collision, where the edge weights reflect aspects of the energy absorption. We introduce and assess three methods for graph extraction and an additional method for further updating each graph with the sequences of absorption. Based on longest-path calculations, we introduce an automated detection of the load-path, which we analyse for the different graph extraction methods and weights. Finally, we show how our method for the detection of load-paths helps in the classification and labelling of CAE simulations.","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124165885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Epistemic and Aleatoric Uncertainty Quantification and Surrogate Modelling in High-Performance Multiscale Plasma Physics Simulations 高性能多尺度等离子体物理模拟中的认知和任意不确定性量化和替代模型
Pub Date : 2023-06-13 DOI: 10.1007/978-3-031-36027-5_45
Ye. V. Yudin, David Coster, U. Toussaint, F. Jenko
{"title":"Epistemic and Aleatoric Uncertainty Quantification and Surrogate Modelling in High-Performance Multiscale Plasma Physics Simulations","authors":"Ye. V. Yudin, David Coster, U. Toussaint, F. Jenko","doi":"10.1007/978-3-031-36027-5_45","DOIUrl":"https://doi.org/10.1007/978-3-031-36027-5_45","url":null,"abstract":"","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124718314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Automating the Analysis of Institutional Design in International Agreements 国际协定中制度设计的自动化分析
Pub Date : 2023-05-26 DOI: 10.48550/arXiv.2305.16750
Anna Wr'oblewska, Bartosz Pieli'nski, Karolina Seweryn, Sylwia Sysko-Roma'nczuk, Karol Saputa, Aleksandra Wichrowska, Hanna Schreiber
This paper explores the automatic knowledge extraction of formal institutional design - norms, rules, and actors - from international agreements. The focus was to analyze the relationship between the visibility and centrality of actors in the formal institutional design in regulating critical aspects of cultural heritage relations. The developed tool utilizes techniques such as collecting legal documents, annotating them with Institutional Grammar, and using graph analysis to explore the formal institutional design. The system was tested against the 2003 UNESCO Convention for the Safeguarding of the Intangible Cultural Heritage.
本文探讨了从国际协议中自动提取正式制度设计的知识——规范、规则和行动者。重点是分析在规范文化遗产关系关键方面的正式制度设计中,参与者的可见性和中心性之间的关系。所开发的工具利用诸如收集法律文件,用制度语法注释它们以及使用图形分析来探索正式的制度设计等技术。该系统是根据2003年联合国教科文组织《保护非物质文化遗产公约》进行测试的。
{"title":"Automating the Analysis of Institutional Design in International Agreements","authors":"Anna Wr'oblewska, Bartosz Pieli'nski, Karolina Seweryn, Sylwia Sysko-Roma'nczuk, Karol Saputa, Aleksandra Wichrowska, Hanna Schreiber","doi":"10.48550/arXiv.2305.16750","DOIUrl":"https://doi.org/10.48550/arXiv.2305.16750","url":null,"abstract":"This paper explores the automatic knowledge extraction of formal institutional design - norms, rules, and actors - from international agreements. The focus was to analyze the relationship between the visibility and centrality of actors in the formal institutional design in regulating critical aspects of cultural heritage relations. The developed tool utilizes techniques such as collecting legal documents, annotating them with Institutional Grammar, and using graph analysis to explore the formal institutional design. The system was tested against the 2003 UNESCO Convention for the Safeguarding of the Intangible Cultural Heritage.","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127061741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strengthening structural baselines for graph classification using Local Topological Profile 利用局部拓扑轮廓增强图分类的结构基线
Pub Date : 2023-05-01 DOI: 10.48550/arXiv.2305.00724
J. Adamczyk, W. Czech
We present the analysis of the topological graph descriptor Local Degree Profile (LDP), which forms a widely used structural baseline for graph classification. Our study focuses on model evaluation in the context of the recently developed fair evaluation framework, which defines rigorous routines for model selection and evaluation for graph classification, ensuring reproducibility and comparability of the results. Based on the obtained insights, we propose a new baseline algorithm called Local Topological Profile (LTP), which extends LDP by using additional centrality measures and local vertex descriptors. The new approach provides the results outperforming or very close to the latest GNNs for all datasets used. Specifically, state-of-the-art results were obtained for 4 out of 9 benchmark datasets. We also consider computational aspects of LDP-based feature extraction and model construction to propose practical improvements affecting execution speed and scalability. This allows for handling modern, large datasets and extends the portfolio of benchmarks used in graph representation learning. As the outcome of our work, we obtained LTP as a simple to understand, fast and scalable, still robust baseline, capable of outcompeting modern graph classification models such as Graph Isomorphism Network (GIN). We provide open-source implementation at href{https://github.com/j-adamczyk/LTP}{GitHub}.
我们分析了拓扑图描述子局部度轮廓(LDP),它形成了一个广泛使用的图分类结构基线。我们的研究重点是在最近开发的公平评估框架的背景下进行模型评估,该框架为图分类的模型选择和评估定义了严格的例程,确保了结果的可重复性和可比性。基于所获得的见解,我们提出了一种新的基线算法,称为局部拓扑轮廓(LTP),它通过使用额外的中心性度量和局部顶点描述符扩展了LDP。对于所有使用的数据集,新方法提供的结果优于或非常接近最新的gnn。具体来说,9个基准数据集中的4个获得了最先进的结果。我们还考虑了基于ldp的特征提取和模型构建的计算方面,以提出影响执行速度和可扩展性的实际改进。这允许处理现代的大型数据集,并扩展了图表示学习中使用的基准组合。作为我们工作的结果,我们获得了LTP作为一个简单易懂、快速、可扩展、仍然健壮的基线,能够胜过现代图分类模型,如图同构网络(GIN)。我们在href{https://github.com/j-adamczyk/LTP}{GitHub}上提供了开源实现。
{"title":"Strengthening structural baselines for graph classification using Local Topological Profile","authors":"J. Adamczyk, W. Czech","doi":"10.48550/arXiv.2305.00724","DOIUrl":"https://doi.org/10.48550/arXiv.2305.00724","url":null,"abstract":"We present the analysis of the topological graph descriptor Local Degree Profile (LDP), which forms a widely used structural baseline for graph classification. Our study focuses on model evaluation in the context of the recently developed fair evaluation framework, which defines rigorous routines for model selection and evaluation for graph classification, ensuring reproducibility and comparability of the results. Based on the obtained insights, we propose a new baseline algorithm called Local Topological Profile (LTP), which extends LDP by using additional centrality measures and local vertex descriptors. The new approach provides the results outperforming or very close to the latest GNNs for all datasets used. Specifically, state-of-the-art results were obtained for 4 out of 9 benchmark datasets. We also consider computational aspects of LDP-based feature extraction and model construction to propose practical improvements affecting execution speed and scalability. This allows for handling modern, large datasets and extends the portfolio of benchmarks used in graph representation learning. As the outcome of our work, we obtained LTP as a simple to understand, fast and scalable, still robust baseline, capable of outcompeting modern graph classification models such as Graph Isomorphism Network (GIN). We provide open-source implementation at href{https://github.com/j-adamczyk/LTP}{GitHub}.","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129393060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of the Impact of COVID-19 Pandemic Lockdowns on Breast Cancer Deaths and Costs in Poland Using Markovian Monte Carlo Simulation 使用马尔可夫蒙特卡罗模拟估计COVID-19大流行封锁对波兰乳腺癌死亡和成本的影响
Pub Date : 2023-04-27 DOI: 10.1007/978-3-031-36024-4_10
M. Dul, Michal K. Grzeszczyk, E. Nojszewska, A. Sitek
{"title":"Estimation of the Impact of COVID-19 Pandemic Lockdowns on Breast Cancer Deaths and Costs in Poland Using Markovian Monte Carlo Simulation","authors":"M. Dul, Michal K. Grzeszczyk, E. Nojszewska, A. Sitek","doi":"10.1007/978-3-031-36024-4_10","DOIUrl":"https://doi.org/10.1007/978-3-031-36024-4_10","url":null,"abstract":"","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117045661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of genetic algorithm to load balancing in networks with a homogeneous traffic flow 遗传算法在均匀流量网络负载均衡中的应用
Pub Date : 2023-04-18 DOI: 10.1007/978-3-031-36021-3_32
M. Bolanowski, Alicja Gerka, A. Paszkiewicz, M. Ganzha, M. Paprzycki
{"title":"Application of genetic algorithm to load balancing in networks with a homogeneous traffic flow","authors":"M. Bolanowski, Alicja Gerka, A. Paszkiewicz, M. Ganzha, M. Paprzycki","doi":"10.1007/978-3-031-36021-3_32","DOIUrl":"https://doi.org/10.1007/978-3-031-36021-3_32","url":null,"abstract":"","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123220671","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From Online Behaviours to Images: A Novel Approach to Social Bot Detection 从在线行为到图像:一种新的社交机器人检测方法
Pub Date : 2023-04-15 DOI: 10.48550/arXiv.2304.07535
Edoardo Di Paolo, M. Petrocchi, A. Spognardi
Online Social Networks have revolutionized how we consume and share information, but they have also led to a proliferation of content not always reliable and accurate. One particular type of social accounts is known to promote unreputable content, hyperpartisan, and propagandistic information. They are automated accounts, commonly called bots. Focusing on Twitter accounts, we propose a novel approach to bot detection: we first propose a new algorithm that transforms the sequence of actions that an account performs into an image; then, we leverage the strength of Convolutional Neural Networks to proceed with image classification. We compare our performances with state-of-the-art results for bot detection on genuine accounts / bot accounts datasets well known in the literature. The results confirm the effectiveness of the proposal, because the detection capability is on par with the state of the art, if not better in some cases.
在线社交网络彻底改变了我们消费和分享信息的方式,但它们也导致了内容的激增,这些内容并不总是可靠和准确的。一种特殊类型的社交账户被认为是促进不受欢迎的内容,超党派和宣传信息。它们是自动账户,通常被称为机器人。专注于Twitter账户,我们提出了一种新的机器人检测方法:我们首先提出了一种新的算法,将账户执行的动作序列转换为图像;然后,我们利用卷积神经网络的强度进行图像分类。我们将我们的性能与文献中已知的真实账户/ bot账户数据集的bot检测的最新结果进行比较。结果证实了该建议的有效性,因为检测能力与最先进的水平相当,如果在某些情况下不是更好的话。
{"title":"From Online Behaviours to Images: A Novel Approach to Social Bot Detection","authors":"Edoardo Di Paolo, M. Petrocchi, A. Spognardi","doi":"10.48550/arXiv.2304.07535","DOIUrl":"https://doi.org/10.48550/arXiv.2304.07535","url":null,"abstract":"Online Social Networks have revolutionized how we consume and share information, but they have also led to a proliferation of content not always reliable and accurate. One particular type of social accounts is known to promote unreputable content, hyperpartisan, and propagandistic information. They are automated accounts, commonly called bots. Focusing on Twitter accounts, we propose a novel approach to bot detection: we first propose a new algorithm that transforms the sequence of actions that an account performs into an image; then, we leverage the strength of Convolutional Neural Networks to proceed with image classification. We compare our performances with state-of-the-art results for bot detection on genuine accounts / bot accounts datasets well known in the literature. The results confirm the effectiveness of the proposal, because the detection capability is on par with the state of the art, if not better in some cases.","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124097817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
r-softmax: Generalized Softmax with Controllable Sparsity Rate r-softmax:具有可控稀疏率的广义Softmax
Pub Date : 2023-04-11 DOI: 10.48550/arXiv.2304.05243
Klaudia Bałazy, Lukasz Struski, Marek Śmieja, J. Tabor
Nowadays artificial neural network models achieve remarkable results in many disciplines. Functions mapping the representation provided by the model to the probability distribution are the inseparable aspect of deep learning solutions. Although softmax is a commonly accepted probability mapping function in the machine learning community, it cannot return sparse outputs and always spreads the positive probability to all positions. In this paper, we propose r-softmax, a modification of the softmax, outputting sparse probability distribution with controllable sparsity rate. In contrast to the existing sparse probability mapping functions, we provide an intuitive mechanism for controlling the output sparsity level. We show on several multi-label datasets that r-softmax outperforms other sparse alternatives to softmax and is highly competitive with the original softmax. We also apply r-softmax to the self-attention module of a pre-trained transformer language model and demonstrate that it leads to improved performance when fine-tuning the model on different natural language processing tasks.
目前,人工神经网络模型在许多学科中取得了显著的成果。将模型提供的表示映射到概率分布的函数是深度学习解决方案不可分割的方面。虽然softmax是机器学习界普遍接受的概率映射函数,但它不能返回稀疏输出,并且总是将正概率扩散到所有位置。在本文中,我们提出了对softmax的改进r-softmax,输出稀疏率可控的稀疏概率分布。与现有的稀疏概率映射函数相比,我们提供了一种直观的机制来控制输出稀疏程度。我们在几个多标签数据集上展示了r-softmax优于softmax的其他稀疏替代方案,并且与原始softmax高度竞争。我们还将r-softmax应用于预训练的转换语言模型的自关注模块,并证明在不同的自然语言处理任务上对模型进行微调时,它可以提高性能。
{"title":"r-softmax: Generalized Softmax with Controllable Sparsity Rate","authors":"Klaudia Bałazy, Lukasz Struski, Marek Śmieja, J. Tabor","doi":"10.48550/arXiv.2304.05243","DOIUrl":"https://doi.org/10.48550/arXiv.2304.05243","url":null,"abstract":"Nowadays artificial neural network models achieve remarkable results in many disciplines. Functions mapping the representation provided by the model to the probability distribution are the inseparable aspect of deep learning solutions. Although softmax is a commonly accepted probability mapping function in the machine learning community, it cannot return sparse outputs and always spreads the positive probability to all positions. In this paper, we propose r-softmax, a modification of the softmax, outputting sparse probability distribution with controllable sparsity rate. In contrast to the existing sparse probability mapping functions, we provide an intuitive mechanism for controlling the output sparsity level. We show on several multi-label datasets that r-softmax outperforms other sparse alternatives to softmax and is highly competitive with the original softmax. We also apply r-softmax to the self-attention module of a pre-trained transformer language model and demonstrate that it leads to improved performance when fine-tuning the model on different natural language processing tasks.","PeriodicalId":125954,"journal":{"name":"International Conference on Conceptual Structures","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121521591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
International Conference on Conceptual Structures
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1