Shuo Yang, M. Barlow, E. Lakshika, Kathryn E. Kasmarik
{"title":"Interaction-Based Trust Evaluation in a Team of Agents Using a Determination of Trust Model","authors":"Shuo Yang, M. Barlow, E. Lakshika, Kathryn E. Kasmarik","doi":"10.1109/SSCI50451.2021.9659848","DOIUrl":null,"url":null,"abstract":"Trust has been widely recognized as one of the most important factors influencing team performance. The ability to accurately evaluate the trustworthiness of team members (agents) is crucial for effective team performance. Interaction data among agents are suitable sources of information determining each agent's trustworthiness. However, the existing interaction-based trust models are usually task specific and are only applicable to some well-defined domains (tasks). This paper addresses the problem of accurate trust evaluation in a team of agents by proposing an interaction-based trust evaluation model - the Determination of Trust Model (DoTM), which is applicable to various team tasks. The DoTM maps the relationships between interaction records and the trustworthiness of an agent through a supervised learning algorithm. To take full advantage of the interaction data, before being fed into the machine learner, interaction data are pre-processed by three data processing methods, i.e., combining data from multiple runs, involving indirect interaction records and calculating relative data across agents. A series of experiments are conducted on a simulation platform which performs a cooperative food foraging task. Different types of flawed agents are introduced to distinguish between agents with different trustworthiness. The experimental results demonstrate that the DoTM achieves high accuracy and consistency in scenarios involving different types of flawed agents. The DoTM is compared with an existing interaction-based trust model - LogitTrust and achieved significantly better evaluation accuracy in all considered scenarios. Moreover, the impact of each data processing method is demonstrated through experimental investigations.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"47 6","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SSCI50451.2021.9659848","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Trust has been widely recognized as one of the most important factors influencing team performance. The ability to accurately evaluate the trustworthiness of team members (agents) is crucial for effective team performance. Interaction data among agents are suitable sources of information determining each agent's trustworthiness. However, the existing interaction-based trust models are usually task specific and are only applicable to some well-defined domains (tasks). This paper addresses the problem of accurate trust evaluation in a team of agents by proposing an interaction-based trust evaluation model - the Determination of Trust Model (DoTM), which is applicable to various team tasks. The DoTM maps the relationships between interaction records and the trustworthiness of an agent through a supervised learning algorithm. To take full advantage of the interaction data, before being fed into the machine learner, interaction data are pre-processed by three data processing methods, i.e., combining data from multiple runs, involving indirect interaction records and calculating relative data across agents. A series of experiments are conducted on a simulation platform which performs a cooperative food foraging task. Different types of flawed agents are introduced to distinguish between agents with different trustworthiness. The experimental results demonstrate that the DoTM achieves high accuracy and consistency in scenarios involving different types of flawed agents. The DoTM is compared with an existing interaction-based trust model - LogitTrust and achieved significantly better evaluation accuracy in all considered scenarios. Moreover, the impact of each data processing method is demonstrated through experimental investigations.
信任已被广泛认为是影响团队绩效的最重要因素之一。准确评估团队成员(代理)可信度的能力对于有效的团队绩效至关重要。智能体之间的交互数据是决定每个智能体可信度的合适信息源。然而,现有的基于交互的信任模型通常是特定于任务的,并且只适用于一些定义良好的领域(任务)。本文提出了一种基于交互的信任评估模型——确定信任模型(Determination of trust model, DoTM),该模型适用于各种团队任务,解决了智能体团队中准确的信任评估问题。DoTM通过监督学习算法映射交互记录与代理可信度之间的关系。为了充分利用交互数据,在将交互数据输入机器学习之前,对交互数据进行了三种数据处理方法的预处理,即合并多次运行的数据、涉及间接交互记录和计算跨agent的相对数据。在一个执行合作觅食任务的仿真平台上进行了一系列的实验。引入不同类型的缺陷代理来区分具有不同可信度的代理。实验结果表明,DoTM在不同类型的有缺陷智能体的场景下具有较高的准确率和一致性。DoTM与现有的基于交互的信任模型LogitTrust进行了比较,在所有考虑的场景中都取得了更好的评估准确性。此外,通过实验研究证明了每种数据处理方法的影响。