首页 > 最新文献

Int. J. Semantic Comput.最新文献

英文 中文
Effects of the Size of Mixed-Reality Person Representations on Stress and Presence in Telecommunication 电信中混合现实人物表征大小对压力和在场的影响
Pub Date : 2019-09-01 DOI: 10.1142/s1793351x19400130
M. Joachimczak, Juan Liu, H. Ando
We study how mixed reality (MR) telepresence can enhance long-distance human interaction and how altering 3D representations of a remote person can be used to modulate stress and anxiety during social interactions. To do so, we developed an MR telepresence system employing commodity depth sensors and Microsoft’s Hololens. A textured, polygonal 3D model of a person was reconstructed in real time and transmitted over network for rendering in remote location using HoloLens. In this study, we used mock job interview paradigm to induce stress in human–subjects interacting with an interviewer presented as an MR hologram. Participants were exposed to three different types of real-time reconstructed virtual holograms of the interviewer, a natural-sized 3D reconstruction (NR), a miniature 3D reconstruction (SR) and a 2D-display representation (LCD). Participants reported their subjective experience through questionnaires, while their biophysical responses were recorded. We found that the size of 3D representation of a remote interviewer had a significant effect on participants’ stress levels and their sense of presence. The questionnaire data showed that NR condition induced more stress and presence than SR condition and was significantly different from LCD condition. We also found consistent patterns in the biophysical data.
我们研究了混合现实(MR)远程呈现如何增强远距离人际互动,以及如何改变远程人的3D表示来调节社交互动中的压力和焦虑。为此,我们开发了一种采用商品深度传感器和微软Hololens的MR远程呈现系统。利用HoloLens技术实时重建具有纹理的多边形三维人体模型,并通过网络传输以供远程渲染。在这项研究中,我们使用模拟工作面试范式来诱导人类受试者与面试官互动时的压力,面试官呈现为MR全息图。参与者被暴露在三种不同类型的实时重建的采访者虚拟全息图中,一种是自然大小的3D重建(NR),一种是微型3D重建(SR),一种是2d显示表示(LCD)。参与者通过问卷报告他们的主观体验,同时记录他们的生物物理反应。我们发现,远程面试官的三维表现的大小对参与者的压力水平和他们的存在感有显著影响。问卷数据显示,NR条件比SR条件诱导的应激和存在感更强,且与LCD条件差异显著。我们还在生物物理数据中发现了一致的模式。
{"title":"Effects of the Size of Mixed-Reality Person Representations on Stress and Presence in Telecommunication","authors":"M. Joachimczak, Juan Liu, H. Ando","doi":"10.1142/s1793351x19400130","DOIUrl":"https://doi.org/10.1142/s1793351x19400130","url":null,"abstract":"We study how mixed reality (MR) telepresence can enhance long-distance human interaction and how altering 3D representations of a remote person can be used to modulate stress and anxiety during social interactions. To do so, we developed an MR telepresence system employing commodity depth sensors and Microsoft’s Hololens. A textured, polygonal 3D model of a person was reconstructed in real time and transmitted over network for rendering in remote location using HoloLens. In this study, we used mock job interview paradigm to induce stress in human–subjects interacting with an interviewer presented as an MR hologram. Participants were exposed to three different types of real-time reconstructed virtual holograms of the interviewer, a natural-sized 3D reconstruction (NR), a miniature 3D reconstruction (SR) and a 2D-display representation (LCD). Participants reported their subjective experience through questionnaires, while their biophysical responses were recorded. We found that the size of 3D representation of a remote interviewer had a significant effect on participants’ stress levels and their sense of presence. The questionnaire data showed that NR condition induced more stress and presence than SR condition and was significantly different from LCD condition. We also found consistent patterns in the biophysical data.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129839830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Segmentation-driven Hierarchical RetinaNet for Detecting Protozoa in Micrograph 分割驱动的分层视网膜网用于显微图像中原生动物的检测
Pub Date : 2019-09-01 DOI: 10.1142/s1793351x19400178
Khoa Pho, Muhamad Kamal Mohammed Amin, A. Yoshitaka
Protozoa detection and identification play important roles in many practical domains such as parasitology, scientific research, biological treatment processes, and environmental quality evaluation. Traditional laboratory methods for protozoan identification are time-consuming and require expert knowledge and expensive equipment. Another approach is using micrographs to identify the species of protozoans that can save a lot of time and reduce the cost. However, the existing methods in this approach only identify the species when the protozoan are already segmented. These methods study features of shapes and sizes. In this work, we detect and identify the images of cysts and oocysts of various species such as: Giardia lamblia, Iodamoeba butschilii, Toxoplasma gondi, Cyclospora cayetanensis, Balantidium coli, Sarcocystis, Cystoisospora belli and Acanthamoeba, which have round shapes in common and affect human and animal health seriously. We propose Segmentation-driven Hierarchical RetinaNet to automatically detect, segment, and identify protozoans in their micrographs. By applying multiple techniques such as transfer learning, and data augmentation techniques, and dividing training samples into life-cycle stages of protozoans, we successfully overcome the lack of data issue in applying deep learning for this problem. Even though there are at most 5 samples per life-cycle category in the training data, our proposed method still achieves promising results and outperforms the original RetinaNet on our protozoa dataset.
原生动物的检测与鉴定在寄生虫学、科学研究、生物处理工艺、环境质量评价等诸多领域发挥着重要作用。传统的实验室原生动物鉴定方法耗时长,需要专业知识和昂贵的设备。另一种方法是使用显微照片来识别原生动物的种类,这可以节省大量的时间和降低成本。然而,现有的方法只能在原生动物已经被分割的情况下识别物种。这些方法研究形状和大小的特征。本工作对蓝氏贾第鞭毛虫、布氏碘达莫伊巴、刚地弓形虫、卡耶坦环孢子虫、大肠平衡虫、肉囊虫、贝利囊异孢子虫、棘阿米巴等多种常见圆形、严重影响人类和动物健康的囊和卵囊的图像进行了检测和鉴定。我们提出了分割驱动的分层视网膜网络来自动检测、分割和识别原生动物的显微照片。通过应用迁移学习和数据增强技术等多种技术,并将训练样本划分为原生动物的生命周期阶段,我们成功地克服了将深度学习应用于该问题时缺乏数据的问题。即使训练数据中每个生命周期类别最多有5个样本,我们提出的方法仍然取得了令人满意的结果,并且在我们的原生动物数据集上优于原始的RetinaNet。
{"title":"Segmentation-driven Hierarchical RetinaNet for Detecting Protozoa in Micrograph","authors":"Khoa Pho, Muhamad Kamal Mohammed Amin, A. Yoshitaka","doi":"10.1142/s1793351x19400178","DOIUrl":"https://doi.org/10.1142/s1793351x19400178","url":null,"abstract":"Protozoa detection and identification play important roles in many practical domains such as parasitology, scientific research, biological treatment processes, and environmental quality evaluation. Traditional laboratory methods for protozoan identification are time-consuming and require expert knowledge and expensive equipment. Another approach is using micrographs to identify the species of protozoans that can save a lot of time and reduce the cost. However, the existing methods in this approach only identify the species when the protozoan are already segmented. These methods study features of shapes and sizes. In this work, we detect and identify the images of cysts and oocysts of various species such as: Giardia lamblia, Iodamoeba butschilii, Toxoplasma gondi, Cyclospora cayetanensis, Balantidium coli, Sarcocystis, Cystoisospora belli and Acanthamoeba, which have round shapes in common and affect human and animal health seriously. We propose Segmentation-driven Hierarchical RetinaNet to automatically detect, segment, and identify protozoans in their micrographs. By applying multiple techniques such as transfer learning, and data augmentation techniques, and dividing training samples into life-cycle stages of protozoans, we successfully overcome the lack of data issue in applying deep learning for this problem. Even though there are at most 5 samples per life-cycle category in the training data, our proposed method still achieves promising results and outperforms the original RetinaNet on our protozoa dataset.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123529006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Learners' Technological Acceptance of VR Content Development: A Sequential 3-Part Use Case Study of Diverse Post-Secondary Students 学习者对VR内容开发的技术接受度:不同大专学生的连续三部分用例研究
Pub Date : 2019-09-01 DOI: 10.1142/s1793351x19400154
V. Nguyen, R. Hite, Tommy Dang
Web-based virtual reality (VR) development tools are in ubiquitous use by software developers, and now, university (undergraduate) students, to move beyond using, to creating new and energizing VR content. Web-based VR (WebVR), among other libraries and frameworks, have risen as a low-cost platform for users to create rich and intuitive VR content and applications. However, the success of WebVR as an instructional tool relies on post-secondary students technological acceptance (TA), the intersectionality of a user’s perceived utility (PU) and perceived ease of use (PEOU, or convenience) with said technological tool. Yet, there is a dearth of exploratory studies of students’ experiences with the AR/VR development technologies to infer their TA. To ascertain the viability of WebVR tools for software engineering undergraduates in the classroom, this paper presents a 3-case contextual investigation of 38 undergraduate students tasked with creating VR content. In each use case, students were provided increasing freedom in their VR content development parameters. Results indicated that students demonstrated elements of technological acceptance in their selection of webVR and other platforms, and not only successfully creating rich and robust VR content (PU), but also executing these projects in a short period (PEOU). Other positive externalities observed were students exhibitions of soft skills (e.g. creativity, critical thinking) and different modes of demonstrating coding knowledge, which suggest further study. Discussed are the lessons learned from the WebVR and VR/AR interventions and recommendations for WebVR instruction. This work may be helpful for both learners and teachers using VR/AR in selecting, designing, and developing coursework materials, tools, and libraries.
基于web的虚拟现实(VR)开发工具被软件开发人员普遍使用,现在,大学(本科生)学生超越使用,创造新的和充满活力的VR内容。在其他库和框架中,基于web的VR (WebVR)已经成为用户创建丰富直观的VR内容和应用程序的低成本平台。然而,WebVR作为一种教学工具的成功依赖于大专学生的技术接受度(TA),用户对所述技术工具的感知效用(PU)和感知易用性(PEOU,或便利性)的交集。然而,缺乏对学生使用AR/VR开发技术的体验的探索性研究来推断他们的TA。为了确定WebVR工具在软件工程本科生课堂上的可行性,本文对38名负责创建VR内容的本科生进行了3个案例的情境调查。在每个用例中,学生在他们的VR内容开发参数中获得了越来越多的自由。结果表明,学生在选择webVR和其他平台时表现出了技术接受的要素,不仅成功地创造了丰富而稳健的VR内容(PU),而且在短时间内执行了这些项目(PEOU)。其他观察到的积极外部性是学生展示软技能(如创造力、批判性思维)和展示编码知识的不同模式,这值得进一步研究。讨论了WebVR和VR/AR干预的经验教训以及对WebVR教学的建议。这项工作可能有助于学习者和教师使用VR/AR选择、设计和开发课程材料、工具和图书馆。
{"title":"Learners' Technological Acceptance of VR Content Development: A Sequential 3-Part Use Case Study of Diverse Post-Secondary Students","authors":"V. Nguyen, R. Hite, Tommy Dang","doi":"10.1142/s1793351x19400154","DOIUrl":"https://doi.org/10.1142/s1793351x19400154","url":null,"abstract":"Web-based virtual reality (VR) development tools are in ubiquitous use by software developers, and now, university (undergraduate) students, to move beyond using, to creating new and energizing VR content. Web-based VR (WebVR), among other libraries and frameworks, have risen as a low-cost platform for users to create rich and intuitive VR content and applications. However, the success of WebVR as an instructional tool relies on post-secondary students technological acceptance (TA), the intersectionality of a user’s perceived utility (PU) and perceived ease of use (PEOU, or convenience) with said technological tool. Yet, there is a dearth of exploratory studies of students’ experiences with the AR/VR development technologies to infer their TA. To ascertain the viability of WebVR tools for software engineering undergraduates in the classroom, this paper presents a 3-case contextual investigation of 38 undergraduate students tasked with creating VR content. In each use case, students were provided increasing freedom in their VR content development parameters. Results indicated that students demonstrated elements of technological acceptance in their selection of webVR and other platforms, and not only successfully creating rich and robust VR content (PU), but also executing these projects in a short period (PEOU). Other positive externalities observed were students exhibitions of soft skills (e.g. creativity, critical thinking) and different modes of demonstrating coding knowledge, which suggest further study. Discussed are the lessons learned from the WebVR and VR/AR interventions and recommendations for WebVR instruction. This work may be helpful for both learners and teachers using VR/AR in selecting, designing, and developing coursework materials, tools, and libraries.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114760418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
Ontology Summarization: Graph-Based Methods and Beyond 本体总结:基于图的方法及超越
Pub Date : 2019-06-25 DOI: 10.1142/S1793351X19300012
Seyedamin Pouriyeh, M. Allahyari, Qingxia Liu, Gong Cheng, H. Arabnia, M. Atzori, F. Mohammadi, K. Kochut
Ontologies have been widely used in numerous and varied applications, e.g. to support data modeling, information integration, and knowledge management. With the increasing size of ontologies, ontology understanding, which is playing an important role in different tasks, is becoming more difficult. Consequently, ontology summarization, as a way to distill key information from an ontology and generate an abridged version to facilitate a better understanding, is getting growing attention. In this survey paper we review existing ontology summarization techniques and focus mainly on graph-based methods, which represent an ontology as a graph and apply centrality-based and other measures to identify the most important elements of an ontology as its summary. After analyzing their strengths and weaknesses, we highlight a few potential directions for future research.
本体已经广泛应用于各种各样的应用中,例如支持数据建模、信息集成和知识管理。随着本体规模的不断扩大,在不同任务中发挥重要作用的本体理解也变得越来越困难。因此,本体摘要作为一种从本体中提取关键信息并生成简化版本以便于更好理解的方法越来越受到人们的关注。在本文中,我们回顾了现有的本体摘要技术,并重点介绍了基于图的方法,该方法将本体表示为图,并应用基于中心性和其他方法来识别本体中最重要的元素作为其摘要。在分析了它们的优缺点后,我们强调了未来研究的几个潜在方向。
{"title":"Ontology Summarization: Graph-Based Methods and Beyond","authors":"Seyedamin Pouriyeh, M. Allahyari, Qingxia Liu, Gong Cheng, H. Arabnia, M. Atzori, F. Mohammadi, K. Kochut","doi":"10.1142/S1793351X19300012","DOIUrl":"https://doi.org/10.1142/S1793351X19300012","url":null,"abstract":"Ontologies have been widely used in numerous and varied applications, e.g. to support data modeling, information integration, and knowledge management. With the increasing size of ontologies, ontology understanding, which is playing an important role in different tasks, is becoming more difficult. Consequently, ontology summarization, as a way to distill key information from an ontology and generate an abridged version to facilitate a better understanding, is getting growing attention. In this survey paper we review existing ontology summarization techniques and focus mainly on graph-based methods, which represent an ontology as a graph and apply centrality-based and other measures to identify the most important elements of an ontology as its summary. After analyzing their strengths and weaknesses, we highlight a few potential directions for future research.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"218 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133611127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
ASIC STA Path Verification Using Semi-Supervised Learning 使用半监督学习的ASIC STA路径验证
Pub Date : 2019-06-25 DOI: 10.1142/S1793351X19400105
James Obert, T. Mannos
To counter manufacturing irregularities and ensure ASIC design integrity, it is essential that robust design verification methods are employed. It is possible to ensure such integrity using ASIC static timing analysis (STA) and machine learning. In this research, uniquely devised machine and statistical learning methods which quantify anomalous variations in Register Transfer Level (RTL) or Graphic Design System II (GDSII) format are discussed. To measure the variations in ASIC analysis data, the timing delays in relation to path electrical characteristics are explored. It is shown that semi-supervised learning techniques are powerful tools in characterizing variations within STA path data and have much potential for identifying anomalies in ASIC RTL and GDSII design data.
为了应对制造违规行为并确保ASIC设计的完整性,必须采用稳健的设计验证方法。使用ASIC静态时序分析(STA)和机器学习可以确保这种完整性。在本研究中,讨论了独特设计的机器和统计学习方法,这些方法量化了寄存器传输级别(RTL)或图形设计系统II (GDSII)格式的异常变化。为了测量ASIC分析数据的变化,探讨了与路径电特性相关的时序延迟。研究表明,半监督学习技术是表征STA路径数据变化的强大工具,在识别ASIC RTL和GDSII设计数据中的异常方面具有很大的潜力。
{"title":"ASIC STA Path Verification Using Semi-Supervised Learning","authors":"James Obert, T. Mannos","doi":"10.1142/S1793351X19400105","DOIUrl":"https://doi.org/10.1142/S1793351X19400105","url":null,"abstract":"To counter manufacturing irregularities and ensure ASIC design integrity, it is essential that robust design verification methods are employed. It is possible to ensure such integrity using ASIC static timing analysis (STA) and machine learning. In this research, uniquely devised machine and statistical learning methods which quantify anomalous variations in Register Transfer Level (RTL) or Graphic Design System II (GDSII) format are discussed. To measure the variations in ASIC analysis data, the timing delays in relation to path electrical characteristics are explored. It is shown that semi-supervised learning techniques are powerful tools in characterizing variations within STA path data and have much potential for identifying anomalies in ASIC RTL and GDSII design data.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"84 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128428226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gait Pattern Recognition Using a Smartwatch Assisting Postoperative Physiotherapy 使用智能手表辅助术后物理治疗的步态模式识别
Pub Date : 2019-06-25 DOI: 10.1142/S1793351X19400117
Athanasios I. Kyritsis, G. Willems, Michel Deriaz, D. Konstantas
Postoperative rehabilitation is led by physiotherapists and is a vital program that re-establishes joint motion and strengthens the muscles around the joint after an orthopedic surgery. Modern smart devices have affected every aspect of human life. Newly developed technologies have disrupted the way various industries operate, including the healthcare one. Extensive research has been carried out on how smartphone inertial sensors can be used for activity recognition. However, there are very few studies on systems that monitor patients and detect different gait patterns in order to assist the work of physiotherapists during the said rehabilitation phase, even outside the time-limited physiotherapy sessions. In this paper, we are presenting a gait recognition system that was developed to detect different gait patterns. The proposed system was trained, tested and validated with data of people who have undergone lower body orthopedic surgery, recorded by Hirslanden Clinique La Colline, an orthopedic clinic in Geneva, Switzerland. Nine different gait classes were labeled by professional physiotherapists. After extracting both time and frequency domain features from the time series data, several machine learning models were tested including a fully connected neural network. Raw time series data were also fed into a convolutional neural network.
术后康复由物理治疗师主导,是骨科手术后重建关节运动和加强关节周围肌肉的重要项目。现代智能设备已经影响了人类生活的方方面面。新开发的技术已经颠覆了各种行业的运作方式,包括医疗保健行业。关于如何将智能手机惯性传感器用于活动识别,已经进行了广泛的研究。然而,很少有研究系统监测患者和检测不同的步态模式,以协助理疗师在上述康复阶段的工作,甚至在有限的物理治疗疗程之外。在本文中,我们提出了一种步态识别系统,用于检测不同的步态模式。瑞士日内瓦的一家骨科诊所Hirslanden Clinique La Colline记录了接受过下体整形手术的患者的数据,并对该系统进行了培训、测试和验证。由专业物理治疗师标记9种不同的步态类别。在从时间序列数据中提取时域和频域特征后,测试了几个机器学习模型,包括一个全连接的神经网络。原始时间序列数据也被输入到卷积神经网络中。
{"title":"Gait Pattern Recognition Using a Smartwatch Assisting Postoperative Physiotherapy","authors":"Athanasios I. Kyritsis, G. Willems, Michel Deriaz, D. Konstantas","doi":"10.1142/S1793351X19400117","DOIUrl":"https://doi.org/10.1142/S1793351X19400117","url":null,"abstract":"Postoperative rehabilitation is led by physiotherapists and is a vital program that re-establishes joint motion and strengthens the muscles around the joint after an orthopedic surgery. Modern smart devices have affected every aspect of human life. Newly developed technologies have disrupted the way various industries operate, including the healthcare one. Extensive research has been carried out on how smartphone inertial sensors can be used for activity recognition. However, there are very few studies on systems that monitor patients and detect different gait patterns in order to assist the work of physiotherapists during the said rehabilitation phase, even outside the time-limited physiotherapy sessions. In this paper, we are presenting a gait recognition system that was developed to detect different gait patterns. The proposed system was trained, tested and validated with data of people who have undergone lower body orthopedic surgery, recorded by Hirslanden Clinique La Colline, an orthopedic clinic in Geneva, Switzerland. Nine different gait classes were labeled by professional physiotherapists. After extracting both time and frequency domain features from the time series data, several machine learning models were tested including a fully connected neural network. Raw time series data were also fed into a convolutional neural network.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125531163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Evaluation of a Model-driven Knowledge Storage and Retrieval IDE for Interactive HRI Systems 交互式HRI系统中模型驱动的知识存储与检索IDE的评价
Pub Date : 2019-06-25 DOI: 10.1142/S1793351X19400099
N. Köster, S. Wrede, P. Cimiano
Efficient storage and querying of long-term human–robot interaction data requires application developers to have an in-depth understanding of the involved domains. Creating syntactically and semantically correct queries in the development process is an error prone task which can immensely impact the interaction experience of humans with robots and artificial agents. To address this issue, we present and evaluate a model-driven software development approach to create a long-term storage system to be used in highly interactive HRI scenarios. We created multiple domain-specific languages that allow us to model the domain and seamlessly embed its concepts into a query language. Along with corresponding model-to-model and model-to-text transformations, we generate a fully integrated workbench facilitating data storage and retrieval. It supports developers in the query design process and allows in-tool query execution without the need to have prior in-depth knowledge of the domain. We evaluated our work in an extensive user study and can show that the generated tool yields multiple advantages compared to the usual query design approach.
长期人机交互数据的高效存储和查询要求应用程序开发人员对所涉及的领域有深入的了解。在开发过程中创建语法和语义正确的查询是一项容易出错的任务,它会极大地影响人类与机器人和人工代理的交互体验。为了解决这个问题,我们提出并评估了一种模型驱动的软件开发方法,以创建一个用于高度交互式HRI场景的长期存储系统。我们创建了多种特定于领域的语言,这些语言允许我们对领域进行建模,并将其概念无缝地嵌入到查询语言中。与相应的模型到模型和模型到文本转换一起,我们生成了一个完全集成的工作台,便于数据存储和检索。它在查询设计过程中为开发人员提供支持,并允许在工具内执行查询,而无需事先对该领域有深入的了解。我们在广泛的用户研究中评估了我们的工作,并且可以显示与通常的查询设计方法相比,生成的工具具有多种优势。
{"title":"Evaluation of a Model-driven Knowledge Storage and Retrieval IDE for Interactive HRI Systems","authors":"N. Köster, S. Wrede, P. Cimiano","doi":"10.1142/S1793351X19400099","DOIUrl":"https://doi.org/10.1142/S1793351X19400099","url":null,"abstract":"Efficient storage and querying of long-term human–robot interaction data requires application developers to have an in-depth understanding of the involved domains. Creating syntactically and semantically correct queries in the development process is an error prone task which can immensely impact the interaction experience of humans with robots and artificial agents. To address this issue, we present and evaluate a model-driven software development approach to create a long-term storage system to be used in highly interactive HRI scenarios. We created multiple domain-specific languages that allow us to model the domain and seamlessly embed its concepts into a query language. Along with corresponding model-to-model and model-to-text transformations, we generate a fully integrated workbench facilitating data storage and retrieval. It supports developers in the query design process and allows in-tool query execution without the need to have prior in-depth knowledge of the domain. We evaluated our work in an extensive user study and can show that the generated tool yields multiple advantages compared to the usual query design approach.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"55 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114060206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Autonomous Object Pick-and-Sort Procedure for Industrial Robotics Application 应用于工业机器人的自主对象拾取与分拣程序
Pub Date : 2019-06-01 DOI: 10.1142/S1793351X19400075
Lianjun Li, Yizhe Zhang, M. Ripperger, J. Nicho, M. Veeraraghavan, A. Fumagalli
This paper describes an industrial robotics application, named Gilbreth, for autonomously picking up objects of different types from a moving conveyor belt and sorting the objects into bins according to their type. The environment, which consists of a moving conveyor belt, a break beam sensor, a 3D camera Kinect sensor, a UR10 industrial robot arm with a vacuum gripper, and different object types such as pulleys, disks, gears, and piston rods, is inspired by the NIST ARIAC competition. A first version of the Gilbreth application is implemented leveraging a number of Robot Operating System (ROS) and ROS-Industrial (ROS-I) packages. The Gazebo package is used to simulate the environment, and six external ROS nodes have been implemented to execute the required functions. Experimental measurements of CPU usage and processing times of the ROS nodes are discussed. In particular, the object recognition ROS package requires the highest processing times and offers an opportunity for designing an iterative method with the aim to fasten completion time. Its processing time is found to be on par with the time required by the robot arm to execute its movement between four poses: pick approach, pick, pick retreat and place.
本文描述了一个名为Gilbreth的工业机器人应用程序,它可以自动从移动的传送带上拾取不同类型的物体,并根据物体的类型将其分类到垃圾箱中。该环境由移动传送带、断梁传感器、3D摄像头Kinect传感器、带真空抓手的UR10工业机器人手臂以及滑轮、磁盘、齿轮和活塞杆等不同类型的物体组成,灵感来自NIST ARIAC竞赛。Gilbreth应用程序的第一个版本是利用许多Robot Operating System (ROS)和ROS- industrial (ROS- i)软件包实现的。Gazebo包用于模拟环境,并且已经实现了六个外部ROS节点来执行所需的功能。讨论了ROS节点的CPU使用和处理时间的实验测量。特别是,目标识别ROS包需要最高的处理时间,并提供了设计迭代方法以加快完成时间的机会。发现其处理时间与机械臂在拾取接近、拾取、拾取后退和放置四个姿态之间执行运动所需的时间相当。
{"title":"Autonomous Object Pick-and-Sort Procedure for Industrial Robotics Application","authors":"Lianjun Li, Yizhe Zhang, M. Ripperger, J. Nicho, M. Veeraraghavan, A. Fumagalli","doi":"10.1142/S1793351X19400075","DOIUrl":"https://doi.org/10.1142/S1793351X19400075","url":null,"abstract":"This paper describes an industrial robotics application, named Gilbreth, for autonomously picking up objects of different types from a moving conveyor belt and sorting the objects into bins according to their type. The environment, which consists of a moving conveyor belt, a break beam sensor, a 3D camera Kinect sensor, a UR10 industrial robot arm with a vacuum gripper, and different object types such as pulleys, disks, gears, and piston rods, is inspired by the NIST ARIAC competition. A first version of the Gilbreth application is implemented leveraging a number of Robot Operating System (ROS) and ROS-Industrial (ROS-I) packages. The Gazebo package is used to simulate the environment, and six external ROS nodes have been implemented to execute the required functions. Experimental measurements of CPU usage and processing times of the ROS nodes are discussed. In particular, the object recognition ROS package requires the highest processing times and offers an opportunity for designing an iterative method with the aim to fasten completion time. Its processing time is found to be on par with the time required by the robot arm to execute its movement between four poses: pick approach, pick, pick retreat and place.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"476 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134438821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Simulation of Subjective Closed Captioning Quality Assessment Using Prediction Models 基于预测模型的主观字幕质量评价模拟
Pub Date : 2019-04-03 DOI: 10.1142/S1793351X19400038
Somang Nam, D. Fels
As a primary user group, Deaf or Hard of Hearing (D/HOH) audiences use Closed Captioning (CC) service to enjoy the TV programs with audio by reading text. However, the D/HOH communities are not completely satisfied with the quality of CC even though the government regulators entail certain rules in the CC quality factors. The measure of the CC quality is often interpreted as an accuracy on translation and regulators use the empirical models to assess. The need of a subjective quality scale comes from the gap in between current empirical assessment models and the audience perceived quality. It is possible to fill the gap by including the subjective assessment by D/HOH audiences. This research proposes a design of an automatic quality assessment system for CC which can predict the D/HOH audience subjective ratings. A simulated rater is implemented based on literature and the CC quality factor representative value extraction algorithm is developed. Three prediction models are trained with a set of CC quality values and corresponding rating scores, then they are compared to find the feasible prediction model.
聋哑人或重听人(D/HOH)作为一个主要的用户群体,使用CC (Closed字幕)服务通过阅读文本来欣赏有音频的电视节目。然而,尽管政府监管部门对CC的质量因素进行了一定的规定,但D/ h社区对CC的质量并不完全满意。CC质量的衡量通常被解释为翻译的准确性,监管机构使用经验模型来评估。主观质量量表的需求来自于当前经验评估模型与受众感知质量之间的差距。有可能通过纳入D/HOH受众的主观评价来填补这一空白。本研究提出了一种能够预测D/HOH观众主观评分的CC自动质量评估系统的设计。在文献研究的基础上,实现了一种模拟评估器,并提出了CC品质因子代表值提取算法。使用一组CC质量值和相应的评级分数训练三种预测模型,然后对它们进行比较,找出可行的预测模型。
{"title":"Simulation of Subjective Closed Captioning Quality Assessment Using Prediction Models","authors":"Somang Nam, D. Fels","doi":"10.1142/S1793351X19400038","DOIUrl":"https://doi.org/10.1142/S1793351X19400038","url":null,"abstract":"As a primary user group, Deaf or Hard of Hearing (D/HOH) audiences use Closed Captioning (CC) service to enjoy the TV programs with audio by reading text. However, the D/HOH communities are not completely satisfied with the quality of CC even though the government regulators entail certain rules in the CC quality factors. The measure of the CC quality is often interpreted as an accuracy on translation and regulators use the empirical models to assess. The need of a subjective quality scale comes from the gap in between current empirical assessment models and the audience perceived quality. It is possible to fill the gap by including the subjective assessment by D/HOH audiences. This research proposes a design of an automatic quality assessment system for CC which can predict the D/HOH audience subjective ratings. A simulated rater is implemented based on literature and the CC quality factor representative value extraction algorithm is developed. Three prediction models are trained with a set of CC quality values and corresponding rating scores, then they are compared to find the feasible prediction model.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"53 56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129862852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Knowledge Extraction of Adaptive Structural Learning of Deep Belief Network for Medical Examination Data 医学检查数据深度信念网络自适应结构学习的知识提取
Pub Date : 2019-04-03 DOI: 10.1142/S1793351X1940004X
Shin Kamada, T. Ichimura, T. Harada
Deep learning has a hierarchical network structure to represent multiple features of input data. The adaptive structural learning method of Deep Belief Network (DBN) can reach the high classification capability while searching the optimal network structure during the training. The method can find the optimal number of hidden neurons for given input data in a Restricted Boltzmann Machine (RBM) by neuron generation–annihilation algorithm, and generate a new hidden layer in DBN by the extension of the algorithm. In this paper, the proposed adaptive structural learning of DBN (Adaptive DBN) was applied to the comprehensive medical examination data for cancer prediction. The developed prediction system showed higher classification accuracy for test data (99.5% for the lung cancer and 94.3% for the stomach cancer) than the several learning methods such as traditional RBM, DBN, Non-Linear Support Vector Machine (SVM), and Convolutional Neural Network (CNN). Moreover, the explicit knowledge that makes the inference process of the trained DBN is required in deep learning. The binary patterns of activated neurons for given input in RBM and the hierarchical structure of DBN can represent the relation between input and output signals. These binary patterns were classified by C4.5 for knowledge extraction. Although the extracted knowledge showed slightly lower classification accuracy than the trained DBN network, it was able to improve inference speed by about 1/40. We report that the extracted IF-THEN rules from the trained DBN for medical examination data showed some interesting features related to initial condition of cancer.
深度学习具有层次网络结构来表示输入数据的多个特征。深度信念网络(Deep Belief Network, DBN)的自适应结构学习方法在训练过程中寻找最优的网络结构,从而达到较高的分类能力。该方法通过神经元生成-湮灭算法在受限玻尔兹曼机(RBM)中找到给定输入数据的最优隐藏神经元数,并通过扩展该算法在DBN中生成新的隐藏层。本文将提出的DBN自适应结构学习(adaptive DBN)应用于综合体检数据中进行癌症预测。与传统的RBM、DBN、非线性支持向量机(SVM)和卷积神经网络(CNN)等几种学习方法相比,所开发的预测系统对测试数据的分类准确率(肺癌为99.5%,胃癌为94.3%)更高。此外,在深度学习中需要对训练好的DBN进行推理过程的显式知识。RBM中给定输入的激活神经元的二值模式和DBN的层次结构可以表示输入和输出信号之间的关系。利用C4.5对这些二元模式进行分类,提取知识。虽然提取的知识的分类精度略低于训练后的DBN网络,但它能够将推理速度提高约1/40。我们报告了从医学检查数据的训练DBN中提取的IF-THEN规则显示了一些与癌症初始状态相关的有趣特征。
{"title":"Knowledge Extraction of Adaptive Structural Learning of Deep Belief Network for Medical Examination Data","authors":"Shin Kamada, T. Ichimura, T. Harada","doi":"10.1142/S1793351X1940004X","DOIUrl":"https://doi.org/10.1142/S1793351X1940004X","url":null,"abstract":"Deep learning has a hierarchical network structure to represent multiple features of input data. The adaptive structural learning method of Deep Belief Network (DBN) can reach the high classification capability while searching the optimal network structure during the training. The method can find the optimal number of hidden neurons for given input data in a Restricted Boltzmann Machine (RBM) by neuron generation–annihilation algorithm, and generate a new hidden layer in DBN by the extension of the algorithm. In this paper, the proposed adaptive structural learning of DBN (Adaptive DBN) was applied to the comprehensive medical examination data for cancer prediction. The developed prediction system showed higher classification accuracy for test data (99.5% for the lung cancer and 94.3% for the stomach cancer) than the several learning methods such as traditional RBM, DBN, Non-Linear Support Vector Machine (SVM), and Convolutional Neural Network (CNN). Moreover, the explicit knowledge that makes the inference process of the trained DBN is required in deep learning. The binary patterns of activated neurons for given input in RBM and the hierarchical structure of DBN can represent the relation between input and output signals. These binary patterns were classified by C4.5 for knowledge extraction. Although the extracted knowledge showed slightly lower classification accuracy than the trained DBN network, it was able to improve inference speed by about 1/40. We report that the extracted IF-THEN rules from the trained DBN for medical examination data showed some interesting features related to initial condition of cancer.","PeriodicalId":217956,"journal":{"name":"Int. J. Semantic Comput.","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130074628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
期刊
Int. J. Semantic Comput.
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1