首页 > 最新文献

2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)最新文献

英文 中文
Message from the CSII 2018 Conference Chair 2018年CSII会议主席致辞
{"title":"Message from the CSII 2018 Conference Chair","authors":"","doi":"10.1109/csii.2018.00005","DOIUrl":"https://doi.org/10.1109/csii.2018.00005","url":null,"abstract":"","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128156421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of Personal Preferences on Points of Interest 个人兴趣点偏好的估计
Shunki Yuge, A. Ogino
The goal of our study is to recommend a travel plan that a tourist can change his/her state of mind to positive feeling. A personal preference of a point of interest (POI) differs individually. Moreover, the general impressions and the personal knowledge of a POI influence the personal preference of it. Therefore, it is difficult for a tourist to make a travel plan concerning POIs where a tourist has never visited, or he/she has not visited much. In this paper, we propose a method to estimate personal preferences on the unknown POIs by using the general impressions and the personal knowledge concerning known POIs. We estimate personal preferences concerning unknown POIs through shaping parameters about the impression and knowledge of POIs involved in personal preference about POIs. We have designed a hierarchical Bayesian model via Markov chain Monte Carlo technique for parameter estimation. As for 15 subjects, we have designed the model by using the general impressions and the personal knowledge concerning 84 POIs. They evaluated the validity of the results of which the model has estimated individual preferences for unknown POI. As for nine of 15 subjects, the result shows that the estimation accuracy is more than 60%. It was shown that the general impression and the personal knowledge of POIs affected the preference.
我们的研究目的是推荐一个旅游计划,游客可以改变他/她的心态,积极的感觉。个人对兴趣点(POI)的偏好各不相同。此外,对POI的总体印象和个人知识会影响个人对其的偏好。因此,对于游客从未去过或很少去过的景点,游客很难制定旅行计划。在本文中,我们提出了一种利用已知poi的一般印象和个人知识来估计个人对未知poi的偏好的方法。我们通过塑造个人对未知点的印象和知识的参数来估计个人对未知点的偏好。利用马尔可夫链蒙特卡罗技术设计了一种分层贝叶斯模型进行参数估计。对于15个被试,我们利用84个poi的总体印象和个人知识来设计模型。他们评估了该模型估计个人对未知POI偏好的结果的有效性。15个被试中有9个被试的估计准确率在60%以上。结果表明,对poi的总体印象和个人知识对其偏好有影响。
{"title":"Estimation of Personal Preferences on Points of Interest","authors":"Shunki Yuge, A. Ogino","doi":"10.1109/CSII.2018.00031","DOIUrl":"https://doi.org/10.1109/CSII.2018.00031","url":null,"abstract":"The goal of our study is to recommend a travel plan that a tourist can change his/her state of mind to positive feeling. A personal preference of a point of interest (POI) differs individually. Moreover, the general impressions and the personal knowledge of a POI influence the personal preference of it. Therefore, it is difficult for a tourist to make a travel plan concerning POIs where a tourist has never visited, or he/she has not visited much. In this paper, we propose a method to estimate personal preferences on the unknown POIs by using the general impressions and the personal knowledge concerning known POIs. We estimate personal preferences concerning unknown POIs through shaping parameters about the impression and knowledge of POIs involved in personal preference about POIs. We have designed a hierarchical Bayesian model via Markov chain Monte Carlo technique for parameter estimation. As for 15 subjects, we have designed the model by using the general impressions and the personal knowledge concerning 84 POIs. They evaluated the validity of the results of which the model has estimated individual preferences for unknown POI. As for nine of 15 subjects, the result shows that the estimation accuracy is more than 60%. It was shown that the general impression and the personal knowledge of POIs affected the preference.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128402614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing a Linked Data-Based Weekly Report Management System 开发基于关联数据的周报管理系统
Rikiya Ando, Tadachika Ozono, T. Shintani
New students assigned to a laboratory learn lessons from their predecessors by referring to previous reports. Our laboratory has accumulated weekly reports over more than twenty years in our weekly report management system, however, students have difficulty with searching for valuable weekly reports from the report system. We aim to extend the existing weekly report management system to help users find valuable past weekly reports. We introduce the idea of linked data to the report management system. We designed the Weekly Report Network to represent weekly reports relevant to submissions. Moreover, we implemented a publication-based search function, a visualization function, and a compilation function on the existing weekly report system to enable reuse of the accumulated weekly reports for twenty years. First, the publication-based search function enables users to find weekly reports relevant publications. The works contain a paper registration, a paper submission, a camera-ready submission, and a presentation. Second, the visualization function illustrates an overview of research activities based on weekly reports for a year. For example, the system makes a graph to show time spent on research activities described in weekly reports. Finally, the compilation function makes an annual report by concatenating and editing weekly reports for the year. This paper explains the Weekly Report Network and the implementation of the extended weekly report management system.
被分配到实验室的新学生通过参考前人的报告来学习前人的经验。我们实验室在周报管理系统中积累了二十多年的周报,但是学生很难从周报系统中检索到有价值的周报。我们的目标是扩展现有的周报管理系统,以帮助用户找到有价值的过去的周报。我们在报表管理系统中引入了关联数据的思想。我们设计了周报网络,以表示与提交相关的周报。此外,我们在现有的周报表系统上实现了基于出版物的搜索功能、可视化功能和编译功能,实现了二十年积累的周报表的重用。首先,基于出版物的搜索功能,用户可以找到周报相关的出版物。作品包括论文注册,论文提交,准备拍照提交和演示。其次,可视化功能显示了一年中基于周报的研究活动概况。例如,系统制作一个图表来显示每周报告中描述的用于研究活动的时间。最后,编译功能通过连接和编辑该年度的周报来生成年度报告。本文阐述了周报网及扩展周报管理系统的实现。
{"title":"Developing a Linked Data-Based Weekly Report Management System","authors":"Rikiya Ando, Tadachika Ozono, T. Shintani","doi":"10.1109/CSII.2018.00015","DOIUrl":"https://doi.org/10.1109/CSII.2018.00015","url":null,"abstract":"New students assigned to a laboratory learn lessons from their predecessors by referring to previous reports. Our laboratory has accumulated weekly reports over more than twenty years in our weekly report management system, however, students have difficulty with searching for valuable weekly reports from the report system. We aim to extend the existing weekly report management system to help users find valuable past weekly reports. We introduce the idea of linked data to the report management system. We designed the Weekly Report Network to represent weekly reports relevant to submissions. Moreover, we implemented a publication-based search function, a visualization function, and a compilation function on the existing weekly report system to enable reuse of the accumulated weekly reports for twenty years. First, the publication-based search function enables users to find weekly reports relevant publications. The works contain a paper registration, a paper submission, a camera-ready submission, and a presentation. Second, the visualization function illustrates an overview of research activities based on weekly reports for a year. For example, the system makes a graph to show time spent on research activities described in weekly reports. Finally, the compilation function makes an annual report by concatenating and editing weekly reports for the year. This paper explains the Weekly Report Network and the implementation of the extended weekly report management system.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128790528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AC Transmission Signal Neural Circuit and the Design of Deep Learning Model 交流传输信号神经电路及深度学习模型设计
M. Kawaguchi, N. Ishii, M. Umeno
In the neural network field, many application models have been proposed. Previous analog neural network models were composed of the operational amplifier and fixed resistance. It is difficult to change the connecting weight of network. In this study, we used analog electronic AC circuits. The connecting weights describe the voltage and input signal describe the frequency. It is easy to change the connection coefficient. This model works only on analog electronic circuits. It can finish the learning process in a very short time and this model will enable more flexible learning. However, the structure of this model is only one input and one output network. We improved the number of unit and network layer. Moreover, we suggest the possibility of realization about the hardware implementation of the deep learning model.
在神经网络领域,已经提出了许多应用模型。以往的模拟神经网络模型是由运算放大器和固定电阻组成的。网络的连接权值很难改变。在这项研究中,我们使用模拟电子交流电路。连接权值描述电压,输入信号描述频率。连接系数很容易改变。这个模型只适用于模拟电路。它可以在很短的时间内完成学习过程,使学习更加灵活。然而,该模型的结构只有一个输入和一个输出网络。我们改进了单元和网络层的数量。此外,我们还提出了在硬件上实现深度学习模型的可能性。
{"title":"AC Transmission Signal Neural Circuit and the Design of Deep Learning Model","authors":"M. Kawaguchi, N. Ishii, M. Umeno","doi":"10.1109/CSII.2018.00011","DOIUrl":"https://doi.org/10.1109/CSII.2018.00011","url":null,"abstract":"In the neural network field, many application models have been proposed. Previous analog neural network models were composed of the operational amplifier and fixed resistance. It is difficult to change the connecting weight of network. In this study, we used analog electronic AC circuits. The connecting weights describe the voltage and input signal describe the frequency. It is easy to change the connection coefficient. This model works only on analog electronic circuits. It can finish the learning process in a very short time and this model will enable more flexible learning. However, the structure of this model is only one input and one output network. We improved the number of unit and network layer. Moreover, we suggest the possibility of realization about the hardware implementation of the deep learning model.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132510346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Concept of Policy Information Decision Method in the Cloud Type Virtual Policy Based Network Management Scheme for the Specific Domain 基于云的特定域虚拟策略网络管理方案中策略信息决策方法的概念
Kazuya Odagiri, Shogo Shimizu, M. Takizawa, N. Ishii
In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, to realize management of the specific domain with some network groups with plural organizations, the concept of policy information decision method applied for this scheme are described.
在目前的互联网系统中,存在着许多使用网络通信匿名性的问题,如个人信息泄露和利用互联网系统犯罪。这就是Internet系统中使用的TCP/IP协议在通信数据上没有用户身份信息的原因,很难对用户进行上述行为的即时监督。基于策略的网络管理(PBNM)就是为了解决上述问题而进行的研究。这是一种通过对每个用户的通信控制来管理整个局域网(LAN)的方案。在这种PBNM中,存在两种类型的方案。作为一种方案,我们从理论上研究了与现有internet相关的目的寻址控制系统(DACS)方案。将该DACS方案应用于Internet系统管理,实现基于策略的Internet系统管理。为了实现由多个组织的网络组组成的特定域的管理,本文描述了该方案所应用的策略信息决策方法的概念。
{"title":"Concept of Policy Information Decision Method in the Cloud Type Virtual Policy Based Network Management Scheme for the Specific Domain","authors":"Kazuya Odagiri, Shogo Shimizu, M. Takizawa, N. Ishii","doi":"10.1109/CSII.2018.00008","DOIUrl":"https://doi.org/10.1109/CSII.2018.00008","url":null,"abstract":"In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, to realize management of the specific domain with some network groups with plural organizations, the concept of policy information decision method applied for this scheme are described.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131837903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improvement of Automatic Composition System Based on Melodic Outlines and Impression Words 基于旋律提纲和印象词的自动作曲系统改进
Saori Nakamura, T. Hochin, Hiroki Nomiya
The purpose of this paper is to compose music satisfying selected ambience on intended melody easily, and to get satisfaction of self-making. The targets are beginners of music theory and some music experience. To achieve those purposes, an automatic composition system, which takes impression words and melodic outlines as inputs has been proposed. The paper revises this system. The revised system makes several arranges and modification to the initial melody based on the music theory, and gives a side melody by the shape of a line. It is experimentally clarified that the music composed by the system is satisfactory, and their moods fit to the impression words specified.
本文的目的是在预定的旋律上轻松地创作出符合所选氛围的音乐,并获得自我创作的满足感。对象为音乐理论的初学者和有一定音乐经验的人。为了达到这些目的,提出了一种以印象词和旋律轮廓为输入的自动作曲系统。本文对该系统进行了修正。修改后的系统在乐理的基础上对原旋律进行了多次整理和修改,并以线的形式给出了副旋律。实验表明,该系统所创作的音乐是令人满意的,他们的情绪符合指定的印象词。
{"title":"Improvement of Automatic Composition System Based on Melodic Outlines and Impression Words","authors":"Saori Nakamura, T. Hochin, Hiroki Nomiya","doi":"10.1109/CSII.2018.00024","DOIUrl":"https://doi.org/10.1109/CSII.2018.00024","url":null,"abstract":"The purpose of this paper is to compose music satisfying selected ambience on intended melody easily, and to get satisfaction of self-making. The targets are beginners of music theory and some music experience. To achieve those purposes, an automatic composition system, which takes impression words and melodic outlines as inputs has been proposed. The paper revises this system. The revised system makes several arranges and modification to the initial melody based on the music theory, and gives a side melody by the shape of a line. It is experimentally clarified that the music composed by the system is satisfactory, and their moods fit to the impression words specified.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116731758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Personal KANSEI Coordinating System for Room Interior Design 房间室内设计的个人感性协调系统
Y. Yasui, A. Ogino
We have developed the KANSEI coordinating system that generates an interior design with the newness impression for a user and design style that the user has demanded. However, the previous system doesn't consider about individual differences in feeling about impression, so there are differences in evaluation for each individual. Therefore, in this paper, we compare the common model made from plural people's data and the personal model made from personal data and see which one is making good KANSEI coordination. In the evaluation of the new system by subjects. About 54% of subjects support the design idea of the common model. Also about 71% of subjects support the design idea of the personal model. The design idea of the personal model was increased by15% over the design idea of the common model, and it was shown that personal model is better.
我们已经开发了KANSEI协调系统,为用户和用户所要求的设计风格产生新颖的室内设计印象。然而,之前的系统没有考虑到个体对印象的感受差异,因此每个个体的评价都存在差异。因此,在本文中,我们比较了由多个人的数据组成的通用模型和由个人数据组成的个人模型,看看哪一个是更好的KANSEI协调。在对新体系的评价上。约54%的被试支持通用模型的设计思路。此外,约71%的受试者支持个人模型的设计理念。个人模型的设计思路比普通模型的设计思路提高了15%,结果表明个人模型的设计思路更好。
{"title":"Personal KANSEI Coordinating System for Room Interior Design","authors":"Y. Yasui, A. Ogino","doi":"10.1109/CSII.2018.00033","DOIUrl":"https://doi.org/10.1109/CSII.2018.00033","url":null,"abstract":"We have developed the KANSEI coordinating system that generates an interior design with the newness impression for a user and design style that the user has demanded. However, the previous system doesn't consider about individual differences in feeling about impression, so there are differences in evaluation for each individual. Therefore, in this paper, we compare the common model made from plural people's data and the personal model made from personal data and see which one is making good KANSEI coordination. In the evaluation of the new system by subjects. About 54% of subjects support the design idea of the common model. Also about 71% of subjects support the design idea of the personal model. The design idea of the personal model was increased by15% over the design idea of the common model, and it was shown that personal model is better.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115506180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Data Migration Scheme Considering Node Reliability for an Autonomous Distributed Storage System 考虑节点可靠性的自治分布式存储系统数据迁移方案
Atsushi Nunome, Hiroaki Hirata
We have proposed a distributed storage system which aims to utilize storage fragments distributed in network nodes without administrators' maintenance cost. Even the performance of storage devices are not uniform, autonomously data block migration helps to achieve enhancing the whole I/O performance of the storage system. However, we have considered all the storage devices to be reliable equally. On this assumption, migration of an important data block to unstable storage might cause degradation of the availability of the data block. In this paper, we propose a scheme to choose the destination of data block migration by evaluating the nodes' reliability along with the performance of storage devices. This scheme aims to improve system stability by preventing to locate a critical data onto an unstable storage device. The storage nodes which lack stability are also utilized for storing a data block which can be easily regenerated or duplicated. The results of the preliminary investigation show that a large number of warning logs from Machine Check Architecture may suggest a sign of unexpected system shutdown.
我们提出了一种分布式存储系统,旨在利用分布在网络节点上的存储碎片,而不需要管理员的维护成本。在存储设备性能不统一的情况下,通过数据块的自主迁移,可以实现存储系统整体I/O性能的提升。但是,我们认为所有的存储设备都是同样可靠的。在这种假设下,将重要的数据块迁移到不稳定的存储可能会降低数据块的可用性。本文提出了一种通过评估节点的可靠性和存储设备的性能来选择数据块迁移目的地的方案。避免将关键数据定位到不稳定的存储设备上,提高系统的稳定性。缺乏稳定性的存储节点也被用于存储易于再生或复制的数据块。初步调查的结果显示,来自Machine Check Architecture的大量警告日志可能表明出现了系统意外关闭的迹象。
{"title":"A Data Migration Scheme Considering Node Reliability for an Autonomous Distributed Storage System","authors":"Atsushi Nunome, Hiroaki Hirata","doi":"10.1109/CSII.2018.00035","DOIUrl":"https://doi.org/10.1109/CSII.2018.00035","url":null,"abstract":"We have proposed a distributed storage system which aims to utilize storage fragments distributed in network nodes without administrators' maintenance cost. Even the performance of storage devices are not uniform, autonomously data block migration helps to achieve enhancing the whole I/O performance of the storage system. However, we have considered all the storage devices to be reliable equally. On this assumption, migration of an important data block to unstable storage might cause degradation of the availability of the data block. In this paper, we propose a scheme to choose the destination of data block migration by evaluating the nodes' reliability along with the performance of storage devices. This scheme aims to improve system stability by preventing to locate a critical data onto an unstable storage device. The storage nodes which lack stability are also utilized for storing a data block which can be easily regenerated or duplicated. The results of the preliminary investigation show that a large number of warning logs from Machine Check Architecture may suggest a sign of unexpected system shutdown.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114857912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Title Page i 第1页
{"title":"Title Page i","authors":"","doi":"10.1109/csii.2018.00001","DOIUrl":"https://doi.org/10.1109/csii.2018.00001","url":null,"abstract":"","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"417 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133536712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mulesoft – Salesforce Integration Using Batch Processing 使用批处理的Salesforce集成
Manvi Seth
Mulesoft has the capability to process messages in batches. It splits the large messages into individual records that are processed asynchronously within batch jobs. Batch Processing can be used for integrating large or small datasets and process the records in parallel. Further, one can set or remove variables on individual records so that during batch processing, Mule can route or otherwise act upon records in a batch according to a record variable. With the batch approach, large volumes of incoming data from any upstream system can be extracted, transformed, and loaded (ETL) into any destination system in real time. In this paper upstream system used is Oracle database and destination system used profoundly is Salesforce. Salesforce is a cloud computing platform which stores data in the form of data objects. This paper identifies challenges that are encountered when upstream systems have complex data storage formats and hence the conversions that are necessary to perform efficacious data transfers are discussed. To help provide a deeper insight, this paper discusses many components that are very specific to batch processing and can be used to implement business logic along with some general scenarios that form the basis of any batch flow. Uses Cases wherein up to 52 million records were retrieved from database, transformed and upserted successfully to Salesforce along with appropriate error handling mechanisms are discussed. Also, the recent news of Salesforce acquiring Mulesoft opens up vast opportunities to integrate data with Salesforce using powerful Mulesoft capabilities like the Batch Processing.
Mulesoft具有批量处理消息的能力。它将大消息拆分为单独的记录,这些记录在批处理作业中进行异步处理。批处理可用于集成大型或小型数据集,并并行处理记录。此外,可以设置或删除单个记录上的变量,以便在批处理期间,Mule可以根据记录变量路由或以其他方式对批处理中的记录进行操作。使用批处理方法,可以实时提取、转换和加载(ETL)来自任何上游系统的大量传入数据到任何目标系统。本文使用的上游系统是Oracle数据库,深度使用的目标系统是Salesforce。Salesforce是一个云计算平台,它以数据对象的形式存储数据。本文确定了当上游系统具有复杂的数据存储格式时所遇到的挑战,因此讨论了执行有效数据传输所需的转换。为了提供更深入的了解,本文讨论了许多特定于批处理的组件,这些组件可用于实现业务逻辑以及构成任何批处理流基础的一些一般场景。讨论了从数据库中检索多达5200万条记录的用例,并成功地将其转换并插入到Salesforce中,同时还讨论了适当的错误处理机制。此外,最近Salesforce收购Mulesoft的消息为使用强大的Mulesoft功能(如批处理)将数据与Salesforce集成提供了巨大的机会。
{"title":"Mulesoft – Salesforce Integration Using Batch Processing","authors":"Manvi Seth","doi":"10.1109/CSII.2018.00009","DOIUrl":"https://doi.org/10.1109/CSII.2018.00009","url":null,"abstract":"Mulesoft has the capability to process messages in batches. It splits the large messages into individual records that are processed asynchronously within batch jobs. Batch Processing can be used for integrating large or small datasets and process the records in parallel. Further, one can set or remove variables on individual records so that during batch processing, Mule can route or otherwise act upon records in a batch according to a record variable. With the batch approach, large volumes of incoming data from any upstream system can be extracted, transformed, and loaded (ETL) into any destination system in real time. In this paper upstream system used is Oracle database and destination system used profoundly is Salesforce. Salesforce is a cloud computing platform which stores data in the form of data objects. This paper identifies challenges that are encountered when upstream systems have complex data storage formats and hence the conversions that are necessary to perform efficacious data transfers are discussed. To help provide a deeper insight, this paper discusses many components that are very specific to batch processing and can be used to implement business logic along with some general scenarios that form the basis of any batch flow. Uses Cases wherein up to 52 million records were retrieved from database, transformed and upserted successfully to Salesforce along with appropriate error handling mechanisms are discussed. Also, the recent news of Salesforce acquiring Mulesoft opens up vast opportunities to integrate data with Salesforce using powerful Mulesoft capabilities like the Batch Processing.","PeriodicalId":202365,"journal":{"name":"2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131952996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
2018 5th International Conference on Computational Science/ Intelligence and Applied Informatics (CSII)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1