Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390650
Costanza Navarretta
This paper deals with speech pauses marking clause boundaries and the gestures which co-occur with them in an audio- and video-recorded corpus of first encounters. The paper also investigates whether information about gestures co-occurring with speech contributes to the automatic prediction of the clause boundary pauses. Since one clause corresponds to one or more semantic units (dialog acts) the pauses investigated mark the start and end of large semantic units. The results of my study indicate that pauses that mark clause boundaries, co-occur with all gesture types in the analyzed corpus. Finally, my automatic prediction experiments show that information about speech tokens preceding the pauses can predict their function as clause boundary markers with high precision and recall, while information about the gestures co-occurring with speech (head movements, facial expressions, and body postures) does not contribute to the prediction.
{"title":"Pauses delimiting semantic boundaries","authors":"Costanza Navarretta","doi":"10.1109/COGINFOCOM.2015.7390650","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390650","url":null,"abstract":"This paper deals with speech pauses marking clause boundaries and the gestures which co-occur with them in an audio- and video-recorded corpus of first encounters. The paper also investigates whether information about gestures co-occurring with speech contributes to the automatic prediction of the clause boundary pauses. Since one clause corresponds to one or more semantic units (dialog acts) the pauses investigated mark the start and end of large semantic units. The results of my study indicate that pauses that mark clause boundaries, co-occur with all gesture types in the analyzed corpus. Finally, my automatic prediction experiments show that information about speech tokens preceding the pauses can predict their function as clause boundary markers with high precision and recall, while information about the gestures co-occurring with speech (head movements, facial expressions, and body postures) does not contribute to the prediction.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"118 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133733427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390555
Szász Csaba
As it is well known, the uninterruptible trend of endowing robotic systems with more human-like intelligence represents a great scientific challenge and a major task of cognitive robotics. With the main goal of improving human-robot interaction, nowadays the great majority of human-robot communication behaviors are implemented on mobile agents, or so called pervasive mobile robots enhanced with complex interaction abilities. However, to choose the adequate hardware and software technologies in order to achieve rapid and efficient advancement in human-computer interactions implementation it looks a difficult and burdening task even for the specialists involved in the topic. Starting from the above observation, the main goal of this paper is to unfold a well-fitted example of mixing last generation hardware resources and software toolkits to implement complex human-like abilities on robotic systems. Besides outlining the advantages and versatility of the chosen technologies the paper also presents research efforts and experimental results regarding symbolic cognitive abilities implementation on a specially developed NI-9631 prototype robot structure. The hardware architecture of this mobile agent has been developed upon a unique robotic configuration designed for human gestures and speech recognition abilities implementation. By using the LabView graphical programming software technology, these modules integrates through specific software drivers various sensor modality including vision and speech signals analyzing. The robot upgraded with the above mentioned capabilities becomes a very flexible and powerful development toolkit for complex human-robot interaction research and highlevel cognitive abilities implementation. In addition, the system also represents a useful platform for a large amount of voice signals and image processing algorithms rapid testing and development, through that the robot displays intelligence and cooperativeness in its behavior.
{"title":"Symbolic cognitive abilities implementation on the NI-9631 pervasive mobile robot","authors":"Szász Csaba","doi":"10.1109/COGINFOCOM.2015.7390555","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390555","url":null,"abstract":"As it is well known, the uninterruptible trend of endowing robotic systems with more human-like intelligence represents a great scientific challenge and a major task of cognitive robotics. With the main goal of improving human-robot interaction, nowadays the great majority of human-robot communication behaviors are implemented on mobile agents, or so called pervasive mobile robots enhanced with complex interaction abilities. However, to choose the adequate hardware and software technologies in order to achieve rapid and efficient advancement in human-computer interactions implementation it looks a difficult and burdening task even for the specialists involved in the topic. Starting from the above observation, the main goal of this paper is to unfold a well-fitted example of mixing last generation hardware resources and software toolkits to implement complex human-like abilities on robotic systems. Besides outlining the advantages and versatility of the chosen technologies the paper also presents research efforts and experimental results regarding symbolic cognitive abilities implementation on a specially developed NI-9631 prototype robot structure. The hardware architecture of this mobile agent has been developed upon a unique robotic configuration designed for human gestures and speech recognition abilities implementation. By using the LabView graphical programming software technology, these modules integrates through specific software drivers various sensor modality including vision and speech signals analyzing. The robot upgraded with the above mentioned capabilities becomes a very flexible and powerful development toolkit for complex human-robot interaction research and highlevel cognitive abilities implementation. In addition, the system also represents a useful platform for a large amount of voice signals and image processing algorithms rapid testing and development, through that the robot displays intelligence and cooperativeness in its behavior.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"158 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132671980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390657
Karolina Galinska, Piotr Luboch, Konrad Kluwak, M. Bieganski
This paper describes implementation of gait recognition that consists of two parts - capturing motion and data analysis. It introduces the process of building database of elementary human movements and explains the choice of BVH recording format. Besides filtering, three different methods of data analysis have been applied - Fourier transform, harmonic analysis and integral computing. Finally, it shows a broad spectrum of gait recognition practical application possibilities.
{"title":"A database of elementary human movements collected with RGB-D type camera","authors":"Karolina Galinska, Piotr Luboch, Konrad Kluwak, M. Bieganski","doi":"10.1109/COGINFOCOM.2015.7390657","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390657","url":null,"abstract":"This paper describes implementation of gait recognition that consists of two parts - capturing motion and data analysis. It introduces the process of building database of elementary human movements and explains the choice of BVH recording format. Besides filtering, three different methods of data analysis have been applied - Fourier transform, harmonic analysis and integral computing. Finally, it shows a broad spectrum of gait recognition practical application possibilities.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128040003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390604
Zsolt Medgyesi, K. Pomázi, Luca Szegletes, B. Forstner
Evaluating mobile and desktop applications from usability aspects is becoming trending as the usage of electronic devices increases every day. Both user loyalty and usage efficiency are key factors in developing successful applications, given the wide variety of the market. An affordable and portable monitoring environment for desktop and mobile platforms could fulfill the specific needs of user experience researchers. In this paper we present a system that monitors the physiological signals of the user while using any application installed on the devices. As a result, we are able track the eye movement, ECG and EEG signals, and analyze the combined data provided by these sensors. Results are visualized in a way that user experience experts can follow effortlessly application usage and cognitive processes of the user, which makes it possible to improve even further the user interface to boost productivity and user loyalty, and lower frustration.
{"title":"Evaluating application usability with portable biofeedback system for mobile and desktop","authors":"Zsolt Medgyesi, K. Pomázi, Luca Szegletes, B. Forstner","doi":"10.1109/COGINFOCOM.2015.7390604","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390604","url":null,"abstract":"Evaluating mobile and desktop applications from usability aspects is becoming trending as the usage of electronic devices increases every day. Both user loyalty and usage efficiency are key factors in developing successful applications, given the wide variety of the market. An affordable and portable monitoring environment for desktop and mobile platforms could fulfill the specific needs of user experience researchers. In this paper we present a system that monitors the physiological signals of the user while using any application installed on the devices. As a result, we are able track the eye movement, ECG and EEG signals, and analyze the combined data provided by these sensors. Results are visualized in a way that user experience experts can follow effortlessly application usage and cognitive processes of the user, which makes it possible to improve even further the user interface to boost productivity and user loyalty, and lower frustration.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131732155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390576
B. Almási, Mark Kosa, Ferenc Fejes, R. Katona, Levente Pusok
The Cognitive Infocommunications became a really hot research area during the past years. As a result of these researches, systems built on the 3D video and multichannel audio transmission will appear as an everyday used technology in the near future. Although the growth of the speed in the physical layer transmission technology seems to be capable to satisfy the increasing speed requirements of the applications, we have to consider the negative effect of networking breakdowns: the network service breakdowns can produce serious problems in the performance of the CogInfoCom systems. In this paper we introduce the MPT network layer multipath communication library, which allows the usage of multiple paths in one communication session. Earlier studies showed that the multipath communication technology is capable to effectively aggregate the throughput of the different paths. Now we examine how the MPT based multipath communication environment reacts to network breakdowns. Our measurement results showed that the TCP based video stream transmission was not influenced by the scheduled network breakdown, even more the unexpected breakdown caused only a little stuttering.
{"title":"MPT: A solution for eliminating the effect of network breakdowns in case of HD video stream transmission","authors":"B. Almási, Mark Kosa, Ferenc Fejes, R. Katona, Levente Pusok","doi":"10.1109/COGINFOCOM.2015.7390576","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390576","url":null,"abstract":"The Cognitive Infocommunications became a really hot research area during the past years. As a result of these researches, systems built on the 3D video and multichannel audio transmission will appear as an everyday used technology in the near future. Although the growth of the speed in the physical layer transmission technology seems to be capable to satisfy the increasing speed requirements of the applications, we have to consider the negative effect of networking breakdowns: the network service breakdowns can produce serious problems in the performance of the CogInfoCom systems. In this paper we introduce the MPT network layer multipath communication library, which allows the usage of multiple paths in one communication session. Earlier studies showed that the multipath communication technology is capable to effectively aggregate the throughput of the different paths. Now we examine how the MPT based multipath communication environment reacts to network breakdowns. Our measurement results showed that the TCP based video stream transmission was not influenced by the scheduled network breakdown, even more the unexpected breakdown caused only a little stuttering.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115702327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390616
G. Kosztolanyi-Ivan, C. Koren, A. Borsos
This paper outlines the recognition process of road types and its influence on speed choice. The appearance and spreading of the term "cognitive infocommunications" led the authors to rethink some of their earlier work from the cognitive perspective. In order to assess the recognition of road types and speed choice a picture sorting exercise and an on-line speed choice survey was completed. Limitations and extensions of the method are also considered.
{"title":"Recognition of road types and speed choice","authors":"G. Kosztolanyi-Ivan, C. Koren, A. Borsos","doi":"10.1109/COGINFOCOM.2015.7390616","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390616","url":null,"abstract":"This paper outlines the recognition process of road types and its influence on speed choice. The appearance and spreading of the term \"cognitive infocommunications\" led the authors to rethink some of their earlier work from the cognitive perspective. In order to assess the recognition of road types and speed choice a picture sorting exercise and an on-line speed choice survey was completed. Limitations and extensions of the method are also considered.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124895405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390558
C. Friberg
Cloud4all[1] is an international project funded by the 7th Framework Programme of the European Union. Its goal is to build a cloud-based framework for user preference handling to allow a user's needs and preferences to be accessed by participating applications and devices, in order to customize themselves to suit the user's needs. The customizations can be triggered by input from external sensors, allowing the system to make adjustments based on environmental factors. We have integrated our video communication apps, eCtouch and eCmobile, with the Cloud4all framework. The apps can now adapt their interfaces and functionality to suit users' preferences. This has resulted in improved usability for targeted user groups and a more targeted focus on accessibility from the developer side.
{"title":"Cloud4all: Accessibility through cloud-based personalization","authors":"C. Friberg","doi":"10.1109/COGINFOCOM.2015.7390558","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390558","url":null,"abstract":"Cloud4all[1] is an international project funded by the 7th Framework Programme of the European Union. Its goal is to build a cloud-based framework for user preference handling to allow a user's needs and preferences to be accessed by participating applications and devices, in order to customize themselves to suit the user's needs. The customizations can be triggered by input from external sensors, allowing the system to make adjustments based on environmental factors. We have integrated our video communication apps, eCtouch and eCmobile, with the Cloud4all framework. The apps can now adapt their interfaces and functionality to suit users' preferences. This has resulted in improved usability for targeted user groups and a more targeted focus on accessibility from the developer side.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122052470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390661
P. Várlaki, P. Baranyi
This part of the paper first deals with some methodological problems of the possible identification of special patterns in the hypothetical evolution of the broadening reflective consciousness ("collective individuation") related to the spiritual history of the 11th century. Furthermore, we intend to present some hypothetical important episodes of the process of the development of the consciousness, the collective individuation with partial interpretation of Pauli's Regiomontanus dream and subsequent famous dream series of 1954-1956, by their interpretation as a long run cognitive process.
{"title":"\"empirical identification\" of the creative cognitive unconscious processes in the collective individuation concerning the \"world-clock models\" part ii. pauli's regiomontanus dream and its historical and spiritual background","authors":"P. Várlaki, P. Baranyi","doi":"10.1109/COGINFOCOM.2015.7390661","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390661","url":null,"abstract":"This part of the paper first deals with some methodological problems of the possible identification of special patterns in the hypothetical evolution of the broadening reflective consciousness (\"collective individuation\") related to the spiritual history of the 11th century. Furthermore, we intend to present some hypothetical important episodes of the process of the development of the consciousness, the collective individuation with partial interpretation of Pauli's Regiomontanus dream and subsequent famous dream series of 1954-1956, by their interpretation as a long run cognitive process.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125410999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390640
L. Czúni, Metwally Rashad
A new approach for lightweight video-based object recognition is introduced where a user moves a camera around a target object of interest. The extraction of image features and the retrieval algorithm is running in a lightweight mobile computer (tablet or phone). We apply a view based model of the objects and the matching of the query and candidate images is based on compact image descriptors coupled with relative orientation.
{"title":"Interactive object recognition with sensor fusion","authors":"L. Czúni, Metwally Rashad","doi":"10.1109/COGINFOCOM.2015.7390640","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390640","url":null,"abstract":"A new approach for lightweight video-based object recognition is introduced where a user moves a camera around a target object of interest. The extraction of image features and the retrieval algorithm is running in a lightweight mobile computer (tablet or phone). We apply a view based model of the objects and the matching of the query and candidate images is based on compact image descriptors coupled with relative orientation.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125541854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2015-10-01DOI: 10.1109/COGINFOCOM.2015.7390561
Liubov Lisitsyna, A. Lyamin, Elena N. Cherepovskaya, I. Martynikhin
In this paper we describe the second stage of developing new Situation Awareness Training and investigation of its effectiveness on improving cognitive intercommunication with e-learning system. Situation Awareness training enhance of attentiveness as well as increase of exam's GPA and nonverbal intelligence indexes had been observed. Improvement of the exam results, mediated by attention increase, suggests the possibility of enhancing students' cognitive intercommunication with online examination systems via the Situation Awareness trainings.
{"title":"Cognitive trainings can improve intercommunication with e-learning system","authors":"Liubov Lisitsyna, A. Lyamin, Elena N. Cherepovskaya, I. Martynikhin","doi":"10.1109/COGINFOCOM.2015.7390561","DOIUrl":"https://doi.org/10.1109/COGINFOCOM.2015.7390561","url":null,"abstract":"In this paper we describe the second stage of developing new Situation Awareness Training and investigation of its effectiveness on improving cognitive intercommunication with e-learning system. Situation Awareness training enhance of attentiveness as well as increase of exam's GPA and nonverbal intelligence indexes had been observed. Improvement of the exam results, mediated by attention increase, suggests the possibility of enhancing students' cognitive intercommunication with online examination systems via the Situation Awareness trainings.","PeriodicalId":377891,"journal":{"name":"2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126714189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：