We are exploring the design and implementation of artificial expressions, kinetic audio-visual representations of real-time physiological data which reflect emotional and cognitive state. We demonstrate the Enactive Mandala, which maps EEG signals to ambient audio-visual music. Transparent real-time feedback of brainwave qualities supports intuitive insight into the connection between thoughts and physiological states.
{"title":"Enactive mandala: sonigraphical brainwave display","authors":"Michael J. Lyons, Tomohiro Tomonaga","doi":"10.1145/2542302.2542306","DOIUrl":"https://doi.org/10.1145/2542302.2542306","url":null,"abstract":"We are exploring the design and implementation of artificial expressions, kinetic audio-visual representations of real-time physiological data which reflect emotional and cognitive state. We demonstrate the Enactive Mandala, which maps EEG signals to ambient audio-visual music. Transparent real-time feedback of brainwave qualities supports intuitive insight into the connection between thoughts and physiological states.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126465184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mobile devices are encountering increasing popularity as systems for interactive storytelling. Novels and comics can be enriched and made interactive by means of touchable interfaces and multimedia contents, so that the usual linear narration can be broken up in many paths and customized, giving rise to alternative developments.
{"title":"Augmented graphics for interactive storytelling on a mobile device","authors":"Marco Marchesi, B. Riccò","doi":"10.1145/2543651.2543683","DOIUrl":"https://doi.org/10.1145/2543651.2543683","url":null,"abstract":"Mobile devices are encountering increasing popularity as systems for interactive storytelling. Novels and comics can be enriched and made interactive by means of touchable interfaces and multimedia contents, so that the usual linear narration can be broken up in many paths and customized, giving rise to alternative developments.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126398945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Before the widespread of modern capture devices, painting served an important role in recording and depicting the real world for human. These painting artworks not only preserve the immediate depiction but also with good aesthetic sense. However, most of the the depictions in the painting are impossible to be reproduced in modern devices. In this extend abstract, we present a method that photolizes an input painting artwork. Our method generates an image which resembles the scene of the painting and has a photo-realistic appearance. A user provides a number of photos which are partly similar to the painting, and specifies a number of corresponding edge strokes in the painting and one of the photos indicating corresponding object edges. Our method automatically deforms these corresponding edges and composites these photos together.
{"title":"Painting photolization","authors":"C. Jung, I-Chao Shen, Sheng-Jie Luo, Chun-Kai Huang, Bing-Yu Chen, Wen-Huang Cheng","doi":"10.1145/2542302.2542332","DOIUrl":"https://doi.org/10.1145/2542302.2542332","url":null,"abstract":"Before the widespread of modern capture devices, painting served an important role in recording and depicting the real world for human. These painting artworks not only preserve the immediate depiction but also with good aesthetic sense. However, most of the the depictions in the painting are impossible to be reproduced in modern devices. In this extend abstract, we present a method that photolizes an input painting artwork. Our method generates an image which resembles the scene of the painting and has a photo-realistic appearance. A user provides a number of photos which are partly similar to the painting, and specifies a number of corresponding edge strokes in the painting and one of the photos indicating corresponding object edges. Our method automatically deforms these corresponding edges and composites these photos together.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125993723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael Cohen, Rasika Ranaweera, Kensuke Nishimura, Y. Sasamoto, Tomohiro Oyama, Tetsunobu Ohashi, Anzu Nakada, J. Villegas, Yong Ping Chen, Sascha Holesch, Jun Yamadera, Hayato Ito, Yasuhiko Saito, Akira Sasaki
Contemporary smartphones and tablets have magnetometers that can be used to detect yaw, which data can be distributed to adjust ambient media. We have built haptic interfaces featuring smartphones and tablets that use compass-derived orientation sensing to modulate virtual displays. Embedding mobile devices into pointing, swinging, and flailing affordances allows "padiddle"-style interfaces, finger spinning, and "poi"-style interfaces, whirling tethered devices, for novel interaction techniques [Cohen et al. 2013].
现代智能手机和平板电脑都有磁力计,可以用来检测偏航,这些数据可以分发给调整环境媒体。我们已经建立了智能手机和平板电脑的触觉界面,使用罗盘衍生的方向感应来调制虚拟显示。将移动设备嵌入指向、摆动和拍打功能中,可以实现“桨”式界面、手指旋转和“poi”式界面以及旋转系绳设备等新颖的交互技术[Cohen et al. 2013]。
{"title":"Twirled affordances, self-conscious avatars, & inspection gestures","authors":"Michael Cohen, Rasika Ranaweera, Kensuke Nishimura, Y. Sasamoto, Tomohiro Oyama, Tetsunobu Ohashi, Anzu Nakada, J. Villegas, Yong Ping Chen, Sascha Holesch, Jun Yamadera, Hayato Ito, Yasuhiko Saito, Akira Sasaki","doi":"10.1145/2543651.2543691","DOIUrl":"https://doi.org/10.1145/2543651.2543691","url":null,"abstract":"Contemporary smartphones and tablets have magnetometers that can be used to detect yaw, which data can be distributed to adjust ambient media. We have built haptic interfaces featuring smartphones and tablets that use compass-derived orientation sensing to modulate virtual displays. Embedding mobile devices into pointing, swinging, and flailing affordances allows \"padiddle\"-style interfaces, finger spinning, and \"poi\"-style interfaces, whirling tethered devices, for novel interaction techniques [Cohen et al. 2013].","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130706706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper presents a recent project on automatic generation of Kandinsky style of abstract paintings using the programming language Processing. It first offers an analysis of Kandinsky's paintings based on his art theories and the author's own understanding and observation. The generation process is described in details and sample generated images styled on four of Kandinsky's paintings are also demonstrated and discussed. Our approach is highly scalable, limited only by the memory space set in Processing. Using random generation, every styled image generated can be unique. A selection of the images generated in the required resolution is also submitted and 70 images are made into a video companion.
{"title":"Generating abstract paintings in Kandinsky style","authors":"Kang Zhang, Jinhui Yu","doi":"10.1145/2542256.2542257","DOIUrl":"https://doi.org/10.1145/2542256.2542257","url":null,"abstract":"This paper presents a recent project on automatic generation of Kandinsky style of abstract paintings using the programming language Processing. It first offers an analysis of Kandinsky's paintings based on his art theories and the author's own understanding and observation. The generation process is described in details and sample generated images styled on four of Kandinsky's paintings are also demonstrated and discussed. Our approach is highly scalable, limited only by the memory space set in Processing. Using random generation, every styled image generated can be unique. A selection of the images generated in the required resolution is also submitted and 70 images are made into a video companion.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133425481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jun-Cheol Park, Yunhun Jang, Hyungwon Choi, Sihyeon Seong, Sunghun Kang, Dae-Shik Kim
Recently, there were various approaches based on the interactive projection system as a user interface due to its broad applicability to projection surfaces[Wilson 2005][Cao et al. 2007]. Among projection surfaces, whiteboard is regarded as the most appropriate media to interact with people by writing or drawing. Throughout this work, we propose an interactive user interface system and some applications for whiteboard based on the projector. This system supports interactions by hand-drawing detection and simple hand-gesture recognition(moving or clicking).
最近,由于交互式投影系统对投影表面的广泛适用性,出现了基于交互式投影系统作为用户界面的各种方法[Wilson 2005][Cao et al. 2007]。在投影表面中,白板被认为是最适合与人进行书写或绘画互动的媒介。在整个工作中,我们提出了一个交互式用户界面系统和一些基于投影仪的白板应用。该系统支持通过手绘检测和简单的手势识别(移动或点击)进行交互。
{"title":"Applications of projection based interactive user interface","authors":"Jun-Cheol Park, Yunhun Jang, Hyungwon Choi, Sihyeon Seong, Sunghun Kang, Dae-Shik Kim","doi":"10.1145/2542302.2542350","DOIUrl":"https://doi.org/10.1145/2542302.2542350","url":null,"abstract":"Recently, there were various approaches based on the interactive projection system as a user interface due to its broad applicability to projection surfaces[Wilson 2005][Cao et al. 2007]. Among projection surfaces, whiteboard is regarded as the most appropriate media to interact with people by writing or drawing. Throughout this work, we propose an interactive user interface system and some applications for whiteboard based on the projector. This system supports interactions by hand-drawing detection and simple hand-gesture recognition(moving or clicking).","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127530380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recent advances in image and volume acquisition as well as computational advances in simulation have led to an explosion of the amount of data that must be visualized and analyzed. Modern techniques combine the parallel processing power of GPUs with out-of-core methods and data streaming to enable the interactive visualization of giga- and terabytes of image and volume data. A major enabler for interactivity is making both the computational and the visualization effort proportional to the amount of data that is actually visible on screen, decoupling it from the full data size. This leads to powerful display-aware multi-resolution techniques that enable the visualization of data of almost arbitrary size. The course consists of two major parts: An introductory part that progresses from fundamentals to modern techniques, and a more advanced part that discusses details of ray-guided volume rendering, novel data structures for display-aware visualization and processing, and the remote visualization of large online data collections. You will learn how to develop efficient GPU data structures and large-scale visualizations, implement out-of-core strategies and concepts such as virtual texturing that have only been employed recently, as well as how to use modern multi-resolution representations. These approaches reduce the GPU memory requirements of extremely large data to a working set size that fits into current GPUs. You will learn how to perform ray-casting of volume data of almost arbitrary size and how to render and process gigapixel images using scalable, display-aware techniques. We will describe custom virtual texturing architectures as well as recent hardware developments in this area. We will also describe client/server systems for distributed visualization, on-demand data processing and streaming, and remote visualization. We will describe implementations using OpenGL as well as CUDA, exploiting parallelism on GPUs combined with additional asynchronous processing and data streaming on CPUs.
{"title":"GPU-based large-scale visualization","authors":"M. Hadwiger, J. Krüger, J. Beyer, S. Bruckner","doi":"10.1145/2542266.2542273","DOIUrl":"https://doi.org/10.1145/2542266.2542273","url":null,"abstract":"Recent advances in image and volume acquisition as well as computational advances in simulation have led to an explosion of the amount of data that must be visualized and analyzed. Modern techniques combine the parallel processing power of GPUs with out-of-core methods and data streaming to enable the interactive visualization of giga- and terabytes of image and volume data. A major enabler for interactivity is making both the computational and the visualization effort proportional to the amount of data that is actually visible on screen, decoupling it from the full data size. This leads to powerful display-aware multi-resolution techniques that enable the visualization of data of almost arbitrary size.\u0000 The course consists of two major parts: An introductory part that progresses from fundamentals to modern techniques, and a more advanced part that discusses details of ray-guided volume rendering, novel data structures for display-aware visualization and processing, and the remote visualization of large online data collections.\u0000 You will learn how to develop efficient GPU data structures and large-scale visualizations, implement out-of-core strategies and concepts such as virtual texturing that have only been employed recently, as well as how to use modern multi-resolution representations. These approaches reduce the GPU memory requirements of extremely large data to a working set size that fits into current GPUs. You will learn how to perform ray-casting of volume data of almost arbitrary size and how to render and process gigapixel images using scalable, display-aware techniques. We will describe custom virtual texturing architectures as well as recent hardware developments in this area. We will also describe client/server systems for distributed visualization, on-demand data processing and streaming, and remote visualization.\u0000 We will describe implementations using OpenGL as well as CUDA, exploiting parallelism on GPUs combined with additional asynchronous processing and data streaming on CPUs.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130832161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In public transportation, quality of service is of paramount importance. In a study on public transportation reliability, approximately half of the riders reduced their use of services due to unreliability, switching to other modes of transportation [Carrel et al. 2013]. It is also known that the perceived wait time at a bus stop is greater than the actual wait time and a real time information diminishes this difference [Mishalani et al. 2006]. However, when real time data itself is unreliable, this is felt particularly frustrating [Carrel et al. 2013].
在公共交通中,服务质量至关重要。在一项关于公共交通可靠性的研究中,大约一半的乘客由于不可靠性而减少了对服务的使用,转而使用其他交通方式[Carrel et al. 2013]。我们还知道,在公交车站感知到的等待时间大于实际等待时间,而实时信息会减少这种差异[Mishalani et al. 2006]。然而,当实时数据本身不可靠时,这让人感到特别沮丧[Carrel et al. 2013]。
{"title":"Real time reliability: mixed reality public transportation","authors":"Antti Nurminen, J. Järvi","doi":"10.1145/2543651.2543689","DOIUrl":"https://doi.org/10.1145/2543651.2543689","url":null,"abstract":"In public transportation, quality of service is of paramount importance. In a study on public transportation reliability, approximately half of the riders reduced their use of services due to unreliability, switching to other modes of transportation [Carrel et al. 2013]. It is also known that the perceived wait time at a bus stop is greater than the actual wait time and a real time information diminishes this difference [Mishalani et al. 2006]. However, when real time data itself is unreliable, this is felt particularly frustrating [Carrel et al. 2013].","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129542674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Jazz that nobody asked for","authors":"E. Fisker","doi":"10.1145/2542398.2542464","DOIUrl":"https://doi.org/10.1145/2542398.2542464","url":null,"abstract":"A young man is haunted by a jazz band.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"139 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125475289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The course presents essential concepts of mobile user-experience design and reviews mobile UX trends in Asia, the US, and Europe, including case studies of developing designs for China, a near failure of user-centered mobile UX design, and cross-cultural issues of mobile UX design for phones and tablets. Participants in this course will learn the following: new terms, concepts, and issues to understand mobile user-centered design, guidelines, personas, and use-scenarios; latest trends and challenges of design of mobile user-interface components (metaphors, mental models, navigation, interaction, and appearance; practical trade-offs from studying competitive analyses and case-study results. Benefits of the course include: increased understanding of key issues, challenges, philosophies, and principles; increased awareness of current and cutting-edge products and services; and increased knowledge of how to use your skills, expertise, and experience.
{"title":"Mobile user-experience design trends","authors":"A. Marcus","doi":"10.1145/2542266.2542278","DOIUrl":"https://doi.org/10.1145/2542266.2542278","url":null,"abstract":"The course presents essential concepts of mobile user-experience design and reviews mobile UX trends in Asia, the US, and Europe, including case studies of developing designs for China, a near failure of user-centered mobile UX design, and cross-cultural issues of mobile UX design for phones and tablets. Participants in this course will learn the following: new terms, concepts, and issues to understand mobile user-centered design, guidelines, personas, and use-scenarios; latest trends and challenges of design of mobile user-interface components (metaphors, mental models, navigation, interaction, and appearance; practical trade-offs from studying competitive analyses and case-study results. Benefits of the course include: increased understanding of key issues, challenges, philosophies, and principles; increased awareness of current and cutting-edge products and services; and increased knowledge of how to use your skills, expertise, and experience.","PeriodicalId":126796,"journal":{"name":"International Conference on Societal Automation","volume":"75 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120969188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}