Prometheus' string series attempt various artistic experiments applied to 'data refraction', a concept that breaks frame of data with modern concept of accurate delivery of information and induces more creative results. The resulting installation work includes various processes such as data extraction from living creature into 3D shape generation and printing, as well as robotic sculpture and data visual performance. 'Prometheus string' series began by recognizing the material essence of life as a stream of non-material data. For example, if you look at the human body, dead cells on one side are falling apart, and on the other, new cell division is constantly occurring. The living things that we can see and touch are just a piece of the continual line of life and death of the many invisible substances that make up our body. The information of living things that have been digitalized becomes a model for realizing unexpected results through a process of 'refraction of data' that is transferred or transformed in a way suitable for various systems. Of course, using information about life can't be said that the information can replace life, but it can be a significant attempt to approach the essence of life with a new perspective on the digital system, which is gradually expanding its scope. Prometheus' string series also intends to continue various artistic experiments applied to the 'refraction of data', a concept that breaks the frame of data with a modern concept of accurate delivery of information and induces more creative results. The experiment to convert from material life to non-material information and from information to artificial life will continue. Also experiments of connecting artificial intelligence patterns for robot movement with social discourse as well.
{"title":"Prometheus string","authors":"S. Jung","doi":"10.1145/3414686.3427137","DOIUrl":"https://doi.org/10.1145/3414686.3427137","url":null,"abstract":"Prometheus' string series attempt various artistic experiments applied to 'data refraction', a concept that breaks frame of data with modern concept of accurate delivery of information and induces more creative results. The resulting installation work includes various processes such as data extraction from living creature into 3D shape generation and printing, as well as robotic sculpture and data visual performance. 'Prometheus string' series began by recognizing the material essence of life as a stream of non-material data. For example, if you look at the human body, dead cells on one side are falling apart, and on the other, new cell division is constantly occurring. The living things that we can see and touch are just a piece of the continual line of life and death of the many invisible substances that make up our body. The information of living things that have been digitalized becomes a model for realizing unexpected results through a process of 'refraction of data' that is transferred or transformed in a way suitable for various systems. Of course, using information about life can't be said that the information can replace life, but it can be a significant attempt to approach the essence of life with a new perspective on the digital system, which is gradually expanding its scope. Prometheus' string series also intends to continue various artistic experiments applied to the 'refraction of data', a concept that breaks the frame of data with a modern concept of accurate delivery of information and induces more creative results. The experiment to convert from material life to non-material information and from information to artificial life will continue. Also experiments of connecting artificial intelligence patterns for robot movement with social discourse as well.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131594914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Can we look at a person's face and determine how they feel? AI emotion recognition systems are designed to detect faces and return confidence levels across a set of emotions such as anger, contempt, disgust, fear, happiness, sadness and surprise. Such systems already operate in our environment and might have the capacity to seriously impact our lives. In the live performance 'Don't Worry, Be Happy', the artist is strapped to an electric chair. Her face is constantly detected by an emotion recognition AI system. As long as she is detected as 'Happy' she is safe. However, each time any other emotion is observed, she receives an electric shock to both her arms. During the performance the artist changes her apparent behavior in order to free herself from the 'punishment' that the AI system delivers. Yet, under the threat of getting shocked, for how long can she perform this exaggerated facial expression so that the machine continues to 'read' her as 'Happy'? The apparatus presented in this performance utilizes the electric chair as a reminder of the use of new technologies as instruments of the law. Such tools initially appeared as legitimate solutions and was later own understood as problematic and inhumane. The performance aims to remind the viewers that we are not powerless when we are confronted with AI algorithms that are looking at us. The artist resists the emotion recognition system by faking a smile. This performative engagement points out to a future of a post-algorithmic society in which we change our behavior in order to align it with algorithms in our environment.
{"title":"Don't worry, be happy","authors":"Avital Meshi","doi":"10.1145/3414686.3427151","DOIUrl":"https://doi.org/10.1145/3414686.3427151","url":null,"abstract":"Can we look at a person's face and determine how they feel? AI emotion recognition systems are designed to detect faces and return confidence levels across a set of emotions such as anger, contempt, disgust, fear, happiness, sadness and surprise. Such systems already operate in our environment and might have the capacity to seriously impact our lives. In the live performance 'Don't Worry, Be Happy', the artist is strapped to an electric chair. Her face is constantly detected by an emotion recognition AI system. As long as she is detected as 'Happy' she is safe. However, each time any other emotion is observed, she receives an electric shock to both her arms. During the performance the artist changes her apparent behavior in order to free herself from the 'punishment' that the AI system delivers. Yet, under the threat of getting shocked, for how long can she perform this exaggerated facial expression so that the machine continues to 'read' her as 'Happy'? The apparatus presented in this performance utilizes the electric chair as a reminder of the use of new technologies as instruments of the law. Such tools initially appeared as legitimate solutions and was later own understood as problematic and inhumane. The performance aims to remind the viewers that we are not powerless when we are confronted with AI algorithms that are looking at us. The artist resists the emotion recognition system by faking a smile. This performative engagement points out to a future of a post-algorithmic society in which we change our behavior in order to align it with algorithms in our environment.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"139 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131694201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
"Let's Chat Like This" is an interactive system that allows two people to observe each others' moods through interacting with a shared interactively generated image. The moving image changes according to the two people's facial expressions. Different from traditional ways of communication, "Let's Chat Like This" focuses more on the emotional aspect of communication. It shows a visualization of the complexity of human emotion and boosts people's emotional communication in a creative no-verbal way. When experiencing this work, people's emotions are bound together with the same moving image they see. The moving image changes depending on their moods. They will be aware of their current moods as well as the other's, the intimacy and empathy between them will be increased. This is not only a "social distancing" art installation that helps us connect emotionally during the COVID-19 pandemic, but also my hypothesis of what future emotional communication will be like. I hope this artwork can evoke deep thinking and maybe cheer people up in this challenging time.
{"title":"Let's chat like this","authors":"Qinyuan Liu","doi":"10.1145/3414686.3427118","DOIUrl":"https://doi.org/10.1145/3414686.3427118","url":null,"abstract":"\"Let's Chat Like This\" is an interactive system that allows two people to observe each others' moods through interacting with a shared interactively generated image. The moving image changes according to the two people's facial expressions. Different from traditional ways of communication, \"Let's Chat Like This\" focuses more on the emotional aspect of communication. It shows a visualization of the complexity of human emotion and boosts people's emotional communication in a creative no-verbal way. When experiencing this work, people's emotions are bound together with the same moving image they see. The moving image changes depending on their moods. They will be aware of their current moods as well as the other's, the intimacy and empathy between them will be increased. This is not only a \"social distancing\" art installation that helps us connect emotionally during the COVID-19 pandemic, but also my hypothesis of what future emotional communication will be like. I hope this artwork can evoke deep thinking and maybe cheer people up in this challenging time.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127948591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
As we all feel as of 2020, most things in the world are reorganized around digital technology and the influence is strong. This technology is rapidly changing toward AI and M2M, where hardware is becoming nanoscale and software is less human intervention in order to process data flooding more efficiently and quickly. For this reason, we were the discoverers of this technology, but we feel a gap where we no longer know how it works. And I think it provides an opportunity for digital life, Digital Being, to emerge from that gap. I have been looking for an invisible and formless creature born out of abandoned technology for 10 years in New York City. I call it, "Digital Being," and it is also the title of my hypothetical story. This creature has atypical movements or other interactions depending on the machine it dominates. Also in this story, the entity can transmit itself over the network. Digital Being: "Hello, World!," a primitive version of the digital being family, has arrived into LCD touch screens through the network. There seems to be no physical connection, but you can guess by seeing the Wi-Fi indicator briefly appear in the right corner of the screen every time I boot it up. I don't know why, but, after arriving, it started to create a flag image by constantly collecting small pixels. To me, this action seems like a process similar to how people co-evolved the state. Please come closer and see what it is doing by touching the screen.
{"title":"Digital being: \"hello, world!\"","authors":"Taezoo Park","doi":"10.1145/3414686.3427138","DOIUrl":"https://doi.org/10.1145/3414686.3427138","url":null,"abstract":"As we all feel as of 2020, most things in the world are reorganized around digital technology and the influence is strong. This technology is rapidly changing toward AI and M2M, where hardware is becoming nanoscale and software is less human intervention in order to process data flooding more efficiently and quickly. For this reason, we were the discoverers of this technology, but we feel a gap where we no longer know how it works. And I think it provides an opportunity for digital life, Digital Being, to emerge from that gap. I have been looking for an invisible and formless creature born out of abandoned technology for 10 years in New York City. I call it, \"Digital Being,\" and it is also the title of my hypothetical story. This creature has atypical movements or other interactions depending on the machine it dominates. Also in this story, the entity can transmit itself over the network. Digital Being: \"Hello, World!,\" a primitive version of the digital being family, has arrived into LCD touch screens through the network. There seems to be no physical connection, but you can guess by seeing the Wi-Fi indicator briefly appear in the right corner of the screen every time I boot it up. I don't know why, but, after arriving, it started to create a flag image by constantly collecting small pixels. To me, this action seems like a process similar to how people co-evolved the state. Please come closer and see what it is doing by touching the screen.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129739149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In NEBULA GO, you can see many nebulae and stars being born and losing, and glimpse the secrets that arise in space. In this NEBULA GO, the universe is expressed through Go, and since ancient times, Go was invented as a tool for observing and studying the movement of celestial bodies. In this work, the artist harmonizes the secrets that occur in the universe by using the act of placing a Go in a square space, various fights caused by it, domain creation, and movement of forces. Looking at NEBULA GO, unlike Go, where victory or defeat is determined, you can observe the numerous planets visible in the universe when all actions have been completed and the changes caused by these planets. Also, by focusing on the birth origin of astronomical observation, actors can appreciate their own microcosm through their actions.
{"title":"Nebula go","authors":"Jungho Kim, Youngho Kim, Taekyung Yoo","doi":"10.1145/3414686.3427166","DOIUrl":"https://doi.org/10.1145/3414686.3427166","url":null,"abstract":"In NEBULA GO, you can see many nebulae and stars being born and losing, and glimpse the secrets that arise in space. In this NEBULA GO, the universe is expressed through Go, and since ancient times, Go was invented as a tool for observing and studying the movement of celestial bodies. In this work, the artist harmonizes the secrets that occur in the universe by using the act of placing a Go in a square space, various fights caused by it, domain creation, and movement of forces. Looking at NEBULA GO, unlike Go, where victory or defeat is determined, you can observe the numerous planets visible in the universe when all actions have been completed and the changes caused by these planets. Also, by focusing on the birth origin of astronomical observation, actors can appreciate their own microcosm through their actions.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123985623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The screen's nature is to both show and to obscure. It forever hypnotizes us, seamlessly eliminating its own qualities as a substrate. It owns the characteristics of a Zelig: forever changing, unstable in any context, and destabilizing context itself. Informed by photography, film, and every meme that ever was, the digital image shifts readily between aspects of each. Its meaning is necessarily slippery and hard to define; possessing a quality that makes it hard to pin down or make fit into a neat category. Given this slipperiness, can we ever grasp the basic, tectonic components of the digital image? The bits and pixels of the screen do little to help our visual understanding of its relationship to one's perspective in everyday life. The seductive illusions and concomitant complexities of our online experiences have enabled an entirely new trompe l'oeil hell of phishing attacks, spoofs, and cross-domain tomfoolery. Digital images, precisely because of their ambivalence towards the picture plane, forever slip from our grasp. Only as Flusser's metaphorical wind blows them from our mental, perceptual grasp do they reveal aspects of their construction. Rather than fight against this liminal quality, we exploit it. Good-for-nothings celebrate the disappearance of materiality; albeit, through lack, dejection, and an embrace of the absence that seems to have brought much of our culture to a standstill. Forever shifting, always shiftless, on an endless joyride from nowhere to anywhere. How does one go about working with this shiftlessness? Each Good-for-nothing raises its metaphorical glass to Herman Melville's crème de la crème good-for-nothing anti-hero, Bartleby. They are images aligned with a scrivener of the post-modern age that can only tell us: 'I prefer not to'.
{"title":"Good-for-nothing (no. 1)","authors":"Nathan Matteson, Nicholas Kersulis","doi":"10.1145/3414686.3427171","DOIUrl":"https://doi.org/10.1145/3414686.3427171","url":null,"abstract":"The screen's nature is to both show and to obscure. It forever hypnotizes us, seamlessly eliminating its own qualities as a substrate. It owns the characteristics of a Zelig: forever changing, unstable in any context, and destabilizing context itself. Informed by photography, film, and every meme that ever was, the digital image shifts readily between aspects of each. Its meaning is necessarily slippery and hard to define; possessing a quality that makes it hard to pin down or make fit into a neat category. Given this slipperiness, can we ever grasp the basic, tectonic components of the digital image? The bits and pixels of the screen do little to help our visual understanding of its relationship to one's perspective in everyday life. The seductive illusions and concomitant complexities of our online experiences have enabled an entirely new trompe l'oeil hell of phishing attacks, spoofs, and cross-domain tomfoolery. Digital images, precisely because of their ambivalence towards the picture plane, forever slip from our grasp. Only as Flusser's metaphorical wind blows them from our mental, perceptual grasp do they reveal aspects of their construction. Rather than fight against this liminal quality, we exploit it. Good-for-nothings celebrate the disappearance of materiality; albeit, through lack, dejection, and an embrace of the absence that seems to have brought much of our culture to a standstill. Forever shifting, always shiftless, on an endless joyride from nowhere to anywhere. How does one go about working with this shiftlessness? Each Good-for-nothing raises its metaphorical glass to Herman Melville's crème de la crème good-for-nothing anti-hero, Bartleby. They are images aligned with a scrivener of the post-modern age that can only tell us: 'I prefer not to'.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126286481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Narcissus was a hunter in Greek mythology who fell in love with his own reflection in the water. Narcissus is the origin of the term narcissism. This artwork, as its name suggests, is based on the myth of Narcissus. A narcissistic ego that conceals the weakness of the individual, focuses energy only on itself. Everyone has narcissism even if a little. Excessive narcissism causes lots of problems from isolation because fascinating by the perfection of oneself makes relationship with the others closed. Sensing the brainwave of an appreciator, creates an interaction that the higher concentration on the reflection on the surface of water, the more blurred observation. Through this interaction, the viewer is interrupted from being deeply immersed in oneself. That experience reflects the reverse of the Narcissus story and expresses that mirrored image of the participant could not exist as complete subject. Also, this artwork is referred to the 'Mirror stage' hypothesized by Jacques Lacan(1901--1981). Unlike the ego-psychologists' assertion that we should strengthen our ego, Jacques Lacan points out the narcissistic ego which is imaginary in human beings and says that we can grow up as a healthy subject through acknowledging that we are lacking ego not just strengthening the ego.
{"title":"Narcissus","authors":"S. Lee","doi":"10.1145/3414686.3427152","DOIUrl":"https://doi.org/10.1145/3414686.3427152","url":null,"abstract":"Narcissus was a hunter in Greek mythology who fell in love with his own reflection in the water. Narcissus is the origin of the term narcissism. This artwork, as its name suggests, is based on the myth of Narcissus. A narcissistic ego that conceals the weakness of the individual, focuses energy only on itself. Everyone has narcissism even if a little. Excessive narcissism causes lots of problems from isolation because fascinating by the perfection of oneself makes relationship with the others closed. Sensing the brainwave of an appreciator, creates an interaction that the higher concentration on the reflection on the surface of water, the more blurred observation. Through this interaction, the viewer is interrupted from being deeply immersed in oneself. That experience reflects the reverse of the Narcissus story and expresses that mirrored image of the participant could not exist as complete subject. Also, this artwork is referred to the 'Mirror stage' hypothesized by Jacques Lacan(1901--1981). Unlike the ego-psychologists' assertion that we should strengthen our ego, Jacques Lacan points out the narcissistic ego which is imaginary in human beings and says that we can grow up as a healthy subject through acknowledging that we are lacking ego not just strengthening the ego.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123573970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This work invites viewers to see the world through a machine's perspective. People are accustomed to seeing the world through an anthropocentric viewpoint and create things accordingly. What will it be like if machines are creating things through their perspective? Created by the Mechanical Creator, what are the challenges this group of mechanical life forms is facing for survival? How do they live within and adapt to the environment? We know that hermit crabs are using human trash as their shells. What would the mechanical life forms do when they are interacting with their living environment?
{"title":"\"Mobile\" device","authors":"Chenwei Chiang","doi":"10.1145/3414686.3427121","DOIUrl":"https://doi.org/10.1145/3414686.3427121","url":null,"abstract":"This work invites viewers to see the world through a machine's perspective. People are accustomed to seeing the world through an anthropocentric viewpoint and create things accordingly. What will it be like if machines are creating things through their perspective? Created by the Mechanical Creator, what are the challenges this group of mechanical life forms is facing for survival? How do they live within and adapt to the environment? We know that hermit crabs are using human trash as their shells. What would the mechanical life forms do when they are interacting with their living environment?","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"177 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115763943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
"Serial paintings" are a series of works highlighting the role of the canvas - or more generally the support of the painting - in the construction of the final form. "Back and Forth - Pneumatic Anadrome" is the first work in the series. In it, a string of coloured beads is pushed back and forth between two spiralling "canvases" using compressed air. Without rearranging the order of the beads, the string is forced to coil alternatively into one or the other spiral: this folding and unfolding reveals in turn images or text with opposing meanings or connotations. Each image has to be destroyed in order to create the other; this cyclic process of creation and destruction is purposefully revealed and triggered by the curiosity of the public.
{"title":"Back and forth: pneumatic anadrome [serial painting 1]","authors":"Á. Cassinelli, C. Sandor, D. Saakes","doi":"10.1145/3414686.3427150","DOIUrl":"https://doi.org/10.1145/3414686.3427150","url":null,"abstract":"\"Serial paintings\" are a series of works highlighting the role of the canvas - or more generally the support of the painting - in the construction of the final form. \"Back and Forth - Pneumatic Anadrome\" is the first work in the series. In it, a string of coloured beads is pushed back and forth between two spiralling \"canvases\" using compressed air. Without rearranging the order of the beads, the string is forced to coil alternatively into one or the other spiral: this folding and unfolding reveals in turn images or text with opposing meanings or connotations. Each image has to be destroyed in order to create the other; this cyclic process of creation and destruction is purposefully revealed and triggered by the curiosity of the public.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125385631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Lee, Eun Young Lee, Joo-seok Moon, Jina Jung, H. Park, H. Lee, Seung Ah Lee
Many people enjoy keeping houseplants and get comfort from the presence of plants. Not only for aesthetics and medical purposes, plants also have many other uses in human history. As a result, plant ecology and its biological evolutions are closely related to human culture. Normally people perceive plants as static objects, but in fact they do move and react to their surrounding environment in real-time. Their responses are just too slow to be recognized and their communication methods just differ from ours. Therefore, people find it hard to understand the biological and ecological contents underneath plants. We imagine what would happen if plants can talk, see, and sense as humans do. Our team is composed of researchers from engineering, HCI, and media arts. Our biology-computer hybrid installation project is collaboratively created based on our imagination driven from diverse experiences and interdisciplinary knowledge. Based on the imagination, we give each plant a character and exaggerate plants' sense by adding electronic devices with text to speech (TTS) voice synthesis and physics-based visual processing. The cultural histories of plants are spoken with all different synthesized human voices generated by our AI-based voice synthesis system. Also, as human vision responds to light, we also imagined that plants could see their surroundings through leaves. Because photosynthesis takes place there. By capturing the image from a mini-camera affixed to the leaf and showing the result of image processing in LCD screens placed among plants, we mimic a vision of the plants. The electrical signal is measured when users touch the plant and it distorts the audio-visual outputs. The overall experience with this work may arouse users to think about plants as a dynamic living being, opening a gap for users to understand the underlying context of plants more deeply.
{"title":"Plantext","authors":"K. Lee, Eun Young Lee, Joo-seok Moon, Jina Jung, H. Park, H. Lee, Seung Ah Lee","doi":"10.1145/3414686.3427139","DOIUrl":"https://doi.org/10.1145/3414686.3427139","url":null,"abstract":"Many people enjoy keeping houseplants and get comfort from the presence of plants. Not only for aesthetics and medical purposes, plants also have many other uses in human history. As a result, plant ecology and its biological evolutions are closely related to human culture. Normally people perceive plants as static objects, but in fact they do move and react to their surrounding environment in real-time. Their responses are just too slow to be recognized and their communication methods just differ from ours. Therefore, people find it hard to understand the biological and ecological contents underneath plants. We imagine what would happen if plants can talk, see, and sense as humans do. Our team is composed of researchers from engineering, HCI, and media arts. Our biology-computer hybrid installation project is collaboratively created based on our imagination driven from diverse experiences and interdisciplinary knowledge. Based on the imagination, we give each plant a character and exaggerate plants' sense by adding electronic devices with text to speech (TTS) voice synthesis and physics-based visual processing. The cultural histories of plants are spoken with all different synthesized human voices generated by our AI-based voice synthesis system. Also, as human vision responds to light, we also imagined that plants could see their surroundings through leaves. Because photosynthesis takes place there. By capturing the image from a mini-camera affixed to the leaf and showing the result of image processing in LCD screens placed among plants, we mimic a vision of the plants. The electrical signal is measured when users touch the plant and it distorts the audio-visual outputs. The overall experience with this work may arouse users to think about plants as a dynamic living being, opening a gap for users to understand the underlying context of plants more deeply.","PeriodicalId":376476,"journal":{"name":"SIGGRAPH Asia 2020 Art Gallery","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129632948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}