Pub Date : 2023-05-23DOI: 10.1109/MPRV.2023.3274770
Ran Liu, Billy Pik Lik Lau, Khairuldanial Ismail, Achala Chathuranga, Chau Yuen, Simon X. Yang, Yong Liang Guan, S. Mao, U-Xuan Tan
Simultaneous localization and mapping (SLAM) is paramount for unmanned systems to achieve self-localization and navigation. It is challenging to perform SLAM in large environments, due to sensor limitations, complexity of the environment, and computational resources. We propose a novel approach for localization and mapping of autonomous vehicles using radio fingerprints,for example wireless fidelity or long term evolution radio features, which are widely available in the existing infrastructure. In particular, we present two solutions to exploit the radio fingerprints for SLAM. In the first solution—namely Radio SLAM, the output is a radio fingerprint map generated using SLAM technique. In the second solution—namely Radio+LiDAR SLAM, we use radio fingerprint to assist conventional LiDAR-based SLAM to improve accuracy and speed, while generating the occupancy map. We demonstrate the effectiveness of our system in three different environments, namely outdoor, indoor building, and semi-indoor environment.
{"title":"Exploiting Radio Fingerprints for Simultaneous Localization and Mapping","authors":"Ran Liu, Billy Pik Lik Lau, Khairuldanial Ismail, Achala Chathuranga, Chau Yuen, Simon X. Yang, Yong Liang Guan, S. Mao, U-Xuan Tan","doi":"10.1109/MPRV.2023.3274770","DOIUrl":"https://doi.org/10.1109/MPRV.2023.3274770","url":null,"abstract":"Simultaneous localization and mapping (SLAM) is paramount for unmanned systems to achieve self-localization and navigation. It is challenging to perform SLAM in large environments, due to sensor limitations, complexity of the environment, and computational resources. We propose a novel approach for localization and mapping of autonomous vehicles using radio fingerprints,for example wireless fidelity or long term evolution radio features, which are widely available in the existing infrastructure. In particular, we present two solutions to exploit the radio fingerprints for SLAM. In the first solution—namely Radio SLAM, the output is a radio fingerprint map generated using SLAM technique. In the second solution—namely Radio+LiDAR SLAM, we use radio fingerprint to assist conventional LiDAR-based SLAM to improve accuracy and speed, while generating the occupancy map. We demonstrate the effectiveness of our system in three different environments, namely outdoor, indoor building, and semi-indoor environment.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"38-46"},"PeriodicalIF":1.6,"publicationDate":"2023-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46377401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-16DOI: 10.1101/2023.05.12.23289646
Jamie Archer, I. Mavridou, S. Stankoski, M. J. Broulidakis, Andrew Cleal, Piotr Walas, M. Fatoorechi, H. Gjoreski, C. Nduka
This article introduces the Emteq's OCOsenseTM smart glasses equipped with a novel noncontact OCOTM sensor technology for measuring facial muscle activation and expressions based on high-resolution tracking of skin movement. We demonstrate that the OCOTM sensor technology based on optomyography is a sensitive and accurate approach for assessing skin movement in three dimensions, providing a means for measuring the facial expressions used to assess emotional valence such as smile, frown, and eyebrow raise. We propose that glasses-based optomyography sensing has the potential to herald a paradigm shift in real-world facial expression monitoring, thus enabling real-time emotional analytics with healthcare and research applications.
{"title":"OCOsenseTM Smart Glasses for Analyzing Facial Expressions Using Optomyographic Sensors","authors":"Jamie Archer, I. Mavridou, S. Stankoski, M. J. Broulidakis, Andrew Cleal, Piotr Walas, M. Fatoorechi, H. Gjoreski, C. Nduka","doi":"10.1101/2023.05.12.23289646","DOIUrl":"https://doi.org/10.1101/2023.05.12.23289646","url":null,"abstract":"This article introduces the Emteq's OCOsenseTM smart glasses equipped with a novel noncontact OCOTM sensor technology for measuring facial muscle activation and expressions based on high-resolution tracking of skin movement. We demonstrate that the OCOTM sensor technology based on optomyography is a sensitive and accurate approach for assessing skin movement in three dimensions, providing a means for measuring the facial expressions used to assess emotional valence such as smile, frown, and eyebrow raise. We propose that glasses-based optomyography sensing has the potential to herald a paradigm shift in real-world facial expression monitoring, thus enabling real-time emotional analytics with healthcare and research applications.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"18-26"},"PeriodicalIF":1.6,"publicationDate":"2023-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42345441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/MPRV.2022.3232780
Projna Paromita, Alaa Khader, Sydney Begerowski, S. Bell, Theodora Chaspari
We used machine learning classifiers and dialog state tracking models, combined with natural language processing techniques relying on lexicon-based methods and data-driven methods, to automatically detect positive and negative microbehaviors between team members in nine, four-person teams in a simulated space habitat. Our findings indicate that the psycholinguistic markers extracted using the linguistic inquiry and word count, STRESSnet dictionaries, and acoustic features can achieve an f1-score up to 54.87% in a three-class classification problem. Our findings also suggest that modeling turns between the sender and target of microbehaviors is significantly more effective in detecting microbehavior than only modeling the sender’s information. Finally, we demonstrate the effect of introducing context for detection purposes. Dialog state tracking approaches that model the linguistic interaction between team members and incorporate contextual information about the task and sentiment of the conversation can further yield improved performance, depicting an f1-score of 57.73%.
{"title":"Linguistic and Vocal Markers of Microbehaviors Between Team Members During Analog Space Exploration Missions","authors":"Projna Paromita, Alaa Khader, Sydney Begerowski, S. Bell, Theodora Chaspari","doi":"10.1109/MPRV.2022.3232780","DOIUrl":"https://doi.org/10.1109/MPRV.2022.3232780","url":null,"abstract":"We used machine learning classifiers and dialog state tracking models, combined with natural language processing techniques relying on lexicon-based methods and data-driven methods, to automatically detect positive and negative microbehaviors between team members in nine, four-person teams in a simulated space habitat. Our findings indicate that the psycholinguistic markers extracted using the linguistic inquiry and word count, STRESSnet dictionaries, and acoustic features can achieve an f1-score up to 54.87% in a three-class classification problem. Our findings also suggest that modeling turns between the sender and target of microbehaviors is significantly more effective in detecting microbehavior than only modeling the sender’s information. Finally, we demonstrate the effect of introducing context for detection purposes. Dialog state tracking approaches that model the linguistic interaction between team members and incorporate contextual information about the task and sentiment of the conversation can further yield improved performance, depicting an f1-score of 57.73%.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"7-18"},"PeriodicalIF":1.6,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41495780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/MPRV.2023.3275772
Nathaniel G. Gordon, Damiano Marsili, Ioannis Nikas, Nicolò Boschetti
Future missions carrying humans to the moon will require fast and resilient communication infrastructure to allow occupants to communicate between various orbiters, rovers, and stations—and to relay valuable data back to Earth. This work begins by examining the two core enabling technologies for space communications: radiofrequency and optical links. These approaches are compared in the context of recent and ongoing missions by NASA and private entities. We then propose a set of recommendations for lunar communications infrastructure to enable habitation. Three pillars unify the approach: scalable design and capabilities, resilience to environmental and cyber threats, and universal applicability to a wide range of mission profiles. The engineering efforts and areas of focus necessary to mitigate identified weaknesses and achieve the described capabilities are discussed. We conclude by highlighting the significance of several upcoming missions that will serve as milestones in proving the viability of optical links as dependable communications infrastructure.
{"title":"Lasers on the Moon: Recommendations for Pioneering Lunar Communication Infrastructure","authors":"Nathaniel G. Gordon, Damiano Marsili, Ioannis Nikas, Nicolò Boschetti","doi":"10.1109/MPRV.2023.3275772","DOIUrl":"https://doi.org/10.1109/MPRV.2023.3275772","url":null,"abstract":"Future missions carrying humans to the moon will require fast and resilient communication infrastructure to allow occupants to communicate between various orbiters, rovers, and stations—and to relay valuable data back to Earth. This work begins by examining the two core enabling technologies for space communications: radiofrequency and optical links. These approaches are compared in the context of recent and ongoing missions by NASA and private entities. We then propose a set of recommendations for lunar communications infrastructure to enable habitation. Three pillars unify the approach: scalable design and capabilities, resilience to environmental and cyber threats, and universal applicability to a wide range of mission profiles. The engineering efforts and areas of focus necessary to mitigate identified weaknesses and achieve the described capabilities are discussed. We conclude by highlighting the significance of several upcoming missions that will serve as milestones in proving the viability of optical links as dependable communications infrastructure.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"19-25"},"PeriodicalIF":1.6,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48162058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/mprv.2023.3275369
{"title":"IEEE Computer Society Has You Covered!","authors":"","doi":"10.1109/mprv.2023.3275369","DOIUrl":"https://doi.org/10.1109/mprv.2023.3275369","url":null,"abstract":"","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"327 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135673440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/MPRV.2023.3251539
Nadine Flegel, Jonas Poehler, T. Mentler, K. Van Laerhoven, Lucy E. Dunne, M. Altini
Early work in wearables research has often proposed visions in which wearable computers are introduced to support human operators in critical environments such as control rooms, ship bridges, cockpits, or operating rooms. Wearable assistants could for instance present critical task-relevant information to users regardless of their location, help in avoiding procedural errors, or enhance collaborations between multiple operators. In reality, however, such visions have not galvanized: What happened? And could operators’ attitudes and misgivings toward wearables be responsible? The rise of personal wearables in the past years has led to fitness trackers, smartwatches, and other consumer devices being worn by a larger audience, likely also among control room operators. We report in this article on findings from a series of onsite interviews and workshops with professional control room operators to get an insight in their attitude toward wearables, and opinions and current views on the use and adoption of wearable and pervasive technologies in their work environment.
{"title":"Whereables? Examining Personal Technology Adoption in Contemporary Control Rooms","authors":"Nadine Flegel, Jonas Poehler, T. Mentler, K. Van Laerhoven, Lucy E. Dunne, M. Altini","doi":"10.1109/MPRV.2023.3251539","DOIUrl":"https://doi.org/10.1109/MPRV.2023.3251539","url":null,"abstract":"Early work in wearables research has often proposed visions in which wearable computers are introduced to support human operators in critical environments such as control rooms, ship bridges, cockpits, or operating rooms. Wearable assistants could for instance present critical task-relevant information to users regardless of their location, help in avoiding procedural errors, or enhance collaborations between multiple operators. In reality, however, such visions have not galvanized: What happened? And could operators’ attitudes and misgivings toward wearables be responsible? The rise of personal wearables in the past years has led to fitness trackers, smartwatches, and other consumer devices being worn by a larger audience, likely also among control room operators. We report in this article on findings from a series of onsite interviews and workshops with professional control room operators to get an insight in their attitude toward wearables, and opinions and current views on the use and adoption of wearable and pervasive technologies in their work environment.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"49-53"},"PeriodicalIF":1.6,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48346502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/mprv.2023.3275391
{"title":"IEEE Computer Society Career Center","authors":"","doi":"10.1109/mprv.2023.3275391","DOIUrl":"https://doi.org/10.1109/mprv.2023.3275391","url":null,"abstract":"","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"300 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135673441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-01DOI: 10.1109/MPRV.2023.3242667
A. Ekblaw, Juliana Cherston, Fangzheng Liu, Irmandy Wicaksono, D. D. Haddad, V. Sumini, J. Paradiso
Humanity's burgeoning crewed and uncrewed presence in space is creating increasing opportunity for ideas and approaches gestated for terrestrial use to be adapted and deployed in space applications. To illustrate this from the perspective of the Pervasive Community, this article overviews a selection of recent and ongoing space-oriented projects in the MIT Media Lab's Responsive Environments Group, and chronicles the roots that most of them had in our prior Pervasive Computing research program. These projects involve wearables, smart fabrics, sensor networks, cross-reality systems, pervasive/reactive displays, microrobots, responsive space habitat interiors, and self-assembling systems for in-space infrastructure. Many of them have been tested in zero-gravity and suborbital flights, on the International Space Station, or will be deployed during an upcoming lunar mission. Assessed together, this portfolio of work points forward to the broad role that some of the tenets of Pervasive Computing (e.g., novel sensing technologies, “smart materials,” and best-in-class modern HCI infrastructure) will play in our near-term space future. This work marks an important inflection point in the space industry, where academic research experiments are rapidly maturing—on the scale of months, not years—to influence the products, tools, and human experiences in low earth orbit and beyond.
{"title":"From UbiComp to Universe—Moving Pervasive Computing Research Into Space Applications","authors":"A. Ekblaw, Juliana Cherston, Fangzheng Liu, Irmandy Wicaksono, D. D. Haddad, V. Sumini, J. Paradiso","doi":"10.1109/MPRV.2023.3242667","DOIUrl":"https://doi.org/10.1109/MPRV.2023.3242667","url":null,"abstract":"Humanity's burgeoning crewed and uncrewed presence in space is creating increasing opportunity for ideas and approaches gestated for terrestrial use to be adapted and deployed in space applications. To illustrate this from the perspective of the Pervasive Community, this article overviews a selection of recent and ongoing space-oriented projects in the MIT Media Lab's Responsive Environments Group, and chronicles the roots that most of them had in our prior Pervasive Computing research program. These projects involve wearables, smart fabrics, sensor networks, cross-reality systems, pervasive/reactive displays, microrobots, responsive space habitat interiors, and self-assembling systems for in-space infrastructure. Many of them have been tested in zero-gravity and suborbital flights, on the International Space Station, or will be deployed during an upcoming lunar mission. Assessed together, this portfolio of work points forward to the broad role that some of the tenets of Pervasive Computing (e.g., novel sensing technologies, “smart materials,” and best-in-class modern HCI infrastructure) will play in our near-term space future. This work marks an important inflection point in the space industry, where academic research experiments are rapidly maturing—on the scale of months, not years—to influence the products, tools, and human experiences in low earth orbit and beyond.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"27-42"},"PeriodicalIF":1.6,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42863749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}