Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications最新文献
Pub Date : 2022-03-01Epub Date: 2022-04-27DOI: 10.1109/percom53586.2022.9762385
Rawan Alharbi, Sougata Sen, Ada Ng, Nabil Alshurafa, Josiah Hester
Wearable cameras provide an informative view of wearer activities, context, and interactions. Video obtained from wearable cameras is useful for life-logging, human activity recognition, visual confirmation, and other tasks widely utilized in mobile computing today. Extracting foreground information related to the wearer and separating irrelevant background pixels is the fundamental operation underlying these tasks. However, current wearer foreground extraction methods that depend on image data alone are slow, energy-inefficient, and even inaccurate in some cases, making many tasks-like activity recognition- challenging to implement in the absence of significant computational resources. To fill this gap, we built ActiSight, a wearable RGB-Thermal video camera that uses thermal information to make wearer segmentation practical for body-worn video. Using ActiSight, we collected a total of 59 hours of video from 6 participants, capturing a wide variety of activities in a natural setting. We show that wearer foreground extracted with ActiSight achieves a high dice similarity score while significantly lowering execution time and energy cost when compared with an RGB-only approach.
{"title":"ActiSight: Wearer Foreground Extraction Using a Practical RGB-Thermal Wearable.","authors":"Rawan Alharbi, Sougata Sen, Ada Ng, Nabil Alshurafa, Josiah Hester","doi":"10.1109/percom53586.2022.9762385","DOIUrl":"https://doi.org/10.1109/percom53586.2022.9762385","url":null,"abstract":"<p><p>Wearable cameras provide an informative view of wearer activities, context, and interactions. Video obtained from wearable cameras is useful for life-logging, human activity recognition, visual confirmation, and other tasks widely utilized in mobile computing today. Extracting foreground information related to the wearer and separating irrelevant background pixels is the fundamental operation underlying these tasks. However, current wearer foreground extraction methods that depend on image data alone are slow, energy-<b>in</b>efficient, and even inaccurate in some cases, making many tasks-like activity recognition- challenging to implement in the absence of significant computational resources. To fill this gap, we built ActiSight, a wearable RGB-Thermal video camera that uses thermal information to make wearer segmentation practical for body-worn video. Using ActiSight, we collected a total of 59 hours of video from 6 participants, capturing a wide variety of activities in a natural setting. We show that wearer foreground extracted with ActiSight achieves a high dice similarity score while significantly lowering execution time and energy cost when compared with an RGB-only approach.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":"2022 ","pages":"237-246"},"PeriodicalIF":0.0,"publicationDate":"2022-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704365/pdf/nihms-1835180.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40491157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We present a comparative analysis of inertial-based odometry algorithms for the purpose of assisted return. An assisted return system facilitates backtracking of a path previously taken, and can be particularly useful for blind pedestrians. We present a new algorithm for path matching, and test it in simulated assisted return tasks with data from WeAllWalk, the only existing data set with inertial data recorded from blind walkers. We consider two odometry systems, one based on deep learning (RoNIN), and the second based on robust turn detection and step counting. Our results show that the best path matching results are obtained using the turns/steps odometry system.
{"title":"Finding Your Way Back: Comparing Path Odometry Algorithms for Assisted Return.","authors":"Chia Hsuan Tsai, Peng Ren, Fatemeh Elyasi, Roberto Manduchi","doi":"10.1109/PerComWorkshops51409.2021.9431082","DOIUrl":"https://doi.org/10.1109/PerComWorkshops51409.2021.9431082","url":null,"abstract":"<p><p>We present a comparative analysis of inertial-based odometry algorithms for the purpose of assisted return. An assisted return system facilitates backtracking of a path previously taken, and can be particularly useful for blind pedestrians. We present a new algorithm for path matching, and test it in simulated assisted return tasks with data from WeAllWalk, the only existing data set with inertial data recorded from blind walkers. We consider two odometry systems, one based on deep learning (RoNIN), and the second based on robust turn detection and step counting. Our results show that the best path matching results are obtained using the turns/steps odometry system.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":"2021 ","pages":"117-122"},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/PerComWorkshops51409.2021.9431082","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39221164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human activity recognition using wearable accelerometers can enable in-situ detection of physical activities to support novel human-computer interfaces. Many of the machine-learning-based activity recognition algorithms require multi-person, multi-day, carefully annotated training data with precisely marked start and end times of the activities of interest. To date, there is a dearth of usable tools that enable researchers to conveniently visualize and annotate multiple days of high-sampling-rate raw accelerometer data. Thus, we developed Signaligner Pro, an interactive tool to enable researchers to conveniently explore and annotate multi-day high-sampling rate raw accelerometer data. The tool visualizes high-sampling-rate raw data and time-stamped annotations generated by existing activity recognition algorithms and human annotators; the annotations can then be directly modified by the researchers to create their own, improved, annotated datasets. In this paper, we describe the tool's features and implementation that facilitate convenient exploration and annotation of multi-day data and demonstrate its use in generating activity annotations.
{"title":"Signaligner Pro: A Tool to Explore and Annotate Multi-day Raw Accelerometer Data.","authors":"Aditya Ponnada, Seth Cooper, Qu Tang, Binod Thapa-Chhetry, Josh Aaron Miller, Dinesh John, Stephen Intille","doi":"10.1109/percomworkshops51409.2021.9431110","DOIUrl":"https://doi.org/10.1109/percomworkshops51409.2021.9431110","url":null,"abstract":"<p><p>Human activity recognition using wearable accelerometers can enable <i>in-situ</i> detection of physical activities to support novel human-computer interfaces. Many of the machine-learning-based activity recognition algorithms require multi-person, multi-day, carefully annotated training data with precisely marked start and end times of the activities of interest. To date, there is a dearth of usable tools that enable researchers to conveniently visualize and annotate multiple days of high-sampling-rate raw accelerometer data. Thus, we developed Signaligner Pro, an interactive tool to enable researchers to conveniently explore and annotate multi-day high-sampling rate raw accelerometer data. The tool visualizes high-sampling-rate raw data and time-stamped annotations generated by existing activity recognition algorithms and human annotators; the annotations can then be directly modified by the researchers to create their own, improved, annotated datasets. In this paper, we describe the tool's features and implementation that facilitate convenient exploration and annotation of multi-day data and demonstrate its use in generating activity annotations.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":"2021 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/percomworkshops51409.2021.9431110","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39365599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2017-03-01Epub Date: 2017-05-04DOI: 10.1109/PERCOM.2017.7917847
Chongguang Bi, Guoliang Xing, Tian Hao, Jina Huh, Wei Peng, Mengyan Ma
Research has shown that family mealtime plays a critical role in establishing good relationships among family members and maintaining their physical and mental health. In particular, regularly eating dinner as a family significantly reduces prevalence of obesity. However, American families with children spend only 1 hour on family meals while three hours watching TV on an average work day. Fine-grained activity-logging is proven effective for increasing self-awareness and motivating people to modify their life styles for improved wellness. This paper presents FamilyLog - a practical system to log family mealtime activities using smartphones and smartwatches. FamilyLog automatically detects and logs details of activities during the mealtime, including occurrence and duration of meal, conversations, participants, TV viewing etc., in an unobtrusive manner. Based on the sensor data collected from real families, we carefully design robust yet lightweight signal features from a set of complex activities during the meal, including clattering sound, arm gestures of eating, human voice, TV sound, etc. Moreover, FamilyLog opportunistically fuses data from built-in sensors of multiple mobile devices available in a family through an HMM-based classifier. To evaluate the real-world performance of FamilyLog, we perform extensive experiments that consist of 77 days of sensor data from 37 subjects in 8 families with children. Our results show that FamilyLog can detect those events with high accuracy across different families and home environments.
{"title":"FamilyLog: A Mobile System for Monitoring Family Mealtime Activities.","authors":"Chongguang Bi, Guoliang Xing, Tian Hao, Jina Huh, Wei Peng, Mengyan Ma","doi":"10.1109/PERCOM.2017.7917847","DOIUrl":"https://doi.org/10.1109/PERCOM.2017.7917847","url":null,"abstract":"<p><p>Research has shown that family mealtime plays a critical role in establishing good relationships among family members and maintaining their physical and mental health. In particular, regularly eating dinner as a family significantly reduces prevalence of obesity. However, American families with children spend only 1 hour on family meals while three hours watching TV on an average work day. Fine-grained activity-logging is proven effective for increasing self-awareness and motivating people to modify their life styles for improved wellness. This paper presents FamilyLog - a practical system to log family mealtime activities using smartphones and smartwatches. FamilyLog automatically detects and logs details of activities during the mealtime, including occurrence and duration of meal, conversations, participants, TV viewing etc., in an unobtrusive manner. Based on the sensor data collected from real families, we carefully design robust yet lightweight signal features from a set of complex activities during the meal, including clattering sound, arm gestures of eating, human voice, TV sound, etc. Moreover, FamilyLog opportunistically fuses data from built-in sensors of multiple mobile devices available in a family through an HMM-based classifier. To evaluate the real-world performance of FamilyLog, we perform extensive experiments that consist of 77 days of sensor data from 37 subjects in 8 families with children. Our results show that FamilyLog can detect those events with high accuracy across different families and home environments.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":"2017 ","pages":"21-30"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/PERCOM.2017.7917847","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35427237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper describes ongoing work in analyzing sensor data logged in the homes of seniors. An estimation of relative energy expenditure is computed using motion density from passive infrared motion sensors mounted in the environment. We introduce a new algorithm for detecting visitors in the home using motion sensor data and a set of fuzzy rules. The visitor algorithm, as well as a previous algorithm for identifying time-away-from-home (TAFH), are used to filter the logged motion sensor data. Thus, the energy expenditure estimate uses data collected only when the resident is home alone. Case studies are included from TigerPlace, an Aging in Place community, to illustrate how the relative energy expenditure estimate can be used to track health conditions over time.
{"title":"Using Passive Sensing to Estimate Relative Energy Expenditure for Eldercare Monitoring.","authors":"Shuang Wang, Marjorie Skubic, Yingnan Zhu, Colleen Galambos","doi":"10.1109/PERCOMW.2011.5766968","DOIUrl":"https://doi.org/10.1109/PERCOMW.2011.5766968","url":null,"abstract":"<p><p>This paper describes ongoing work in analyzing sensor data logged in the homes of seniors. An estimation of relative energy expenditure is computed using motion density from passive infrared motion sensors mounted in the environment. We introduce a new algorithm for detecting visitors in the home using motion sensor data and a set of fuzzy rules. The visitor algorithm, as well as a previous algorithm for identifying time-away-from-home (TAFH), are used to filter the logged motion sensor data. Thus, the energy expenditure estimate uses data collected only when the resident is home alone. Case studies are included from TigerPlace, an Aging in Place community, to illustrate how the relative energy expenditure estimate can be used to track health conditions over time.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":" ","pages":"642-648"},"PeriodicalIF":0.0,"publicationDate":"2011-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/PERCOMW.2011.5766968","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"32706075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rose Williams, Srikant Jalan, Edie Stern, Yves A Lussier
We implemented an end-to-end notification system that pushed urgent clinical laboratory results to Blackberry 7510 devices over the Nextel cellular network. We designed our system to use user roles and notification policies to abstract and execute clinical notification procedures. We anticipated some problems with dropped and non-delivered messages when the device was out-of-network, however, we did not expect the same problems in other situations like device reconnection to the network. We addressed these problems by creating cascading "fault tolerance" policies to drive notification escalation when messages timed-out or delivery failed. This paper describes our experience in providing an adaptable, fault tolerant pervasive notification system for delivering secure, critical, time-sensitive patient laboratory results.
{"title":"Cascading Policies Provide Fault Tolerance for Pervasive Clinical Communications.","authors":"Rose Williams, Srikant Jalan, Edie Stern, Yves A Lussier","doi":"10.1109/PERCOMW.2005.22","DOIUrl":"https://doi.org/10.1109/PERCOMW.2005.22","url":null,"abstract":"<p><p>We implemented an end-to-end notification system that pushed urgent clinical laboratory results to Blackberry 7510 devices over the Nextel cellular network. We designed our system to use user roles and notification policies to abstract and execute clinical notification procedures. We anticipated some problems with dropped and non-delivered messages when the device was out-of-network, however, we did not expect the same problems in other situations like device reconnection to the network. We addressed these problems by creating cascading \"fault tolerance\" policies to drive notification escalation when messages timed-out or delivery failed. This paper describes our experience in providing an adaptable, fault tolerant pervasive notification system for delivering secure, critical, time-sensitive patient laboratory results.</p>","PeriodicalId":89224,"journal":{"name":"Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications","volume":"2005 ","pages":"209-212"},"PeriodicalIF":0.0,"publicationDate":"2005-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/PERCOMW.2005.22","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"29606659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Proceedings of the ... IEEE International Conference on Pervasive Computing and Communications. IEEE International Conference on Pervasive Computing and Communications