Bernd Münzer, Andreas Leibetseder, Sabrina Kletz, Manfred Jürgen Primus, Klaus Schöffmann
With the growing hype for wearable devices recording biometric data comes the readiness to capture and combine even more personal information as a form of digital diary - lifelogging today is practiced ever more and can be categorized anywhere between an informative hobby and a life-changing experience. From an information processing point of view, analyzing the entirety of such multi-source data is immensely challenging, which is why the first Lifelog Search Challenge 2018 competition is brought into being, as to encourage the development of efficient interactive data retrieval systems. Answering this call, we present a retrieval system based on our video search system diveXplore, which has successfully been used in the Video Browser Showdown 2017 and 2018. Due to the different task definition and available data corpus, the base system was adapted and extended to this new challenge. The resulting lifeXplore system is a flexible retrieval and exploration tool that offers various easy-to-use, yet still powerful search and browsing features that have been optimized for lifelog data and for usage by novice users. Besides efficient presentation and summarization of lifelog data, it includes searchable feature maps, concept and metadata filters, similarity search and sketch search.
{"title":"lifeXplore at the Lifelog Search Challenge 2018","authors":"Bernd Münzer, Andreas Leibetseder, Sabrina Kletz, Manfred Jürgen Primus, Klaus Schöffmann","doi":"10.1145/3210539.3210541","DOIUrl":"https://doi.org/10.1145/3210539.3210541","url":null,"abstract":"With the growing hype for wearable devices recording biometric data comes the readiness to capture and combine even more personal information as a form of digital diary - lifelogging today is practiced ever more and can be categorized anywhere between an informative hobby and a life-changing experience. From an information processing point of view, analyzing the entirety of such multi-source data is immensely challenging, which is why the first Lifelog Search Challenge 2018 competition is brought into being, as to encourage the development of efficient interactive data retrieval systems. Answering this call, we present a retrieval system based on our video search system diveXplore, which has successfully been used in the Video Browser Showdown 2017 and 2018. Due to the different task definition and available data corpus, the base system was adapted and extended to this new challenge. The resulting lifeXplore system is a flexible retrieval and exploration tool that offers various easy-to-use, yet still powerful search and browsing features that have been optimized for lifelog data and for usage by novice users. Besides efficient presentation and summarization of lifelog data, it includes searchable feature maps, concept and metadata filters, similarity search and sketch search.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125507687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Liting Zhou, Zaher Hinbarji, Duc-Tien Dang-Nguyen, C. Gurrin
In this paper, we introduce a first generation interactive lifelog search engine called systemname, a system that allows a user to retrieve the moments from the personal life archives in a reliable and efficient manner. We designed this system to assist a user in examining their life experience to gain insights into their activities and lifestyle. We also discuss how this interactive search engine performs over the six LSC development topics.
{"title":"LIFER: An Interactive Lifelog Retrieval System","authors":"Liting Zhou, Zaher Hinbarji, Duc-Tien Dang-Nguyen, C. Gurrin","doi":"10.1145/3210539.3210542","DOIUrl":"https://doi.org/10.1145/3210539.3210542","url":null,"abstract":"In this paper, we introduce a first generation interactive lifelog search engine called systemname, a system that allows a user to retrieve the moments from the personal life archives in a reliable and efficient manner. We designed this system to assist a user in examining their life experience to gain insights into their activities and lifestyle. We also discuss how this interactive search engine performs over the six LSC development topics.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117349693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adrià Alsina Torra, Xavier Giro-i-Nieto, C. Gurrin
In this work, we describe an interactive lifelog search engine developed for the LSC 2018 search challenge at ACM ICMR 2018. The paper introduces the four-step process required to support lifelog search engines and describes the source data for the search engine as well as the approach to ranking chosen for the iterative search engine. Finally the interface used is introduced before we highlight the limits of the current prototype and suggest opportunities for future work.
{"title":"An Interactive Lifelog Search Engine for LSC2018","authors":"Adrià Alsina Torra, Xavier Giro-i-Nieto, C. Gurrin","doi":"10.1145/3210539.3210546","DOIUrl":"https://doi.org/10.1145/3210539.3210546","url":null,"abstract":"In this work, we describe an interactive lifelog search engine developed for the LSC 2018 search challenge at ACM ICMR 2018. The paper introduces the four-step process required to support lifelog search engines and describes the source data for the search engine as well as the approach to ranking chosen for the iterative search engine. Finally the interface used is introduced before we highlight the limits of the current prototype and suggest opportunities for future work.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115736560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","authors":"","doi":"10.1145/3210539","DOIUrl":"https://doi.org/10.1145/3210539","url":null,"abstract":"","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129436977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Session details: Panel Discussion","authors":"C. Gurrin","doi":"10.1145/3252920","DOIUrl":"https://doi.org/10.1145/3252920","url":null,"abstract":"","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114822867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wolfgang Hürst, K.M.R. Ouwehand, M. Mengerink, Aaron Duane, C. Gurrin
We present a virtual reality system for accessing geotagged photos taken with a lifelogging camera. Photos are spatially located on a world map that can be explored with a head-mounted display. Using a virtual reality headset allows users to easily and intuitively explore this large information space. Images are initially represented by icons but become visible once a user gets closer to a particular area of interest. While not suitable for all search tasks, this visualisation has benefits in situations where location plays a significant role; be it because the actual content is location-related or because the owner of the lifelog remembers and associates the related event with certain places. Likewise, our spatial representation of the data often implicitly reveals a temporal relationship, which can be helpful in the search process as well.
{"title":"Geospatial Access to Lifelogging Photos in Virtual Reality","authors":"Wolfgang Hürst, K.M.R. Ouwehand, M. Mengerink, Aaron Duane, C. Gurrin","doi":"10.1145/3210539.3210547","DOIUrl":"https://doi.org/10.1145/3210539.3210547","url":null,"abstract":"We present a virtual reality system for accessing geotagged photos taken with a lifelogging camera. Photos are spatially located on a world map that can be explored with a head-mounted display. Using a virtual reality headset allows users to easily and intuitively explore this large information space. Images are initially represented by icons but become visible once a user gets closer to a particular area of interest. While not suitable for all search tasks, this visualisation has benefits in situations where location plays a significant role; be it because the actual content is location-related or because the owner of the lifelog remembers and associates the related event with certain places. Likewise, our spatial representation of the data often implicitly reveals a temporal relationship, which can be helpful in the search process as well.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124118444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Duc-Tien Dang-Nguyen, Klaus Schöffmann, Wolfgang Hürst
Lifelogging is becoming an increasingly important topic of research and this paper highlights the thoughts of the three panelists at the LSC - Lifelog Search Challenge at ICMR 2018 in Yokohama, Japan on June 11, 2018. The thoughts cover important topics such as the need for challenges in multimedia access, the need for a better user interface and the challenges in building datasets and organising benchmarking activities such as the LSC.
{"title":"LSE2018 Panel - Challenges of Lifelog Search and Access","authors":"Duc-Tien Dang-Nguyen, Klaus Schöffmann, Wolfgang Hürst","doi":"10.1145/3210539.3210540","DOIUrl":"https://doi.org/10.1145/3210539.3210540","url":null,"abstract":"Lifelogging is becoming an increasingly important topic of research and this paper highlights the thoughts of the three panelists at the LSC - Lifelog Search Challenge at ICMR 2018 in Yokohama, Japan on June 11, 2018. The thoughts cover important topics such as the need for challenges in multimedia access, the need for a better user interface and the challenges in building datasets and organising benchmarking activities such as the LSC.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114870732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The Lifelog Search Challenge (LSC) invites researchers to share their prototypes for lifelog exploration and retrieval and encourages competition to evaluate effective methodologies for this. In this paper. we present a novel approach to visual lifelog exploration using a virtual reality (VR) platform. Findings from our initial experiments with known-item search from lifelog data have motivated us to build a retrieval engine for virtual reality that uses visual concepts automatically extracted from the lifelog visual data as the basis for it's filtering mechanism.
{"title":"Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018","authors":"Aaron Duane, C. Gurrin, Wolfgang Hürst","doi":"10.1145/3210539.3210544","DOIUrl":"https://doi.org/10.1145/3210539.3210544","url":null,"abstract":"The Lifelog Search Challenge (LSC) invites researchers to share their prototypes for lifelog exploration and retrieval and encourages competition to evaluate effective methodologies for this. In this paper. we present a novel approach to visual lifelog exploration using a virtual reality (VR) platform. Findings from our initial experiments with known-item search from lifelog data have motivated us to build a retrieval engine for virtual reality that uses visual concepts automatically extracted from the lifelog visual data as the basis for it's filtering mechanism.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"282 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116088028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thanh-Dat Truong, Tung Dinh Duy, Vinh-Tiep Nguyen, M. Tran
Lifelogging data provides useful insight understanding about our lives during daily activities. Thus, it is essential to develop a system to assist users to retrieve events or memories from lifelogging data from ad-hoc text queries. In this paper, we first propose a method to process lifelogging data by grouping images into visual shots and clusters, then extract semantic concepts on scene category and attributes, entities, and actions. We then develop a query system that supports 4 main types of query conditions: temporal, spatial, entity and action, and extra data criteria. Our system is expected to efficiently assist users to search for past moments in daily logs.
{"title":"Lifelogging Retrieval based on Semantic Concepts Fusion","authors":"Thanh-Dat Truong, Tung Dinh Duy, Vinh-Tiep Nguyen, M. Tran","doi":"10.1145/3210539.3210545","DOIUrl":"https://doi.org/10.1145/3210539.3210545","url":null,"abstract":"Lifelogging data provides useful insight understanding about our lives during daily activities. Thus, it is essential to develop a system to assist users to retrieve events or memories from lifelogging data from ad-hoc text queries. In this paper, we first propose a method to process lifelogging data by grouping images into visual shots and clusters, then extract semantic concepts on scene category and attributes, entities, and actions. We then develop a query system that supports 4 main types of query conditions: temporal, spatial, entity and action, and extra data criteria. Our system is expected to efficiently assist users to search for past moments in daily logs.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"40 11","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120874173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Known-item search in multimodal lifelog data represents a challenging task for present search engines. Since sequences of temporally close images represent a significant part of the provided data, an interactive video retrieval tool with few extensions could be confronted at Lifelog Search Challenge in known-item search tasks. We present an update of the SIRET interactive video retrieval tool that recently won the Video Browser Showdown 2018. As the tool relies on frame-based representations and retrieval models, it can be directly used also for images from lifelog cameras. The updates comprise mostly visualization and navigation methods for a high number of visually similar scenes representing repetitive daily activities.
{"title":"Using an Interactive Video Retrieval Tool for LifeLog Data","authors":"Jakub Lokoč, Tomás Soucek, Gregor Kovalcík","doi":"10.1145/3210539.3210543","DOIUrl":"https://doi.org/10.1145/3210539.3210543","url":null,"abstract":"Known-item search in multimodal lifelog data represents a challenging task for present search engines. Since sequences of temporally close images represent a significant part of the provided data, an interactive video retrieval tool with few extensions could be confronted at Lifelog Search Challenge in known-item search tasks. We present an update of the SIRET interactive video retrieval tool that recently won the Video Browser Showdown 2018. As the tool relies on frame-based representations and retrieval models, it can be directly used also for images from lifelog cameras. The updates comprise mostly visualization and navigation methods for a high number of visually similar scenes representing repetitive daily activities.","PeriodicalId":276500,"journal":{"name":"Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127713735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：