A review on devices and learning techniques in domestic intelligent environment

Abstract

With the rapid development and wide proliferation of sensor devices and the Internet of Things (IoT), machine learning algorithms processing and analysing one or more modalities of sensory signals have become an active research field given its numerous applications, particularly in the domestic intelligent environment (DIE). In the past decades, the research on sensing and interactive devices of DIE and deep learning (DL) based methods have become strikingly popular. Several missions, such as the pro- cessing and analysis of sensing signals related to domestic instruments and the control of certain devices to act upon the results, comprise the main working targets in DIE. The goal of this review is to provide a brief overview of the aforementioned sensors, their related DL algorithms and their applications. To comprehend the ideas behind the use of various devices found in domestic intelligent instruments, we first summarize the available information. Then, to quantify and adapt the residents’ knowledge of the household environment, we review data-driven learning techniques based on the aforementioned sensor-based devices and introduce robotic applications that provide helpers and action outputs in the environment. Finally, we investigate the commonly utilized datasets relevant to DIE and human activ- ity recognition (HAR) and explore the challenges and prospects of their applications in the DIE field.