Aashish Kalra, Aishwarya Salunke, Pooja Majali, Preeti Bhandiwad, Kavita Chachadi, S. Kamath, Sandeep Jana, Rajas Joshi
{"title":"野外的手","authors":"Aashish Kalra, Aishwarya Salunke, Pooja Majali, Preeti Bhandiwad, Kavita Chachadi, S. Kamath, Sandeep Jana, Rajas Joshi","doi":"10.1109/AICAPS57044.2023.10074180","DOIUrl":null,"url":null,"abstract":"Hand pose estimation has been playing a major role in many applications such as in Augmented/Virtual reality that is the human-computer interaction and gesture recognition. Among the existing hand datasets, some of them are synthetically generated which do not provide information about the background considering the various lighting conditions where the hand skin tone information would be lost.Hence, the proposed Labelled Hand Dataset in the Wild provides this additional information and also solves a major problem ie occlusion. Since manually annotating a large dataset is a tedious task,hence we propose a novel approach to automate the generation of large dataset using the triangulation method which is also known as multiview Annotation.In this approach two best frames are labelled with the 2D points(21 keypoints) which are then triangulated in 3D space using multiview geometry with the use of fiducial markers.These triangulated points in a 3D space are reprojected onto all other images of a particular pose and this process is repeated for all the other poses thus automating the generation of large labeled dataset in wild.","PeriodicalId":146698,"journal":{"name":"2023 International Conference on Advances in Intelligent Computing and Applications (AICAPS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Labeled Hands in Wild\",\"authors\":\"Aashish Kalra, Aishwarya Salunke, Pooja Majali, Preeti Bhandiwad, Kavita Chachadi, S. Kamath, Sandeep Jana, Rajas Joshi\",\"doi\":\"10.1109/AICAPS57044.2023.10074180\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Hand pose estimation has been playing a major role in many applications such as in Augmented/Virtual reality that is the human-computer interaction and gesture recognition. Among the existing hand datasets, some of them are synthetically generated which do not provide information about the background considering the various lighting conditions where the hand skin tone information would be lost.Hence, the proposed Labelled Hand Dataset in the Wild provides this additional information and also solves a major problem ie occlusion. Since manually annotating a large dataset is a tedious task,hence we propose a novel approach to automate the generation of large dataset using the triangulation method which is also known as multiview Annotation.In this approach two best frames are labelled with the 2D points(21 keypoints) which are then triangulated in 3D space using multiview geometry with the use of fiducial markers.These triangulated points in a 3D space are reprojected onto all other images of a particular pose and this process is repeated for all the other poses thus automating the generation of large labeled dataset in wild.\",\"PeriodicalId\":146698,\"journal\":{\"name\":\"2023 International Conference on Advances in Intelligent Computing and Applications (AICAPS)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Advances in Intelligent Computing and Applications (AICAPS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AICAPS57044.2023.10074180\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Advances in Intelligent Computing and Applications (AICAPS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AICAPS57044.2023.10074180","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Hand pose estimation has been playing a major role in many applications such as in Augmented/Virtual reality that is the human-computer interaction and gesture recognition. Among the existing hand datasets, some of them are synthetically generated which do not provide information about the background considering the various lighting conditions where the hand skin tone information would be lost.Hence, the proposed Labelled Hand Dataset in the Wild provides this additional information and also solves a major problem ie occlusion. Since manually annotating a large dataset is a tedious task,hence we propose a novel approach to automate the generation of large dataset using the triangulation method which is also known as multiview Annotation.In this approach two best frames are labelled with the 2D points(21 keypoints) which are then triangulated in 3D space using multiview geometry with the use of fiducial markers.These triangulated points in a 3D space are reprojected onto all other images of a particular pose and this process is repeated for all the other poses thus automating the generation of large labeled dataset in wild.