This paper addresses the problem of gender recognition by proposing a new feature descriptor to be used in classification. The contribution of this work is an extension to the local binary patterns traditionally used as descriptors. Local binary patterns include information about the relationship between a central pixel value and those of its neighboring pixels in a very compact manner. In the proposed method we incorporate into the descriptor more information from the neighborhood by using four predefined patterns, rather than just one, as in the classic model. We evaluate the performance of our method on the standard FERET database by comparing it to existing methods and show that we can extract more discriminative features and subsequently provide better gender recognition accuracy.
{"title":"An Extended Local Binary Pattern for Gender Classification","authors":"A. R. Ardakany, M. Nicolescu, M. Nicolescu","doi":"10.1109/ISM.2013.61","DOIUrl":"https://doi.org/10.1109/ISM.2013.61","url":null,"abstract":"This paper addresses the problem of gender recognition by proposing a new feature descriptor to be used in classification. The contribution of this work is an extension to the local binary patterns traditionally used as descriptors. Local binary patterns include information about the relationship between a central pixel value and those of its neighboring pixels in a very compact manner. In the proposed method we incorporate into the descriptor more information from the neighborhood by using four predefined patterns, rather than just one, as in the classic model. We evaluate the performance of our method on the standard FERET database by comparing it to existing methods and show that we can extract more discriminative features and subsequently provide better gender recognition accuracy.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"1 1","pages":"315-320"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85563368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Skeletonization, or automatic skeleton extraction, is a technology in 3DCG which automatically extract skeletons (i.e. bones, joints and their hierarchical structures) from 3D models. Such skeletons are important shape and pose descriptors for object representation, object recognition etc. Some existing skeletonization methods have difficulties in correctly extracting the position of joints. Some other methods are able to extract joints correctly to some extent, but controlling the number of bones and joints in their structure is not allowed. Therefore applying motion data acquired from motion capture devices to 3D models still involves a lot of manual work. In this paper, we propose a novel animation skeletonization method suited for CG animation based on Gauss sphere representation. By applying vertex Gauss sphere representation first and then applying template matching approach regardless of the object's shape, the proposed method is able to extract the same numbers of joints or bones in the same structure as in given motion data, i.e. one can directly apply existing motion data without the need of manual adjustment. Experimental results showed that the proposed method achieves 90% accuracy of pose estimation and 73% accuracy of joint estimation.
{"title":"Template Matching Skeletonization Based on Gauss Sphere Representation","authors":"T. Aoki, Vicky Sintunata","doi":"10.1109/ISM.2013.19","DOIUrl":"https://doi.org/10.1109/ISM.2013.19","url":null,"abstract":"Skeletonization, or automatic skeleton extraction, is a technology in 3DCG which automatically extract skeletons (i.e. bones, joints and their hierarchical structures) from 3D models. Such skeletons are important shape and pose descriptors for object representation, object recognition etc. Some existing skeletonization methods have difficulties in correctly extracting the position of joints. Some other methods are able to extract joints correctly to some extent, but controlling the number of bones and joints in their structure is not allowed. Therefore applying motion data acquired from motion capture devices to 3D models still involves a lot of manual work. In this paper, we propose a novel animation skeletonization method suited for CG animation based on Gauss sphere representation. By applying vertex Gauss sphere representation first and then applying template matching approach regardless of the object's shape, the proposed method is able to extract the same numbers of joints or bones in the same structure as in given motion data, i.e. one can directly apply existing motion data without the need of manual adjustment. Experimental results showed that the proposed method achieves 90% accuracy of pose estimation and 73% accuracy of joint estimation.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"92 1","pages":"61-68"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86276926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Multimedia retrieval is a problem domain involving salient features extraction, machine learning, indexing, and retrieval. There are a variety of implementations for these tasks, which are difficult to compose and reuse due to the interface and language incompatibility. Because of this low reusability, researchers often have to implement their experiments from scratch and the resulting programs are not optimized for efficiency and cannot be easily adapted for parallelization. In this paper, we present PIR (Pipeline Information Retrieval), a domain specific language (DSL) for multimedia feature manipulation. The goal is to unify the programming tasks for feature-related programming in multimedia retrieval experiments by hiding the programming details under a flexible layer of domain specific interface. This DSL enables us to optimize the feature-related tasks by compiling the DSL programs into pipeline graphs, which can be executed using a variety of strategies to eliminate redundant computation and enable parallelization and change propagation.
{"title":"PIR: A Domain Specific Language for Multimedia Retrieval","authors":"Xiaobing Huang, Tian Zhao, Yu Cao","doi":"10.1109/ISM.2013.68","DOIUrl":"https://doi.org/10.1109/ISM.2013.68","url":null,"abstract":"Multimedia retrieval is a problem domain involving salient features extraction, machine learning, indexing, and retrieval. There are a variety of implementations for these tasks, which are difficult to compose and reuse due to the interface and language incompatibility. Because of this low reusability, researchers often have to implement their experiments from scratch and the resulting programs are not optimized for efficiency and cannot be easily adapted for parallelization. In this paper, we present PIR (Pipeline Information Retrieval), a domain specific language (DSL) for multimedia feature manipulation. The goal is to unify the programming tasks for feature-related programming in multimedia retrieval experiments by hiding the programming details under a flexible layer of domain specific interface. This DSL enables us to optimize the feature-related tasks by compiling the DSL programs into pipeline graphs, which can be executed using a variety of strategies to eliminate redundant computation and enable parallelization and change propagation.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"30 1","pages":"359-363"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90188209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The use of wide angle lens on commodity cameras are becoming increasingly popular. However, this leads to image distortions due to the large difference in relative orientation of the different foreground objects with respect to the camera's image plane. More importantly, these distortions are different in different parts of the image since it depends entirely on the position and orientation of the foreground object with respect to the image plane. Such distortions often manifest themselves as objects in the foreground appearing fatter than they are supposed to be or parts thereof (e.g. hands or head of people) looking disproportionately larger than the rest of them. Though there are earlier works addressing other common distortions in cameras like radial distortions, little attention has been given to this problem. In this paper, we present an effective method to remove such distortions in foreground objects minimally distorting the background. This is achieved efficiently using a mesh-based pixel displacement technique assisted by a simple and intuitive user interface design.
{"title":"Undistorting Foreground Objects in Wide Angle Images","authors":"M. A. Tehrani, A. Majumder, M. Gopi","doi":"10.1109/ISM.2013.17","DOIUrl":"https://doi.org/10.1109/ISM.2013.17","url":null,"abstract":"The use of wide angle lens on commodity cameras are becoming increasingly popular. However, this leads to image distortions due to the large difference in relative orientation of the different foreground objects with respect to the camera's image plane. More importantly, these distortions are different in different parts of the image since it depends entirely on the position and orientation of the foreground object with respect to the image plane. Such distortions often manifest themselves as objects in the foreground appearing fatter than they are supposed to be or parts thereof (e.g. hands or head of people) looking disproportionately larger than the rest of them. Though there are earlier works addressing other common distortions in cameras like radial distortions, little attention has been given to this problem. In this paper, we present an effective method to remove such distortions in foreground objects minimally distorting the background. This is achieved efficiently using a mesh-based pixel displacement technique assisted by a simple and intuitive user interface design.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"1 1","pages":"46-52"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89145488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In view of the resource demanding nature of 3D Tele-immersion (3DTI), we apply Morphing-based Frame Synthesis (MBFS) on delivery of both online and offline 3DTI visual content to decrease the resource consumption without degrading the perceptual quality. We further investigate the relationship between the level-of-motion of the content and the effectiveness of MBFS. In light of the results, we propose an on-the-fly resource adaptor for 3DTI video transmission which utilizes a perceptual model built from data compiled by a series of subjective experiments. Results show that our adaptor achieves 43% to 87% compression ratio for offline compression on 3DTI videos of different baseline user activities, and a 10% on-the-fly bandwidth saving on complex user activity without perceptible degradation.
{"title":"Impact of Morphing-Based Frame Synthesis on Bandwidth Optimization for 3DTI Video","authors":"Chien-Nan Chen, K. Nahrstedt","doi":"10.1109/ISM.2013.40","DOIUrl":"https://doi.org/10.1109/ISM.2013.40","url":null,"abstract":"In view of the resource demanding nature of 3D Tele-immersion (3DTI), we apply Morphing-based Frame Synthesis (MBFS) on delivery of both online and offline 3DTI visual content to decrease the resource consumption without degrading the perceptual quality. We further investigate the relationship between the level-of-motion of the content and the effectiveness of MBFS. In light of the results, we propose an on-the-fly resource adaptor for 3DTI video transmission which utilizes a perceptual model built from data compiled by a series of subjective experiments. Results show that our adaptor achieves 43% to 87% compression ratio for offline compression on 3DTI videos of different baseline user activities, and a 10% on-the-fly bandwidth saving on complex user activity without perceptible degradation.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"3 1","pages":"211-218"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83352410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this paper a novel approach to the mixed noise removal in color images is proposed. The described method is a generalization of the Non-Local Means algorithm, where the pixels in the filtering window are ordered and only the most centrally located pixels in the filtering window are considered and used to calculate the weights needed for the averaging operation. The comparison with the existing state-of-the-art denoising schemes in terms of image restoration quality measures shows, that the new approach yields significantly better results in suppressing mixed noise in color digital images.
{"title":"Trimmed Non-local Means Technique for Mixed Noise Removal in Color Images","authors":"Krystian Radlak, B. Smolka","doi":"10.1109/ISM.2013.78","DOIUrl":"https://doi.org/10.1109/ISM.2013.78","url":null,"abstract":"In this paper a novel approach to the mixed noise removal in color images is proposed. The described method is a generalization of the Non-Local Means algorithm, where the pixels in the filtering window are ordered and only the most centrally located pixels in the filtering window are considered and used to calculate the weights needed for the averaging operation. The comparison with the existing state-of-the-art denoising schemes in terms of image restoration quality measures shows, that the new approach yields significantly better results in suppressing mixed noise in color digital images.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"13 1","pages":"405-406"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76826743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Obesity has become a worldwide problem which most countries are trying to fight. It affects many people, irrespective of age, race, gender, or religion, anyone can suffer from obesity that leads to serious problems for individuals and for society as a whole. In this study we have selected two groups of people: the basic people who rarely exercise on a weekly basis, and the average people who exercise regularly every week. We have explored the attitude of the two groups towards mixing exercises with games in order to motivate the people with basic activity levels to exercise more frequently. We have used a qualitative standard online questionnaire from AttrakDiff and we have done a quantitative study of some important factors during exercises. The results of the qualitative and quantitative studies were very encouraging, as they reveal that mixing games with exercises can transform boring exercises into entertaining ones. It can also motivate players to continue and repeat the exercises. The ANOVA test has been applied and it shows that combining games with the bike has a significant effect on the speed and the average rotation per minute of the participants.
{"title":"Evaluating Player Experience in Cycling Exergames","authors":"M. Hoda, Rana Alattas, Abdulmotaleb El Saddik","doi":"10.1109/ISM.2013.81","DOIUrl":"https://doi.org/10.1109/ISM.2013.81","url":null,"abstract":"Obesity has become a worldwide problem which most countries are trying to fight. It affects many people, irrespective of age, race, gender, or religion, anyone can suffer from obesity that leads to serious problems for individuals and for society as a whole. In this study we have selected two groups of people: the basic people who rarely exercise on a weekly basis, and the average people who exercise regularly every week. We have explored the attitude of the two groups towards mixing exercises with games in order to motivate the people with basic activity levels to exercise more frequently. We have used a qualitative standard online questionnaire from AttrakDiff and we have done a quantitative study of some important factors during exercises. The results of the qualitative and quantitative studies were very encouraging, as they reveal that mixing games with exercises can transform boring exercises into entertaining ones. It can also motivate players to continue and repeat the exercises. The ANOVA test has been applied and it shows that combining games with the bike has a significant effect on the speed and the average rotation per minute of the participants.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"1 1","pages":"415-420"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90522718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The Fog Screen can create high-quality walk-through images onto a translucent fog plane with rear-projection, so that they appear to float in mid-air. Projector's hotspot may distract viewers, but here we present a method based on fluorescence and front-projection to apparently remove the projector's light altogether. The fluorescent Fog Screen can create even more magical images than the standard Fog Screen.
{"title":"A Fluorescent Mid-air Screen","authors":"I. Rakkolainen, K. Palovuori","doi":"10.1109/ISM.2013.14","DOIUrl":"https://doi.org/10.1109/ISM.2013.14","url":null,"abstract":"The Fog Screen can create high-quality walk-through images onto a translucent fog plane with rear-projection, so that they appear to float in mid-air. Projector's hotspot may distract viewers, but here we present a method based on fluorescence and front-projection to apparently remove the projector's light altogether. The fluorescent Fog Screen can create even more magical images than the standard Fog Screen.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"1 1","pages":"25-29"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73484876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recently, it has become a major network application to use mobile devices to watch multimedia streams through the network or Internet. Buffer overflow/underflow caused by an unstable network(e.g. a weak wireless connection) is very likely to result in flickering or stuttering playback of a media stream. A general but complicated solution is to implement complex streaming protocol to control the output of stream data. However, it comes with higher development and maintenance costs and also reduces the flexibility of integrating compatible player software. In this paper, we propose an efficient playback buffer output control mechanism. The media timestamp, sleep instruction and system time are employed to regulate the output of stream data. Evaluation results prove that the proposed mechanism achieves high output accuracy and minimize output jitters of stream data.
{"title":"Efficient Buffer Output Control for Multimedia Stream Playback","authors":"Yi-Yu Su, Pin-Chuan Liu, Ching-Chun Kao","doi":"10.1109/ISM.2013.98","DOIUrl":"https://doi.org/10.1109/ISM.2013.98","url":null,"abstract":"Recently, it has become a major network application to use mobile devices to watch multimedia streams through the network or Internet. Buffer overflow/underflow caused by an unstable network(e.g. a weak wireless connection) is very likely to result in flickering or stuttering playback of a media stream. A general but complicated solution is to implement complex streaming protocol to control the output of stream data. However, it comes with higher development and maintenance costs and also reduces the flexibility of integrating compatible player software. In this paper, we propose an efficient playback buffer output control mechanism. The media timestamp, sleep instruction and system time are employed to regulate the output of stream data. Evaluation results prove that the proposed mechanism achieves high output accuracy and minimize output jitters of stream data.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"40 1","pages":"504-505"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75042394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Web multimedia content has reached much importance lately. One of the most important content types is online video, as demonstrated by the success of platforms such as YouTube. The growth in the volume of available online video is also observed in corporate scenarios, such as TV station. This paper evaluates a set of corporate online videos hosted by Sambatech, a company that holds the largest platform for online multimedia content distribution in Latin America. We propose a novel analytical approach for video recommendation, focusing on video objects being consumed. After modeling this service, we characterize the contents from multiple sources, and propose techniques for multimedia content recommendation. Experimental results indicate that the proposed method is very promising, which had obtained almost 70 in precision. We also perform distinct evaluations using different approaches from literature, such as the state-of-the-art technique for item recommendation.
{"title":"Modeling, Characterization and Recommendation of Multimedia Web Content Services","authors":"Diego Duarte, A. Pereira, C. Davis","doi":"10.1109/ISM.2013.36","DOIUrl":"https://doi.org/10.1109/ISM.2013.36","url":null,"abstract":"Web multimedia content has reached much importance lately. One of the most important content types is online video, as demonstrated by the success of platforms such as YouTube. The growth in the volume of available online video is also observed in corporate scenarios, such as TV station. This paper evaluates a set of corporate online videos hosted by Sambatech, a company that holds the largest platform for online multimedia content distribution in Latin America. We propose a novel analytical approach for video recommendation, focusing on video objects being consumed. After modeling this service, we characterize the contents from multiple sources, and propose techniques for multimedia content recommendation. Experimental results indicate that the proposed method is very promising, which had obtained almost 70 in precision. We also perform distinct evaluations using different approaches from literature, such as the state-of-the-art technique for item recommendation.","PeriodicalId":6311,"journal":{"name":"2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)","volume":"62 1","pages":"179-186"},"PeriodicalIF":0.0,"publicationDate":"2013-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75596347","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}