{"title":"Session details: Multimedia Artworks Analysis","authors":"T. Yamasaki","doi":"10.1145/3406282","DOIUrl":"https://doi.org/10.1145/3406282","url":null,"abstract":"","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133091567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","authors":"","doi":"10.1145/3379173","DOIUrl":"https://doi.org/10.1145/3379173","url":null,"abstract":"","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122063047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
People change their hairstyles to make their appearance attractive, however it is difficult to determine which hairstyles are attractive. In this study, we aim to recommend a hairstyle that improves the attractiveness for an input face using attractiveness evaluation and image generation by deep learning. In the experiment, we first learned the attractiveness and obtained results similar to human intuition. Second, the hairstyle of the input image was changed using two methods: hairstyle attribute conversion and face swapping. Finally, a comparison experiment was performed by subjectively evaluating the input image and the image obtained by the proposed method. As a result, the proposed method was able to generate images with high evaluation value.
{"title":"Recommendations for Attractive Hairstyles","authors":"Yuto Nakamae, Xueting Wang, T. Yamasaki","doi":"10.1145/3379173.3393709","DOIUrl":"https://doi.org/10.1145/3379173.3393709","url":null,"abstract":"People change their hairstyles to make their appearance attractive, however it is difficult to determine which hairstyles are attractive. In this study, we aim to recommend a hairstyle that improves the attractiveness for an input face using attractiveness evaluation and image generation by deep learning. In the experiment, we first learned the attractiveness and obtained results similar to human intuition. Second, the hairstyle of the input image was changed using two methods: hairstyle attribute conversion and face swapping. Finally, a comparison experiment was performed by subjectively evaluating the input image and the image obtained by the proposed method. As a result, the proposed method was able to generate images with high evaluation value.","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133349037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
YouTubers have recently become highly popular. Generating eye-catching thumbnails is an important factor in attracting viewers. In this study, we propose an automatic YouTube-video-thumbnail generation method that ensures the following: rich facial expression of the YouTuber in the frame, clear presentation of the subject of the video, and clear description of the content through a headline. We compared thumbnails generated by the proposed method with those generated by existing methods or those of actually posted videos (i.e., ground truth), and we evaluated the results.
{"title":"Automatic YouTube-Thumbnail Generation and Its Evaluation","authors":"Akari Shimono, Yuki Kakui, T. Yamasaki","doi":"10.1145/3379173.3393711","DOIUrl":"https://doi.org/10.1145/3379173.3393711","url":null,"abstract":"YouTubers have recently become highly popular. Generating eye-catching thumbnails is an important factor in attracting viewers. In this study, we propose an automatic YouTube-video-thumbnail generation method that ensures the following: rich facial expression of the YouTuber in the frame, clear presentation of the subject of the video, and clear description of the content through a headline. We compared thumbnails generated by the proposed method with those generated by existing methods or those of actually posted videos (i.e., ground truth), and we evaluated the results.","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115521053","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Session details: Attractiveness Computing in Multimedia","authors":"W. Chu","doi":"10.1145/3406283","DOIUrl":"https://doi.org/10.1145/3406283","url":null,"abstract":"","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126527663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We propose a texture synthesis method based on generative adversarial networks, focusing on a cultural emblem, called Batik, of southeastern Asian countries. We propose a two-stage training approach to construct the network, first generating patches and then combining patches to generate the entire Batik image. Regular repetition and synthesis artifact removal are jointly considered to guide model training. In the evaluation, we show that the proposed generator fuses two Batik styles, removes blocking artifacts, and generates harmonious Batik images. Qualitative and quantitative evaluations are provided to show promising performance from several perspectives.
{"title":"BatikGAN: A Generative Adversarial Network for Batik Creation","authors":"W. Chu, Lin-Yu Ko","doi":"10.1145/3379173.3393710","DOIUrl":"https://doi.org/10.1145/3379173.3393710","url":null,"abstract":"We propose a texture synthesis method based on generative adversarial networks, focusing on a cultural emblem, called Batik, of southeastern Asian countries. We propose a two-stage training approach to construct the network, first generating patches and then combining patches to generate the entire Batik image. Regular repetition and synthesis artifact removal are jointly considered to guide model training. In the evaluation, we show that the proposed generator fuses two Batik styles, removes blocking artifacts, and generates harmonious Batik images. Qualitative and quantitative evaluations are provided to show promising performance from several perspectives.","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130325517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this paper, we propose a CNN-feature-based image retrieval method to find the ideal style image that better translates the material of an object. An ideal style image must share semantic information with the content image, while containing distinctive characteristics of the desired material. Therefore, we first refine the search by selecting the most discriminative images from the target material. Subsequently, our search process focuses on the object semantics by removing the style information using instance normalization whitening. Thus, the search is performed using the normalized CNN features. In order to translate materials to object regions, we combine semantic segmentation with neural style transfer. We segment objects from the content image by using a weakly supervised segmentation method, and transfer the material of the retrieved style image to the segmented areas. We demonstrate quantitatively and qualitatively that by using ideal style images, the results of the conventional neural style transfer are significantly improved, overcoming state-of-the-art approaches, such as WCT, MUNIT, and StarGAN.
{"title":"Style Image Retrieval for Improving Material Translation Using Neural Style Transfer","authors":"Gibran Benitez-Garcia, Wataru Shimoda, Keiji Yanai","doi":"10.1145/3379173.3393707","DOIUrl":"https://doi.org/10.1145/3379173.3393707","url":null,"abstract":"In this paper, we propose a CNN-feature-based image retrieval method to find the ideal style image that better translates the material of an object. An ideal style image must share semantic information with the content image, while containing distinctive characteristics of the desired material. Therefore, we first refine the search by selecting the most discriminative images from the target material. Subsequently, our search process focuses on the object semantics by removing the style information using instance normalization whitening. Thus, the search is performed using the normalized CNN features. In order to translate materials to object regions, we combine semantic segmentation with neural style transfer. We segment objects from the content image by using a weakly supervised segmentation method, and transfer the material of the retrieved style image to the segmented areas. We demonstrate quantitatively and qualitatively that by using ideal style images, the results of the conventional neural style transfer are significantly improved, overcoming state-of-the-art approaches, such as WCT, MUNIT, and StarGAN.","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124415685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Takuro Karamatsu, Gibran Benitez-Garcia, Keiji Yanai, S. Uchida
In this paper, we tackle a challenging domain conversion task between photo and icon images. Although icons often originate from real object images (i.e., photographs), severe abstractions and simplifications are applied to generate icon images by professional graphic designers. Moreover, there is no one-to-one correspondence between the two domains, for this reason we cannot use it as the ground-truth for learning a direct conversion function. Since generative adversarial networks (GAN) can undertake the problem of domain conversion without any correspondence, we test CycleGAN and UNIT to generate icons from objects segmented from photo images. Our experiments with several image datasets prove that CycleGAN learns sufficient abstraction and simplification ability to generate icon-like images.
{"title":"Iconify: Converting Photographs into Icons","authors":"Takuro Karamatsu, Gibran Benitez-Garcia, Keiji Yanai, S. Uchida","doi":"10.1145/3379173.3393708","DOIUrl":"https://doi.org/10.1145/3379173.3393708","url":null,"abstract":"In this paper, we tackle a challenging domain conversion task between photo and icon images. Although icons often originate from real object images (i.e., photographs), severe abstractions and simplifications are applied to generate icon images by professional graphic designers. Moreover, there is no one-to-one correspondence between the two domains, for this reason we cannot use it as the ground-truth for learning a direct conversion function. Since generative adversarial networks (GAN) can undertake the problem of domain conversion without any correspondence, we test CycleGAN and UNIT to generate icons from objects segmented from photo images. Our experiments with several image datasets prove that CycleGAN learns sufficient abstraction and simplification ability to generate icon-like images.","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132064593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","authors":"","doi":"10.5555/3403748","DOIUrl":"https://doi.org/10.5555/3403748","url":null,"abstract":"","PeriodicalId":416027,"journal":{"name":"Proceedings of the 2020 Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129182628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：