The wide-ranging applications and big data of ubiquitous multimedia present both unprecedented challenges and unique opportunities for multimedia computing research. This was the main theme of the 2015 IEEE International Symposium on Multimedia (ISM 2015), and this special issue provides another forum for the researchers of the top symposium papers to further present their research results to the community.
{"title":"Ubiquitous Multimedia: Emerging Research on Multimedia Computing","authors":"Yonghong Tian, Min Chen, L. Sousa","doi":"10.1109/MMUL.2016.28","DOIUrl":"https://doi.org/10.1109/MMUL.2016.28","url":null,"abstract":"The wide-ranging applications and big data of ubiquitous multimedia present both unprecedented challenges and unique opportunities for multimedia computing research. This was the main theme of the 2015 IEEE International Symposium on Multimedia (ISM 2015), and this special issue provides another forum for the researchers of the top symposium papers to further present their research results to the community.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115291885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Learn how the Bay Area Multimedia Forum Series (BAMMF) got started, how it has grown since its first event back in November 2013, and how it is helping Silicon Valley researchers in both industry and academia share and collaborate to address challenges and guide future research.
{"title":"The BAMMF Series in Silicon Valley","authors":"Qiong Liu","doi":"10.1109/MMUL.2016.34","DOIUrl":"https://doi.org/10.1109/MMUL.2016.34","url":null,"abstract":"Learn how the Bay Area Multimedia Forum Series (BAMMF) got started, how it has grown since its first event back in November 2013, and how it is helping Silicon Valley researchers in both industry and academia share and collaborate to address challenges and guide future research.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123935177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Here, EIC Yong Rui reflects on how much AI and multimedia technologies have advanced in the past 60 years, discussing progress made in visual media understanding and the challenges ahead for the video2text problem.
{"title":"Understanding Multimedia","authors":"Y. Rui","doi":"10.1109/MMUL.2016.24","DOIUrl":"https://doi.org/10.1109/MMUL.2016.24","url":null,"abstract":"Here, EIC Yong Rui reflects on how much AI and multimedia technologies have advanced in the past 60 years, discussing progress made in visual media understanding and the challenges ahead for the video2text problem.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"145 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121296486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This special issue is a collaboration between the 2014 IEEE International Symposium on Multimedia (ISM 2014) and IEEE MultiMedia. For over a decade, ISM has been an internationally renowned forum for researchers and practitioners to develop solutions and exchange ideas in emerging multimedia research and applications. The articles in this issue are extended versions of the top ISM 2014 papers on multimedia research.
{"title":"Emerging Multimedia Research and Applications","authors":"M. Shyu, Shu‐Ching Chen","doi":"10.1109/MMUL.2015.84","DOIUrl":"https://doi.org/10.1109/MMUL.2015.84","url":null,"abstract":"This special issue is a collaboration between the 2014 IEEE International Symposium on Multimedia (ISM 2014) and IEEE MultiMedia. For over a decade, ISM has been an internationally renowned forum for researchers and practitioners to develop solutions and exchange ideas in emerging multimedia research and applications. The articles in this issue are extended versions of the top ISM 2014 papers on multimedia research.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"142 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121916130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Multimedia has become the central means for communicating in our daily lives. With this, it is no longer confined to entertainment or personal media collections. Multimedia has become an integral part of the tools and systems that are providing solutions to today's societal challenges.
{"title":"Multimedia Takes on Societal Challenges","authors":"Susanne CJ Boll","doi":"10.1109/MMUL.2015.85","DOIUrl":"https://doi.org/10.1109/MMUL.2015.85","url":null,"abstract":"Multimedia has become the central means for communicating in our daily lives. With this, it is no longer confined to entertainment or personal media collections. Multimedia has become an integral part of the tools and systems that are providing solutions to today's societal challenges.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"190 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121727519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Unsolicited interleaved media content is common in digital TV systems, particularly in broadcast TV, in which advertisements are inserted into programs transmitted sequentially. Although certain existing middleware systems address this problem, their solutions have limitations. This work proposes an alternative approach that provides high-level event-based abstractions that hide or minimize the complexity of dealing with interleaved media content as part of hypermedia applications. This article discusses how multimedia languages and players can handle multiple time bases in supporting intermedia synchronization with interleaved media content. The proposal has been incorporated in the Nested Context Language (NCL) and in its player, the main component of the Ginga digital TV middleware. This approach can also be adapted to be used in other languages and engines.
{"title":"Interleaved Time Bases in Hypermedia Synchronization","authors":"M. Moreno, R. Costa, L. Soares","doi":"10.1109/MMUL.2015.74","DOIUrl":"https://doi.org/10.1109/MMUL.2015.74","url":null,"abstract":"Unsolicited interleaved media content is common in digital TV systems, particularly in broadcast TV, in which advertisements are inserted into programs transmitted sequentially. Although certain existing middleware systems address this problem, their solutions have limitations. This work proposes an alternative approach that provides high-level event-based abstractions that hide or minimize the complexity of dealing with interleaved media content as part of hypermedia applications. This article discusses how multimedia languages and players can handle multiple time bases in supporting intermedia synchronization with interleaved media content. The proposal has been incorporated in the Nested Context Language (NCL) and in its player, the main component of the Ginga digital TV middleware. This approach can also be adapted to be used in other languages and engines.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125154678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
With the proliferation of social media, which is largely fostered by the boom of the Internet and mobile ecosystems, a huge amount of multimedia data has been generated, forming the multimedia big data. However, because multimedia data is unstructured and multimodal in nature, with real-time and Quality of Experience requirements, multimedia big data computing has not only created unprecedented opportunities but also imposed fundamental challenges in storage, processing, and analysis. Here, the authors introduce the principal concepts for multimedia big data computing, discuss what the scientific problems and fundamental challenges are, and present methodologies and approaches from the perspectives of the multimedia life cycle and multimedia big data computing life cycle. They also speculate on the research opportunities and directions for multimedia big data computing.
{"title":"Multimedia Big Data Computing","authors":"Wenwu Zhu, Peng Cui, Zhi Wang, Gang Hua","doi":"10.1109/MMUL.2015.66","DOIUrl":"https://doi.org/10.1109/MMUL.2015.66","url":null,"abstract":"With the proliferation of social media, which is largely fostered by the boom of the Internet and mobile ecosystems, a huge amount of multimedia data has been generated, forming the multimedia big data. However, because multimedia data is unstructured and multimodal in nature, with real-time and Quality of Experience requirements, multimedia big data computing has not only created unprecedented opportunities but also imposed fundamental challenges in storage, processing, and analysis. Here, the authors introduce the principal concepts for multimedia big data computing, discuss what the scientific problems and fundamental challenges are, and present methodologies and approaches from the perspectives of the multimedia life cycle and multimedia big data computing life cycle. They also speculate on the research opportunities and directions for multimedia big data computing.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121156041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
To celebrate the achievements of the magazine and to recognize the profound contributions from authors, IEEE MultiMedia has establish two annual awards starting this year--best article and best department. Learn about the first winners of these two new awards.
{"title":"Establishing Best Papers for IEEE MultiMedia","authors":"Y. Rui","doi":"10.1109/MMUL.2015.63","DOIUrl":"https://doi.org/10.1109/MMUL.2015.63","url":null,"abstract":"To celebrate the achievements of the magazine and to recognize the profound contributions from authors, IEEE MultiMedia has establish two annual awards starting this year--best article and best department. Learn about the first winners of these two new awards.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128391787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Papadopoulos, Pablo César, David A. Shamma, Aisling Kelliher, R. Jain
This special issue touches on many significant aspects of multimedia retrieval, including content analysis and understanding, content- and context-based indexing, search and retrieval, HCI technologies, and image and video summarization and visualization. It converges on the nexus of social multimedia and storytelling around real-world experiences, events, and places. Aside from the challenging research problems in this emerging area, its topics are linked to a host of important commercial and creative applications in sectors such as media, entertainment, arts and culture, sports, and music.
{"title":"Social Multimedia and Storytelling [Guest editors' introduction]","authors":"S. Papadopoulos, Pablo César, David A. Shamma, Aisling Kelliher, R. Jain","doi":"10.1109/MMUL.2015.68","DOIUrl":"https://doi.org/10.1109/MMUL.2015.68","url":null,"abstract":"This special issue touches on many significant aspects of multimedia retrieval, including content analysis and understanding, content- and context-based indexing, search and retrieval, HCI technologies, and image and video summarization and visualization. It converges on the nexus of social multimedia and storytelling around real-world experiences, events, and places. Aside from the challenging research problems in this emerging area, its topics are linked to a host of important commercial and creative applications in sectors such as media, entertainment, arts and culture, sports, and music.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"150 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133589310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In the early 2000s, the definition of multimedia expanded to include not only content but also context. Then, with the advent of social networks, connectivity was added. This 3C model of multimedia--including content, context, and connectivity--lets us process and understand multimedia in a new way.
{"title":"Multimedia Goes Beyond Content","authors":"Y. Rui","doi":"10.1109/MMUL.2015.45","DOIUrl":"https://doi.org/10.1109/MMUL.2015.45","url":null,"abstract":"In the early 2000s, the definition of multimedia expanded to include not only content but also context. Then, with the advent of social networks, connectivity was added. This 3C model of multimedia--including content, context, and connectivity--lets us process and understand multimedia in a new way.","PeriodicalId":290893,"journal":{"name":"IEEE Multim.","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131063491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}