{"title":"Scaling AI filmmaking with collaborative networking","authors":"Haohong Wang, Daniel Smith, Ugur Demir","doi":"10.1049/cmu2.12877","DOIUrl":null,"url":null,"abstract":"<p>In this work, MineStudio is introduced, a novel AI filmmaking framework designed to facilitate future creative collaborative networks. MineStudio uses a hybrid digitization approach that involves reconstructing 3D digital environments, capturing 2D live-action performances, employing AI tools to generate synthetic images and videos, and compositing with AI assistance. This method effectively addresses the main challenges in the current AI video generation, including consistency, directability, and issues with human actions and interactions. MineStudio has been utilized to create pioneering AI films, such as the love story “Next Stop Paris” and the sci-fi short film “Message in a Bot”, and has been recognized as a trailblazer in the AI filmmaking industry.</p>","PeriodicalId":55001,"journal":{"name":"IET Communications","volume":"19 1","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2025-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cmu2.12877","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Communications","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/cmu2.12877","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
In this work, MineStudio is introduced, a novel AI filmmaking framework designed to facilitate future creative collaborative networks. MineStudio uses a hybrid digitization approach that involves reconstructing 3D digital environments, capturing 2D live-action performances, employing AI tools to generate synthetic images and videos, and compositing with AI assistance. This method effectively addresses the main challenges in the current AI video generation, including consistency, directability, and issues with human actions and interactions. MineStudio has been utilized to create pioneering AI films, such as the love story “Next Stop Paris” and the sci-fi short film “Message in a Bot”, and has been recognized as a trailblazer in the AI filmmaking industry.
期刊介绍：
IET Communications covers the fundamental and generic research for a better understanding of communication technologies to harness the signals for better performing communication systems using various wired and/or wireless media. This Journal is particularly interested in research papers reporting novel solutions to the dominating problems of noise, interference, timing and errors for reduction systems deficiencies such as wasting scarce resources such as spectra, energy and bandwidth.
Topics include, but are not limited to:
Coding and Communication Theory;
Modulation and Signal Design;
Wired, Wireless and Optical Communication;
Communication System
Special Issues. Current Call for Papers:
Cognitive and AI-enabled Wireless and Mobile - https://digital-library.theiet.org/files/IET_COM_CFP_CAWM.pdf
UAV-Enabled Mobile Edge Computing - https://digital-library.theiet.org/files/IET_COM_CFP_UAV.pdf
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
