User interaction in mixed reality interactive storytelling

M. Cavazza, Olivier Martin, Fred Charles, Xavier Marichal, Steven J. Mead
{"title":"User interaction in mixed reality interactive storytelling","authors":"M. Cavazza, Olivier Martin, Fred Charles, Xavier Marichal, Steven J. Mead","doi":"10.1109/ISMAR.2003.1240732","DOIUrl":null,"url":null,"abstract":"In this paper, we describe a mixed reality system based on a \"magic mirror\" model, in which the user's image is captured in real time by a video camera, extracted from his/her background and mixed with a 3D graphic model of a virtual image including the synthetic characters taking part in the story. The resulting image is projected on a large screen facing the user, who sees his/her own image embedded in the virtual stage with the synthetic actors. The graphic component of the mixed reality world is based on a game engine, Unreal Tournament 2003. This engine not only performs graphic rendering and character animation but incorporates a new version of our previously described storytelling engine. A single 2D camera facing the user analyses the image in real-time by segmenting the user's contours.","PeriodicalId":296266,"journal":{"name":"The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings.","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2003-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISMAR.2003.1240732","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12

Abstract

In this paper, we describe a mixed reality system based on a "magic mirror" model, in which the user's image is captured in real time by a video camera, extracted from his/her background and mixed with a 3D graphic model of a virtual image including the synthetic characters taking part in the story. The resulting image is projected on a large screen facing the user, who sees his/her own image embedded in the virtual stage with the synthetic actors. The graphic component of the mixed reality world is based on a game engine, Unreal Tournament 2003. This engine not only performs graphic rendering and character animation but incorporates a new version of our previously described storytelling engine. A single 2D camera facing the user analyses the image in real-time by segmenting the user's contours.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
混合现实互动叙事中的用户交互
在本文中,我们描述了一个基于“魔镜”模型的混合现实系统,在这个系统中,用户的图像被摄像机实时捕获,从他/她的背景中提取出来,并与虚拟图像的三维图形模型混合,其中包括参与故事的合成角色。生成的图像投射在面向用户的大屏幕上,用户可以看到自己的图像与合成演员一起嵌入虚拟舞台。混合现实世界的图像组件是基于一个游戏引擎,虚幻竞技场2003。这个引擎不仅执行图形渲染和角色动画,还包含了我们之前描述的讲故事引擎的新版本。面对用户的单个2D摄像机通过分割用户的轮廓来实时分析图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Real-time workspace localisation and mapping for wearable robot Herding sheep: live system for distributed augmented reality Computer vision based head tracking from re-configurable 2D markers for AR Augmented reality kanji learning A wearable augmented reality system with personal positioning based on walking locomotion analysis
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1