MetaMorph: AI Assistance to Transform Lo-Fi Sketches to Higher Fidelities

Proceedings of the 32nd Australian Conference on Human-Computer Interaction Pub Date : 2020-12-02 DOI:10.1145/3441000.3441030

Vinoth Pandian Sermuga Pandian, Sarah Suleri, C. Beecks, M. Jarke

{"title":"MetaMorph: AI Assistance to Transform Lo-Fi Sketches to Higher Fidelities","authors":"Vinoth Pandian Sermuga Pandian, Sarah Suleri, C. Beecks, M. Jarke","doi":"10.1145/3441000.3441030","DOIUrl":null,"url":null,"abstract":"Transforming lo-fi UI sketches to higher-fidelities is an expensive, time-consuming process that requires significant rework. In this paper, we systematically research utilizing AI to assist the transformation of lo-fi sketches to higher fidelities. To provide this assistance, we introduce MetaMorph, an AI tool to detect the constituent UI elements of lo-fi sketches. To train MetaMorph, we collected the UISketch dataset that contains 6,785 hand-drawn sketches of 21 UI elements, 201 hand-drawn lo-fi sketches, and 125,000 synthetically generated lo-fi sketches. MetaMorph provides 63.5% mAP for hand-drawn lo-fi sketches and 82.9% mAP for synthetic lo-fi sketches. Results from ASQ indicate that designers experience an above-average satisfaction level towards ease of task completion (4.9), time taken (5.3), and supporting information (5.3) upon utilizing AI assistance for transforming lo-fi sketches. Their qualitative feedback indicates that they perceive utilizing AI as a novel and useful approach to transform lo-fi sketches into higher fidelities.","PeriodicalId":265398,"journal":{"name":"Proceedings of the 32nd Australian Conference on Human-Computer Interaction","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 32nd Australian Conference on Human-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3441000.3441030","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 6

Abstract

Transforming lo-fi UI sketches to higher-fidelities is an expensive, time-consuming process that requires significant rework. In this paper, we systematically research utilizing AI to assist the transformation of lo-fi sketches to higher fidelities. To provide this assistance, we introduce MetaMorph, an AI tool to detect the constituent UI elements of lo-fi sketches. To train MetaMorph, we collected the UISketch dataset that contains 6,785 hand-drawn sketches of 21 UI elements, 201 hand-drawn lo-fi sketches, and 125,000 synthetically generated lo-fi sketches. MetaMorph provides 63.5% mAP for hand-drawn lo-fi sketches and 82.9% mAP for synthetic lo-fi sketches. Results from ASQ indicate that designers experience an above-average satisfaction level towards ease of task completion (4.9), time taken (5.3), and supporting information (5.3) upon utilizing AI assistance for transforming lo-fi sketches. Their qualitative feedback indicates that they perceive utilizing AI as a novel and useful approach to transform lo-fi sketches into higher fidelities.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

MetaMorph: AI辅助转换低保真草图到更高的保真度

将低保真UI草图转换为高保真度是一个昂贵且耗时的过程，需要大量的返工。在本文中，我们系统地研究了利用人工智能辅助低保真草图到更高保真度的转换。为了提供这种帮助，我们介绍MetaMorph，一个人工智能工具来检测低保真草图的组成UI元素。为了训练MetaMorph，我们收集了UISketch数据集，其中包含21个UI元素的6,785个手绘草图，201个手绘低保真草图和125,000个合成低保真草图。MetaMorph为手绘低保真草图提供63.5% mAP，为合成低保真草图提供82.9% mAP。ASQ的结果表明，设计师在使用人工智能辅助转换低保真草图时，对任务完成的易用性(4.9)、所需时间(5.3)和支持信息(5.3)的满意度高于平均水平。他们的定性反馈表明，他们认为利用人工智能是一种新颖而有用的方法，可以将低保真草图转换为更高的保真度。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Proceedings of the 32nd Australian Conference on Human-Computer Interaction

自引率

0.00%

发文量