Jorge Ramírez, Marcos Báez, F. Casati, L. Cernuzzi, B. Benatallah
{"title":"DREC: towards a Datasheet for Reporting Experiments in Crowdsourcing","authors":"Jorge Ramírez, Marcos Báez, F. Casati, L. Cernuzzi, B. Benatallah","doi":"10.1145/3406865.3418318","DOIUrl":null,"url":null,"abstract":"Factors such as instructions, payment schemes, platform demographics, along with strategies for mapping studies into crowdsourcing environments, play an important role in the reproducibility of results. However, inferring these details from scientific articles is often a challenging endeavor, calling for the development of proper reporting guidelines. This paper makes the first steps towards this goal, by describing an initial taxonomy of relevant attributes for crowdsourcing experiments, and providing a glimpse into the state of reporting by analyzing a sample of CSCW papers.","PeriodicalId":93424,"journal":{"name":"CSCW '20 Companion : conference companion publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing : October 17-21, 2020, Virtual Event, USA. Conference on Computer-Supported Cooperative Work and So...","volume":"3 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2020-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"CSCW '20 Companion : conference companion publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing : October 17-21, 2020, Virtual Event, USA. Conference on Computer-Supported Cooperative Work and So...","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3406865.3418318","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5
Abstract
Factors such as instructions, payment schemes, platform demographics, along with strategies for mapping studies into crowdsourcing environments, play an important role in the reproducibility of results. However, inferring these details from scientific articles is often a challenging endeavor, calling for the development of proper reporting guidelines. This paper makes the first steps towards this goal, by describing an initial taxonomy of relevant attributes for crowdsourcing experiments, and providing a glimpse into the state of reporting by analyzing a sample of CSCW papers.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
