Pub Date : 2022-05-07DOI: 10.3847/25c2cfeb.fa63c30e
W. Tucker, G. Blumenthal
{"title":"Robert J. Gould (1935–2009)","authors":"W. Tucker, G. Blumenthal","doi":"10.3847/25c2cfeb.fa63c30e","DOIUrl":"https://doi.org/10.3847/25c2cfeb.fa63c30e","url":null,"abstract":"","PeriodicalId":251707,"journal":{"name":"Vol. 54, Issue 1 (Obituaries, News & Commentaries, Community Reports)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131066917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-11DOI: 10.3847/25c2cfeb.4ece85d4
J. D. Meyer, Andrea Corvill'on, John M. Carpenter, A. Plunkett, R. Kurowski, Alex Chalevin, Jakob Bruenker, D.-C. Kim, E. Mac'ias
In response to the challenges presented by high reviewer workloads in traditional panel reviews and increasing numbers of submitted proposals, ALMA implemented distributed peer review to assess the majority of proposals submitted to the Cycle 8 Main Call. In this paper, we present an analysis of this review process. Over 1000 reviewers participated in the process to review 1497 proposals, making it the largest implementation of distributed peer review to date in astronomy, and marking the first time this process has been used to award the majority of observing time at an observatory. We describe the process to assign proposals to reviewers, analyze the nearly 15,000 ranks and comments submitted by reviewers to identify any trends and systematics, and gather feedback on the process from reviewers and Principal Investigators (PIs) through surveys. Approximately 90% of the proposal assignments were aligned with the expertise of the reviewer, as measured both by the expertise keywords provided by the reviewers and the reviewers' self-assessment of their expertise on their assigned proposals. PIs rated 73% of the individual review comments as helpful, and even though the reviewers had a broad range of experience levels, PIs rated the quality of the comments received from students and senior researchers similarly. The primary concerns raised by PIs were the quality of some reviewer comments and high dispersions in the ranks. The ranks and comments are correlated with various demographics to identify the main areas in which the review process can be improved in future cycles.
为了应对传统小组评审的高审稿人工作量和提交的提案数量不断增加所带来的挑战，ALMA实施了分布式同行评审，以评估提交给Cycle 8 Main Call的大多数提案。在本文中，我们对这一审查过程进行了分析。超过1000名审稿人参与了审查1497份提案的过程，使其成为天文学迄今为止最大的分布式同行评审实施，并标志着该过程首次被用于奖励天文台的大部分观测时间。我们描述了将提案分配给审稿人的过程，分析了审稿人提交的近15,000个排名和评论，以确定任何趋势和系统，并通过调查收集审稿人和主要研究者(pi)对该过程的反馈。大约90%的提案分配与审稿人的专业知识一致，通过审稿人提供的专业知识关键词和审稿人对其分配的提案的专业知识的自我评估来衡量。个人意见评价者将73%的个人意见评价为有帮助的，即使审稿人具有广泛的经验水平，个人意见评价者对学生和高级研究人员的评论质量的评价也是相似的。pi提出的主要问题是一些审稿人评论的质量和级别的高度分散。职级和评论与各种人口统计资料相关联，以确定审查过程在今后周期中可以改进的主要领域。
{"title":"Analysis of the ALMA Cycle 8 Distributed Peer Review Process","authors":"J. D. Meyer, Andrea Corvill'on, John M. Carpenter, A. Plunkett, R. Kurowski, Alex Chalevin, Jakob Bruenker, D.-C. Kim, E. Mac'ias","doi":"10.3847/25c2cfeb.4ece85d4","DOIUrl":"https://doi.org/10.3847/25c2cfeb.4ece85d4","url":null,"abstract":"In response to the challenges presented by high reviewer workloads in traditional panel reviews and increasing numbers of submitted proposals, ALMA implemented distributed peer review to assess the majority of proposals submitted to the Cycle 8 Main Call. In this paper, we present an analysis of this review process. Over 1000 reviewers participated in the process to review 1497 proposals, making it the largest implementation of distributed peer review to date in astronomy, and marking the first time this process has been used to award the majority of observing time at an observatory. We describe the process to assign proposals to reviewers, analyze the nearly 15,000 ranks and comments submitted by reviewers to identify any trends and systematics, and gather feedback on the process from reviewers and Principal Investigators (PIs) through surveys. Approximately 90% of the proposal assignments were aligned with the expertise of the reviewer, as measured both by the expertise keywords provided by the reviewers and the reviewers' self-assessment of their expertise on their assigned proposals. PIs rated 73% of the individual review comments as helpful, and even though the reviewers had a broad range of experience levels, PIs rated the quality of the comments received from students and senior researchers similarly. The primary concerns raised by PIs were the quality of some reviewer comments and high dispersions in the ranks. The ranks and comments are correlated with various demographics to identify the main areas in which the review process can be improved in future cycles.","PeriodicalId":251707,"journal":{"name":"Vol. 54, Issue 1 (Obituaries, News & Commentaries, Community Reports)","volume":"90 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122314665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-03-17DOI: 10.3847/25c2cfeb.f789e35e
G. Chanan
{"title":"Jerry Nelson (1944–2017)","authors":"G. Chanan","doi":"10.3847/25c2cfeb.f789e35e","DOIUrl":"https://doi.org/10.3847/25c2cfeb.f789e35e","url":null,"abstract":"","PeriodicalId":251707,"journal":{"name":"Vol. 54, Issue 1 (Obituaries, News & Commentaries, Community Reports)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116593937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-03-15DOI: 10.3847/25c2cfeb.db5dba79
D. Schwartz
{"title":"Michael Juda (1959–2016)","authors":"D. Schwartz","doi":"10.3847/25c2cfeb.db5dba79","DOIUrl":"https://doi.org/10.3847/25c2cfeb.db5dba79","url":null,"abstract":"","PeriodicalId":251707,"journal":{"name":"Vol. 54, Issue 1 (Obituaries, News & Commentaries, Community Reports)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115125988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：