首页 > 最新文献

ACM Transactions on Computing Education最新文献

英文 中文
Combining GitHub, Chat, and Peer Evaluation Data to Assess Individual Contributions to Team Software Development Projects 结合GitHub、Chat和同行评估数据评估个人对团队软件开发项目的贡献
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-05-02 DOI: 10.1145/3593592
C. Hundhausen, Phill Conrad, Olusola O. Adesope, Ahsun Tariq
Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n = 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’ contributions to the team, and the equality of team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous.
评估团队软件开发项目是出了名的困难,通常基于主观指标。为了使评估更加严格,我们进行了一项实证研究,探索基于同伴和讲师评估的主观指标与基于GitHub和聊天数据的客观指标之间的关系。我们研究了23个本科生软件团队(n=117名学生),他们来自北美两所研究型大学的两门本科生计算课程。我们收集了团队的数据:(a)来自GitHub代码库的提交和问题,(b)来自Slack和Microsoft teams渠道的聊天消息,(c)来自CATME同行评估系统的同行评估评级,以及(d)课程的个人作业评分。我们从(a)和(b)中得出了衡量团队成员对团队的贡献的指标,以及团队成员贡献的平等性。然后,我们进行了皮尔逊分析,以确定指标、同行评估评级和个人成绩之间的相关性。我们发现团队成员的GitHub贡献、聊天贡献和同行评价之间存在显著的正相关。此外,团队GitHub贡献的平等性与团队的平均同行评价评级呈正相关,与这些评级的差异呈负相关。然而,在团队聊天贡献的平等性和他们的同伴评价评级之间没有发现这种正相关性。我们的研究扩展了之前的研究结果,提供了证据表明:(a)团队成员的聊天贡献,就像他们在GitHub上的贡献一样,与他们的同行评价呈正相关;(b) 团队成员的聊天贡献与他们在GitHub上的贡献呈正相关;以及(c)团队GitHub贡献的平等性与其同行评估评级呈正相关。这些结果进一步支持了这样一种观点,即结合客观和主观指标可以使团队软件项目的评估更加全面和严格。
{"title":"Combining GitHub, Chat, and Peer Evaluation Data to Assess Individual Contributions to Team Software Development Projects","authors":"C. Hundhausen, Phill Conrad, Olusola O. Adesope, Ahsun Tariq","doi":"10.1145/3593592","DOIUrl":"https://doi.org/10.1145/3593592","url":null,"abstract":"Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n = 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’ contributions to the team, and the equality of team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous.","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"23 1","pages":"1 - 23"},"PeriodicalIF":2.4,"publicationDate":"2023-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41635789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Global Manager: A Serious Game to Raise Awareness of the Challenges of Being a Project Manager in Global Software Development 全球经理:一个严肃的游戏,提高认识的挑战,成为一个项目经理在全球软件开发
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-04-27 DOI: 10.1145/3592620
A. Vizcaíno, F. García, V. Menéndez, Antonio Manjavacas, Rubén Márquez, Marta Molina
Project managers tend to confront multiple challenges in Global Software Development (GSD), including misunderstandings about the project requirements, complex estimations of costs, risks, and efforts, along with increases in task allocation and a lack of coordination. “Soft skills” play a fundamental role in solving these challenges, as they are the human or social abilities that facilitate the resolution of conflicts and involve dealing with people and managing projects in their most social and creative dimension. However, developing the soft skills that allow project managers to lead in an effective manner is not an easy task, especially in global or distributed environments, where coordination and control problems are commonplace. One suitable mechanism with which to develop these soft skills is that of serious games, which focus on learning by doing and allow users to simulate real scenarios. The authors of this article are aware of the usefulness of this type of teaching method and have, therefore, developed the serious game described herein. This serious game is denominated as Global Manager and is focused on helping both students and novice project managers to become aware of the factors that may affect GSD projects. Global Manager was evaluated by means of a quasi-experiment based on a pretest-posttest design, which was used to assess whether the game can increase the players’ awareness and knowledge of the factors that a project manager should consider in GSD projects. The results obtained after evaluating the game were quite satisfactory, as the game taught the players to differentiate between global and distributed software projects and to experience situations that may and do occur in these settings. Furthermore, Global Manager helped improve players' perceptions of the importance of different influencing factors in GSD.
项目经理在全球软件开发(GSD)中往往面临多重挑战,包括对项目需求的误解、对成本、风险和努力的复杂估计,以及任务分配的增加和缺乏协调。“软技能”在解决这些挑战方面发挥着根本作用,因为它们是促进解决冲突的人类或社会能力,涉及与人打交道和管理最具社会性和创造性的项目。然而,开发使项目经理能够有效领导的软技能并不是一项容易的任务,尤其是在全球或分布式环境中,协调和控制问题很常见。开发这些软技能的一个合适机制是严肃游戏,它专注于边做边学,并允许用户模拟真实场景。本文的作者意识到这种教学方法的有用性,因此开发了本文所述的严肃游戏。这个严肃的游戏被命名为“全球经理”,专注于帮助学生和新手项目经理意识到可能影响GSD项目的因素。Global Manager是通过基于前测后测设计的准实验进行评估的,该设计用于评估游戏是否可以提高玩家对项目经理在GSD项目中应该考虑的因素的意识和知识。评估游戏后获得的结果非常令人满意,因为游戏教会玩家区分全局软件项目和分布式软件项目,并体验在这些环境中可能发生的情况。此外,Global Manager帮助提高了参与者对GSD中不同影响因素重要性的认知。
{"title":"Global Manager: A Serious Game to Raise Awareness of the Challenges of Being a Project Manager in Global Software Development","authors":"A. Vizcaíno, F. García, V. Menéndez, Antonio Manjavacas, Rubén Márquez, Marta Molina","doi":"10.1145/3592620","DOIUrl":"https://doi.org/10.1145/3592620","url":null,"abstract":"Project managers tend to confront multiple challenges in Global Software Development (GSD), including misunderstandings about the project requirements, complex estimations of costs, risks, and efforts, along with increases in task allocation and a lack of coordination. “Soft skills” play a fundamental role in solving these challenges, as they are the human or social abilities that facilitate the resolution of conflicts and involve dealing with people and managing projects in their most social and creative dimension. However, developing the soft skills that allow project managers to lead in an effective manner is not an easy task, especially in global or distributed environments, where coordination and control problems are commonplace. One suitable mechanism with which to develop these soft skills is that of serious games, which focus on learning by doing and allow users to simulate real scenarios. The authors of this article are aware of the usefulness of this type of teaching method and have, therefore, developed the serious game described herein. This serious game is denominated as Global Manager and is focused on helping both students and novice project managers to become aware of the factors that may affect GSD projects. Global Manager was evaluated by means of a quasi-experiment based on a pretest-posttest design, which was used to assess whether the game can increase the players’ awareness and knowledge of the factors that a project manager should consider in GSD projects. The results obtained after evaluating the game were quite satisfactory, as the game taught the players to differentiate between global and distributed software projects and to experience situations that may and do occur in these settings. Furthermore, Global Manager helped improve players' perceptions of the importance of different influencing factors in GSD.","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"23 1","pages":"1 - 31"},"PeriodicalIF":2.4,"publicationDate":"2023-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44164547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of Submission Limits and Regression Penalties to Improve Student Behavior with Automatic Assessment Systems 用自动评估系统评估提交限制和退步处罚以改善学生行为
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-04-20 DOI: 10.1145/3591210
R. Lawrence, Sarah Foss, Tatiana Urazova
Objectives. Automatic assessment systems are widely used to provide rapid feedback for students and reduce grading time. Despite the benefits of increased efficiency and improved pedagogical outcomes, an ongoing challenge is mitigating poor student behaviors when interacting with automatic assessment systems including numerous submissions, trial-and-error, and relying on marking feedback for problem solving. These behaviors negatively affect student learning as well as have significant impact on system resources. This research quantitatively examines how utilizing submission policies such as limiting the number of submissions and applying regression penalties can reduce negative student behaviors. The hypothesis is that both submission policies will have a significant impact on student behavior and reduce both the number of submissions and regressions in student performance. The research questions evaluate the impact on student behavior, determine which submission policy is the most effective, and what submission policy is preferred by students. Participants. The study involved two course sections in two different semesters consisting of a total of 224 students at the University of British Columbia, a research-intensive university. The students were evaluated using an automated assessment system in a large third year database course. Study Methods. The two course sections used an automated assessment system for constructing database design diagrams for assignments and exams. The first section had no limits on the number of submissions for both assignments and exams. The second section had limits for the exams but no limits on assignments. On the midterm, participants were randomly assigned to have either a restriction on the total number of submissions or unlimited submissions but with regression penalties if a graded answer was lower than a previous submission. On the final exam, students were given the option of selecting their submission policy. Student academic performance and submission profiles were compared between the course sections and the different submission policies. Findings. Unrestricted use of automatic grading systems results in high occurrence of undesirable student behavior including trial-and-error guessing and reduced time between submissions without sufficient independent thought. Both submission policies of limiting maximum submissions and utilizing regression penalties significantly reduce these behaviors by up to 85%. Overall, students prefer maximum submission limits, and demonstrate improved behavior and educational outcomes. Conclusions. Automated assessment systems when used for larger problems related to design and programming have benefits when deployed with submission restrictions (maximum attempts or regression penalty) for both improved student learning behaviors and to reduce the computational costs for the system. This is especially important for summative assessment but reasonable limits for formative assessme
目标。自动评估系统被广泛用于为学生提供快速反馈并缩短评分时间。尽管提高了效率和改善了教学效果,但一个持续的挑战是,在与自动评估系统互动时,减轻学生的不良行为,包括大量提交、试错,以及依靠评分反馈来解决问题。这些行为不仅会对学生的学习产生负面影响,还会对系统资源产生重大影响。这项研究定量地考察了利用提交政策(如限制提交数量和应用回归惩罚)如何减少学生的负面行为。假设这两种提交政策都会对学生行为产生重大影响,并减少提交数量和学生表现的退步。研究问题评估了对学生行为的影响,确定哪种提交政策最有效,以及学生更喜欢什么提交政策。参与者。这项研究涉及不列颠哥伦比亚大学这所研究密集型大学的两个不同学期的两个课程部分,共有224名学生。在一个大型的三年级数据库课程中,使用自动评估系统对学生进行了评估。研究方法。这两个课程部分使用了一个自动评估系统来构建作业和考试的数据库设计图。第一节对作业和考试的提交数量没有限制。第二节对考试有限制,但对作业没有限制。在期中考试中,参与者被随机分配对提交的总数量有限制或无限制提交,但如果评分答案低于前一次提交,则会受到回归惩罚。在期末考试中,学生可以选择自己的提交政策。比较了课程部分和不同提交政策之间的学生学习成绩和提交情况。调查结果。不受限制地使用自动评分系统会导致不良学生行为的频繁发生,包括试错猜测,以及在没有足够独立思考的情况下缩短提交时间。限制最大提交量和使用回归惩罚的提交策略都能显著减少85%的这些行为。总的来说,学生更喜欢最大提交限制,并表现出改善的行为和教育成果。结论。当用于与设计和编程相关的较大问题时,自动评估系统在部署时具有提交限制(最大尝试次数或回归惩罚),既有利于改善学生的学习行为,也有利于降低系统的计算成本。这对总结性评估尤其重要,但对形成性评估的合理限制也很有价值。
{"title":"Evaluation of Submission Limits and Regression Penalties to Improve Student Behavior with Automatic Assessment Systems","authors":"R. Lawrence, Sarah Foss, Tatiana Urazova","doi":"10.1145/3591210","DOIUrl":"https://doi.org/10.1145/3591210","url":null,"abstract":"Objectives. Automatic assessment systems are widely used to provide rapid feedback for students and reduce grading time. Despite the benefits of increased efficiency and improved pedagogical outcomes, an ongoing challenge is mitigating poor student behaviors when interacting with automatic assessment systems including numerous submissions, trial-and-error, and relying on marking feedback for problem solving. These behaviors negatively affect student learning as well as have significant impact on system resources. This research quantitatively examines how utilizing submission policies such as limiting the number of submissions and applying regression penalties can reduce negative student behaviors. The hypothesis is that both submission policies will have a significant impact on student behavior and reduce both the number of submissions and regressions in student performance. The research questions evaluate the impact on student behavior, determine which submission policy is the most effective, and what submission policy is preferred by students. Participants. The study involved two course sections in two different semesters consisting of a total of 224 students at the University of British Columbia, a research-intensive university. The students were evaluated using an automated assessment system in a large third year database course. Study Methods. The two course sections used an automated assessment system for constructing database design diagrams for assignments and exams. The first section had no limits on the number of submissions for both assignments and exams. The second section had limits for the exams but no limits on assignments. On the midterm, participants were randomly assigned to have either a restriction on the total number of submissions or unlimited submissions but with regression penalties if a graded answer was lower than a previous submission. On the final exam, students were given the option of selecting their submission policy. Student academic performance and submission profiles were compared between the course sections and the different submission policies. Findings. Unrestricted use of automatic grading systems results in high occurrence of undesirable student behavior including trial-and-error guessing and reduced time between submissions without sufficient independent thought. Both submission policies of limiting maximum submissions and utilizing regression penalties significantly reduce these behaviors by up to 85%. Overall, students prefer maximum submission limits, and demonstrate improved behavior and educational outcomes. Conclusions. Automated assessment systems when used for larger problems related to design and programming have benefits when deployed with submission restrictions (maximum attempts or regression penalty) for both improved student learning behaviors and to reduce the computational costs for the system. This is especially important for summative assessment but reasonable limits for formative assessme","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"23 1","pages":"1 - 24"},"PeriodicalIF":2.4,"publicationDate":"2023-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42792993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tracing Participation Beyond Computing Careers: How Women Reflect on Their Experiences in Computing Programs 追踪计算机职业之外的参与:女性如何反思她们在计算机项目中的经历
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-04-17 DOI: https://dl.acm.org/doi/10.1145/3582564
Melissa Perez, Patricia Garcia

Norms and values in computing education are constantly changing as dominant narratives about the role of computing in society evolve over time. Within the current evolving landscape of computing education, researchers and practitioners have advocated for ensuring people from all backgrounds, and particularly women, non-binary, and Black, Indigenous, and Latinx people, are able to participate equitably within the field of computing. Yet, the values of computing educational experiences are narrowly framed within career outcomes, such as securing a career in computing, leaving many important experiences and ways of participating in the field out of the picture. To address this, we conducted reflective interviews with women who participated in broadening participation in computing (BPC) programs to understand their perceptions of computing and how it aligns (or not) with what they value about their experiences in computing learning environments. We investigate the following research questions: (1) How do women who participated in BPC programs describe their perceptions of computing? (2) How do those perceptions align or misalign with the program outcomes they valued? The findings from our study call attention to tensions arising from centering “computing careers” in BPC work and highlight the outcomes of participation valued by the women in our study, such as developing communities and relationships, gaining communication skills, and expanding perspectives on skills computer scientists should possess.

随着时间的推移,关于计算机在社会中的作用的主导叙事不断演变,计算机教育的规范和价值观也在不断变化。在当前不断发展的计算机教育环境中,研究人员和实践者提倡确保来自所有背景的人,特别是妇女、非二进制、黑人、土著和拉丁裔人,能够公平地参与计算机领域。然而,计算机教育经历的价值被狭隘地限定在职业结果中,比如确保在计算机领域的职业生涯,而将许多重要的经验和参与该领域的方式排除在外。为了解决这一问题,我们对参与扩大计算机(BPC)项目的女性进行了反思性访谈,以了解她们对计算机的看法,以及它如何与她们在计算机学习环境中所看重的经历相一致(或不一致)。我们调查了以下研究问题:(1)参与BPC计划的女性如何描述她们对计算机的看法?(2)这些看法如何与他们所重视的项目结果一致或不一致?我们的研究结果引起了人们对以BPC工作为中心的“计算机职业”所产生的紧张关系的关注,并强调了我们研究中女性所重视的参与的结果,例如发展社区和关系,获得沟通技巧,以及扩展计算机科学家应该拥有的技能的观点。
{"title":"Tracing Participation Beyond Computing Careers: How Women Reflect on Their Experiences in Computing Programs","authors":"Melissa Perez, Patricia Garcia","doi":"https://dl.acm.org/doi/10.1145/3582564","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3582564","url":null,"abstract":"<p>Norms and values in computing education are constantly changing as dominant narratives about the role of computing in society evolve over time. Within the current evolving landscape of computing education, researchers and practitioners have advocated for ensuring people from all backgrounds, and particularly women, non-binary, and Black, Indigenous, and Latinx people, are able to participate equitably within the field of computing. Yet, the values of computing educational experiences are narrowly framed within career outcomes, such as securing a career in computing, leaving many important experiences and ways of participating in the field out of the picture. To address this, we conducted reflective interviews with women who participated in broadening participation in computing (BPC) programs to understand their perceptions of computing and how it aligns (or not) with what they value about their experiences in computing learning environments. We investigate the following research questions: (1) How do women who participated in BPC programs describe their perceptions of computing? (2) How do those perceptions align or misalign with the program outcomes they valued? The findings from our study call attention to tensions arising from centering “computing careers” in BPC work and highlight the outcomes of participation valued by the women in our study, such as developing communities and relationships, gaining communication skills, and expanding perspectives on skills computer scientists should possess.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"36 10","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding the Impact of Peer Instruction in CS Principles Teacher Professional Development 理解同伴指导对计算机科学原理教师专业发展的影响
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-04-17 DOI: https://dl.acm.org/doi/10.1145/3585077
Karla Hamlen Mansour, Debbie K. Jackson, Lisa Bievenue, Adam Voight, Nigamanth Sridhar

In a nationwide initiative to increase computer science Education in K-12, many teachers were recruited to CS teaching positions but without adequate preparation, which can lead to lack of confidence and feelings of isolation [35, 54]. In response to these issues, the purpose of this study was to determine the effectiveness of a newly developed summer professional development program with follow-up support with the goal of improving teacher confidence and informing teacher beliefs about computer science. This training featured peer instruction and an emphasis on computer science principles. It took place over three years, and was used to prepare teachers from over 50 schools across a midwestern state. Using Hierarchical Linear Modeling, data analysis from 57 teachers and 871 students showed that teacher confidence and content knowledge increased significantly, and to a greater extent for those who began with the lowest levels of confidence. Students also made significant knowledge gains from before to after taking the class. Student gains were higher for those whose teachers were more confident in their ability to teach computer science.

在全国范围内增加K-12计算机科学教育的倡议中,许多教师被招募到CS教学岗位,但没有充分的准备,这可能导致缺乏信心和孤立感[35,54]。针对这些问题,本研究的目的是确定新开发的夏季专业发展计划的有效性,并提供后续支持,以提高教师信心和告知教师有关计算机科学的信念。这次培训的特点是同伴指导,强调计算机科学原理。这个项目进行了三年多,为中西部一个州50多所学校的教师提供了培训。使用层次线性模型,对来自57名教师和871名学生的数据分析表明,教师的信心和内容知识显著增加,对于那些开始时信心水平最低的人来说,这种增加的程度更大。学生们在上课前后也获得了显著的知识收获。那些老师对自己教授计算机科学的能力更有信心的学生,他们的成绩会更高。
{"title":"Understanding the Impact of Peer Instruction in CS Principles Teacher Professional Development","authors":"Karla Hamlen Mansour, Debbie K. Jackson, Lisa Bievenue, Adam Voight, Nigamanth Sridhar","doi":"https://dl.acm.org/doi/10.1145/3585077","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3585077","url":null,"abstract":"<p>In a nationwide initiative to increase computer science Education in K-12, many teachers were recruited to CS teaching positions but without adequate preparation, which can lead to lack of confidence and feelings of isolation [35, 54]. In response to these issues, the purpose of this study was to determine the effectiveness of a newly developed summer professional development program with follow-up support with the goal of improving teacher confidence and informing teacher beliefs about computer science. This training featured peer instruction and an emphasis on computer science principles. It took place over three years, and was used to prepare teachers from over 50 schools across a midwestern state. Using Hierarchical Linear Modeling, data analysis from 57 teachers and 871 students showed that teacher confidence and content knowledge increased significantly, and to a greater extent for those who began with the lowest levels of confidence. Students also made significant knowledge gains from before to after taking the class. Student gains were higher for those whose teachers were more confident in their ability to teach computer science.</p><p></p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"36 11","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Think-Aloud Study of Novice Debugging 新手调试的有声思考研究
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-03-30 DOI: 10.1145/3589004
Jacqueline L. Whalley, Amber Settle, Andrew Luxton-Reilly
Debugging is a core skill required by programmers, yet we know little about how to effectively teach the process of debugging. The challenges of learning debugging are compounded for novices who lack experience and are still learning the tools they need to program effectively. In this work, we report a case study in which we used a think-aloud protocol to gain insight into the behaviour of three students engaged in debugging tasks. Our qualitative analysis reveals a variety of helpful practices and barriers that limit the effectiveness of debugging. We observe that comprehension, evidence-based activities, and workflow practices all contribute to novice debugging success. Lack of sustained effort, precision, and methodical processes negatively impact debugging effectiveness. We anticipate that understanding how students engage in debugging tasks will aid future work to address ineffective behaviours and promote effective debugging activities.
调试是程序员需要的一项核心技能,然而我们对如何有效地教授调试过程知之甚少。对于缺乏经验且仍在学习有效编程所需工具的新手来说,学习调试的挑战更加复杂。在这项工作中,我们报告了一个案例研究,在这个案例研究中,我们使用了一个有声思考协议来深入了解三名从事调试任务的学生的行为。我们的定性分析揭示了限制调试有效性的各种有用的实践和障碍。我们观察到理解、基于证据的活动和工作流实践都有助于新手调试的成功。缺乏持续的努力、准确性和有条理的过程会对调试的有效性产生负面影响。我们期望了解学生如何参与调试任务将有助于未来的工作解决无效行为并促进有效的调试活动。
{"title":"A Think-Aloud Study of Novice Debugging","authors":"Jacqueline L. Whalley, Amber Settle, Andrew Luxton-Reilly","doi":"10.1145/3589004","DOIUrl":"https://doi.org/10.1145/3589004","url":null,"abstract":"Debugging is a core skill required by programmers, yet we know little about how to effectively teach the process of debugging. The challenges of learning debugging are compounded for novices who lack experience and are still learning the tools they need to program effectively. In this work, we report a case study in which we used a think-aloud protocol to gain insight into the behaviour of three students engaged in debugging tasks. Our qualitative analysis reveals a variety of helpful practices and barriers that limit the effectiveness of debugging. We observe that comprehension, evidence-based activities, and workflow practices all contribute to novice debugging success. Lack of sustained effort, precision, and methodical processes negatively impact debugging effectiveness. We anticipate that understanding how students engage in debugging tasks will aid future work to address ineffective behaviours and promote effective debugging activities.","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"23 1","pages":"1 - 38"},"PeriodicalIF":2.4,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"64073106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A Generalized Estimating Equations Approach to Investigate Predictors of Teacher Candidates’ Views of Coding 用广义估计方程方法研究教师候选人编码观的预测因子
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-03-14 DOI: 10.1145/3587163
B. Belland, Chanmin Kim, A. Y. Zhang, Eunseo Lee
This article reports the analysis of data from five different studies to identify predictors of preservice, early childhood teachers’ views of (a) the nature of coding, (b) integration of coding into preschool classrooms, and (c) relation of coding to fields other than computer science (CS). Significant changes in views of coding were predicted by time, prior robot programming experience, and perceptions of the value of coding. Notably, prior programming knowledge and positive perceptions of mathematics predicted decreases in views of coding from pre- to post-survey.
本文对五项不同研究的数据进行了分析,以确定职前幼儿教师对(a)编码的性质,(b)将编码融入幼儿园课堂,以及(c)编码与计算机科学(CS)以外领域的关系的看法的预测因素。编码观点的显著变化可以通过时间、先前的机器人编程经验和对编码价值的感知来预测。值得注意的是,先前的编程知识和积极的数学认知预测了从调查前到调查后编码观点的下降。
{"title":"A Generalized Estimating Equations Approach to Investigate Predictors of Teacher Candidates’ Views of Coding","authors":"B. Belland, Chanmin Kim, A. Y. Zhang, Eunseo Lee","doi":"10.1145/3587163","DOIUrl":"https://doi.org/10.1145/3587163","url":null,"abstract":"This article reports the analysis of data from five different studies to identify predictors of preservice, early childhood teachers’ views of (a) the nature of coding, (b) integration of coding into preschool classrooms, and (c) relation of coding to fields other than computer science (CS). Significant changes in views of coding were predicted by time, prior robot programming experience, and perceptions of the value of coding. Notably, prior programming knowledge and positive perceptions of mathematics predicted decreases in views of coding from pre- to post-survey.","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":" ","pages":"1 - 23"},"PeriodicalIF":2.4,"publicationDate":"2023-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45502520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Teacher Attitudes & Beliefs in Computer Science (T-ABC): Development & Validation of a Teacher Survey Instrument 计算机科学教师的态度与信念(T-ABC):教师调查工具的开发与验证
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-03-14 DOI: https://dl.acm.org/doi/10.1145/3569945
Darcy Ronan, D. Cenk Erdil, Dennis Brylow

Instrument development is an important step towards unlocking the analytical power of teacher attitudes and beliefs towards Computer Science (CS). Teacher dispositions have strong empirical and theoretical ties to teacher motivation, professional choices, and classroom practices. To determine consensus desirable attitudes and beliefs, we analyzed 17 key documents produced by 12 national and international organizations associated with CS and the CS education reform movement. An analysis of 98 relevant coded segments yielded four dispositional targets: an equity orientation, a teacher growth mindset, and key beliefs regarding (career) outcomes and epistemology of CS. Statements crafted for these targets as well as self-efficacy were reviewed through an expert panel (N = 5) and a pilot study (N = 22) before the T-ABC was administered to elementary teachers in a large grant-funded outreach project (N = 772). Psychometric analysis demonstrates high reliability (Cronbach’s alpha = 0.89) and satisfactory extraction and loading onto a three factor model, with CS beliefs, growth mindset, and self-efficacy as major factors. Identification and measurements of teacher dispositions enables further analysis of how teacher beliefs may support or hinder effective practice in CS instruction, how teacher populations may differ, and how identified dispositions may change with exposure to various CS learning experiences.

仪器开发是打开教师对计算机科学(CS)的态度和信念的分析能力的重要一步。教师性格与教师动机、专业选择和课堂实践有着强烈的实证和理论联系。为了确定共识的理想态度和信念,我们分析了由12个与计算机科学和计算机科学教育改革运动相关的国家和国际组织制作的17个关键文件。对98个相关编码片段的分析得出了四个性格目标:公平取向、教师成长心态和关于(职业)结果和CS认识论的关键信念。在一个大型资助外展项目(N = 772)中对小学教师实施T-ABC之前,通过一个专家小组(N = 5)和一个试点研究(N = 22)对这些目标和自我效能感的陈述进行了审查。心理测量分析结果表明,以CS信念、成长心态和自我效能为主要因素的三因素模型具有较高的信度(Cronbach’s alpha = 0.89),提取和加载效果良好。教师性格的识别和测量可以进一步分析教师信念如何支持或阻碍计算机科学教学的有效实践,教师群体如何不同,以及已识别的性格如何随着接触各种计算机科学学习经验而变化。
{"title":"Teacher Attitudes & Beliefs in Computer Science (T-ABC): Development & Validation of a Teacher Survey Instrument","authors":"Darcy Ronan, D. Cenk Erdil, Dennis Brylow","doi":"https://dl.acm.org/doi/10.1145/3569945","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3569945","url":null,"abstract":"<p>Instrument development is an important step towards unlocking the analytical power of teacher attitudes and beliefs towards Computer Science (CS). Teacher dispositions have strong empirical and theoretical ties to teacher motivation, professional choices, and classroom practices. To determine consensus desirable attitudes and beliefs, we analyzed 17 key documents produced by 12 national and international organizations associated with CS and the CS education reform movement. An analysis of 98 relevant coded segments yielded four dispositional targets: an equity orientation, a teacher growth mindset, and key beliefs regarding (career) outcomes and epistemology of CS. Statements crafted for these targets as well as self-efficacy were reviewed through an expert panel (N = 5) and a pilot study (N = 22) before the T-ABC was administered to elementary teachers in a large grant-funded outreach project (N = 772). Psychometric analysis demonstrates high reliability (Cronbach’s alpha = 0.89) and satisfactory extraction and loading onto a three factor model, with CS beliefs, growth mindset, and self-efficacy as major factors. Identification and measurements of teacher dispositions enables further analysis of how teacher beliefs may support or hinder effective practice in CS instruction, how teacher populations may differ, and how identified dispositions may change with exposure to various CS learning experiences.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"36 12","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Barriers and Supports to Offering Computer Science in High Schools: A Case Study of Structures and Agents 在高中开设计算机科学课程的障碍与支持:结构与代理的个案研究
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-03-14 DOI: https://dl.acm.org/doi/10.1145/3572900
Miranda C. Parker

In the age of computing, there still exist many schools that do not offer computer science courses. The reason can be esoteric to designers of interventions, curricula, and policies. This study aims to answer the research question: What do school officials perceive as barriers to and supports for offering computer science courses at their school? This article provides a case study of four public high schools in the state of Georgia to better understand the barriers to adopting computer science. Interviews conducted with school principals, counselors, and teachers were thematically analyzed to study each case. The pattern that emerged from these themes is framed by structuration theory, wherein the structures (school policies, resources, and courses) influence the agents (teachers, students, the community), and in turn, the agents influence the structures. This framing provides insights into what attributes can be supports for or barriers against schools offering computer science courses.

在计算机时代,仍然有许多学校不提供计算机科学课程。其中的原因对于干预措施、课程和政策的设计者来说可能很深奥。本研究旨在回答研究问题:学校官员认为在他们学校开设计算机科学课程的障碍和支持是什么?本文提供了佐治亚州四所公立高中的案例研究,以更好地理解采用计算机科学的障碍。对学校校长、辅导员和教师的访谈进行了主题分析,以研究每个案例。从这些主题中出现的模式由结构理论构成,其中结构(学校政策,资源和课程)影响代理人(教师,学生,社区),反过来,代理人影响结构。这个框架提供了对学校提供计算机科学课程的支持或障碍的见解。
{"title":"Barriers and Supports to Offering Computer Science in High Schools: A Case Study of Structures and Agents","authors":"Miranda C. Parker","doi":"https://dl.acm.org/doi/10.1145/3572900","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3572900","url":null,"abstract":"<p>In the age of computing, there still exist many schools that do not offer computer science courses. The reason can be esoteric to designers of interventions, curricula, and policies. This study aims to answer the research question: <i>What do school officials perceive as barriers to and supports for offering computer science courses at their school?</i> This article provides a case study of four public high schools in the state of Georgia to better understand the barriers to adopting computer science. Interviews conducted with school principals, counselors, and teachers were thematically analyzed to study each case. The pattern that emerged from these themes is framed by structuration theory, wherein the structures (school policies, resources, and courses) influence the agents (teachers, students, the community), and in turn, the agents influence the structures. This framing provides insights into what attributes can be supports for or barriers against schools offering computer science courses.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"17 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138542683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Validation of a Spanish-language Version of a Computer Programming Aptitude Test for First-year University Students 一年级学生计算机程序设计能力倾向测试的西班牙语版本的验证
IF 2.4 3区 工程技术 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2023-03-14 DOI: https://dl.acm.org/doi/10.1145/3579365
Francisco Vásquez, Juan Felipe Calderón, Federico Meza, Andrea Vásquez

There is increasing interest in computer science and computing bachelor programs due to the growing importance of technology in the globalized world. Thus, as higher education institutions strive to serve a diverse student demographic, it is salient to gauge their programming abilities to improve guidance on learning processes regarding their initial knowledge state. Despite the availability of certain instruments to measure student programming skills, these are traditionally aimed at younger populations and do not accurately discriminate the different levels of ability among university students. This article introduces a translation into Spanish and validation of an existing English-language aptitude test for computing jobs that can be used to measure the programming abilities of students with no prior experience in the field. Following a cyclic research methodology, two iterations were carried out in this article. First, the aforementioned test was translated and validated via expert judgment and focus groups, in which certain items were removed subsequent to a quantitative analysis. The resultant instrument underwent a second validation using a larger population of students. Analysis conducted after the second iteration showed this instrument to deliver good internal consistency, good difficulty and discrimination indices, and a moderate correlation with the grades of the midterm exam of a programming course undertaken by first year engineering students. This work contributes to both increasing the number of tests available in the Spanish language with which to assess programming abilities, as well as to the broader literature regarding test adaptation, translation and validation.

由于技术在全球化世界中日益重要,人们对计算机科学和计算机学士课程的兴趣越来越大。因此,随着高等教育机构努力为多样化的学生提供服务,衡量他们的编程能力以改善关于他们初始知识状态的学习过程的指导是很重要的。尽管有一些工具可以衡量学生的编程技能,但这些工具传统上是针对年轻人的,并不能准确区分大学生的不同能力水平。本文介绍了一种针对计算工作的现有英语能力测试的西班牙语翻译和验证,该测试可用于衡量没有该领域经验的学生的编程能力。遵循循环研究方法,本文进行了两次迭代。首先,上述测试通过专家判断和焦点小组进行翻译和验证,其中某些项目在定量分析后被删除。由此产生的仪器在更大的学生群体中进行了第二次验证。第二次迭代后的分析表明,该工具具有良好的内部一致性,较好的难度和判别指标,与工程一年级学生的编程课程期中考试成绩有适度的相关性。这项工作既有助于增加可用的西班牙语测试的数量,用于评估编程能力,也有助于扩充有关测试改编、翻译和验证的更广泛的文献。
{"title":"Validation of a Spanish-language Version of a Computer Programming Aptitude Test for First-year University Students","authors":"Francisco Vásquez, Juan Felipe Calderón, Federico Meza, Andrea Vásquez","doi":"https://dl.acm.org/doi/10.1145/3579365","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3579365","url":null,"abstract":"<p>There is increasing interest in computer science and computing bachelor programs due to the growing importance of technology in the globalized world. Thus, as higher education institutions strive to serve a diverse student demographic, it is salient to gauge their programming abilities to improve guidance on learning processes regarding their initial knowledge state. Despite the availability of certain instruments to measure student programming skills, these are traditionally aimed at younger populations and do not accurately discriminate the different levels of ability among university students. This article introduces a translation into Spanish and validation of an existing English-language aptitude test for computing jobs that can be used to measure the programming abilities of students with no prior experience in the field. Following a cyclic research methodology, two iterations were carried out in this article. First, the aforementioned test was translated and validated via expert judgment and focus groups, in which certain items were removed subsequent to a quantitative analysis. The resultant instrument underwent a second validation using a larger population of students. Analysis conducted after the second iteration showed this instrument to deliver good internal consistency, good difficulty and discrimination indices, and a moderate correlation with the grades of the midterm exam of a programming course undertaken by first year engineering students. This work contributes to both increasing the number of tests available in the Spanish language with which to assess programming abilities, as well as to the broader literature regarding test adaptation, translation and validation.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"36 14","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
ACM Transactions on Computing Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1