{"title":"对成年人的工程观点进行有效和可靠的评估","authors":"Erdogan Kaya, Hasan Deniz, Ezgi Yesilyurt","doi":"10.1002/jee.20524","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Pre-college engineering education reform documents aim to help students develop engineering literacy. Helping students develop sophisticated epistemological views about engineering makes a significant contribution toward developing engineering-literate citizenry. Despite these widely recognized benefits, research on students' and teachers' epistemological views about engineering, commonly termed nature of engineering (NOE) views, has remained stagnant due to the absence of an open-ended questionnaire whose collected evidence of validity indicates its appropriateness for assessing students' and teachers' NOE understanding.</p>\n </section>\n \n <section>\n \n <h3> Purpose</h3>\n \n <p>The purpose of this study is threefold: (a) describing the development of a new open-ended instrument, the Views of Nature of Engineering Questionnaire version B (VNOE-B), (b) providing evidence in support of the VNOE-B validity and reliability, and (c) discussing the implications of the newly developed instrument for future research.</p>\n </section>\n \n <section>\n \n <h3> Design/Method</h3>\n \n <p>We aimed to provide evidence for the content and face validity of the VNOE-B by seeking input from a panel of science/engineering educators. Evidence for the construct validity was determined by analyzing the open-ended questionnaire and semistructured interview responses provided by pre-service and in-service teachers (considered novices in this field) and experts (engineers and engineering educators).</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Our findings indicate that the VNOE-B is consistently successful in differentiating between experts' and novices' NOE views. All engineering experts held sophisticated NOE views across all NOE views under study, whereas most novices held partially informed or uninformed NOE views.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Evidence of validity supports the appropriateness of the VNOE-B as an open-ended instrument for assessing adults' NOE views. Its application may guide teacher educators in determining the efficacy of teacher professional development in meeting the aim of improving in-service teachers' NOE understanding. Additionally, VNOE-B may potentially inform the success of pre-service teacher training.</p>\n </section>\n </div>","PeriodicalId":50206,"journal":{"name":"Journal of Engineering Education","volume":"112 3","pages":"634-673"},"PeriodicalIF":3.9000,"publicationDate":"2023-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jee.20524","citationCount":"1","resultStr":"{\"title\":\"Toward developing a valid and reliable assessment of adults' nature of engineering views\",\"authors\":\"Erdogan Kaya, Hasan Deniz, Ezgi Yesilyurt\",\"doi\":\"10.1002/jee.20524\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>Pre-college engineering education reform documents aim to help students develop engineering literacy. Helping students develop sophisticated epistemological views about engineering makes a significant contribution toward developing engineering-literate citizenry. Despite these widely recognized benefits, research on students' and teachers' epistemological views about engineering, commonly termed nature of engineering (NOE) views, has remained stagnant due to the absence of an open-ended questionnaire whose collected evidence of validity indicates its appropriateness for assessing students' and teachers' NOE understanding.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Purpose</h3>\\n \\n <p>The purpose of this study is threefold: (a) describing the development of a new open-ended instrument, the Views of Nature of Engineering Questionnaire version B (VNOE-B), (b) providing evidence in support of the VNOE-B validity and reliability, and (c) discussing the implications of the newly developed instrument for future research.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Design/Method</h3>\\n \\n <p>We aimed to provide evidence for the content and face validity of the VNOE-B by seeking input from a panel of science/engineering educators. Evidence for the construct validity was determined by analyzing the open-ended questionnaire and semistructured interview responses provided by pre-service and in-service teachers (considered novices in this field) and experts (engineers and engineering educators).</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>Our findings indicate that the VNOE-B is consistently successful in differentiating between experts' and novices' NOE views. All engineering experts held sophisticated NOE views across all NOE views under study, whereas most novices held partially informed or uninformed NOE views.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusion</h3>\\n \\n <p>Evidence of validity supports the appropriateness of the VNOE-B as an open-ended instrument for assessing adults' NOE views. Its application may guide teacher educators in determining the efficacy of teacher professional development in meeting the aim of improving in-service teachers' NOE understanding. Additionally, VNOE-B may potentially inform the success of pre-service teacher training.</p>\\n </section>\\n </div>\",\"PeriodicalId\":50206,\"journal\":{\"name\":\"Journal of Engineering Education\",\"volume\":\"112 3\",\"pages\":\"634-673\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2023-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jee.20524\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Engineering Education\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/jee.20524\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Engineering Education","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jee.20524","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Toward developing a valid and reliable assessment of adults' nature of engineering views
Background
Pre-college engineering education reform documents aim to help students develop engineering literacy. Helping students develop sophisticated epistemological views about engineering makes a significant contribution toward developing engineering-literate citizenry. Despite these widely recognized benefits, research on students' and teachers' epistemological views about engineering, commonly termed nature of engineering (NOE) views, has remained stagnant due to the absence of an open-ended questionnaire whose collected evidence of validity indicates its appropriateness for assessing students' and teachers' NOE understanding.
Purpose
The purpose of this study is threefold: (a) describing the development of a new open-ended instrument, the Views of Nature of Engineering Questionnaire version B (VNOE-B), (b) providing evidence in support of the VNOE-B validity and reliability, and (c) discussing the implications of the newly developed instrument for future research.
Design/Method
We aimed to provide evidence for the content and face validity of the VNOE-B by seeking input from a panel of science/engineering educators. Evidence for the construct validity was determined by analyzing the open-ended questionnaire and semistructured interview responses provided by pre-service and in-service teachers (considered novices in this field) and experts (engineers and engineering educators).
Results
Our findings indicate that the VNOE-B is consistently successful in differentiating between experts' and novices' NOE views. All engineering experts held sophisticated NOE views across all NOE views under study, whereas most novices held partially informed or uninformed NOE views.
Conclusion
Evidence of validity supports the appropriateness of the VNOE-B as an open-ended instrument for assessing adults' NOE views. Its application may guide teacher educators in determining the efficacy of teacher professional development in meeting the aim of improving in-service teachers' NOE understanding. Additionally, VNOE-B may potentially inform the success of pre-service teacher training.