Line Muff Bech, Simone Poetzsch, Kamilla Andersen, Birgitte Nørgaard
{"title":"医疗保健入职——丹麦入职问卷(DOQ-34)的内容效度和信度。","authors":"Line Muff Bech, Simone Poetzsch, Kamilla Andersen, Birgitte Nørgaard","doi":"10.1097/CEH.0000000000000448","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>During recent years, health care organizations have paid increasing attention to onboarding because of recruitment challenges. Organizational initiatives are frequently monitored and evaluated using questionnaire data, and to produce high-quality data, reliable instruments are paramount. We aimed to investigate the content validity and reliability of the Danish Onboarding Questionnaire, including cognitive interviewing and test-retest analyses.</p><p><strong>Method: </strong>We investigated content validity, including face validity and the content validity index, and reliability for the percentage of agreement. To analyze the cognitive interview data, thematic analysis was applied, followed by the question-and-answer model to categorize the problems revealed. To test reliability, the percentage of agreement was calculated with an accepted deviation of 1 on test-retest data.</p><p><strong>Results: </strong>Regarding the mental processes, multiple items were identified to be challenged regarding comprehension (clarification of concepts and understanding), judgment (ambiguity and relevance), and response (anonymity and personal information). The mental process retrieval was not represented. The subscale content validity index/Ave was found to be 0.935, representing a \"good\" level of content validity. With an accepted deviation of 1, the mean agreement was 97.7%.</p><p><strong>Discussion: </strong>Questionnaire items causing uncertainties or challenges are potential sources of deteriorated content validity and should be revised. We suggest that the Danish Onboarding Questionnaire-34 undergo an item reduction, which might increase its validity and reliability.</p>","PeriodicalId":50218,"journal":{"name":"Journal of Continuing Education in the Health Professions","volume":"43 3","pages":"148-154"},"PeriodicalIF":1.6000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Onboarding in Health Care-Content Validity and Reliability of the Danish Onboarding Questionnaire (DOQ-34).\",\"authors\":\"Line Muff Bech, Simone Poetzsch, Kamilla Andersen, Birgitte Nørgaard\",\"doi\":\"10.1097/CEH.0000000000000448\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>During recent years, health care organizations have paid increasing attention to onboarding because of recruitment challenges. Organizational initiatives are frequently monitored and evaluated using questionnaire data, and to produce high-quality data, reliable instruments are paramount. We aimed to investigate the content validity and reliability of the Danish Onboarding Questionnaire, including cognitive interviewing and test-retest analyses.</p><p><strong>Method: </strong>We investigated content validity, including face validity and the content validity index, and reliability for the percentage of agreement. To analyze the cognitive interview data, thematic analysis was applied, followed by the question-and-answer model to categorize the problems revealed. To test reliability, the percentage of agreement was calculated with an accepted deviation of 1 on test-retest data.</p><p><strong>Results: </strong>Regarding the mental processes, multiple items were identified to be challenged regarding comprehension (clarification of concepts and understanding), judgment (ambiguity and relevance), and response (anonymity and personal information). The mental process retrieval was not represented. The subscale content validity index/Ave was found to be 0.935, representing a \\\"good\\\" level of content validity. With an accepted deviation of 1, the mean agreement was 97.7%.</p><p><strong>Discussion: </strong>Questionnaire items causing uncertainties or challenges are potential sources of deteriorated content validity and should be revised. We suggest that the Danish Onboarding Questionnaire-34 undergo an item reduction, which might increase its validity and reliability.</p>\",\"PeriodicalId\":50218,\"journal\":{\"name\":\"Journal of Continuing Education in the Health Professions\",\"volume\":\"43 3\",\"pages\":\"148-154\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2023-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Continuing Education in the Health Professions\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.1097/CEH.0000000000000448\",\"RegionNum\":4,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Continuing Education in the Health Professions","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1097/CEH.0000000000000448","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Onboarding in Health Care-Content Validity and Reliability of the Danish Onboarding Questionnaire (DOQ-34).
Introduction: During recent years, health care organizations have paid increasing attention to onboarding because of recruitment challenges. Organizational initiatives are frequently monitored and evaluated using questionnaire data, and to produce high-quality data, reliable instruments are paramount. We aimed to investigate the content validity and reliability of the Danish Onboarding Questionnaire, including cognitive interviewing and test-retest analyses.
Method: We investigated content validity, including face validity and the content validity index, and reliability for the percentage of agreement. To analyze the cognitive interview data, thematic analysis was applied, followed by the question-and-answer model to categorize the problems revealed. To test reliability, the percentage of agreement was calculated with an accepted deviation of 1 on test-retest data.
Results: Regarding the mental processes, multiple items were identified to be challenged regarding comprehension (clarification of concepts and understanding), judgment (ambiguity and relevance), and response (anonymity and personal information). The mental process retrieval was not represented. The subscale content validity index/Ave was found to be 0.935, representing a "good" level of content validity. With an accepted deviation of 1, the mean agreement was 97.7%.
Discussion: Questionnaire items causing uncertainties or challenges are potential sources of deteriorated content validity and should be revised. We suggest that the Danish Onboarding Questionnaire-34 undergo an item reduction, which might increase its validity and reliability.
期刊介绍:
The Journal of Continuing Education is a quarterly journal publishing articles relevant to theory, practice, and policy development for continuing education in the health sciences. The journal presents original research and essays on subjects involving the lifelong learning of professionals, with a focus on continuous quality improvement, competency assessment, and knowledge translation. It provides thoughtful advice to those who develop, conduct, and evaluate continuing education programs.