Christian X. Navarro-Cota;Ana I. Molina;Miguel A. Redondo;Carmen Lacave
{"title":"A Comprehensive Usability Measurement Tool for m-Learning Applications","authors":"Christian X. Navarro-Cota;Ana I. Molina;Miguel A. Redondo;Carmen Lacave","doi":"10.1109/TE.2023.3347191","DOIUrl":null,"url":null,"abstract":"Contribution: This article describes the process used to create a questionnaire to evaluate the usability of mobile learning applications (CECAM). The questionnaire includes specific questions to assess user interface usability and pedagogical usability. Background: Nowadays, mobile applications are expanding rapidly and are commonly used in educational institutions to support the learning and teaching process. But the possible deficient usability could decrease the utility of learning activities and the student’s motivation. Therefore, careful planning and design by the developer are required, along with a usability evaluation of the applications. Research Questions: How could an instrument be developed to evaluate the usability of m-learning applications that combine technical and pedagogical aspects? How can the quality of the developed instrument be determined? Methodology: A structured questionnaire was created like a measuring tool to evaluate and design m-learning applications. Different statistical techniques, including reliability and validity assessments, were employed to evaluate the quality of the instrument, which is determined through the calibration of the CECAM survey. Findings: After the validity analysis of the questionnaire, a scale with 56 items was obtained, with an alpha reliability coefficient of 0.911 (an excellent measuring scale). It pretends to be used by teachers to design or evaluate m-learning applications, improve their usability, and enhance the students’ learning experience.","PeriodicalId":55011,"journal":{"name":"IEEE Transactions on Education","volume":"67 2","pages":"209-223"},"PeriodicalIF":2.1000,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10401952","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Education","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10401952/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
Contribution: This article describes the process used to create a questionnaire to evaluate the usability of mobile learning applications (CECAM). The questionnaire includes specific questions to assess user interface usability and pedagogical usability. Background: Nowadays, mobile applications are expanding rapidly and are commonly used in educational institutions to support the learning and teaching process. But the possible deficient usability could decrease the utility of learning activities and the student’s motivation. Therefore, careful planning and design by the developer are required, along with a usability evaluation of the applications. Research Questions: How could an instrument be developed to evaluate the usability of m-learning applications that combine technical and pedagogical aspects? How can the quality of the developed instrument be determined? Methodology: A structured questionnaire was created like a measuring tool to evaluate and design m-learning applications. Different statistical techniques, including reliability and validity assessments, were employed to evaluate the quality of the instrument, which is determined through the calibration of the CECAM survey. Findings: After the validity analysis of the questionnaire, a scale with 56 items was obtained, with an alpha reliability coefficient of 0.911 (an excellent measuring scale). It pretends to be used by teachers to design or evaluate m-learning applications, improve their usability, and enhance the students’ learning experience.
期刊介绍:
The IEEE Transactions on Education (ToE) publishes significant and original scholarly contributions to education in electrical and electronics engineering, computer engineering, computer science, and other fields within the scope of interest of IEEE. Contributions must address discovery, integration, and/or application of knowledge in education in these fields. Articles must support contributions and assertions with compelling evidence and provide explicit, transparent descriptions of the processes through which the evidence is collected, analyzed, and interpreted. While characteristics of compelling evidence cannot be described to address every conceivable situation, generally assessment of the work being reported must go beyond student self-report and attitudinal data.