Pub Date : 2021-07-22DOI: 10.1007/s41686-021-00057-7
Andrea Gregg, Junxiu Yu, Jessica Resig, Lynne Johnson, Eunsung Park, Phil Stuczynski
Instructional designers (IDs) are charged with what some might argue is the impossible: implementing innovative technologies and new pedagogical approaches within complex systems that often implicitly discourage change. This 6-year case study examined key factors influencing the exploration, multi-course pilot, and ultimate end of an adaptive learning (AL) project. AL has been recognized as a potentially transformative approach for online learning that individualizes instruction to each student based on demonstrated competencies. Past research has considered performance comparisons, learner characteristics, course design, and teaching practices, but what has been largely overlooked is an examination of the ways in which the university context itself impacts, and is impacted by, AL. Our study showed that while IDs and instructors easily recognize the potential benefits of AL, it is significantly more difficult to gain sustained administrative leadership advocacy. Primary challenges encountered were (1) AL’s disruption to the online teaching and learning status quo and (2) ongoing tensions between institutional structure, culture, and best practices for AL. The findings of this study suggest that a systems-based approach to organizational change is necessary for the successful implementation of multifaceted approaches like AL. The paper offers IDs greater insight into what can happen “behind the scenes” to support or challenge the success of educational technology implementations. While they may not always be able to impact these factors directly, having more awareness about the system complexity can allow them to be more strategic in asking for resources and buy-in from leadership.
{"title":"Promising Educational Technology Meets Complex System: a 6-year Case Study of an Adaptive Learning Project from Initial Exploration Through the End of a Pilot","authors":"Andrea Gregg, Junxiu Yu, Jessica Resig, Lynne Johnson, Eunsung Park, Phil Stuczynski","doi":"10.1007/s41686-021-00057-7","DOIUrl":"https://doi.org/10.1007/s41686-021-00057-7","url":null,"abstract":"<p>Instructional designers (IDs) are charged with what some might argue is the impossible: implementing innovative technologies and new pedagogical approaches within complex systems that often implicitly discourage change. This 6-year case study examined key factors influencing the exploration, multi-course pilot, and ultimate end of an adaptive learning (AL) project. AL has been recognized as a potentially transformative approach for online learning that individualizes instruction to each student based on demonstrated competencies. Past research has considered performance comparisons, learner characteristics, course design, and teaching practices, but what has been largely overlooked is an examination of the ways in which the university context itself impacts, and is impacted by, AL. Our study showed that while IDs and instructors easily recognize the potential benefits of AL, it is significantly more difficult to gain sustained administrative leadership advocacy. Primary challenges encountered were (1) AL’s disruption to the online teaching and learning status quo and (2) ongoing tensions between institutional structure, culture, and best practices for AL. The findings of this study suggest that a systems-based approach to organizational change is necessary for the successful implementation of multifaceted approaches like AL. The paper offers IDs greater insight into what can happen “behind the scenes” to support or challenge the success of educational technology implementations. While they may not always be able to impact these factors directly, having more awareness about the system complexity can allow them to be more strategic in asking for resources and buy-in from leadership.</p>","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"24 14 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2021-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138537553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-07-15DOI: 10.1007/s41686-021-00056-8
Holley L. Handley, Nancy B. Hastings
This article is a formative reflection that walks the reader through the experience of taking an existing body of research and then using one aspect of that analytical framework to conduct a new and original study. This reflection presents an account of that research process. Hattie (2009) has conducted extensive research examining influences on student achievement. This article describes how a researcher took the domains he defined to categorize the influences on student achievement and used them to frame the newly developed investigation. This article reflects on the unique application of Hattie’s domains as a lens to examine a K-12 organization. An overview of the study and a summary of the findings are presented to give the reader context. The focus of this article is a detailed reflection on how the research was conceived and formed. The following six questions guide this reflection:
1. Was the experience useful?
2. What was learned?
3. How did this experience facilitate personal growth/development?
4. How was this experience impactful?
5. What would, on reflection, be done differently?
6. Were the research choices well-reasoned?
A thoughtful reflection on the process serves to inform decisions critical to formulate potential additional studies. Reflecting on the past process provides thoughtful insights for future research.
{"title":"Authentic Use of Hattie’s Meta-analyses to Frame Educational Research: a Researcher’s Reflection","authors":"Holley L. Handley, Nancy B. Hastings","doi":"10.1007/s41686-021-00056-8","DOIUrl":"https://doi.org/10.1007/s41686-021-00056-8","url":null,"abstract":"<p>This article is a formative reflection that walks the reader through the experience of taking an existing body of research and then using one aspect of that analytical framework to conduct a new and original study. This reflection presents an account of that research process. Hattie (2009) has conducted extensive research examining influences on student achievement. This article describes how a researcher took the domains he defined to categorize the influences on student achievement and used them to frame the newly developed investigation. This article reflects on the unique application of Hattie’s domains as a lens to examine a K-12 organization. An overview of the study and a summary of the findings are presented to give the reader context. The focus of this article is a detailed reflection on how the research was conceived and formed. The following six questions guide this reflection:</p><p>1. Was the experience useful?</p><p>2. What was learned?</p><p>3. How did this experience facilitate personal growth/development?</p><p>4. How was this experience impactful?</p><p>5. What would, on reflection, be done differently?</p><p>6. Were the research choices well-reasoned?</p><p>A thoughtful reflection on the process serves to inform decisions critical to formulate potential additional studies. Reflecting on the past process provides thoughtful insights for future research.</p>","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"39 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2021-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138537578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-06-25DOI: 10.1007/s41686-021-00055-9
Tim Coughlan, Kate Lister, Mathijs Lucassen
Student mental health is a critical issue that institutions are struggling to tackle proactively. The wellbeing of students is largely invisible to institutions unless specific mental health conditions are diagnosed and disclosed. In comparison to the importance placed on academic aspects, the affective experiences of education throughout the study journeys of students are rarely acknowledged. Approaches for students to develop emotional awareness, through which they learn to understand and manage their emotions, are limited. In this article, we describe the design and evaluation of Our Journey, a platform for students to represent their study journeys through describing the events and emotions they experience. The conceptual and user experience design of the platform was derived from participatory activities with students and staff and has been further refined via several physical and online iterations. In this paper, we report findings from an exploratory pilot trial of Our Journey with 54 students studying for a range of qualifications at an online learning institution. Through an analysis of the journeys that the students produced and a post-trial survey, we found that Our Journey can support representations of emotional awareness in relation to study events which prompted students to reflect on important aspects of their study and personal development. The design and use of the platform have also prompted important considerations around how emotion is represented, as well as how the privacy and ownership of these representations of personal experiences can be managed to support students and institutions to potentially benefit from novel tools such as Our Journey.
{"title":"Representing the Unseen with “Our Journey”: a Platform to Capture Affective Experiences and Support Emotional Awareness in University-Level Study","authors":"Tim Coughlan, Kate Lister, Mathijs Lucassen","doi":"10.1007/s41686-021-00055-9","DOIUrl":"https://doi.org/10.1007/s41686-021-00055-9","url":null,"abstract":"<p>Student mental health is a critical issue that institutions are struggling to tackle proactively. The wellbeing of students is largely invisible to institutions unless specific mental health conditions are diagnosed and disclosed. In comparison to the importance placed on academic aspects, the affective experiences of education throughout the study journeys of students are rarely acknowledged. Approaches for students to develop emotional awareness, through which they learn to understand and manage their emotions, are limited. In this article, we describe the design and evaluation of <i>Our Journey</i>, a platform for students to represent their study journeys through describing the events and emotions they experience. The conceptual and user experience design of the platform was derived from participatory activities with students and staff and has been further refined via several physical and online iterations. In this paper, we report findings from an exploratory pilot trial of <i>Our Journey</i> with 54 students studying for a range of qualifications at an online learning institution. Through an analysis of the journeys that the students produced and a post-trial survey, we found that <i>Our Journey</i> can support representations of emotional awareness in relation to study events which prompted students to reflect on important aspects of their study and personal development. The design and use of the platform have also prompted important considerations around how emotion is represented, as well as how the privacy and ownership of these representations of personal experiences can be managed to support students and institutions to potentially benefit from novel tools such as <i>Our Journey</i>.</p>","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"85 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2021-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138537579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-06-01DOI: 10.1007/s41686-021-00054-w
T. L. Arrington, Lara M. Willox
{"title":"“I Need to Sit on My Hands and Put Tape on My Mouth”: Improving Teachers’ Design Thinking Knowledge, Skills, and Attitudes Through Professional Development","authors":"T. L. Arrington, Lara M. Willox","doi":"10.1007/s41686-021-00054-w","DOIUrl":"https://doi.org/10.1007/s41686-021-00054-w","url":null,"abstract":"","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"5 1","pages":"27 - 38"},"PeriodicalIF":1.5,"publicationDate":"2021-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41686-021-00054-w","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44033353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-01-14DOI: 10.1007/s41686-020-00052-4
Efrén de la Mora Velasco, Atsusi Hirumi, Baiyun Chen
{"title":"Improving Instructional Videos with Background Music and Sound Effects: A Design-Based Research Approach","authors":"Efrén de la Mora Velasco, Atsusi Hirumi, Baiyun Chen","doi":"10.1007/s41686-020-00052-4","DOIUrl":"https://doi.org/10.1007/s41686-020-00052-4","url":null,"abstract":"","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"5 1","pages":"1 - 15"},"PeriodicalIF":1.5,"publicationDate":"2021-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41686-020-00052-4","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41760579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-01-06DOI: 10.1007/s41686-020-00053-3
Qijie Cai, David Robinson
This paper explains how a graduate online course has been designed, redesigned and continuously refined in the last decade, applying the Quality Matters (QM) Framework and Universal Design for Learning Principles (UDL). To improve the course design, the course designers and instructors are engaged in a reflective process of examining relevant factors, including external contexts that demanded changes in the course, the course’s existing features, learner characteristics and needs, and the nature and requirements of the course content, activities, assessments. The paper provides detailed descriptions of the design process, as well as the modifications and changes made for the course over years and demonstrates how the design features adheres to the UDL principles.
{"title":"Design, Redesign, and Continuous Refinement of an Online Graduate Course: A Case Study for Implementing Universal Design for Learning","authors":"Qijie Cai, David Robinson","doi":"10.1007/s41686-020-00053-3","DOIUrl":"https://doi.org/10.1007/s41686-020-00053-3","url":null,"abstract":"This paper explains how a graduate online course has been designed, redesigned and continuously refined in the last decade, applying the Quality Matters (QM) Framework and Universal Design for Learning Principles (UDL). To improve the course design, the course designers and instructors are engaged in a reflective process of examining relevant factors, including external contexts that demanded changes in the course, the course’s existing features, learner characteristics and needs, and the nature and requirements of the course content, activities, assessments. The paper provides detailed descriptions of the design process, as well as the modifications and changes made for the course over years and demonstrates how the design features adheres to the UDL principles. ","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"63 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2021-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138537534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-01Epub Date: 2020-01-06DOI: 10.1007/s41686-019-00038-x
Matthew Schmidt, Allison P Fisher, Joshua Sensenbaugh, Brandt Ling, Carmen Rietta, Lynn Babcock, Brad G Kurowski, Shari L Wade
Mild Traumatic Brain Injury (mTBI) is a significant cause of morbidity for adolescents. Currently, there is a lack of evidence-based interventions to address common sequelae of mTBI. To address this gap, we designed a program to promote recovery for adolescents following mTBI. Preliminary testing of the Self-Monitoring Activity Regulation and Relaxation Treatment (SMART) program demonstrated good usability but indicated a need for modifications to the program. The SMART application was redesigned with the addition of more interactive and gamified components. Content was also reframed to specifically target and engage adolescents with mTBI. We describe the usability evaluation of the updated SMART application. Children aged 11-18 years diagnosed with mTBI who were 1 to 6 months post mTBI were recruited to participate in a 1-2-hour usability session in which they thought aloud and responded to targeted usability-related questions during their interaction with the SMART program. After completing the session, participants rated their usability experience using the System Usability Scale (SUS) and rated the overall user-friendliness of the program. Participants' responses during the session were qualitatively coded and analyzed. Six adolescents participated in a usability session (average age = 13.7 years). On the SUS, participants rated the program as highly usable (M = 85.6, SD = 3.24). They also had overwhelmingly positive feedback regarding the content, design and structure of the program. Overall, findings suggest that the redesigned SMART program was usable, acceptable, and relevant to adolescents with mTBI. Based on adolescents' feedback, additional modifications were made before the program undergoes efficacy testing.
{"title":"User experience (re)design and evaluation of a self-guided, mobile health app for adolescents with mild Traumatic Brain Injury.","authors":"Matthew Schmidt, Allison P Fisher, Joshua Sensenbaugh, Brandt Ling, Carmen Rietta, Lynn Babcock, Brad G Kurowski, Shari L Wade","doi":"10.1007/s41686-019-00038-x","DOIUrl":"10.1007/s41686-019-00038-x","url":null,"abstract":"<p><p>Mild Traumatic Brain Injury (mTBI) is a significant cause of morbidity for adolescents. Currently, there is a lack of evidence-based interventions to address common sequelae of mTBI. To address this gap, we designed a program to promote recovery for adolescents following mTBI. Preliminary testing of the Self-Monitoring Activity Regulation and Relaxation Treatment (SMART) program demonstrated good usability but indicated a need for modifications to the program. The SMART application was redesigned with the addition of more interactive and gamified components. Content was also reframed to specifically target and engage adolescents with mTBI. We describe the usability evaluation of the updated SMART application. Children aged 11-18 years diagnosed with mTBI who were 1 to 6 months post mTBI were recruited to participate in a 1-2-hour usability session in which they thought aloud and responded to targeted usability-related questions during their interaction with the SMART program. After completing the session, participants rated their usability experience using the System Usability Scale (SUS) and rated the overall user-friendliness of the program. Participants' responses during the session were qualitatively coded and analyzed. Six adolescents participated in a usability session (average age = 13.7 years). On the SUS, participants rated the program as highly usable (M = 85.6, SD = 3.24). They also had overwhelmingly positive feedback regarding the content, design and structure of the program. Overall, findings suggest that the redesigned SMART program was usable, acceptable, and relevant to adolescents with mTBI. Based on adolescents' feedback, additional modifications were made before the program undergoes efficacy testing.</p>","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"4 2","pages":"51-64"},"PeriodicalIF":1.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8046025/pdf/nihms-1677448.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38811999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-11-19DOI: 10.1007/s41686-020-00051-5
Albert D. Ritzhaupt, Natercia Valle, Max Sommer
{"title":"Design, Development, and Evaluation of an Online Statistics Course for Educational Technology Doctoral Students: a Design and Development Case","authors":"Albert D. Ritzhaupt, Natercia Valle, Max Sommer","doi":"10.1007/s41686-020-00051-5","DOIUrl":"https://doi.org/10.1007/s41686-020-00051-5","url":null,"abstract":"","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"4 1","pages":"119 - 135"},"PeriodicalIF":1.5,"publicationDate":"2020-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41686-020-00051-5","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45811481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-11-03DOI: 10.1007/s41686-020-00050-6
Nicole Barclay, Carl D. Westine, Angela Claris, Florence Martin
{"title":"Development and Implementation of Adaptive Learning to Engage Learners in Engineering Technology","authors":"Nicole Barclay, Carl D. Westine, Angela Claris, Florence Martin","doi":"10.1007/s41686-020-00050-6","DOIUrl":"https://doi.org/10.1007/s41686-020-00050-6","url":null,"abstract":"","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"4 1","pages":"107 - 118"},"PeriodicalIF":1.5,"publicationDate":"2020-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41686-020-00050-6","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42238761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-08-18DOI: 10.1007/s41686-020-00049-z
Matthew Schmidt, Li Cheng, S. Raj, S. Wade
{"title":"Formative Design and Evaluation of a Responsive eHealth/mHealth Intervention for Positive Family Adaptation Following Pediatric Traumatic Brain Injury","authors":"Matthew Schmidt, Li Cheng, S. Raj, S. Wade","doi":"10.1007/s41686-020-00049-z","DOIUrl":"https://doi.org/10.1007/s41686-020-00049-z","url":null,"abstract":"","PeriodicalId":73753,"journal":{"name":"Journal of formative design in learning","volume":"4 1","pages":"88 - 106"},"PeriodicalIF":1.5,"publicationDate":"2020-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41686-020-00049-z","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43014709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}