Development and validation of an observational tool to measure engagement in telepractice early intervention.

Purpose: To develop and validate an evidence-based observational tool to measure engagement in telepractice early intervention (EI).

Materials and methods: The Engagement in Telepractice Observational Tool (eTOT) was developed based on a previous e-Delphi study. Two independent raters used a set of 50 items to score 45 videorecorded telepractice EI sessions with young children with communication difficulties and their family. Principal component analysis (PCA) and reliability measures were conducted.

Results: PCA identified six key components related to the measurement of engagement in telepractice. The components representing professional behaviours were (1) interacting directly with the parent; (2) getting to know the child and family to keep them motivated; (3) maximising the telepractice environment; and (4) demonstrating and practising the parent's role as agent of therapy. The two remaining components represented family behaviours: (5) parent interacting and supporting their child; and (6) family collaborating directly with the professional. The eTOT was found to have good reliability (α = .86), with very good test-retest and inter-rater reliability scores (κ_w = .85 and .94 respectively).

Conclusion: There is preliminary evidence that the eTOT is a valid and reliable tool to measure engagement during telepractice EI. The eTOT can be used as a self-reflection tool to identify and provide engagement-building opportunities in family-centred telepractice EI.