A/B Testing of User Enrollment Forms to Enhance Diversity in the Biomedical Workforce via the National Research Mentoring Network: User-Centered Design Case Study.

Abstract

Background: The National Research Mentoring Network (NRMN) is a National Institutes of Health-funded program for diversifying the science, technology, engineering, math, and medicine research workforce through the provision of mentoring, networking, and professional development resources. The NRMN provides mentoring resources to members through its online platform-MyNRMN.

Objective: MyNRMN helps members build a network of mentors. Our goal was to expand enrollment and mentoring connections, especially among those who have been historically underrepresented in biomedical training and the biomedical workforce.

Methods: To improve the ease of enrollment, we implemented the split testing of iterations of our user interface for platform registration. To increase mentoring connections, we developed multiple features that facilitate connecting via different pathways.

Results: Our improved user interface yielded significantly higher rates of completed registrations (P<.001). Our analysis showed improvement in completed enrollments that used the version 1 form when compared to those that used the legacy form (odds ratio 1.52, 95% CI 1.30-1.78). The version 2 form, with its simplified, 1-step process and fewer required fields, outperformed the legacy form (odds ratio 2.18, 95% CI 1.90-2.50). By improving the enrollment form, the rate of MyNRMN enrollment completion increased from 57.3% (784/1368) with the legacy form to 74.5% (2016/2706) with the version 2 form. Our newly developed features delivered an increase in connections between members.

Conclusions: Our technical efforts expanded MyNRMN's membership base and increased connections between members. Other platform development teams can learn from these efforts to increase enrollment among underrepresented groups and foster continuing, successful engagement.