Speaking on the record: Combining interviews with search log analysis in user research

Abstract

The use of mixed methods in library and information science research is more effective in generating insightful results when the methods are fully integrated with each other. A novel sequential mixed methods approach was developed to more holistically study user search behavior within a library discovery system. Customized semi-structured interview protocols, using the critical incident technique, were based on each participant's search logs. Findings from the interviews informed statistical log analysis, which identified features of search sessions that made accessing resources more likely. Individual interviews provide more precise data when protocols are created using the participants' logs. Similarly, statistical log analyses are enhanced with users' descriptions of their behaviors in library discovery systems. While prior studies have employed both interviews and log analysis, using the methods to inform one another reduces the limitations and enhances the benefits of each.