Validation of a dispositional critical thinking scale using an original analytical methodology for addressing data from Google Trends

Abstract

Purpose

A methodological approach is required that complements studies based on surveys, providing a perspective with greater truthfulness and coverage. The study aims to develop a methodology to validate psychological/managerial constructs using data from Google Trends, taking as a case study a critical thinking (CT) scale in organizational domains previously supported by survey data.

Design/methodology/approach

The developed methodology consists of eight stages, in which the following is integrated: (1) Internet search interest data (19 Spanish-speaking countries); (2) deductive research processes (e.g. theoretical model, linguistic manifestations, fieldwork, data matrix, analysis statistical, reporting); (3) psychometric properties (e.g. construct validity, criterion validity, reliability) and (4) objective data to examine criterion validity (e.g. unemployment rate).

Findings

The application of the methodology produces evidence that supports the reliability (Cronbach’s alpha, Guttman’s λ₄), construct validity (intra-correlations and correlations with reference variables: “entrepreneurship,” “critical thinking,” “soccer,” “beer,” “pornography”) and criterion validity (prediction of unemployment rate) of the CT scale.

Research limitations/implications

The methodology makes it possible to support or invalidate the quality of construct measurement scales by planning, capturing and processing data available on the internet.

Practical implications

This manuscript is useful for research in business management (and related areas), which is intensive in the use of psychological/managerial constructs.

Originality/value

The methodology uses a new type of evidence; it is noninvasive, usually more truthful than responses to surveys, and has greater coverage of people participating indirectly in the study.