Proposal, design, and evaluation of a values-based online survey

Abstract

A values-informed modeling software program is proposed and developed for enhancing online surveys. The authors explore a method to prompt users to examine the interactions between their preferences over a set of alternatives and their values in an online survey. The authors first present the underlying theories, design parameters, and features used to prompt values-informed thinking in participants. We then describe our exploratory test of an early version of P2P-DSS. In this test, fifteen participants used the system to provide their input on a decision about aggregate mining and then completed a post-task questionnaire. The authors integrated realistic problem constraints and end user feedback early in the design of P2P-DSS by addressing a real-world decision. Some participants indicate that P2P-DSS helped them to express their own preferences. P2P-DSS may also have encouraged some people to consider preferences they disagreed with. Participants also identified opportunities to improve the user experience. While focused on a real decision, the goal was to elicit feedback on an early design of P2P-DSS, not to conduct a case study. This work will inform redesigns and examinations of P2P-DSS specifically and sets the stage for further studies into a role for values activation in online surveys and decision support.