Interactive Control and Visualization of Difficulty Inferences from User-Interface Commands

Abstract

Recently, there has been research on inferring user emotions. Like other inference research, it requires an iterative process in which what-if scenarios are played with different features and algorithms. Traditional, general-purpose data mining tools such as Weka have played an important part in promoting this process. We have augmented this toolset with an additional interactive test-bed designed for prediction and communication of programmer difficulties from user-interface commands. It provides end-user interfaces for communicating, correcting, and reacting to the predictions. In addition, it offers researchers user-interfaces for interacting with the prediction process as it is executed rather than, as in traditional mining tools, after it has generated data for a set of experimental subjects. These user-interfaces can be used to determine key elements of the prediction process, why certain wrong or right predictions have been made, and change parameters of the process. A video demonstration this work is available at http://youtu.be/09LpDIPG5h8.