While many areas of medicine have benefited from the development of objective assessment tools and biomarkers, there have been comparatively few improvements in techniques used to assess brain function and dysfunction. Brain functions such as perception, cognition, and motor control are commonly measured using criteria-based, ordinal scales which can be coarse, have floor/ceiling effects, and often lack the precision to detect change. There is growing recognition that kinematic and kinetic-based measures are needed to quantify impairments following neurological injury such as stroke, in particular for clinical research and clinical trials. This paper will first consider the challenges with using criteria-based ordinal scales to quantify impairment and recovery. We then describe how kinematic-based measures can overcome many of these challenges and highlight a statistical approach to quantify kinematic measures of behavior based on performance of neurologically healthy individuals. We illustrate this approach with a visually-guided reaching task to highlight measures of impairment for individuals following stroke. Finally, there has been considerable controversy about the calculation of motor recovery following stroke. Here, we highlight how our statistical-based approach can provide an effective estimate of impairment and recovery.