Reliability issues in the development of computerized information systems

Abstract

ABSTRACT This paper examines issues of reliability in the development of computerized information systems and presents several strategies for dealing with them. It is based on our experience in developing a national hospital social work information system in Israel. Strategies included the careful and explicit definition of categories and the assessment of inter-rater reliability based on case records and on the systematic manipulation of key variables. Analysis of the data confirmed the reliability of most items of the system. It also pointed out a number of problem areas, and service as the basis for further refining variable categories and definitions to overcome difficulties revealed in the Study.