A structured expert review process was implemented to evaluate the technical content and usability of a program on aeration system design for grain storages. Technical evaluation was used to determine if the computer program generated solutions similar to expert solutions. Other aspects of the evaluation focused on measures of ease of use, effectiveness of information conveyance and usefulness of solution. The evaluation procedure and questionnaires are described and results from the evaluation of an aeration system design program are summarized. The evaluation process served to validate the aeration system design program, generate suggestions for improving the program, identify areas for further research and advance aeration system design technology by bringing together experts representing the range of practice. The review process was beneficial and could be adapted for use with other decision support programs.
Watson, Dennis G., Andrews, Mary P. and Brook, Roger C. "Evaluating a Computer Program with a Structured Expert Review Process." Applied Engineering in Agriculture 4, No. 4 (Jan 1988): 350-355. doi:10.13031/2013.26631.