In this paper, we describe an evaluation framework for legal information systems. The framework is based on knowledge criteria. We distinguish four belief types, viz. perceptual beliefs, testimonial beliefs, inferential beliefs, and interpretative beliefs. Beliefs of these types can be transformed into knowledge by the fulfilment of knowledge criteria. The knowledge criteria examined are truth, justification proper, reliability, consistency, and coherence. There is a hierarchy among these criteria. We will show that beliefs, depending on the type they belong to, become knowledge by applying different subsets of these criteria. Two legal information systems are evaluated using this framework. Results are presented and two conclusions are drawn. Finally, further research on legal knowledge criteria is suggested.
Laurens Mommers, H. Jaap van den Herik