Typical application fields of Knowledge Based Systems are a usually characterized by having human expertise as the only one source to specify their desired behavior. Their design, evaluation and refinement has to make effective use of this valuable source. After sketching the concept of collecting validation experience in a Validation Knowledge Base (VKB), the paper introduces an estimation of the significance of the cases collected in the VKB. A high significance signalizes that a VKB should not longer serve as a case-based source of external knowledge, but compiled into the Knowledge Base instead. A technology to compile well-selected cases into the Knowledge Base of the system under evaluation is shown.