We present an account of designing and evaluating a university-wide expert search engine. We performed system-based evaluation to determine the optimal retrieval settings and an extensive user-based evaluation with three different user groups: scientific researchers, students, and outside visitors of the website looking for experts. Our search engine significantly outperformed the old search system in terms of effectiveness, efficiency, and user satisfaction. Key words: Expert search, evaluation, search engine, interactive IR