This paper presents our experiments in applying semantic information to improve the precision of the information retrieval module in a closed-domain question-answering system. That system aims at replying questions on services offered by a large company, here Bell Canada. Our approach consists in finding a set of special terms and building an ontological concept hierarchy, which can effectively characterize the relevance of a retrieved candidate to its corresponding question. Combining these two kinds of semantic information with the information retrieval module has resulted in very good improvements.