An ontology is a speci...cation of a conceptualization, a shared understanding of some domain of interest. The paper develops an algorithm that hierarchically groups words together which conceptually belong together. We assume conceptual similarity if words often appear in the same context. This leads to a hierachical extension of Bayesian probabilistic latent semantic indexing. We derive the update formulae of the algorithm and present some preliminary examples of derived classes.