Video analysis and mixed reality (MR) systems, which integrate the virtual world and the real world, are important topics of multimedia research. In this paper, we propose an efficient 3D city construction system from omni video data as a practical application of MR systems. To develop this system, two main methods are proposed for analyzing omni video data. The first one is omniEPI analysis, which makes it possible to obtain 3D information from omni video data robustly and efficiently. The second method is omniPVI analysis, which makes it possible to obtain not only front images of the buildings but also side images of them. To demonstrate the effectiveness of these methods, we present some experimental results and the prototype systems using outdoor environment omni video data.