Owing to the recent development of digital broadcasting technology such as Satellite, CATV, the Internet and the expansion of the network systems, the amount of video data we can obtain is increasing day by day. In this paper, we propose Advanced Database TV (ADTV), an interactive video database system which lets us share video data on the network, as an application for future Interactive TV service. We propose an interactive video database system to process real-world video data as a further example of ADTV. On its implementation, we propose an automatic organization method focusing on video objects in each frames to describe video data in an efficient way. The prototype system provide three basic services , "Description", "Question and Answer" and "Image and Information Retrieval", about buildings as real-world video objects linked with digital city maps.