This paper proposes a wearable annotation overlay system which can correctly annotate dynamic users of wearable computers. To provide users with the newest annotation information, a network shared database system for wearable AR systems has been proposed. With the database, a wearable annotation overlay system which can dynamically annotate users of wearable systems has been investigated. In conventional systems, since dynamic users’ position is transmitted to wearable AR systems via a shared database server, it is difficult to overlay annotations at a correct position because of low frequency of updating and delay of client-server communication. In this paper, we propose a new effective method for wearable AR systems to obtain dynamic users’ positions by using hybrid peer-to-peer(P2P). In experiments, annotations on dynamic users have been proven to be overlaid correctly enough to show where users are.