Abstract: We propose a concept of real-time human proxy for avatar-based communication systems, which virtualizes a human in the real world in real-time and which lets the virtualized human behave as if he/she was present at a distant place. For estimating RHP, we apply it to a simple game and a virtual classroom system. The experimental results shows us that RHP is useful for avatar-based communication. Key Words: avatar-based communication, virtual reality, motion capture, motion generation Category: H.5.1, H.5.2, H.5.3, I.3.7