In this paper, we propose a forward spotting scheme that executes gesture segmentation and recognition simultaneously by detecting start point. By using competitive differential observation probability, sliding window and accumulative HMMs, we apply the proposed method to recognize the upper-body gestures for controlling the curtains and lights in a smart home environment.