This paper describes stochastic modeling of pencoordinate information in HMMs with structured character pattern representation (SCPR) for on-line Japanese handwriting recognition. SCPR allows HMMs for Kanji character patterns to share common subpatterns. Although SCPR-based HMMs have been successfully applied to Kanji character recognition, the pen-coordinate feature has not been modeled since it is unique feature in each character pattern. In this paper, we employ mapping from a common subpattern to each occurrence in Kanji patterns and adaptation of state parameters to each character pattern in generating character HMMs by composing SCPRbased HMMs. Experimental results show that the pencoordinate feature modeled in the SCPR-based HMMs effects significantly.