This paper presents an off-line Arabic Handwriting recognition system based on the selection of different state of the art features and the combination of multiple Hidden Markov Models classifiers. Beside the classical use of the off-line features, we add the use of on-line features and the combination of the developed systems. The designed recognizer is implemented using the HMM-Toolkit. In a first step, we use different features to make the classification and we compare the performance of single classifiers. In a second step, we proceed to the combination of the on-line and the off-line based systems using different combination methods. The system is evaluated using the IFN/ENIT database. The recognition rate is in maximum 63.90% for the individual systems. The combination of the on-line and the off-line