Artificial neural networks (ANN), esp. multilayer perceptrons (MLP) have been widely used in pattern recognition and classification. Nevertheless, how to incorporate a priori knowledge to design ANN is still an open problem. This paper tries to give some insightful discussions on this topic emphasizing weight initialization from three perspectives. Theoretical analyses and simulations are offered for validation.