—Although the current E-Learning systems have many merits, many of them only treat advanced information technology as simple communication tools, and release some learning contents and exercises in the network. In this paper, a one-class-in-one network for emotion recognition system in E-learning is proposed and implemented in the paper. Using a large database of phoneme-balanced Chinese words read by speakers consciously trying to portray an emotion, we trained and tested this module. We achieved a recognition rate of approximately 55%. The results obtained in this study demonstrate that emotion recognition in speech is feasible, and that neural networks are well suited for this task.