A Relationship between Generalization Error and Training Samples in Kernel Regressors

A relationship between generalization error and training samples in kernel regressors is discussed in this paper. The generalization error can be decomposed into two components. One is a distance between an unknown true function and an adopted model space. The other is a distance between an estimated function and the orthogonal projection of the unknown true function onto the model space. In our previous work, we gave a framework to evaluate the first component. In this paper, we theoretically analyze the second one and show that a larger set of training samples usually causes a larger generalization error. Keywords-kernel regressor; reproducing kernel Hilbert space; generalization error; sample points;

• Type: Conference
• Year: 2010
• Where: ICPR
• Authors: Akira Tanaka, Hideyuki Imai, Mineichi Kudo, Masaaki Miyakoshi
• Keywords: Computer Vision, Generalization Error, ICPR 2010, Model Space, Unknown True Function