Based on the Nystr¨om approximation and the primal-dual formulation of Least Squares Support Vector Machines (LS-SVM), it becomes possible to apply a nonlinear model to a large scale regression problem. This is done by using a sparse approximation of the nonlinear mapping induced by the kernel matrix, with an active selection of support vectors based on quadratic Renyi entropy criteria. The methodology is applied to the case of load forecasting as an example of a real-life large scale problem in industry, for the case of 24-hours ahead predictions. The results are reported for different number of initial support vectors, which cover between 1% and 4% of the entire sample, with satisfactory results.
Marcelo Espinoza, Johan A. K. Suykens, Bart De Moo