Probability Density Function Estimation Using Orthogonal Forward Regression

— Using the classical Parzen window estimate as the target function, the kernel density estimation is formulated as a regression problem and the orthogonal forward regression technique is adopted to construct sparse kernel density estimates. The proposed algorithm incrementally minimises a leave-oneout test error score to select a sparse kernel model, and a local regularisation method is incorporated into the density construction process to further enforce sparsity. The kernel weights are finally updated using the multiplicative nonnegative quadratic programming algorithm, which has the ability to reduce the model size further. Except for the kernel width, the proposed algorithm has no other parameters that need tuning, and the user is not required to specify any additional criterion to terminate the density construction procedure. Two examples are used to demonstrate the ability of this regressionbased approach to effectively construct a sparse kernel density estimate with comparab...

• Type: Conference
• Year: 2007
• Where: IJCNN
• Authors: Sheng Chen, Xia Hong, Chris J. Harris
• Keywords: IJCNN 2007, Kernel Density, Kernel Density Estimate, Sparse Kernel Density