Bias-Corrected Bootstrap and Model Uncertainty

The bootstrap has become a popular method for exploring model (structure) uncertainty. Our experiments with artificial and realworld data demonstrate that the graphs learned from bootstrap samples can be severely biased towards too complex graphical models. Accounting for this bias is hence essential, e.g., when exploring model uncertainty. We find that this bias is intimately tied to (well-known) spurious dependences induced by the bootstrap. The leading-order bias-correction equals one half of Akaike’s penalty for model complexity. We demonstrate the effect of this simple bias-correction in our experiments. We also relate this bias to the bias of the plug-in estimator for entropy, as well as to the difference between the expected test and training errors of a graphical model, which asymptotically equals Akaike’s penalty (rather than one half).

• Type: Conference
• Year: 2003
• Where: NIPS
• Authors: Harald Steck, Tommi Jaakkola
• Keywords: Akaike’s Penalty, Bias, Graphical Model, NIPS 2003, NIPS 2007