Optimization-based simulation of nonsmooth rigid multibody dynamics