On sparse representations of linear operators and the approximation of matrix products