A nonlinear loop filter for quantization noise removal in hybrid video compression