We consider a first-order Markov source, which is predictively encoded using a DPCM-style encoder. The quantized compressed prediction residual is transmitted over an erasure channel. Additionally, a Wyner-Ziv encoded version of the prediction residual is transmitted in order to provide error resilience. When the symbols from the first transmission are erased by the channel, this second description is decoded, and limits the maximum distortion that can occur. Since the quantization step size used in the second description is, in general, larger than that used in the main transmission, error protection is lossy. Using highrate quantization theory, we derive expressions for the rate and the end-to-end distortion incurred by this system. We show that, compared to conventional lossless forward error correction, this lossy error protection scheme is robust in the sense that it allows the received signal quality to degrade gracefully when the erasure probability increases.