A large number of videos cannot be visualized on mobile devices (e.g., PDAs or mobile phones) due to an inappropriate color depth of the displays. Important details are lost if the color depth is reduced. A major challenge is the preservation of the semantic content in spite of this fact. In this paper, we present a novel adaptation algorithm to enable the playback of videos on color-limited mobile devices. Dithering algorithms diffuse the error to neighbor pixels and do not work very well for videos. We propose a non-linear transformation of luminance values and use textures in combination with edges to reduce the color depth in videos. Categories and Subject Descriptors I.4.3 [Image processing and computer vision]: Enhancement; I.4.8 [Image processing and computer vision]: Scene analysis General Terms Algorithms Keywords video adaptation, dithering, transcoding