In this paper, an image-based method---non-uniform light field mapping is proposed which combines edge-based surface light field partition and non-uniform decomposition of light field matrixes for real-time rendering. Through this method view-dependent appearance of scenes with complex reflectance properties can be rendered in real-time. This method obtains surface light field by resampling the data which are captured from vantage points. To acquire interactive rendering rate we propose to partition surface light field over bi-triangles and arrange it into 2-D matrixes, then we approximate surface light field data by non-uniformly factoring these matrixes into textures. Finally, we present an image-based rendering method which improves rendering performance through textures sorting and rendering directly from these compact data with t...