Towards visual quality rather than pixel-wise fidelity, we propose an image coding scheme integrated with edge-based inpainting and texture synthesis. In this scheme, an original image is analyzed at encoder side so that some blocks are removed during encoding. The edges related to these removed blocks will be compressed and transmitted. At decoder side, we propose an image restoration method, which consists of edge-based inpainting and texture synthesis, in order to fully utilize the transmitted edges and naturally restore the removed blocks. Experimental results show that our scheme can achieve up to 32% bit-rate saving at similar visual quality levels, compared with H.264/AVC intra coding.