In this paper, we propose a novel interactive integral imaging system using vision-based 3D fingertip interface. This system consists of the real 3D image generation system based on integral imaging technique and the interaction device using a real-time finger detection interface. The proposed system can be used in effective human computer interaction method for real 3D image. To show the usefulness of the proposed system, we carry out the preliminary experiment and the results are presented.