— A critical assumption of many multi-view control systems is the initial visibility of the regions of interest from all the views. An initialization step is proposed for a hybrid eyein-hand/eye-to-hand grasping system to fullfil this requirement. In this paper, the object of interest is assumed to be within the eye-to-hand field of view, whereas it may not be within the eyein-hand one. The object model is unknown and no database is used. The object lies in a complex scene with a cluttered background. A method to automatically focus on the object of interest is presented, tested and validated on a multi view robotic system.