While intensity-based similarity measures are increasingly used for medical image registration, they often rely on implicit assumptions regarding the physics of imaging. The motivation of this paper is to determine what are the assumptions corresponding to a number of popular similarity measures in order to better understand their use, and finally help choosing the one which is the most appropriate for a given class of problems. After formalizing registration based on general image acquisition models, we show that the search for an optimal measure can be cast into a maximum likelihood estimation problem. We then derive similarity measures corresponding to different modeling assumptions and retrieve some well-known measures (correlation coefficient, correlation ratio, mutual information). Finally, we present results of registration between 3D MR and 3D Ultrasound images to illustrate the importance of choosing an appropriate similarity measure.