PhoneGuide: museum guidance supported by on-device object recognition on mobile phones

We present PhoneGuide – an enhanced museum guidance approach that uses camera-equipped mobile phones and on-device object recognition. Our main technical achievement is a simple and lightweight object recognition approach that is realized with single-layer perceptron neuronal networks. In contrast to related systems which perform computational intensive image processing tasks on remote servers, our intention is to carry out all computations directly on the phone. This ensures little or even no network traffic and consequently decreases cost for online times. Our laboratory experiments and field surveys have shown that photographed museum exhibits can be recognized with a probability of over 90%. We have evaluated different feature sets to optimize the recognition rate and performance. Our experiments revealed that normalized color features are most effective for our method. Choosing such a feature set allows recognizing an object below one second on upto-date phones. The amount of d...

• Type: Conference
• Year: 2005
• Where: MUM
• Authors: Paul Föckler, Thomas Zeidler, Benjamin Brombach, Erich Bruns, Oliver Bimber
• Keywords: Multimedia, MUM 2005, Object Recognition, Object Recognition Approach, On-device Object Recognition