ChemInk: a natural real-time recognition system for chemical drawings

We describe a new sketch recognition framework for chemical structure drawings that combines multiple levels of visual features using a jointly trained conditional random field. This joint model of appearance at different levels of detail makes our framework less sensitive to noise and drawing variations, improving accuracy and robustness. In addition, we present a novel learning-based approach to corner detection that achieves nearly perfect accuracy in our domain. The result is a recognizer that is better able to handle the wide range of drawing styles found in messy freehand sketches. Our system handles both graphics and text, producing a complete molecular structure as output. It works in real time, providing visual feedback about the recognition progress. On a dataset of chemical drawings our system achieved an accuracy rate of 97.4%, an improvement over the best reported results in literature. A preliminary user study also showed that participants were on average over twice as ...

• Type: Journal
• Year: 2011
• Where: IUI
• Authors: Tom Y. Ouyang, Randall Davis
• Keywords: Accuracy Rate, Freehand Sketches, IUI 2011, Software Engineering, Structure Drawings