If future electronic documents are to be truly useful, we must devise ways to automatically turn them into knowledgebases. In particular, we must be able to do this for diagrams. This paper discussesbiological diagrams. We describe the three major aspects of diagrams: visual salience, domain conventions and pragmatics. We next describe the organization of diagrams into informational and substrate components. The latter are typically collections of objects related by Generalized Equivalence Relations. To analyze diagrams, we define Graphics Constraint Grammars (GCGs) that can be used for both syntacticand semantic analysis. Each grammar rule describes a rule object and consists of a Production, describing the constituents of the object, Constraints that must hold between the constituents and Propagators that build properties of the rule object from the constituents. We discuss how a mix of Darsing and constraint satisfaction 2. A biological diagram example The example chosen for this d...
Robert P. Futrelle