VigNet: Grounding Language in Graphics using Frame Semantics

Bob Coyne, Daniel Bauer, Owen Rambow

Abstract: This paper introduces Vignette Semantics, a lexical semantic theory based on Frame Semantics that represents conceptual and graphical relations. We also describe a lexical resource that implements this theory, VigNet, and its application in text-to-scene generation.