An Open Web Platform for Rule-Based Speech-to-Sign Translation

Autor/a: RAYNER, Manny; BOUILLON, Pierrette; EBLING, Sarah; GERLACH, Johanna; STRASLY, Irene; TSOURAKIS, Nikos
Año: 2016
Editorial: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 162–168
Tipo de código: Copyright
Soporte: Digital


Medios de comunicación y acceso a la información » Nuevas Tecnologías


We present an open web platform for developing, compiling, and running rule- based speech to sign language translation applications. Speech recognition is per- formed using the Nuance Recognizer 10.2 toolkit, and signed output, including both manual and non-manual components, is rendered using the JASigning avatar system. The platform is designed to make the component technologies readily accessible to sign language experts who are not necessarily computer scientists. Translation grammars are written in a version of Synchronous Context-Free Grammar adapted to the peculiarities of sign language. All processing is carried out on a remote server, with content uploaded and accessed through a web interface. Initial experiences show that simple translation grammars can be implemented on a time-scale of a few hours to a few days and produce signed output readily comprehensible to Deaf informants. Overall, the platform drastically lowers the barrier to entry for researchers interested in build- ing applications that generate high-quality signed language.