Projects

The FluSS project investigates fluency in speech and signing across proficiency levels (L1 and L2).

This project has at its core research into semi-automatic language sample analysis. The focus is on the development and evaluation of a software which can be used to support speech therapists in the diagnostics of language disorders in children. In a first phase, the goal is to create a corpus with spontaneous speech of children of ages four to six with typical and atypical language development in Swiss German and Standard German. This data is then used to train automatic speech recognition and automatic language sample analysis models. The process targeted is semi-automatic, with a human (i.e., an expert) in the loop.

Digilinguo is a platform that promotes sustainable practices in the use of digital translation and language tools, thus allowing for language barriers to be overcome in public institutions. Three channels will be created to help it in achieving this objective: 1) a test track for trying out and testing digital tools, 2) an online platform for the training of interpreting specialists and 3) meet-ups that facilitate the networking of stakeholders from the worlds of research, education and practice.

SIGMA aims to provide fundamental tools for automatically processing sign languages, with the main goal of improving a higher-level task: sign language machine translation. Improving machine translation for sign languages is relevant for Swiss and international societies.

The goal of this project is to evaluate large multimodal AI systems (Gemini and equivalent systems) to help users with accessibility requirements to plan journeys that involve navigation in indoor and outdoor public spaces with confidence. The outcome of the project will be an evaluation conducted according to the latest international standards that provides valuable feedback on promoting advance journey planning for persons with disabilities to improve model capabilities.

Finding one’s way on a UZH campus can be challenging, especially for first-year students, visitors, and students and staff with disabilities. The "Indoornavigation@UZH" project is an implementation project involving various departments and divisions at UZH. It aims to improve wayfinding and navigation within UZH by introducing a digital solution that addresses the diverse needs of users.

This project aims to make scientific graphs accessible to people with visual impairments, who often rely on screen readers to access digital content.

IICT was a four-year project supported by the Swiss Innovation Agency (Innosuisse) under its flagship scheme, with a total budget of CHF 12.3 million. Its objective was to develop information and communication technologies (ICT) in the context of persons with disabilities. The project addressed five key application areas: text simplification, sign language translation, sign language assessment, audio description, and spoken subtitles, and successfully delivered innovative technologies and tools in these domains.

EASIER aims to create a framework for barrier-free communication among deaf and hearing citizens across Europe by enabling users of European sign languages to use their preferred language to interact with hearing individuals.

In this project, together with CFS GmbH ("capito") in Graz, Austria, we worked on semi-automatic text simplification for German with the aim of producing simplified German at levels A1, A2, and B1 according to the Common European Framework of Reference for Languages (CEFR). The output of our neural machine translation models is postedited by human translators.

The goal of this project was to pioneer an assessment system for Swiss German Sign Language (Deutschschweizerische Gebärdensprache, DSGS) using automatic sign language recognition technology. To achieve this goal, the project used a multidisciplinary framework that followed two strands of research, one on sign language technology and one on sign assessment with a common link to sign language linguistics.

SMILE II aims to research and build advanced technology for sign language learning. More precisely, the project builds on the groundwork of the SNSF Sinergia project SMILE I, which dealt with assessment of the manual activity of Swiss German Sign Language (Deutschschweizerische Gebärdensprache, DSGS) in isolated signs produced by L1 users and L2 learners. SMILE II extends this technology to continuous sign language assessment including both manual and non-manual components of signs so that a DSGS learner’s sentence-level production can be assessed in an automatic manner.

This two-part project dealt with Swiss German Sign Language. The first part involved sign language machine translation, the second sign language animation assessment, i.e., the evaluation of virtual signers, or 'avatars'.

In the Trainslate (=train+translate) project we developed a system that automatically translates German train announcements of the Swiss Federal Railways (Schweizerische Bundesbahnen, SBB) into Swiss German Sign Language. The idea for such a system was suggested to us by Deaf signers in Switzerland.