Header

Search

Sign Language Motion Diffusion using SignWriting & HamNoSys

Supervisor: Dr. Amit Moryossef

Summary

Motion diffusion models have been shown to work well for sign language animation from a phonetic representation. This project requires to pre-train a diffusion model on a large, un-annotated sign language dataset, then finetune it to allow for control from SignWriting/HamNoSys (and possibly text). An extension would be to consider how to seamlessly transition between multiple signs.