Comparison of phoneme and viseme based acoustic units for speech driven realistic lip animation

Bozkurt E., Erdem Ç., Erzin E., Erdem T., Oezkan M.

1st International Conference on 3DTV, Kos Isl, Yunanistan, 7 - 09 Mayıs 2007, ss.85-86 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu.2007.4298572
  • Basıldığı Şehir: Kos Isl
  • Basıldığı Ülke: Yunanistan
  • Sayfa Sayıları: ss.85-86
  • Marmara Üniversitesi Adresli: Hayır

Özet

Natural looking lip animation, synchronized with incoming speech, is essential for realistic character animation. In this work, we evaluate the performance of phone and viseme based acoustic units, with and without context information, for generating realistic lip synchronization using HMM based recognition systems. We conclude via objective evaluations that utilization of viseme based units with context information outperforms the other methods.