Realistic Head Motion Synthesis for an Image-based Talking Head



Kang Liu and Joern Ostermann

accepted in the preceedings of IEEE conference FG 2011

    Abstract

      In this paper, we present a novel approach to add flexible head motions to talking heads. First, head motion patterns are collected from original recordings. These head motion patterns are recorded video segments with different head motions, like nod and shake. The head motion is synthesized by selecting and concatenating appropriate head motion patterns according to the input text or head motion tags. In order to join these patterns, optical flow based morphing is used to smooth transitions without introducing noticeable discontinuities. Experimental results show that head motion synthesis is realistic, and animations with flexible head motions are rated with a higher average mean opinion score than the ones with repeated head motions.

      Results:

        Head Motion Synthesis
        Pair No. Repeated Flexible
        1 s001 s001_a
        2 s002 s002_a
        3 s003 s003_a
        4 s004 s004_a
        5 s005 , s005' s005_a


        Leibniz Universitaet Hannover

          

        TNT Home | LUH | Search | Administrator
        Updated 21/02/2011
        Webpage design M.Sc. Kang Liu