Decoder-side Motion Estimation

TNT members involved in this project:
Dr.-Ing. Marco Munderloh

In current video coding solutions, such as MPEG-1,2,4 Video or ITU-T H.26x standards, the encoder estimates the motion in inter frames (P and B frames) and transmits the motion vectors and the residue to the decoder. Thus, temporal correlations between frames are exploited and compression is achieved.

Due to block-based motion estimation, accurate compensation at object borders can only be achieved with small block sizes. However, the smaller the block, the more motion vectors have to be transmitted, resulting in a discrepancy to bit rate reduction. Therefore, the block size has a significant impact on compression performance and is limited to 4x4 pixel in H.264 / MPEG-4 AVC.

To overcome the drawbacks of segmentation and block-based motion compensation, motion estimation can be performed at the decoder. In this case, the predicted motion is already known at the decoder and thus, the transmission of the motion vectors can be omitted. Depending on the compensation accuracy, additional bits can be saved in the residue.

Show all publications
  • Sven Klomp
    Decoderseitige Bewegungsschätzung in der Videocodierung
    Fortschritt-Berichte VDI : Reihe 10, Informatik, Kommunikation, VDI Verlag GmbH, Vol. 10, No. 820, p. 98, Düsseldorf, 2012
  • Sven Klomp, Jörn Ostermann
    Motion Estimation at the Decoder
    Effective Video Coding for Multimedia Applications, InTech, pp. 77-92, April 2011, edited by Sudhakar Radhakrishnan
  • Sven Klomp, Marco Munderloh, Jörn Ostermann
    Decoder-Side Motion Estimation Assuming Temporally or Spatially Constant Motion
    ISRN Signal Processing, Vol. 2011, April 2011, edited by G. Camps-Valls, F. Palmieri, and L. Zhang