Decoder-side Motion Estimation

TNT members involved in this project:
Dr.-Ing. Marco Munderloh

In current video coding solutions, such as MPEG-1,2,4 Video or ITU-T H.26x standards, the encoder estimates the motion in inter frames (P and B frames) and transmits the motion vectors and the residue to the decoder. Thus, temporal correlations between frames are exploited and compression is achieved.

Due to block-based motion estimation, accurate compensation at object borders can only be achieved with small block sizes. However, the smaller the block, the more motion vectors have to be transmitted, resulting in a discrepancy to bit rate reduction. Therefore, the block size has a significant impact on compression performance and is limited to 4x4 pixel in H.264 / MPEG-4 AVC.

To overcome the drawbacks of segmentation and block-based motion compensation, motion estimation can be performed at the decoder. In this case, the predicted motion is already known at the decoder and thus, the transmission of the motion vectors can be omitted. Depending on the compensation accuracy, additional bits can be saved in the residue.

Show recent publications only
  • Conference Contributions
    • Sven Klomp, Marco Munderloh, Jörn Ostermann
      Decoder-Side Hierarchical Motion Estimation for Dense Vector Fields
      Picture Coding Symposium, pp. 362-365, Nagoya, Japan, December 2010
    • Sven Klomp, Marco Munderloh, Jörn Ostermann
      Block Size Dependent Error Model for Motion Compensation
      IEEE International Conference on Image Processing, pp. 969-972, Hong Kong, September 2010
    • Marco Munderloh, Sven Klomp, Jörn Ostermann
      Mesh-based Decoder-Side Motion Estimation
      IEEE International Conference on Image Processing, pp. 2049-2052, Hong Kong, September 2010
    • Sven Klomp, Marco Munderloh, Yuri Vatis, Jörn Ostermann
      Decoder-Side Block Motion Estimation for H.264 / MPEG-4 AVC Based Video Coding
      IEEE International Symposium on Circuits and Systems, pp. 1641-1644, Taipei, Taiwan, May 2009
  • Journals
    • Sven Klomp, Marco Munderloh, Jörn Ostermann
      Decoder-Side Motion Estimation Assuming Temporally or Spatially Constant Motion
      ISRN Signal Processing, Vol. 2011, April 2011, edited by G. Camps-Valls, F. Palmieri, and L. Zhang
  • Books
    • Sven Klomp
      Decoderseitige Bewegungsschätzung in der Videocodierung
      Fortschritt-Berichte VDI : Reihe 10, Informatik, Kommunikation, VDI Verlag GmbH, Vol. 10, No. 820, p. 98, Düsseldorf, 2012
  • Book Chapters
    • Sven Klomp, Jörn Ostermann
      Motion Estimation at the Decoder
      Effective Video Coding for Multimedia Applications, InTech, pp. 77-92, April 2011, edited by Sudhakar Radhakrishnan
  • Standardisation Contributions
    • Sven Klomp, Marco Munderloh, Jörn Ostermann
      Decoder-Side Motion Estimation with Modified Reference List
      Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-B026, July 2010