Motion and Aliasing Compensated Prediction

TNT members involved in this project:
Nobody is listed for this project right now!
Show all

Previous motion compensated hybrid video coding standards such as H.263, MPEG-1 and MPEG-2 (H.262) are based on a fractional-pel displacement vector resolution of 1/2-pel and a Bilinear interpolation filter. The newest standard H.264/AVC allows for 1/4-pel resolution with a fixed Wiener filter applied to half-pel positions and a Bilinear filter applied to quarter-pel positions. In general, motion compensation is disturbed by aliasing components contained in an image signal, thus limiting the prediction accuracy obtained by motion compensation.

The motion and aliasing compensated prediction aims at reducing the aliasing, quantisation and motion estimation errors, camera noise, etc. More accurate motion compensation exploiting image contents adaptively, results in less prediction error to be coded, thus making video source coding more efficient.

Aliasing reduction is achieved by applying a Wiener interpolation filter, which is indepently calculated for each frame. In order to enable analytical calculation of the filter coefficients, a non-separable 2D filter scheme is applied. For every fractional-pel position to be interpolated, an individual set of 2D filter coefficients is determined. As a result, a coding gain of up to 1.0 dB for HDTVsequences and up to 0.6 dB for CIF-sequences compared to the standard H.264/AVC is obtained. This approach became the start point for the current exploration software of VCEG. The exact coding gains results for an extensive test set can be found here. Furthermore, in order to show that the approach does not decrease the visual quality, here some results:

Sequence Config file Data rate Y-PSNR Download
City, 720p, 60Hz, reference encoder_city_std.cfg 2178.492 kbit/s 34.549 dB
City, 720p, 60Hz, AIF encoder_city_aif.cfg 2035.042 kbit/s 34.737 dB
Foreman, CIF, 30Hz, reference encoder_foreman_std.cfg 223.489 kbit/s 34.087 dB
Foreman, CIF, 30Hz, AIF encoder_foreman_aif.cfg 202.504 kbit/s 34.217 dB

Show recent publications only
  • Conference Contributions
    • Deyao Zhu, Marco Munderloh, Bodo Rosenhahn, Jörg Stückler
      Learning to Disentangle Latent Physical Factors for Video Prediction
      German Conference on Pattern Recognition (GCPR), September 2019
    • Yuri Vatis, Jörn Ostermann
      Locally Adaptive Non-Separable Interpolation Filter for H.264/AVC
      Proc. ICIP 2006, IEEE International Conference on Image Processing, pp. 33-36, Atlanta, USA, October 2006
    • Yuri Vatis, Bernd Edler, Dieu Thanh Nguyen, Jörn Ostermann
      Motion-and Aliasing-compensated Prediction using a two-dimensional non-separable Adaptive Wiener Interpolation Filter
      Proc. ICIP 2005, IEEE International Conference on Image Processing, Vol. 2, pp. 894-897, ISBN 0-7803-9135-7, Genova, Italy, September 2005
    • Yuri Vatis, Bernd Edler, Ingolf Wassermann, Dieu Thanh Nguyen, Jörn Ostermann
      Coding of Coefficients of two-dimensional non-separable Adaptive Wiener Interpolation Filter
      Proc. VCIP 2005, SPIE Visual Communication & Image Processing, pp. 623-631, Bejing, China, July 2005
    • Thomas Wedi
      Adaptive 3D Interpolation Filter for Motion and Aliasing Compensated Prediction
      Proc. Picture Coding Symposium (PCS 2003), Saint-Malo, France, April 2003
    • Thomas Wedi
      Adaptive Interpolation Filter for Motion and Aliasing Compensated Prediction
      Proc. Electronic Imaging 2002: Visual Communications and Image Processing (VCIP 2002), San Jose, California USA, January 2002, 2002
    • Thomas Wedi
      Adaptive Interpolation Filter for Motion Compensated Prediction
      Proc. IEEE International Conference on Image Processing (ICIP), Rochester, New York USA, September 2002, 2002
    • Thomas Wedi
      Adaptive Interpolation Filter for Motion Compensated Hybrid Video Coding
      Proc. Picture Coding Symposium (PCS 2001), Seoul, Korea, April 2001
    • Thomas Wedi
      Hybrid Video Coding Based on High-Resolution Displacement Vectors
      Proc. Electronic Imaging 2001: Visual Communications and Image Processing (VCIP 2001), San Jose, California USA, January 2001, 2001
    • Thomas Wedi
      A time-recursive interpolation filter for motion compensated prediction considering aliasing
      Proc. IEEE International Conference on Image Processing (ICIP 99), Kobe, Japan, October 1999, 1999
  • Journals
    • Yuri Vatis, Jörn Ostermann
      Adaptive Interpolation Filter for H.264/AVC
      IEEE Transactions on Circuits and Systems for Video Technology, Vol. 19, No. 2, pp. 179 - 192, February 2009
    • Thomas Wedi, Hans Georg Musmann
      Motion and Aliasing Compensated Prediction for Hybrid Video Coding
      IEEE Transactions on Circuits and Systems for Video Technology, invited paper, July 2003
  • Standardisation Contributions
    • Yuri Vatis, Jörn Ostermann
      Syntax of adaptive filter coefficients in the KTA reference model
      ITU-T Q.6/SC16, doc. VCEG-AF09, San Jose, USA, April 2007
    • Yuri Vatis, Jörn Ostermann
      Rate-distortion optimised coder control for adaptive interpolation filter in the KTA reference model
      ITU-T Q.6/SC16, doc. VCEG-AE16, Marrakech, Morocco, January 2007
    • Yuri Vatis, Jörn Ostermann
      Prediction of P- and B-Frames Using a Two-dimensional Non-separable Adaptive Wiener Interpolation Filter
      ITU-T Q.6/SC16, doc. VCEG-AD08, Hangzhou, China, October 2006
    • Matthias Narroschke, Yuri Vatis
      Increasing the coding efficiency by adaptive interpolation filters, adaptive prediction error coding, and 1/8-pel displacement vector resolution
      ISO/IEC JTC1/SC29/WG11 Doc. M13137, Montreux, Switzerland, April 2006
    • Yuri Vatis, Jörn Ostermann
      Comparison of Complexity between Two-dimensional non-separable Adaptive Interpolation Filter and Standard Wiener Filter
      ITU-T SG16/Q.6 Doc. VCEG-AA11, Nice, France, October 2005
    • Yuri Vatis, Bernd Edler, Dieu Thanh Nguyen, Jörn Ostermann
      Two-dimensional non-separable Adaptive Wiener Interpolation Filter for H.264/AVC
      ITU-T SGI 6/Q.6 Doc. VCEG-Z17, Busan, South Korea, April 2005