Global Motion Compensation for Video Surveillance

TNT members involved in this project:
Martin Benjak, M. Sc.
Dr.-Ing. Marco Munderloh
Prof. Dr.-Ing. Jörn Ostermann
Show all

Detection of Objects in a scene is quite important nowadays, e.g. for surveillance purposes. Most of the algorithms used require a static background to be able to separate moving or added objects from the monitored area. If the camera is not static, knowledge about the camera movement is required to be able to compensate the global motion. If the watched scene can be approximated as planar, the compensation is quite easy using a affine or projective transformation. However, if the scene is not planar but contains 3D objects, like furniture, walls, or buildings, for instance, a more complex compensation is required.

Compensation of the global motion should be possible even if the observed scene is not planar. To be able to be used in a surveillance system, the compensation must be done in real time. Therefore, fully 3D scene reconstruction as done in structure from motion is not an option.

To keep the required processing power low, a full 3D scene reconstruction should be avoided. In video coding, the mesh-based motion compensation technology has proved to be able to compensate shape of objects better than normal block-based compensation. We adopted this approach to compensate global motion in a scene containing 3D objects.

Show recent publications only
  • Conference Contributions
    • Holger Meuel, Marco Munderloh, Matthias Reso, Jörn Ostermann
      Optical Flow Cluster Filtering for ROI Coding
      Proceedings of 30th Picture Coding Symposium (PCS), pp. 129-132, San Jose, California, USA, December 2013
    • Marco Munderloh, Holger Meuel, Joern Ostermann
      Mesh-based Global Motion Compensation for Robust Mosaicking and Detection of Moving Objects in Aerial Surveillance
      IEEE CVPR 2011, 1st Workshop of Aerial Video Processing (WAVP), pp. 1-6, Colorado Springs, Colorado, USA, June 2011
    • Marco Munderloh, Sven Klomp, Jörn Ostermann
      Mesh-based Decoder-Side Motion Estimation
      IEEE International Conference on Image Processing, pp. 2049-2052, Hong Kong, September 2010
  • Journals
    • Holger Meuel, Marco Munderloh, Matthias Reso, Jörn Ostermann
      Mesh-based Piecewise Planar Motion Compensation and Optical Flow Clustering for ROI Coding
      APSIPA Transactions on Signal and Information Processing, Vol. 4, October 2015
  • Books
    • Holger Meuel
      Analysis of Affine Motion-Compensated Prediction and its Application in Aerial Video Coding
      Fortschritt-Berichte VDI, VDI Verlag GmbH, Vol. 10, No. 865, Düsseldorf, December 2019
    • Marco Munderloh
      Detection of Moving Objects for Aerial Surveillance of Arbitrary Terrain
      Fortschritt-Berichte VDI, VDI Verlag GmbH, Vol. 10, No. 847, 2016
  • Book Chapters
    • Holger Meuel, Julia Schmidt, Marco Munderloh, Jörn Ostermann
      Advanced Video Coding for Next-Generation Multimedia Services - Chapter 3: Region of Interest Coding for Aerial Video Sequences Using Landscape Models
      Advanced Video Coding for Next-Generation Multimedia Services, Intech, pp. 51-78, January 2013, edited by Yo-Sung Ho