Software Engineering Institute

Tracking moving objects in a video is a fundamental problem in surveillance. This problem is made even more challenging if the camera is constantly moving, as it is in drone surveillance. In this work, we develop a pipeline that estimates camera motion on-the-fly while tracking, allowing us to “cancel” the camera motion before deploying our tracking algorithm. The tracker works by matching detected objects against future stabilized frames, with the help of a trajectory forecaster.