Video Stabilization Based on
Feature Trajectory Augmentation and Selection
and Robust Mesh Grid Warping


We propose a video stabilization algorithm, which extracts a guaranteed number of reliable feature trajectories for robust mesh grid warping. We first estimate feature trajectories through a video sequence and transform the feature positions into rolling-free smoothed positions. When the number of the estimated trajectories is insufficient, we generate virtual trajectories by augmenting incomplete trajectories using a low-rank matrix completion scheme. Next, we detect feature points on a large moving object and exclude them so as to stabilize camera movements, rather than object movements. With the selected feature points, we set a mesh grid on each frame and warp each grid cell by moving the original feature positions to the smoothed ones. For robust warping, we formulate a cost function based on the reliability weights of each feature point and each grid cell. The cost function consists of a data term, a structure-preserving term, and a regularization term. By minimizing the cost function, we determine the robust mesh grid warping and achieve the stabilization. Experimental results demonstrate that the proposed algorithm reconstructs videos more stably than conventional algorithms.


Synthetic Videos

"Bucket" (10.3MB) (55.3MB)
"Sliding bucket"
Sliding (10.8MB)

Sliding (55.9MB)
"Orange train" (1.96MB) (15.2MB)
"Airplane" (4.52MB) (105MB)


Fig. 4. Validation of the bi-layer clustering

Fig. 5. Bi-layer clustering of feature points

Sec. III-D-2. Validation of the robust mesh grid warping

Sec. IV-A. Test on synthetic video sequences

Fig. 14. Comparison with conventional algorithms

Fig. 15. Comparison with YouTube Stabilizer (YTS)

More comparisons with YouTube Stabilizer (YTS)

Fig. 16. Comparison with Warp Stabilizer (WAS)

More comparisons with Warp Stabilizer (WAS)

Experimental Results

Input video sequences and our stabilization results for each category