Abstract

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

Overview

Symmetric vs. asymmetric

Demo video

Publication

Junhuem Park, Chul Lee, and Chang-Su Kim, "Asymmetric Bilateral Motion Estimation for Video Frame Interpolation," accepted to Proceedings of International Conference on Computer Vision (ICCV), 2021.
[arxiv] [code]