Learning-based Method
Watching a large number of video clips captured by professional filmmakers is an effective way for beginners to learn video shooting skills and ultimately derive their own creative works. Therefore, we designed an imitation-based system that learns the artistic intention of the cameramen through watching professional aerial videos. We designed a camera planner that analyzes the video contents and previous camera motion to predict future camera motion. Furthermore, we propose a planning framework, which can imitate a filming style by "seeing" only one single demonstration video of such style. We named it "one-shot imitation filming." To the best of our knowledge, this is the first work that extends imitation learning to autonomous filming. Experimental results in both simulation
and field test exhibit significant improvements over existing techniques and our approach
managed to help inexperienced pilots capture cinematic videos.
[1] Chong Huang, Yuanjie Dang, Peng Chen, Xin Yang and Kwang-Ting (Tim) Cheng, One-Shot Imitation Filming of Human Motion Videos, arXiv. 2019
[2] Chong Huang, Chuan-En Lin, Zhenyu Yang, Yan Kong, Peng Chen, Xin Yang and Kwang-Ting (Tim) Cheng, Learning to Film from Professional Human Motion Videos , CVPR 2019
[3] Chong Huang, Zhenyu Yang, Yan Kong, Peng Chen, Xin Yang and Kwang-Ting (Tim) Cheng, Learning to Capture a Film-Look Video with a Camera Drone, ICRA 2019
