Camera work estimation from a monocular video based on optical flow

Jinta Sakai; Chun Xie; Hidehiko Shishido; Itaru Kitahara

doi:10.1117/12.3018893

2 May 2024 Camera work estimation from a monocular video based on optical flow

Jinta Sakai, Chun Xie, Hidehiko Shishido, Itaru Kitahara

Proceedings Volume 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024; 1316427 (2024) https://doi.org/10.1117/12.3018893
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2024, 2024, Langkawi, Malaysia

Abstract

Camera work is a critical aspect of conveying the atmosphere and impressions in movies, and it plays a vital role in video analysis. This research proposes a method to estimate camera work from monocular videos by analyzing the optical flow within the video frames. Our method facilitates the estimation of camera work in videos featuring dynamic subjects by incorporating semantic segmentation. Additionally, it is capable of distinguishing between zoom and dolly movements, which previous works have not achieved. The method uses the relationship between image depth, optical flow, and image coordinates to perform such classification.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jinta Sakai, Chun Xie, Hidehiko Shishido, and Itaru Kitahara "Camera work estimation from a monocular video based on optical flow", Proc. SPIE 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024, 1316427 (2 May 2024); https://doi.org/10.1117/12.3018893

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available