Stereo Video Retargeting: Bringing the Theater Experience into Our Home

演讲者: Prof. Chia-Wen Lin (林嘉文)

时间:2018-09-07 10:00-12:00

地点: Room 106, ICST

Abstract:The popularity of stereo images/videos and various VR/AR display devices poses the need of resizing stereo image/video pairs. Nevertheless, traditional resizing methods like uniform scaling and cropping usually lead to annoying shape and depth distortions such as depth change and window violation. Although content-aware retargeting schemers can address such problems, existing content-aware methods often incur conflicts among the requirements on shape, depth, and temporal coherency preservation, thereby failing to meet one or more of these requirements. This can significantly degrade the quality of experience when watching at 3D movie at home. In this talk, we will introduce our recent results on how to simultaneously avoid shape and depth distortions as well as maintain the temporal coherency of shape and depth while resizing a stereo image/video to a desired size. Different from the existing methods, our method effectively avoids the conflicts among depth, shape and temporal-coherency requirements by relaxing the resizing constraints on those regions in a 3D scene that cannot be perceived by human eyes to maintain the temporal coherency of the remaining regions. Based on this new finding, our method employs depth information to derive effective temporal-coherency constraints so as to offer visually pleasing results and achieves significantly better retargeting performance than existing methods, making it possible to bring the theater experience into our home.

Speaker bio:Prof. Chia-Wen Lin received his PhD degree in Electrical Engineering from National Tsing Hua University (NTHU), Hsinchu, Taiwan in 2000. He is currently a Professor with the Department of Electrical Engineering, NTHU, Taiwan. He also serves as Deputy Director of the AI Research Center of NTHU, and Director of Multimedia Technology Research Center of the EECS College, NTHU. His research interests include image/video processing, computer vision, and video networking.

Dr. Lin is an IEEE Fellow. He is a Distinguished Lecturer of IEEE CASS during 2018-2019. He has served as Associate Editor of IEEE Transactions on Image Processing, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, and IEEE Multimedia. He served as a Steering Committee member of the IEEE Transactions on Multimedia during 2013-2015. He was Chair of the Multimedia Systems and Applications Technical Committee of the IEEE CASS. He served as TPC Chair of IEEE ICME in 2010 and is the Conference Chair of IEEE VCIP 2018 in Taichung and TPC Chair of IEEE ICIP 2019 in Taipei. His papers won the Best Paper Award of IEEE VCIP 2015, and the Young Investigator Award of VCIP 2005.