Deepdive:a learning-based approach for virtual camera in immersive contents

查看全文 作　　者：Muhammad [1]IRFAN;Muhammad [2]MUNSIF

机构地区：[1]Department of Computer Science,Oakland University,Michigan,USA;[2]Digital Image Processing Laboratory,Islamia College,Peshawar,Pakistan

出　　处：《Virtual Reality & Intelligent Hardware》索引2022年第4卷第3期,共16页

摘　　要：A 360°video stream provide users a choice of viewing one's own point of interest inside the immersive contents.Performing head or hand manipulations to view the interesting scene in a 360°video is very tedious and the user may view the interested frame during his head/hand movement or even lose it.While automatically extracting user's point of interest(UPI)in a 360°video is very challenging because of subjectivity and difference of comforts.To handle these challenges and provide user's the best and visually pleasant view,we propose an automatic approach by utilizing two CNN models:object detector and aesthetic score of the scene.The proposed framework is three folded:pre-processing,Deepdive architecture,and view selection pipeline.In first fold,an input 360°video-frame is divided into three sub frames,each one with 120°view.In second fold,each sub-frame is passed through CNN models to extract visual features in the sub-frames and calculate aesthetic score.Finally,decision pipeline selects the sub frame with salient object based on the detected object and calculated aesthetic score.As compared to other state-of-the-art techniques which are domain specific approaches i.e.,support sports 360°video,our syste m support most of the 360°videos genre.Performance evaluation of proposed framework on our own collected data from various websites indicate performance for different categories of 360°videos. 关键词：Virtual reality Immersive contents Deep learning AESTHETIC SALIENCY

相关文献

参考文献（54）
引证文献（2）
耦合文献（0）

参考文献(54)

引证文献(2)

互联网出版许可证新出网证(渝)字10号全国400电话 - 免长途话费

Deepdive:a learning-based approach for virtual camera in immersive contents

参考文献(54)

引证文献(2)

用户提示