Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Subtitle Region Selection of S3D Images in Consideration of Visual Discomfort and Viewing Habit

Subtitle Region Selection of S3D Images in Consideration of Visual Discomfort and Viewing Habit Subtitles, serving as a linguistic approximation of the visual content, are an essential element in stereoscopic advertisement and the film industry. Due to the vergence accommodation conflict, the stereoscopic 3D (S3D) subtitle inevitably causes visual discomfort. To meet the viewing experience, the subtitle region should be carefully arranged. Unfortunately, very few works have been dedicated to this area. In this article, we propose a method for S3D subtitle region selection in consideration of visual discomfort and viewing habit. First, we divide the disparity map into multiple depth layers according to the disparity value. The preferential processed depth layer is determined by considering the disparity value of the foremost object. Second, the optimal region and coarse disparity value for S3D subtitle insertion are chosen by convolving the selective depth layer with the mean filter. Specifically, the viewing habit is considered during the region selection. Finally, after region selection, the disparity value of the subtitle is further modified by using the just noticeable depth difference (JNDD) model. Given that there is no public database reported for the evaluation of S3D subtitle insertion, we collect 120 S3D images as the test platform. Both objective and subjective experiments are conducted to evaluate the comfort degree of the inserted subtitle. Experimental results demonstrate that the proposed method can obtain promising performance in improving the viewing experience of the inserted subtitle. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) Association for Computing Machinery

Subtitle Region Selection of S3D Images in Consideration of Visual Discomfort and Viewing Habit

Download PDF
16 pages

Loading next page...
 
/lp/association-for-computing-machinery/subtitle-region-selection-of-s3d-images-in-consideration-of-visual-EV5SN6o9cN

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Association for Computing Machinery
Copyright
Copyright © 2019 ACM
ISSN
1551-6857
eISSN
1551-6865
DOI
10.1145/3325197
Publisher site
See Article on Publisher Site

Abstract

Subtitles, serving as a linguistic approximation of the visual content, are an essential element in stereoscopic advertisement and the film industry. Due to the vergence accommodation conflict, the stereoscopic 3D (S3D) subtitle inevitably causes visual discomfort. To meet the viewing experience, the subtitle region should be carefully arranged. Unfortunately, very few works have been dedicated to this area. In this article, we propose a method for S3D subtitle region selection in consideration of visual discomfort and viewing habit. First, we divide the disparity map into multiple depth layers according to the disparity value. The preferential processed depth layer is determined by considering the disparity value of the foremost object. Second, the optimal region and coarse disparity value for S3D subtitle insertion are chosen by convolving the selective depth layer with the mean filter. Specifically, the viewing habit is considered during the region selection. Finally, after region selection, the disparity value of the subtitle is further modified by using the just noticeable depth difference (JNDD) model. Given that there is no public database reported for the evaluation of S3D subtitle insertion, we collect 120 S3D images as the test platform. Both objective and subjective experiments are conducted to evaluate the comfort degree of the inserted subtitle. Experimental results demonstrate that the proposed method can obtain promising performance in improving the viewing experience of the inserted subtitle.

Journal

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) – Association for Computing Machinery

Published: Aug 20, 2019

Keywords: Stereoscopic 3D

References

  • A stereo display prototype with multiple focal distances
    Akeley, Kurt; Watt, Simon J.; Girshick, Ahna Reza; Banks, Martin S.
  • ITU-R BT-500
    Rec,
  • ITU-R BT
    Rec,
  • Visual comfort modeling for disparity in 3D contents based on Weber--Fechner’s Law
    Chen, Zaiqing; Shi, Junsheng; Huang, Xiaoqiao; Yun, Lijun; Tai, Yonghan
  • Visual comfort for stereoscopic 3D by using motion sensors on 3D mobile devices
    Chu, Chung-Hua
  • Display dependent preprocessing of depth maps based on just noticeable depth difference modeling
    De Silva, D. Varuna SX; Ekmekcioglu, Erhan; Fernando, Warnakulasuriya Anil Chandana; Worrall, Stewart T.
  • A metric of visual comfort for stereoscopic motion
    Du, Song-Pei; Masia, Belen; Hu, Shi-Min; Gutierrez, Diego
  • Saliency detection for stereoscopic images
    Fang, Yuming; Wang, Junle; Narwaria, Manish; Callet, Patrick Le; Lin, Weisi
  • Visual attention modeling for stereoscopic video: A benchmark and computational model
    Fang, Yuming; Zhang, Chi; Li, Jing; Lei, Jianjun; Silva, Matthieu Perreira Da; Callet, Patrick Le
  • Impact of acquisition distortion on the quality of stereoscopic images
    Goldmann, Lutz; De Simone, Francesca; Ebrahimi, Touradj
  • Three-dimensional displays: A review and applications analysis
    Holliman, Nicolas S.; Dodgson, Neil A.; Favalora, Gregg E.; Pockett, Lachlan
  • Visual comfort assessment for stereoscopic images based on sparse coding with multi-scale dictionaries
    Jiang, Qiuping; Shao, Feng; Jiang, Gangyi; Yu, Mei; Peng, Zongju
  • On predicting visual comfort of stereoscopic images: A learning to rank based approach
    Jiang, Qiuping; Shao, Feng; Lin, Weisi; Jiang, Gangyi
  • Visual comfort enhancement in stereoscopic 3D images using saliency-adaptive nonlinear disparity mapping
    Jung, Cheolkon; Cao, Lihui; Liu, Hongmin; Kim, Joongkyu
  • Depth sensation enhancement using the just noticeable depth difference
    Jung, Seung-Won; Ko, Sung-Jea
  • Predicting visual discomfort of stereoscopic images using human attention model
    Jung, Yong Ju; Sohn, Hosik; Lee, Seong-Il; Park, Hyun Wook; Ro, Yong Man
  • Objective visual comfort evaluation method based on disparity information and motion for stereoscopic video
    Kan, Bochao; Zhao, Yan; Wang, Shigang
  • Transfer function model of physiological mechanisms underlying temporal visual discomfort experienced when viewing stereoscopic 3D images
    Kim, Taewan; Lee, Sanghoon; Bovik, Alan Conrad
  • The impact of video characteristics and subtitles on visual comfort of 3D TV
    Lambooij, M.; Murdoch, M.J.; IJsselsteijn, Wijnand A.; Heynderickx, Ingrid
  • Visual discomfort in stereoscopic dsplays: A review
    Lambooij, Marc T.M.; IJsselsteijn, W.A.; Heynderickx, Ingrid
  • Nonlinear disparity mapping for stereoscopic 3D
    Lang, Manuel; Hornung, Alexander; Wang, Oliver; Poulakos, Steven; Smolic, Aljoscha; Gross, Markus
  • Depth sensation enhancement for multiple virtual view rendering
    Lei, Jianjun; Zhang, Cuicui; Fang, Yuming; Gu, Zhouye; Ling, Nam; Hou, Chunping
  • Stereoscopic image quality assessment based on depth and texture information
    Liu, Xingang; Kang, Kai; Liu, Yinbo
  • Visual presence: Viewing geometry visual information of UHD S3D entertainment
    Oh, H.; Lee, S.
  • 3D visual discomfort prediction: Vergence, foveation, and the physiological optics of accommodation
    Park, Jincheol; Lee, Sanghoon; Bovik, Alan Conrad
  • 3D visual discomfort predictor: Analysis of disparity and neural activity statistics
    Park, Jincheol; Oh, Heeseok; Lee, Sanghoon; Bovik, Alan Conrad
  • Improvement of stereoscopic comfort through control of the disparity and of the spatial frequency content
    Perrin, Jérôme; Fuchs, Philippe; Roumes, Corinne; Perret, Francois
  • Early computational processing in binocular vision and depth perception
    Read, Jenny
  • Optimizing visual comfort for stereoscopic 3D display based on color-plus-depth signals
    Shao, Feng; Jiang, Qiuping; Fu, Randi; Yu, Mei; Jiang, Gangyi
  • Visual discomfort relaxation for stereoscopic 3D images by adjusting zero-disparity plane for projection
    Shao, Feng; Li, Zhutuan; Jiang, Qiuping; Jiang, Gangyi; Yu, Mei; Peng, Zongju
  • Optimizing multiview video plus depth retargeting technique for stereoscopic 3D displays
    Shao, Feng; Lin, Wenchong; Fu, Randi; Yu, Mei; Jiang, Gangyi
  • Toward simultaneous visual comfort and depth sensation optimization for stereoscopic 3-D experience
    Shao, Feng; Lin, Weisi; Li, Zhutuan; Jiang, Gangyi; Dai, Qionghai
  • Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays
    De Silva, V.; Fernando, A.; Worrall, S.; Arachchi, H. K.; Kondoz, A.
  • Visual comfort amelioration technique for stereoscopic images: Disparity remapping to mitigate global and local discomfort causes
    Sohn, Hosik; Jung, Yong Ju; Lee, Seong-Il; Speranza, Filippo; Ro, Yong Man
  • Stereoscopic 3D-TV: Visual comfort
    Tam, Wa James; Speranza, Filippo; Yano, Sumio; Shimono, Koichi; Ono, Hiroshi
  • Viewing experience of 3D movie with subtitles: Where to put subtitles in a 3D movie? In 5th International Workshop on Quality of Multimedia Experience (QoMEX’13)
    Wan, Shuai; Chang, Bo; Yang, Fuzheng
  • Study on the impact of the depth of 3D subtitles on visual comfort
    Wu, Yan; Li, Qi; Yang, Jingjing; Li, Xiujun; Gao, Ning
  • Combining local and global measures for DIBR-synthesized image quality evaluation
    Yue, Guanghui; Hou, Chunping; Gu, Ke; Zhou, Tianwei; Zhai, Guangtao
  • Blind stereoscopic 3D image quality assessment via analysis of naturalness, structure, and binocular asymmetry
    Yue, Guanghui; Hou, Chunping; Jiang, Qiuping; Yang, Yang
  • Subjective visual comfort assessment based on fusion time for depth information
    Yue, Guanghui; Hou, Chunping; Lu, Kaining; Feng, Dandan; Li, Yao
  • Visual fatigue and discomfort after stereoscopic display viewing
    Zhang, Li; Zhang, Ya-Qin; Zhang, Jing-Shang; Xu, Liang; Jonas, Jost B