Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The Tangible Desktop

The Tangible Desktop Audio-only interfaces, facilitated through text-to-speech screen reading software, have been the primary mode of computer interaction for blind and low-vision computer users for more than four decades. During this time, the advances that have made visual interfaces faster and easier to use, from direct manipulation to skeuomorphic design, have not been paralleled in nonvisual computing environments. The screen reader–dependent community is left with no alternatives to engage with our rapidly advancing technological infrastructure. In this article, we describe our efforts to understand the problems that exist with audio-only interfaces. Based on observing screen reader use for 4 months at a computer training school for blind and low-vision adults, we identify three problem areas within audio-only interfaces: ephemerality, linear interaction, and unidirectional communication. We then evaluated a multimodal approach to computer interaction called the Tangible Desktop that addresses these problems by moving semantic information from the auditory to the tactile channel. Our evaluation demonstrated that among novice screen reader users, Tangible Desktop improved task completion times by an average of 6 minutes when compared to traditional audio-only computer systems. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Accessible Computing (TACCESS) Association for Computing Machinery

The Tangible Desktop

Download PDF
28 pages

Loading next page...
 
/lp/association-for-computing-machinery/the-tangible-desktop-0pEyrDVpnQ
Publisher
Association for Computing Machinery
Copyright
Copyright © 2017 ACM
ISSN
1936-7228
eISSN
1936-7236
DOI
10.1145/3075222
Publisher site
See Article on Publisher Site

Abstract

Audio-only interfaces, facilitated through text-to-speech screen reading software, have been the primary mode of computer interaction for blind and low-vision computer users for more than four decades. During this time, the advances that have made visual interfaces faster and easier to use, from direct manipulation to skeuomorphic design, have not been paralleled in nonvisual computing environments. The screen reader–dependent community is left with no alternatives to engage with our rapidly advancing technological infrastructure. In this article, we describe our efforts to understand the problems that exist with audio-only interfaces. Based on observing screen reader use for 4 months at a computer training school for blind and low-vision adults, we identify three problem areas within audio-only interfaces: ephemerality, linear interaction, and unidirectional communication. We then evaluated a multimodal approach to computer interaction called the Tangible Desktop that addresses these problems by moving semantic information from the auditory to the tactile channel. Our evaluation demonstrated that among novice screen reader users, Tangible Desktop improved task completion times by an average of 6 minutes when compared to traditional audio-only computer systems.

Journal

ACM Transactions on Accessible Computing (TACCESS) – Association for Computing Machinery

Published: Aug 11, 2017

Keywords: Accessibility

References

  • Implementation of assistive technology with students who are visually impaired: Teachers’ readiness
    Abner, G.; Lahm, E.
  • Statistical Snapshots from the American Foundation for the Blind
    Afb,
  • Body mnemonics portable device interaction design concept
    Ängeslevä, Jussi; Oakley, Ian; Hughes, Stephen; OModhrain, Sile
  • Auditory and tactile interfaces for representing the visual effects on the web
    Asakawa, C.; Takagi, H.; Ino, S.; Ifukube, T.
  • TeslaTouch: Electrovibration for touch surfaces
    Bau, O.; Poupyrev, ; Israr, A.; Harrison,
  • Earcons and icons: Their structure and common design principles
    Blattner, Meera M.; Sumikawa, Denise A.; Greenberg, Robert M.
  • More than meets the eye: A survey of screen-reader browsing strategies
    Borodin, Yevgen; Bigham, Jeffrey P.; Dausch, Glenn; Ramakrishnan, I. V.
  • Tactons: Structured tactile messages for non-visual information display
    Brewster, Stephen; Brown, Lorna M.
  • A first investigation into the effectiveness of tactons
    Brown, L. M.; Brewster, S. A.; Purchase, H. C.
  • Why do i keep interrupting myself?: Environment, habit and self-interruption
    Dabbish, Laura; Mark, Gloria; González, Víctor M.
  • The design of auditory user interfaces for blind users
    Donker, Hilko; Klante, Palle; Gorny, Peter
  • Providing access to graphical user interfaces–not graphical screens
    Edwards, W. Keith; Mynatt, Elizabeth D.; Stockton, Kathryn
  • Spatial gestures using a tactile-proprioceptive display
    Folmer, Eelke; Morelli, Tony
  • Review of research on the intelligibility and comprehension of accelerated speech
    Foulke, E.; Sticht, T. G.
  • “Constant, constant, multi-tasking craziness”: Managing multiple working spheres
    González, Victor M.; Mark, Gloria
  • AirWave: Non-contact haptic feedback using air vortex rings
    Gupta, Sidhant; Morris, Dan; Patel, Shwetak N.; Tan, Desney
  • Distributed cognition: Toward a new foundation for human-computer interaction research
    Hollan, James; Hutchins, Edwin; Kirsh, David
  • Empowering individuals with do-it-yourself assistive technology
    Hurst, Amy; Tobias, Jasmine
  • As-rigid-as-possible shape manipulation
    Igarashi, Takeo; Moscovich, Tomer; Hughes, John F.
  • Tangible bits: Towards seamless interfaces between people, bits and atoms
    Ishii, Hiroshi; Ullmer, Brygg
  • Touch
    Klatzky, Roberta L.; Lederman, Susan J.
  • 3D Printing: When and Where Does It Make Sense?, Vol
    Klein, Susanne; Adams, Guy; Dickin, Fraser; Simske, Steve
  • Tactile web browsing for blind users
    Kuber, Ravi; Yu, Wai; O’Modhrain, M. Sile
  • The effectiveness of haptic cues as an assistive technology for human memory
    Kuznetsov, Stacey; Dey, Anind K.; Hudson, Scott E.
  • What frustrates screen reader users on the web: A study of 100 blind users
    Lazar, Jonathan; Allen, Aaron; Kleinman, Jason; Malarkey, Chris
  • Is your web page accessible?: A comparative study of methods for assessing web page accessibility for the blind
    Mankoff, Jennifer; Fait, Holly; Tran, Tu
  • Bored mondays and focused afternoons: The rhythm of attention and online activity in the workplace
    Mark, Gloria; Iqbal, Shamsi T.; Czerwinski, Mary; Johns, Paul
  • Transforming graphical interfaces into auditory interfaces for blind users
    Mynatt, Elizabeth
  • Nonvisual presentation of graphical user interfaces: Contrasting two approaches
    Mynatt, Elizabeth D.; Weber, Gerhard
  • Heuristic evaluation
    Nielsen, J
  • Accessibility: A web engineering approach
    Plessers, Peter; Casteleyn, S.; Yesilada, Yesilada; Troyer, O. D.; Stevens, R.; Harper, S.; Goble, C.
  • Graphical user interfaces and visually disabled users
    Poll, L. H. D.; Waterham, R. P.
  • A tactile windowing system for blind users
    Prescher, Denise; Weber, Gerhard; Spindler, Martin
  • Emacspeak—A speech interface
    Raman, T. V.
  • Representing graphical user interfaces with sound: A review of approaches
    Ratanasit, Dan; Moore, Melody M.
  • Web accessibility as a side effect
    Richards, John T.; Montague, Kyle; Hanson, Vicki L.
  • Auditory memory in congenitally blind adults: A behavioral-electrophysiological investigation
    Röder, Brigitte; Rösler, Frank; Neville, Helen J.
  • The expanded core curriculum: Where we have been, where we are going, and how we can get there
    Sapp, W.; Hatlen, P.
  • Midas: Fabricating custom capacitive touch sensors to prototype interactive objects
    Savage, Valkyrie; Zhang, Xiaohan; Hartmann, Björn
  • A generic direct-manipulation 3d-auditory environment for hierarchical navigation in non-visual interaction
    Savidis, Anthony; Stephanidis, Constantine; Korte, Andreas; Crispien, Kai; Fellbaum, Klaus
  • Audio hallway: A virtual acoustic environment for browsing
    Schmandt, Chris
  • Preparing for future learning with a tangible user interface: The case of neuroscience
    Schneider, Bertrand; Wallace, James M.; Blikstein, Paulo; Pea, Roy
  • Section 508 Law and Related Laws and Policies
    Section,
  • Tangible user interfaces: Past, present, and future directions
    Shaer, Orit; Hornecker, Eva
  • AIREAL: Interactive tactile experiences in free air
    Sodhi, R.; Poupyrev, ; Glisson, M.; Israr, A.
  • Challenging information foraging theory: Screen reader users are not always driven by information scent
    Vigo, Markel; Harper, Simon
  • A snapshot of the first encounters of visually disabled users with the Web
    Vigo, Markel; Harper, Simon
  • Multimodal feedback: Establishing a performance baseline for improved access by individuals with visual impairments
    Vitense, Holly S.; Jacko, Julie A.; Emery, V. Kathlene
  • Web Accessibility Initiative (WAI)
    W3C.,
  • Web Content Accessibility Guidelines (WCAG)
    W3C.,
  • Web Accessibility in Mind
    Webaim,
  • FingerFlux: Near-surface haptic feedback on tabletops
    Weiss, Malte; Voelker, Simon; Borchers, Jan; Wacharamanotham, Chat
  • SLAP widgets: Bridging the gap between virtual and physical controls on tabletops
    Weiss, Malte; Wagner, Julie; Jansen, Yvonne; Jennings, Roger; Khoshabeh, Ramsin; Hollan, James D.; Borchers, Jan
  • A survey of blind users on the usability of email applications
    Wentz, Brian; Hochheiser, Harry; Lazar, Jonathan
  • Tactile display for the visually impaired using TeslaTouch
    Xu, Cheng; Israr, Ali; Poupyrev, Ivan; Bau, Olivier; Harrison, Chris
  • Screen Readers Cannot See
    Yesilada, Yeliz; Harper, Simon; Goble, Carole; Stevens, Robert
  • Distributed cognition, representation, and affordance
    Zhang, Jiajie; Patel, Vimla L.
  • Assistive technology for students with visual impairments: Challenges and needs in teachers’ preparation programs and practice
    Zhou, Li; Parker, Amy T.; Smith, Derrick W.; Griffin-Shirley, Nora
  • To TUI or not to TUI: Evaluating performance and preference in tangible vs
    Zuckerman, Oren; Gal-Oz, Ayelet