Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Teachable machines for accessibility

Teachable machines for accessibility How can accessibility research leverage advances in machine learning and artificial intelligence with limited data? In this article, we argue that teachable machines can empower accessibility research by enabling individuals with disabilities to personalize a data-driven assistive technology. By significantly constraining the conditions of the machine learning task to a specific user and their environment, these technologies can achieve higher robustness in real world scenarios. In contrast to automatic personalization, the end user is called to consciously provide training examples and actively interact with the machine learning algorithm to increase its accuracy. We demonstrate this concept with a concrete example: teachable object recognizers trained by and for blind users. Furthermore, we discuss open challenges in designing and building teachable machines with a focus on accessibility. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM SIGACCESS Accessibility and Computing Association for Computing Machinery

Teachable machines for accessibility

Kacorri, Hernisa
ACM SIGACCESS Accessibility and Computing , Volume (119): 9 – Nov 27, 2017
Download PDF
9 pages

Loading next page...
 
/lp/association-for-computing-machinery/teachable-machines-for-accessibility-GCk2gcTCF0

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Association for Computing Machinery
Copyright
Copyright © 2017 Author
ISSN
1558-2337
eISSN
1558-1187
DOI
10.1145/3167902.3167904
Publisher site
See Article on Publisher Site

Abstract

How can accessibility research leverage advances in machine learning and artificial intelligence with limited data? In this article, we argue that teachable machines can empower accessibility research by enabling individuals with disabilities to personalize a data-driven assistive technology. By significantly constraining the conditions of the machine learning task to a specific user and their environment, these technologies can achieve higher robustness in real world scenarios. In contrast to automatic personalization, the end user is called to consciously provide training examples and actively interact with the machine learning algorithm to increase its accuracy. We demonstrate this concept with a concrete example: teachable object recognizers trained by and for blind users. Furthermore, we discuss open challenges in designing and building teachable machines with a focus on accessibility.

Journal

ACM SIGACCESS Accessibility and Computing – Association for Computing Machinery

Published: Nov 27, 2017

References

  • Discriminative k-shot learning using probabilistic models
    Bauer, ; M., ; Rojas-Carulla, ; M., ; Świαtkowski, ; J.B., ; Schölkopf, ; B., ; Turner, ; R.E.,,
  • A personalizable mobile sound detector app design for deaf and hard-of-hearing users
    Bragg, ; D., ; Huynh, ; N., ; Ladner, ; R.E.,,
  • WeAllWalk: An Annotated Data Set of Inertial Sensor Time Series from Blind Walkers
    Flores, ; G.H., ; Manduchi, ; R.,,
  • Improved inference and autotyping in EEG-based BCI typing systems
    Fowler, ; A., ; Roark, ; B., ; Orhan, ; U., ; Erdogmus, ; D., ; Fried-Oken, ; M.,,
  • https://experiments
    Cam, Giorgio
  • VizMap: Accessible Visual Information through Crowdsourced Map Reconstruction
    Gleason, ; C., ; Guo, ; A., ; Laput, ; G., ; Kitani, ; K., ; Bigham, ; J.P.,,
  • Characterizing and visualizing physical world accessibility at scale using crowdsourcing, computer vision, and machine learning
    Hara, ; K., ; Froehlich, ; J.E.,,
  • Release of experimental stimuli and questions for evaluating facial expressions in animations of American Sign Language
    Huenerfauth, ; M., ; Kacorri, ; H.,,
  • Continuous profile models in ASL syntactic facial expression synthesis
    Kacorri, ; H., ; Huenerfauth, ; M.,,
  • People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges
    Kacorri, ; H., ; Kitani, ; K.M., ; Bigham, ; J.P., ; Asakawa, ; C.,,
  • Supporting orientation of people with visual impairment: Analysis of large scale usage data
    Kacorri, ; H., ; Mascetti, ; S., ; Gerino, ; A., ; Ahmetovic, ; D., ; Takagi, ; H., ; Asakawa, ; C.,,
  • https://experiments
    Karmann, ; B., ; Programming, Objectifier Spatial
  • Validation of a keystroke-level model for a text entry system used by people with disabilities
    Koester, ; H.H., ; Levine, ; S.P.,,
  • Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation
    Lu, ; P., ; Huenerfauth, ; M.,,
  • Computer-based tracking, analysis, and visualization of linguistically significant nonmanual events in American Sign Language (ASL)
    Neidle, ; C., ; Liu, ; J., ; Liu, ; B., ; Peng, ; X., ; Vogler, ; C., ; Metaxas, ; D.,,
  • A survey on transfer learning
    Pan, ; S.J., ; Yang, ; Q.,,
  • Learning to learn, from transfer learning to domain adaptation: A unifying perspective
    Patricia, ; N., ; Caputo, ; B.,,
  • A resource of errors written in Spanish by people with dyslexia and its linguistic, phonetic and visual analysis
    Rello, ; L., ; Baeza-Yates, ; R., ; Llisterri, ; J.,,
  • The TORGO database of acoustic and articulatory speech from speakers with dysarthria
    Rudzicz, ; F., ; Namasivayam, ; A.K., ; Wolff, ; T.,,
  • Imagenet large scale visual recognition challenge
    Russakovsky, ; O., ; Deng, ; J., ; Su, ; H., ; Krause, ; J., ; Satheesh, ; S., ; Ma, ; S., ; Huang, ; Z., ; Karpathy, ; A., ; Khosla, ; A., ; Bernstein, ; M., ; Berg, ; A.C.,,
  • NavCog3: An Evaluation of a Smartphone-Based Blind Indoor Navigation Assistant with Semantic Features in a Large-Scale Environment
    Sato, ; D., ; Oh, ; U., ; Naito, ; K., ; Takagi, ; H., ; Asakawa, ; C., ; Kitani, ; K.,,
  • "Hands On" Visual Recognition for Visually Impaired Users
    Sosa-García, ; J., ; Odone, ; F.,,
  • Integrating language models into classifiers for BCI communication: a review
    Speier, ; W., ; Arnold, ; C., ; Pouratian, ; N.,,
  • Rethinking the inception architecture for computer vision
    Szegedy, ; C., ; Vanhoucke, ; V., ; Ioffe, ; S., ; Shlens, ; J., ; Wojna, ; Z.,,
  • Matching networks for one shot learning
    Vinyals, ; O., ; Blundell, ; C., ; Lillicrap, ; T., ; Wierstra, ; D.,,
  • https://experiments
    Machine, Teachable
  • Isolated Sign Language Recognition with Grassmann Covariance Matrices
    Wang, ; H., ; Chai, ; X., ; Hong, ; X., ; Zhao, ; G., ; Chen, ; X.,,
  • https://github
    P., Warden; iPhoneTracker,
  • https://experiments
    Wekinator,
  • Real time object scanning using a mobile phone and cloud-based visual search engine
    Zhong, ; Y., ; Garrigues, ; P.J., ; Bigham, ; J.P.,,