Ability Haptic Tablet For The Accessibility of Digital Content to the Visually Impaired


Digital technologies are ubiquitous in our daily lives and have fundamentally changed the way we communicate and interact with each other with information. We have anytime, anywhere access to digital content in a wide range of formats, from images, videos, text and voice to virtual and augmented reality experiences. Because today's technologies rely almost exclusively on visual and auditory feedback, obvious accessibility issues arise. In fact, access to digital content remains difficult for people with visual impairments.


In the ABILITY project, a new method is being used to develop a low-cost multi-line Braille display that is directly coupled to a multi-touch tablet. In addition, the tablet has a screen that can vibrate selectively over the entire screen surface. This opens up entirely new possibilities for the non-visual presentation of information, especially when combined with other sensory modalities such as speech or sounds and user interaction.


OFFIS supports this project by researching AI methods for the analysis of visual media (e.g. recognition of objects, faces, environments) and methods for the translation of visual content into tactile-acoustic content that can be output via the new technology. Furthermore, OFFIS is working on the development of use cases in which the potential of these developments can be demonstrated and evaluated with the target group.

Towards AI-based Accessible Digital Media: Image Analysis Pipelines and Blind User Studies

Salous, Mazen and Lange, Daniel and Von Reeken, Timo and Heuten, Wilko and Boll, Susanne and Abdenebaoui, Larbi; 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC); 2023

Lund Universitet
Inside Vision
Samsung Electronics (UK) Limited
Lithuanian association for the blind and visually impaired


Start: 01.09.2022
End: 31.08.2025

Source of funding

Related projects


Haptic, Audio and Visual Interfaces for Maps and Location Based Services


Enhanced Network Accessibility for the Blind and Visually Impaired (only available in german)