Towards Respectful Smart Glasses through Conversation Detection

Meirose, Franziska and Schultze, Sven and Kuehlewind, Sebastian and Koelle, Marion and Abdenebaoui, Larbi and Boll, Susanne
Gesellschaft für Informatik e.V.
Talking to each other is personal, maybe even intimate. Thus, privacy expectations are particularly high during interpersonal conversations, and image or audio recordings are problematic in these contexts. In consequence, smart glasses and other body-worn devices with “always-on” cameras are not well accepted during interpersonal conversations. Proposing a simple-to-implement computer vision procedure, we work towards a solution to this issue. Using imagery from a head-worn camera we detect face-to-face conversations in real-time, as well as distinguish between intimate, personal and social conversations based on intrinsic camera parameters. Starting from a fictive scenario, we illustrate how this knowledge can be used for interaction designs that increase both, the users’ as well as their bystanders’ privacy, e.g., by muting audio or disabling the camera. Finally, we suggest directions for future work.