Skip to Main content Skip to Navigation
New interface
Habilitation à diriger des recherches

From Direct manipulation to Gestures: Moving the Expressive Power from the Displays to the Fingers

Caroline Appert 1, 2, 3 
2 ILDA - Interacting with Large Data
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : Optimizing the bandwidth of the communication channel between users and the system is fundamental for designing efficient interactive systems. Apart from the case of speech-based interfaces that rely on users’ natural language, this entails designing an efficient language that users can adopt and that the system can understand. My research has been focusing on studying and optimizing the two fol- lowing types of languages: interfaces that allow users to trigger actions through the direct manipulation of on-screen objects, and interactive systems that allow users to invoke commands by performing specific movements. Direct manipulation re- quires encoding most information in the graphical representation, mostly relying on users’ ability to recognize visual elements; whereas gesture-based interaction interprets the shape and dynamics of users’ movements, mostly relying on users’ ability to recall specific movements. This manuscript presents my main research projects about these two types of language, and discusses how we can increase the efficiency of interactive systems that make use of them. When using direct manip- ulation, achieving a high expressive power and a good level of usability depends on the interface’s ability to accommodate large graphical scenes while enabling the easy selection and manipulation of objects in the scene. When using gestures, it depends on the number of different gestures in the system’s vocabulary, as well as on the simplicity of those gestures, that should remain easy to learn and execute. I conclude with directions for future work around interaction with tangible objects.
Document type :
Habilitation à diriger des recherches
Complete list of metadata

Cited literature [242 references]  Display  Hide  Download
Contributor : Caroline Appert Connect in order to contact the contributor
Submitted on : Thursday, July 6, 2017 - 12:37:53 PM
Last modification on : Saturday, June 25, 2022 - 10:25:38 PM
Long-term archiving on: : Wednesday, January 24, 2018 - 8:49:28 PM


  • HAL Id : tel-01557524, version 1


Caroline Appert. From Direct manipulation to Gestures: Moving the Expressive Power from the Displays to the Fingers. Human-Computer Interaction [cs.HC]. Paris-Sud XI, 2017. ⟨tel-01557524⟩



Record views


Files downloads