Multisensory

The CORDIS-ANIMA language and the force-feedback gestural systems permit to simulate virtual objects and interact with them in a complete and multisensory way, ie using simultaneously gestural action and tactile, auditive and visual perception.

  • The first complete real-time multisensory simulation, named "jeu de tennis rétroactif et sonore" ( "retroactive  and audio tennis game") was produced in 1983 ; deformable object, force-feedback, real-time visualization and audio feedback.
  • The second demonstration, called "Horloge" ("Clockwork") shows a physical model of complex clockwork mechanics which produces simultaneously sound and image.

These multisensory simulations are currently in development, particularly with the help of the latest real-time simulator, TELLURIS. They contribute to the creation of new art forms combining sound, image and interactivity, and also new simulators for complex tasks (surgery, telecommunication, ...)

Scientific and technological questions

The multisensory models call for a simulator capable of synchronously executing tasks at different frequencies (44,1 KHz  for audio simulations, 1 KHz for gestures, and 50 Hz for visualization). This brings up questions concerning psycho-perception (inter-sensory transfers, multisensory fusion and fission, ...)

1983 : audio and force-feedback tennis game - Real-time image-sound-gesture force-feedback model of a deformable ball, a rigid racket and collisions. The user feels the ball's impacts on the racket.


©ACROE 83 - Authors : A. Luciani, J. L. Florens - program CORDIS-ANIMA (cf Products page )

An exemple of a complex mechanical model, created with the CORDIS - ANIMA engine: the virtual clockwork. Sound and image are produced using a single particle-based physical model. (Extract from the musical movie "ESQUISSES").


©ACROE 93 - Autors : J. Nouiri, C. Cadoz, A. Luciani, A. Habibi - Program CORDIS-ANIMA (cf. Products)