Creating AI-driven characters able to interact autonomously with people to help them feel and dance with each other even if they are physically not in the same space
The Internet connects individuals to the world and to other people by means of virtual social networks. However, the online experience is mostly passive, disconnected and disembodied. Internet users are patently part of the digital world, but often isolated from real-world sensations and feelings such as the presence of others, their touch, or their movement. Users find themselves isolated, instead of brought together, by the very technologies that are designed to connect them.
CAROUSEL is a FET/EIC Pathfinder project whose vision is that, with the support of novel, original and imaginative combinations of Artificial Intelligence and immersive interaction technologies, people will be able to feel each other’s presence, touch, and movement, even if they are physically disconnected. These new developments will help overcome isolation and loneliness and bring improvements to our health, work, and wellbeing. Moreover, they will also generate the foundations for an ecosystem of original, as yet unimagined forms of communication and expression.
In CAROUSEL, dance has been chosen as vehicle to implement the project’s vision. Because dance is a profoundly human activity; people dance when are in love or to show happiness, as sharing a dance with someone creates a deep connection. By combining thinking, feeling and sensing with physical movement, dance generates powerful positive effects on physiological and psychological well-being.
The project studies include modern freeform dance styles in groups and in pairs, folk dances, and partner dances such as tango. Scientifically and technically, CAROUSEL believes dance presents a special challenge due to the complex dependency between the motions, the music, the tactile contact and the dancers’ feelings and sensations. The results learned from dance will open up research avenues to many other use cases in the future, from physical training to manual assembly, martial arts, companionship etc., that require close and subtle collaboration and synchronization in groups.
A person may feel lonely or isolated if they find themselves with nobody to contact, temporary confined, in pandemic quarantine or lockdown conditions. This person may open an interaction with a digital character and start dancing together; other real people may decide to join. In live events an icebreaker, for example from a group animator, an inspiring dancer, musician, moderator, trainer, or companion is often needed to kick-start the interaction. CAROUSEL researchers imagine that an autonomous digital character will be able to play this role in the future. This is precisely the technical CAROUSEL breakthrough: to create AI-driven characters who will be able to interact autonomously with a single person or a group of people in a meaningful way and the people can feel and dance with each other even if they are physically not in the same space!
The core of the CAROUSEL research is the experimentation with humans. The project involves partners from technical, scientific, social science, innovation, and artistic backgrounds from the outset. The research will study the main senses involved in dancing: Audio, Vision, Haptics, to develop technology for human interaction and intelligent simulation and control of physically plausible digital characters.
The innovation perspective of this new branch of “Real-World Social and Physical AI” is tremendous as it has countless applications, requiring meaningful physical and social interaction. In particular, in the future, digital characters may act as physical trainers, dancers, entertainers, actors, coworkers, health assistants, guides, educators, spectators, physical therapists and companions. Beyond social, entertainment, health and educational applications, CAROUSEL’s insights on body language and group dynamics may be deployed in many other areas, including security, peace-making, emergency handling and autonomous driving.
The project is coordinated by Deutsche Forschungszentrum für Künstliche Intelligenz (DFKI)s with the participation of Edinburgh Napier University, Aalto University, Grassroots Arts and Research and VIVITnet.
FET-Open and FET Proactive are now part of the Enhanced European Innovation Council (EIC) Pilot (specifically the Pathfinder), the new home for deep-tech research and innovation in Horizon 2020, the EU funding programme for research and innovation
Photo by Adriana Aceves on Unsplash
Self Healing Soft Robots in Action
Fully-autonomous self-healing soft robotic devices thanks to the interdisciplinary combination between self-healing polymer science and soft robotics