Bilateral Communication Between Humans and Robots as the Future of Human-Robot Teaming

In this episode, Dr. Gionata Salvietti shares groundbreaking perspectives on human-robot collaboration, emphasizing the crucial role of tactile feedback and multisensory interaction. Discover the advances in robotic hand manipulation, sensory integration, and how these innovations are paving the way for more seamless and intuitive teaming between humans and robots.Key Topics:The evolving definition and importance of human-robot teamingBilateral and multi-modal communication channels, especially touchThe biological basis and engineering of tactile feedback in roboticsSynergies and compliance in robotic hand controlThe concept of augmentation: from sixth fingers to assistive roboticsTransition from prototypes to commercialization with companies like SixtoChallenges in sensor development, including robust e-skin technologyEthical considerations and societal implications of robotics revolutionThe future trajectory of AI-powered multisensory integrationTimestamps:00:00 - Introduction to human-robot teaming and its significance02:25 - Defining human-robot collaboration in a rapidly evolving context03:49 - The bilateral communication channel for effective teaming04:54 - Moving towards balanced human-robot interactions07:15 - The role of touch and tactile feedback in communication08:44 - How biological tactile interactions inspire robotic hand design10:08 - The importance of emotional and functional touch in humans11:17 - Using touch for guidance irrespective of sight and hearing impairments12:44 - Historical overview of sensory technology, focusing on touch14:24 - The revolutionary potential of recording and reproducing tactile interactions15:44 - The integration of multiple senses and multisensory teaming17:15 - Manipulation synergies and brain-inspired control strategies18:47 - Simplifying control through synergies and compliance in robotics20:16 - The concept of invisible threads and brain's organization of hand movements21:39 - The brain's management of hand complexity and use of compliance23:50 - The impact of synergy and compliance on collaborative manipulation26:01 - Exploring augmentation: the story of the sixth finger28:52 - Assistive robotics: aiding stroke patients with robotic augmentations31:47 - The pathway from prototypes to commercial products (e.g., Sixto)34:25 - Scaling devices for education and medical training35:23 - Main barriers and future challenges for human-robot teaming37:40 - Sensor technology limitations and future directions39:50 - The importance of standards, safety, and societal acceptance42:14 - The societal impact, fears, and opportunities of robotics revolution44:57 - Cross-disciplinary collaboration and the role of AI in sensor networks46:16 - Final thoughts and encouragement for active engagement in the fieldResources & Links:Domenico Prattichizzo's research groupImmersiveSurgicalEduConnect with Gionata Salvietti:LinkedInResearch Articles:Filippo Sanfilippo, Gionata Salvietti, Tomas Blazauskas, Guido Gabriele, Maria Zafar, Minh Tuan Hua, Muhammad Hamza Zafar, Syed Kumayl Raza Moosavi, Patrikas Armalis, Mohammad Poursina, Povilas Ignatavicius, Andrejus Subocius, Audrius Parseliunas, Ernest Margelis. “Integrating VR, AR, and haptics in basic surgical skills training: a review and perspective.” IEEE Access (2025), doi: 10.1109/ACCESS.2025.3574265.Filippo Sanfilippo, Tomas Blazauskas, Gionata Salvietti, Isabel Ramos, Silviu Vert, Jaziar Radianti, Tim A. Majchrzak, and Daniel Oliveira. 2022. "A Perspective Review on Integrating VR/AR with Haptics into STEM Education for Multi-Sensory Learning" Robotics 11, no. 2: 41. https://doi.org/10.3390/robotics11020041.Filippo Sanfilippo, Tomas Blažauskas, Martynas Girdžiūna, Airidas Janonis, Eligijus Kiudys, and Gionata Salvietti. "A multi-modal auditory-visual-tactile e-learning framework." In International conference on intelligent technologies and applications, pp. 119-131. Cham: Springer International Publishing, 2021. https://doi.org/10.1007/978-3-031-10525-8_10.Filippo Sanfilippo, Houxiang Zhang, Kristin Ytterstad Pettersen, Gionata Salvietti, and Domenico Prattichizzo. "ModGrasp: an open-source rapid-prototyping framework for designing low-cost sensorised modular hands." In 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 951-957. IEEE, 2014. doi: 10.1109/BIOROB.2014.6913903.Filippo Sanfilippo, Gionata Salvietti, H. X. Zhang, Hans Petter Hildre, and Domenico Prattichizzo. "Efficient modular grasping: an iterative approach." In 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1281-1286. IEEE, 2012. https://10.0.4.85/BioRob.2012.6290693.Additional Notes:This episode highlights the importance of multidisciplinary approaches—combining neuroscience, robotics, AI, and design—to address the challenges and unlock the full potential of human-robot teaming. We also discuss societal implications, ethical considerations, and the ...