What’s next

The researchers are now working to integrate verbal communication, using a large language model like ChatGPT into Emo. As robots become more capable of behaving like humans, Lipson is well aware of the ethical considerations associated with this new technology.

“Although this capability heralds a plethora of positive applications, ranging from home assistants to educational aids, it is incumbent upon developers and users to exercise prudence and ethical considerations,” says Lipson, James and Sally Scapa Professor of Innovation in the Department of Mechanical Engineering at Columbia Engineering, co-director of the Makerspace at Columbia, and a member of the Data Science Institute. “But it’s also very exciting -- by advancing robots that can interpret and mimic human expressions accurately, we're moving closer to a future where robots can seamlessly integrate into our daily lives, offering companionship, assistance, and even empathy. Imagine a world where interacting with a robot feels as natural and comfortable as talking to a friend.” 

About the Study

Journal: Science Robotics

Title: “Human-Robot Facial Co-expression”

Authors: Yuhang Hu (1); Boyuan Chen (2, 3, 4); Jiong Lin (1); Yunzhe Wang (5); Yingke Wang (5); Cameron Mehlman (1); and Hod Lipson (1, 6)

1. Creative Machines Laboratory, Mechanical Engineering Department, Columbia University,
2. Mechanical Engineering and Materials Department, Duke University
3. Electrical and Computer Engineering Department, Duke University
4. Computer Science Department, Duke University
5. Computer Science Department, Columbia University
6. Data Science Institute, Columbia University

Funding: The study was supported by the National Science Foundation AI Institute for Dynamical Systems (DynamicsAI.org ) grant 2112085, and an Amazon grant through the Columbia Center of AI Technology (CAIT).

COI: The authors declare that they have no competing interests.