Embedded Physical AI
Alexandra Ion, Carnegie Mellon University
Thursday 14th November 2024. 13:00-14:00 GMT. The Buncar.
The world around us is inherently physical, yet adaptive interfaces focus mostly on digital content and representations. Physical AI is moving in the right direction by creating models that can understand instructions and perform physical tasks in the real world, typically with humanoid or quadrupedal robots as physical AI agents.
In this talk, I envision a future where such physical AI agents move into the background—instead of interacting with large general-purpose robots, we should interact with physical objects that are familiar to us. I call this Embedded Physical AI. Bottles, desks, chairs, walls; any object surrounding us should dynamically adapt to our needs, by not only adjusting their user interfaces to fit the context but also by transforming their physical features, material properties, and affordances to instantly become exactly what users need in that moment.
I will discuss how creating such intelligent agents requires two main components: (1) adaptive physical architectures to facilitate physical change, e.g., through metamaterials, shape-changing interfaces, soft robotics, etc., and (2) sensing and prediction systems to understand when and what functionality users require. With new approaches in predictive user modeling and innovations in manufacturing and material science, the time might just be ripe to make this challenging vision a reality.