Multimodality ☆

Modern frontier models are natively multimodal — trained on interleaved text, images and audio so the same weights can watch, listen, read and respond. GPT-4o's real-time voice and Gemini's video understanding mark the shift; robotics VLAs extend it to action. Each added modality multiplies training-data and compute appetite.