Figure Status Update - OpenAI Speech-to-Speech Reasoning

What people said

ben_w · 2025-01 · Reference

> For starters, human minds do more than just language. These days, so do the AI (even though these ones are still called LLMs, which I think is now a bad name even though I continue to use the term without always being mindful of this). > I've yet to see an humanoid robot controlled by an LLM that can tackle difficult physical problems like riding a bike or skiing in for the first time real-time, just as humans, that need to coordinate at least 5 senses (some say up to 20 but I digress) plus emotions and a train of thought to do so. 1) I'd agree that AI are slow learners (as measured by number of examples rather than wall clock). For me, this is more significant than the difference in wattage. 2) 13 years ago, before the Transformer model: [LINK] 3) We don't use 5 senses to ride a bike; I can believe touch, vision, proprioception, and balance are all involved, but that's only 4. Why would hearing, smell, or taste be involved? For emotion, my weakly-held belief is that this is what motivates us and tells us what the concept of "good" even is — i.e. it doesn't give us reasoning beyond being a motivation to learn to reason. > It is surprising that LLMs are so capable, but for 2000kcal a day humans are still more impressive to me. Our biological energy efficiency sure is nice, though progress with silicon is continuing even if the rate of improvement is decreasing: [LINK] That said, I don't consider the substrate efficiency to be an indication of if the thing running on it is or

Read the original HN comment ↗

fragmede · 2024-12 · Reference

[LINK] specifically their speech demo video (which is, of course, a demo video) [VIDEO] [LINK] and [LINK] are undoubtedly using such models. It's an area of active research, eg [LINK] [LINK] [LINK] [LINK]

Read the original HN comment ↗

xvector · 2024-10 · Reference

> Let’s say you gave o1 an API to control a good robot. Could it throw a football? Maybe. > Could it accomplish even the most basic tasks? Definitely: [VIDEO]

Read the original HN comment ↗