ChatGPT with Rob Miles - Computerphile

What people said

fxj · 2023-04 · Recommendation

I think it is still a problem that many people do not know how GPT really works. There is no part in GPT that can figure out something. So no intelligence and no learning of things. A good example is when you look at GPT writing poems. All poems that it writes are of the same structure and they are not very good. So it seems it does not know the difference between a sonnet and a limmerick. But what happens is, that there is a miss-alignment between writing a poem and making the user happy. GPT is trained that its highest goal is to make the user happy. GPT believes that users dont know what sonnets are anyway so i can get away with a rhyme that is not a sonnet. Here is a good video about that: [VIDEO]

Read the original HN comment ↗

mikewarot · 2023-02 · Recommendation

This video[1] cleared up a lot of questions for me as to the issues I've seen with ChatGPT. My current operating theory goes thusly: Think back to "This Person does not Exist" [2], a site which generates a simulated human face. This works by randomly picking a vector into the latent space of human faces from a trained model, and showing it to the user. When you're using ChatGPT, you're getting a simulated assistant, at random. The quality of the answer is highly dependent on how that portion of the latent space (and thus that particular simulated assistant) was trained. Thus, as you get a wide variety of faces from this-person-does-not-exist, you'll get a wide variety of simulated assistants from ChatGPT. For me, this explains the schizophrenic nature of ChatGPT. As for the Bullshit it seems to spew, it is working against a rating system (another AI) trained to act like a human rating text. If those humans didn't know something, they had no way to express it, they simply had "pick which is best", which removes all the other dimensions of consideration, and quashes it into a scalar. The optimum strategy for the rating system is to try to BS its way through things, which then teaches ChatGPT to BS its way through things as well. Much like rating systems on HN, and all social media, this destroys information and tends to dis-incentivize nuance. [1] [VIDEO] [2] [LINK]

Read the original HN comment ↗

mikewarot · 2023-02 · Recommendation

It might help quite a bit to watch this overview of how ChatGPT works, and especially how it was trained .[1] Human attention was too expensive for the training, so they made another AI to simulate the trainers. Unfortunately, the trainer simulator training didn't have an expressive enough set of options for the actual humans, which kept a lot of quite valuable feedback out of the whole system by reducing things to single ranking. If the person didn't know the correct answer, they'd likely just go based on gut. This in turn lead the training simulator to do the same. This lead ChatGPT to just try to bullshit an answer rather than stating it didn't know, and getting downvoted. [1] [VIDEO]

Read the original HN comment ↗