A Hackers' Guide to Language Models

What people said

mangoman · 2024-02 · Strong recommendation

I understand the sadness around not understanding it, it's fucking hard. however, there are more and more resources online getting published for how to get started understanding it that help with understanding the math at an abstraction that helps with learning how to build with it. I would strongly strongly strongly recommend starting with karpathy's from 0 to hero neural networks youtube course - it starts with building a tensor library and back propagation, explaining it in a way that finally clicked for me [LINK] jeremy howard also has a fantastic video that is more around how to use LLMs and such called a hacker's guide to language models - [VIDEO] as i've dove more and more into it, i would strongly recommend trying to run things on your local machine too (llama.cpp, ollama, LM studio). that has helped me fight that feeling of like "are we all just going to be open AI developers in the end" and made me feel like you _can_ integrate these things into stuff you build by your self. I can't imagine how fucked we'd all be if llama was never opensourced. being old does not mean that you can't continue to grow, and remember that it's okay to feel overwhelmed about all this - many people are.

Read the original HN comment ↗

dojitza1 · 2023-11 · Strong recommendation

An interesting solution to the blind spot error (taken directly from Jeremy Howard's amazing guide to language models - [VIDEO] ) is to erase the chat history and try again. Once GPT has made an error (or as the author of this article says, the early layers have irreversibly pruned some important data), it will very often start to be even more wrong.

Read the original HN comment ↗

tarruda · 2023-11 · Strong recommendation

If you're looking for a practical guide on how to use LLMs, highly recommend "Hackers Guide to language models" by Jeremy Howard. 1.5h video packed with practical information: [VIDEO]

Read the original HN comment ↗