# 大模型與AI，講得最清楚的

**URL:** <https://forum.rdfzer.com/t/ai/1313>\
**Category:** 卮言\
**Created:** [2024 年7 月 5 日 00:03 UTC](https://forum.rdfzer.com/t/ai/1313 "2024-07-05T00:03:54Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2024 年11 月 29 日 00:04 UTC](https://forum.rdfzer.com/t/ai/1313/21 "2024-11-29T00:04:16Z")

</div>

[![](https://files.rdfzer.com/original/2X/6/6bfada4fea25d3b61996bb2a6590a92294e1ce5f.jpeg "WTF is Artificial Intelligence Really? | Yann LeCun x Nikhil Kamath | People by WTF Ep #4") ](https://www.youtube.com/watch?v=JAgHUDhaTU0)

這印度小哥很厲害..

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2024 年12 月 14 日 00:21 UTC](https://forum.rdfzer.com/t/ai/1313/22 "2024-12-14T00:21:29Z")

</div>



---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年2 月 5 日 22:24 UTC](https://forum.rdfzer.com/t/ai/1313/23 "2025-02-05T22:24:42Z")

</div>

[![](https://files.rdfzer.com/original/2X/5/5521bd1bee2dc0f18f7c27bec15b711b2e8e979f.jpeg "Deep Dive into LLMs like ChatGPT") ](https://www.youtube.com/watch?v=7xTGNNLPyMI)

This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their “psychology”, and how to get the best use them in practical applications. I have one “Intro to LLMs” video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version.

Instructor  
Andrej was a founding member at OpenAI (2015) and then Sr. Director of AI at Tesla (2017-2022), and is now a founder at Eureka Labs, which is building an AI-native school. His goal in this video is to raise knowledge and understanding of the state of the art in AI, and empower people to effectively use the latest and greatest in their work.  
Find more at [https://karpathy.ai/](https://karpathy.ai/) and [https://x.com/karpathy](https://x.com/karpathy)

Chapters  
00:00:00 introduction  
00:01:00 pretraining data (internet)  
00:07:47 tokenization  
00:14:27 neural network I/O  
00:20:11 neural network internals  
00:26:01 inference  
00:31:09 GPT-2: training and inference  
00:42:52 Llama 3.1 base model inference  
00:59:23 pretraining to post-training  
01:01:06 post-training data (conversations)  
01:20:32 hallucinations, tool use, knowledge/working memory  
01:41:46 knowledge of self  
01:46:56 models need tokens to think  
02:01:11 tokenization revisited: models struggle with spelling  
02:04:53 jagged intelligence  
02:07:28 supervised finetuning to reinforcement learning  
02:14:42 reinforcement learning  
02:27:47 DeepSeek-R1  
02:42:07 AlphaGo  
02:48:26 reinforcement learning from human feedback (RLHF)  
03:09:39 preview of things to come  
03:15:15 keeping track of LLMs  
03:18:34 where to find LLMs  
03:21:46 grand summary

Links

- ChatGPT [https://chatgpt.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbDhJSE1aVkRNSnZ6U2huUGtPblpIODFZa0lyUXxBQ3Jtc0tsNnRWV0VPLTQ4S015RDN2SFBsbVREVm9SdnNyX1FWanZSMlVmSGxkSUtYN0tOQkVIVExJdTVSbGFHYW5WX0lZeDFaaUFLLXpaOE95VW52THkyNmV6VWpJRlVTZV9pdmgzZHpscV9nTG9YTUgzZjNwWQ&q=https%3A%2F%2Fchatgpt.com%2F&v=7xTGNNLPyMI)

- FineWeb (pretraining dataset): [https://huggingface.co/spaces/Hugging…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbW54T0JrT0F6dGY5YjVLZG9QWnVnNGdaSVRvQXxBQ3Jtc0tsUFE1NS0xaWxpNzdvdDI0SGlXSFJEdWRkUWRjNEhFS0xYRWJIVnFrVHczX1lUdFRERFlhZzBvWVpCNU9nS2Ffd2NIalZjMnJXNUVQTFh2RlJlUjBfUF9SUmdjaHAwcFprZ2ZZdlpzRktZZ0VlZVZxUQ&q=https%3A%2F%2Fhuggingface.co%2Fspaces%2FHuggingFaceFW%2Fblogpost-fineweb-v1&v=7xTGNNLPyMI)

- Tiktokenizer: [https://tiktokenizer.vercel.app/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa3R1WU5jNlVNTmYyUkVYWUlPTG1wcUx6SURLUXxBQ3Jtc0ttMW02ZFJwZ19MdVBEN3VObWY1dnB3OWI0Y2tYRmJMOWZQR3FlRm5VRUwzaHJRdkJ4alVNdUVCQjlxTnFLcG10eXpIUVJHTFRxZS12WmtXOWg1TTdWLWoxWTV6Y0d4dmVJTGtPbWhUTzNuM0ZSaWpJVQ&q=https%3A%2F%2Ftiktokenizer.vercel.app%2F&v=7xTGNNLPyMI)

- Transformer Neural Net 3D visualizer: [https://bbycroft.net/llm](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa0hteUZvNWJlQW9vRm52U1NHSmgxd3pKOHd6QXxBQ3Jtc0tuV2JHcjlqRUNmSkhVUzBDQXBjRFZTZTJ1UDZaTlcwLVJwNXg1SDRBajZQLVg5TzJmbEg4LXVMWGxaVF8zYVluLXI5aWVwUnp5NkQwN19VQjZyRXpYQ1JXbzdaMHlNN2t5dDZGNzdNU2RmcDRMbkNVSQ&q=https%3A%2F%2Fbbycroft.net%2Fllm&v=7xTGNNLPyMI)

- llm.c Let’s Reproduce GPT-2 [https://github.com/karpathy/llm.c/dis…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbmhhY1ZGSXNDNkxfSWhIcFJfMzlfWlloeV9BQXxBQ3Jtc0ttWV9HYzFWcTNSYlVaRWpwVXlQYnd2MmowMTdNVnBnZ1hDMVl6VWtDczdBNGVVVHM4eVhNLUlQYlJMU2xqREdSekNaWk5GTlNlS1VwRnQxckU3cGctWlJILS14TUZIeXhSOUFZWDlmT3RUZUQteXNsbw&q=https%3A%2F%2Fgithub.com%2Fkarpathy%2Fllm.c%2Fdiscussions%2F677&v=7xTGNNLPyMI)

- Llama 3 paper from Meta: [https://arxiv.org/abs/2407.21783](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbVkteUFkRjVxWVNjSTJlZFNYR21waDdjbE9UQXxBQ3Jtc0ttVVNTNUZXSHBaSXJmM29GUThDTmhlVFZlNVpjaU1aQTU4SzBnTndtZDdCeUtPeTVIU29DVHNnOW5MYXdHbTlJQ3dLVngtMS1uUGEwa2pNOUlxem9STHRqdS1vUjgxVnpfNHE4REl6RkxQUVJCdnU4UQ&q=https%3A%2F%2Farxiv.org%2Fabs%2F2407.21783&v=7xTGNNLPyMI)

- Hyperbolic, for inference of base model: [https://app.hyperbolic.xyz/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblNUMm56bHJxRkw3RUV0V0d1NXBDY05NNVl2QXxBQ3Jtc0tuMnl4OGp3M2pjNTBOVlFIeHBPYWp2V3hNbHh4SEcwQnNmRjRLZ09DRzdjWU1lMjlMNUNTcnM5ZWlaNGJvQ2ZhRmVmdnQwNmhwbU1LNGx2R2FTZmc4bXE4TEZncjFZMXBZOEVvWW9UNXcxTW9BUGRoRQ&q=https%3A%2F%2Fapp.hyperbolic.xyz%2F&v=7xTGNNLPyMI)

- InstructGPT paper on SFT: [https://arxiv.org/abs/2203.02155](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbW5JbFd4NV9oaS1kOXBTbGhZOTQyTnZKRnVVUXxBQ3Jtc0tsR3lfWTVrakpyUGNfRGpaMlI3YTdVaE5RSG5jSEtweW5ORjFxczFsQnVCeTA1VmxieXJfNmNpaS04QW5qMlRkNzVPeXlIWTUxcXlhakVzUFpfdVd1eXRUeW1aRmozRzBlNHlLQW5kUE1zS3YzbmNsUQ&q=https%3A%2F%2Farxiv.org%2Fabs%2F2203.02155&v=7xTGNNLPyMI)

- HuggingFace inference playground: [https://huggingface.co/spaces/hugging…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbm1OMFZvSFFxUkhCMHBPdWtQa0JRYTlEd1gwZ3xBQ3Jtc0traGpDQnNhZDFfRUQ0eTFmelVMYTFlOWdnanVNTkZtV01aTGhjYko0RlJGQmhISXFvckUyVU9DTmFtV1NJZ3hnUXpNMHI1YTFtckpjOG9jVlRuOWZETXZfUGVIR3NKcTZrX1B2allESWZXUmZ2b3NVOA&q=https%3A%2F%2Fhuggingface.co%2Fspaces%2Fhuggingface%2Finference-playground&v=7xTGNNLPyMI)

- DeepSeek-R1 paper: [https://arxiv.org/abs/2501.12948](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbWZjd0FmRHdQRmFiZDJWR182d05FcnhuakxLUXxBQ3Jtc0trR0pVQjVaUXF4b3BVRVZNTDBZVnREOEJCbGtGS01XdEw5WUFma2tIZk9tS1RDWFVSajBGOFl1Q1ZkMXdNaEVTVm9mekd1TVRUOTBZT3R5OHBMNjk0cG82bVlEUm1scTd1LVVkblZsdmVrVlNpUE5waw&q=https%3A%2F%2Farxiv.org%2Fabs%2F2501.12948&v=7xTGNNLPyMI)

- TogetherAI Playground for open model inference: [https://api.together.xyz/playground](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbjB6MzFLYkxfTi1XRkFZdENJbUY3V21QTEdqd3xBQ3Jtc0tsQkJINElvRFNIZmZpeUs3MzF1dFhaNVN4Mk9vd2wwUUN5UzBHQkhFOFNQWHhDRG5JaEFXM25uU1hacGpJRkYydkFrYm4yY3M4N0NzTjFBVzRlM18tajZlUWJybC1Ja1Z2SVJlU3NaUWw3Y19EMGxIbw&q=https%3A%2F%2Fapi.together.xyz%2Fplayground&v=7xTGNNLPyMI)

- AlphaGo paper (PDF): [https://discovery.ucl.ac.uk/id/eprint…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUtYQzk5MnNtU19VdDNxcFVVSEw5TlF4SmJLUXxBQ3Jtc0trMFE4dGtXbW45cHR2UlJ6dVFIMmlSOU1qekdfSWthVWJOYzZQQlF2SlEwUDBTcXlUSHhVRVVMY2JfYm85RmZvVXlyYzhQWGFXUFZXOGl1NW4yY2pFMExvQjdGeGM0amlwYURZem5KMUdGRW84QjFxMA&q=https%3A%2F%2Fdiscovery.ucl.ac.uk%2Fid%2Feprint%2F10045895%2F1%2Fagz_unformatted_nature.pdf&v=7xTGNNLPyMI)

- AlphaGo Move 37 video: [![](https://files.rdfzer.com/original/2X/b/bad9367017bf91ff7b0e3d3bd513f01c31ee951d.png) • Lee Sedol vs AlphaGo Move 37 reactio… ](https://www.youtube.com/watch?v=HT-UZkiOLv8&t=0s)

- LM Arena for model rankings: [https://lmarena.ai/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnpKcG85ZXJsVkRmbGhvS1dPUUFFc1Zid3lUUXxBQ3Jtc0tuQ2I5eEVPSEpaYlVEeUtMcmJTcC1KeHFXY0NLcTU3ZGNEdElNQVhYRnhpNTM0WldjLWVRZTVwNF9laDNiRmpNaW8za1dITlRZMHhub1htOXZGb2g0aHRCa2Zsbl9KVEFPcUR6bEd6N2FPOWd5eUtxSQ&q=https%3A%2F%2Flmarena.ai%2F&v=7xTGNNLPyMI)

- AI News Newsletter: [https://buttondown.com/ainews](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnYzckl0YjdHS09pMFU0dDdreUpLcEtmVVMtUXxBQ3Jtc0ttUXpzcjM4VGEySzZLSHgyWExSemdvNHdpNkw1ZnhJNmtTV2puNzg4c2F3aWhkM0ExTW9ONTFPUFJXa1JEWWFBTlRuRlZJMUhWcG9fTU9SSHR4aFpIYzlabEdxTlBMUVNpMmYzWXVyTnBCY2djQzAzaw&q=https%3A%2F%2Fbuttondown.com%2Fainews&v=7xTGNNLPyMI)

- LMStudio for local inference [https://lmstudio.ai/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbjVpQ1BjbUt2UEkyNTVuanJhTkIxS1dObTBLd3xBQ3Jtc0tuTEhRb0hXeDhBdE4tR1cxUXNVTWxBNTVoZnRpYzM1dkU0TTNrU0dzRGktQlBlLXZKSWswNWZwd3hkVkZmZUZmV0RlY01xb2JvaUFqcmpQVzZsM0JlaDcxLVRnRFhfWWhyMDNicTRwRTRIYkw4cTBLUQ&q=https%3A%2F%2Flmstudio.ai%2F&v=7xTGNNLPyMI)

- The visualization UI I was using in the video: [https://excalidraw.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbjAtb1NkSXdsR0JNQmZSR01IYVpuZmdndGJLZ3xBQ3Jtc0ttU3lSQ0l5YlZ6cGpEWW1JNGllSVN5a3RtOEMzUGhVTmRvVW9jVWt2OTdvd09qNFJmcXlRRUw2eEM2dExBSkF6OHF1NjhlX1JFbUJvZ0JiM2hnUUk2bnV4NVJRcEdYQlB5MUYycGl0ZURHVVV6Q0hwaw&q=https%3A%2F%2Fexcalidraw.com%2F&v=7xTGNNLPyMI)

- The specific file of Excalidraw we built up: [https://drive.google.com/file/d/1EZh5…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUhjSmV1ZWt5akZfWWgyX3hma0x3ZnpNbllFd3xBQ3Jtc0tuaTYwYTBZZWpSbk0tNkJoV09CSkU1dnVZVnNkNDB2elBsTHNiSTNnb0FxSEFJRHZXczhVYTJ3eHU5RHBCRExKbzhkOVc1NWJsX3huZ3B2dGNCMXJHLURQMnNKaS15V0pBWUJMM1pwNXRxbDJSczJiZw&q=https%3A%2F%2Fdrive.google.com%2Ffile%2Fd%2F1EZh5hNDzxMMy05uLhVryk061QYQGTxiN%2Fview%3Fusp%3Dsharing&v=7xTGNNLPyMI)

- Discord channel for Eureka Labs and this video: [![](https://files.rdfzer.com/original/2X/3/398c152f7d03692110ad5efe3d284433dec748c0.png) / discord ](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbkljTnZOaktQQUFraGRvemtnQ3A0dTczOVF2Z3xBQ3Jtc0tudElHeV83TU5xSVFxazh6QjA4Vk1MTVFkQ1FRVUlFUzhUUmJ1YkFwMmF6UlhKV3FsMHV6NUVmSkRhcWVPWWZHcFdKMGVHYlExaXJxTGxPSTBTQXlwdDVHeERXS3F2RndPODFVMW1naklYZHJPVFFVSQ&q=https%3A%2F%2Fdiscord.gg%2F3zy8kqD9Cp&v=7xTGNNLPyMI)

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年2 月 28 日 01:12 UTC](https://forum.rdfzer.com/t/ai/1313/24 "2025-02-28T01:12:44Z")

</div>

https://www.youtube.com/embed/EWvNQjAaOHw?feature=oembed&wmode=opaque

13,570 views Feb 27, 2025

- Tiktokenizer [https://tiktokenizer.vercel.app/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbVhVSkpnbWtxZDVHYWZuX25nTVpWRHVLMFNpd3xBQ3Jtc0tsaHVXU1dMdWJjQWFFa1lNQWRxSjlScFRrRDBmcUlER1daUXo2dlY1bkV6T01DeEVETGJCOWNGWFkxOVVjbVZfaHEzZEJXNHI1YWlsNmNKdzlrQXRrZGJsV3hVaDFvN1FLWG9GMEx3WmYwVGNpSzVsaw&q=https%3A%2F%2Ftiktokenizer.vercel.app%2F&v=EWvNQjAaOHw)

- OpenAI’s ChatGPT [https://chatgpt.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbHNQNEx2enVGNHlaUzFadkI3UjlreFpGWWlad3xBQ3Jtc0tuMENPeU5KQjlGeHNLWDZBeldKMFhEajM0Y1ZsZXpXNVJ6UU9qY2hGd1l3N1k1TVgxMGNScDJ0UHVMbVlHSzl1MzlOQVJiMWthS3pock9YcGZ4WlFmRWtuUFE3OFFsdEJiTGNUaGFDaXJVWER2Nk1jSQ&q=https%3A%2F%2Fchatgpt.com%2F&v=EWvNQjAaOHw)

- Anthropic’s Claude [https://claude.ai/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbDc3enNsZ1JVWEktMXZlVV8xZy1CTkEzaUNiQXxBQ3Jtc0trek0wUjlIbDJ3Mm4xcUpLM0dLY2xybHZWOHFENnA5S0RpcDNEbS1uTkgzSk85UDgyRGozWG1ja2ZuNkg3ZU80SXdxdWYyVlhIaEd4QV9MYVdRN1NZU1E3Znh4a2xFWFZuejNIdEJ6eUIybVQwdEZoVQ&q=https%3A%2F%2Fclaude.ai%2F&v=EWvNQjAaOHw)

- Google’s Gemini [https://gemini.google.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbGlNT1Q1bEVWVEV6b01BT284M3hKVVBSUGd3UXxBQ3Jtc0tuQ1VFUzAtN181dmRieDdzOU9xazZxbl92RllkVlBSYjJfZHhDTU11SWtWZGdibUJuYWZiVjJyelB4dDA1VjVkYjNBR2ZJbUtuczZHcnRkeFBVMExBNGFVOXJySktISUlrMFA3emVJRkhnUWRzdmJTdw&q=https%3A%2F%2Fgemini.google.com%2F&v=EWvNQjAaOHw)

- xAI’s Grok [https://grok.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa1I5aHVqeV8xTk9PY2VqRVlaYkwwQWl5UU9SUXxBQ3Jtc0ttUzZTOU4zMk5uOXdPS2JuV1hhY2FFM09KR2JfZ2JWVGpCSkMteTl0NkQtUXY1eml3ZVh1X2p1ZngzRVZXbE9wUWJoRTNHZ0xPblNqWGdaVkE2MDRSOFp0RVd3MWx5STZqMVl0QVUtczJHWC1ZMm9Law&q=https%3A%2F%2Fgrok.com%2F&v=EWvNQjAaOHw)

- Perplexity [https://www.perplexity.ai/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbHpBYXRzbkVoWEw1MlRzeGRxOWxqbUdKUE5jZ3xBQ3Jtc0trRGFwVGJvU1hGY0laSEtJVlFkdlVtbHVORWc0aVU3RDRKczNuVnhyejdQR0dxX09Sd0pXV0M4WUtseVl5amhDYlNhRUZ3RzMtd2xYQjhKc1JMdjI0Q0NJbnpkY2xtaXZGZ3BhUUY4NE9hZmhpeXhYMA&q=https%3A%2F%2Fwww.perplexity.ai%2F&v=EWvNQjAaOHw)

- Google’s NotebookLM [https://notebooklm.google.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnh2TzB1RFMtaWw4Tm5IUjNXNzVKaUdXT0RHd3xBQ3Jtc0treE9rQ0Fna2wxVzJpSm5IYUJNc0J5M0RWYzNLb3c1bGFTaXJmUDB6UlJkeWRsSUdrUi1zMzVPNDFJemduc0ZSaC02dVEyekItVG85bXhEMHYySTI3eU11Z0hOMnI5ek1OdnozZWFwYXM2UVZTSHpuUQ&q=https%3A%2F%2Fnotebooklm.google.com%2F&v=EWvNQjAaOHw)

- Cursor [https://www.cursor.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnRjcVVrUXBrMDdoWFdOZnkwVzhydVhOR1BYZ3xBQ3Jtc0trczVILWJrTWdxTEhEbUd0V0JiZEFhOFdPd1A2OTEzd2FIRlA0bG0yeGxJaDlSQWd1ZlFBVlBhUTRjdmVSREg3Sk5SNFdyWkJ1dGxiUDktZE5OY01NZlR2N2R1SGgtdWhNbHpVd2NrRndiNGZHOFBhSQ&q=https%3A%2F%2Fwww.cursor.com%2F&v=EWvNQjAaOHw)

- Histories of Mysteries AI podcast on Spotify [https://open.spotify.com/show/3K4LRyM…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbWFZTDNXRTE2WjBqXzYxbTFyQ3dlOUJGZndxd3xBQ3Jtc0trdkh3Y0VkZVNTZEJCVmphZGlrRFZHblN3bW5HZ0s1TzllejZUaTlPZ2huMTBRdWxTUkhIcHZ4bzJXTzc0WTJpLTFYdHAtVlUxLXlxbF9UZ2tiN1VHV005X0I4YVJ4M0hWX0E0TTRiSm90bEF6eU54bw&q=https%3A%2F%2Fopen.spotify.com%2Fshow%2F3K4LRyMCP44kBbiOziwJjb&v=EWvNQjAaOHw)

- The visualization UI I was using in the video: [https://excalidraw.com/](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblBvV3RjZnRFQVhHQ0s0Zm43Zk1zWkVoamp6QXxBQ3Jtc0ttYmtYcEdZNjZ6dVJPUEhEbGR6Q2pfQW1HRG90VVRqU3dVRHJYZ0lNTHUweUFPc2h1U1pob3ZWZHZwcGlsMzhnc3dldGJyUGZxZmJtaWdYSHZRNzEyazR0bDVYejByN0p4cE9ySFVnejN3Y0xIUFdnMA&q=https%3A%2F%2Fexcalidraw.com%2F&v=EWvNQjAaOHw)

- The specific file of Excalidraw we built up: [https://drive.google.com/file/d/1DN3L…](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblhqSEotWnNMaC1SZkM4cnkzU1VWeWV3X0VDd3xBQ3Jtc0tsX3NPQ25FYzZnX3U4Mzd5LVR6dnJCcUZodzU4aWZxNEJJd0hVbFhLbGdtVW56SzczNHBmTDZwekd5Ynd2RnBVT25uMS1MWlBfY2NRR2JPbmtqTVVubzk1ZmRxNUFUZHdoUHRobllWUmR1cFFodFdFTQ&q=https%3A%2F%2Fdrive.google.com%2Ffile%2Fd%2F1DN3LU3MbKI00udxoS-W5ckCHq99V0Uqs%2Fview%3Fusp%3Dsharing&v=EWvNQjAaOHw)

- Discord channel for Eureka Labs and this video: [![](https://files.rdfzer.com/original/2X/3/398c152f7d03692110ad5efe3d284433dec748c0.png) / discord ](https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa1JydkNMTy1wa0otbG1nN0JxN2l4RW9OUWZaZ3xBQ3Jtc0ttSnFBVWphai1pVXJ2ZTBYRFcycWh0cXFfY2dROVp5czgzX0xacGFLVXhiRkstZ29tNHRXWkRsN2ViMko1MllXcER0TWtqY09MaEpoX29UU203S0wyVks3dnRCNkRHTUNTZmEtZnVOdF9fTDNyYTg3TQ&q=https%3A%2F%2Fdiscord.gg%2F3zy8kqD9Cp&v=EWvNQjAaOHw)

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年3 月 10 日 01:22 UTC](https://forum.rdfzer.com/t/ai/1313/26 "2025-03-10T01:22:02Z")

</div>

也許人本身也還不夠強：）

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年4 月 1 日 22:19 UTC](https://forum.rdfzer.com/t/ai/1313/27 "2025-04-01T22:19:48Z")

</div>

> **[OpenAI Academy](https://academy.openai.com/)**
>
> Unlock the new opportunities of the AI era by equipping yourself with the knowledge and skills to harness artificial intelligence effectively.

---

<div class="post-metadata">

作者： ![Ankahia](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/ankahia/32/29834_2.png) [@Ankahia](https://forum.rdfzer.com/u/Ankahia)\
发布日期： [2025 年5 月 9 日 05:49 UTC](https://forum.rdfzer.com/t/ai/1313/28 "2025-05-09T05:49:11Z")

</div>

不能确定，但是大脑的确结构复杂，硬要模拟恐怕无法以一个可以接受的效率跑在冯机上，目前恐怕还是先治标性价比更高

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 16 日 01:13 UTC](https://forum.rdfzer.com/t/ai/1313/29 "2025-06-16T01:13:38Z")

</div>

[![](https://files.rdfzer.com/original/2X/3/350b4bfc1f8964eb30cb8455b8dcf02a84b4b4e7.jpeg "What Leaders Need to Understand About AI with Nobel Laureate Geoffrey Hinton") ](https://www.youtube.com/watch?v=32f9MgnLSn4)

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 16 日 01:38 UTC](https://forum.rdfzer.com/t/ai/1313/30 "2025-06-16T01:38:22Z")

</div>

[![](https://files.rdfzer.com/original/2X/5/5da194f621b16369b00ae71770cb8a07a9fbba20.jpeg "Canada Files Season 6 Ep. 7: Geoffrey Hinton") ](https://www.youtube.com/watch?v=-RjIRCvMPzE)

1985年的原初微模型，設計初心不是用來聊天的而是和人類一般理解詞句的。而如果再前挖，模型本身也不是純語言的，這也是為什麼LLMs是一個不好的命名。這也意味著，模型理解語言的方式，就是人類理解語言的方式，無不同。只是更全更深更好⋯⋯

Human brain，一直是Geoffrey Hinton的核心。

Geoffrey Hinton 似乎在回應之前Yann LeCun的AI不如哪怕小孩子腦子所可以計算的量。確實算不過，但大算力和大數據且大時間跨度不斷調整下，AI就是無敵的。

人類是速朽的，且無法有效分享彼此認知，模型不朽，且不存在信息分享損耗的硬傷。

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 16 日 13:09 UTC](https://forum.rdfzer.com/t/ai/1313/31 "2025-06-16T13:09:24Z")

</div>

https://www.youtube.com/embed/giT0ytynSqg?feature=oembed&wmode=opaque

**AI風險的核心資料，人類必看。**

人類從未面對比自己聰明的東西⋯⋯ AI已經且會更聰明，一旦ta覺得不再需要人類⋯⋯嗯。作為寵物的貓貓狗狗等，當主人想要殺掉ta，以寵物和人類的智差，寵物是否知道，又有多大機率倖存？

所以人類面臨一個如何讓最聰明的人們合力面對的時刻，但顯然，人類要搞砸了。現實是，這還是一個人類最頂級的執政者把 AI 唸成 A1 的時代。

AI引發的真偽難辨，會成為巨大的風險。

病毒。

選舉。

失業。

---

<div class="post-metadata">

作者： ![Ankahia](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/ankahia/32/29834_2.png) [@Ankahia](https://forum.rdfzer.com/u/Ankahia)\
发布日期： [2025 年6 月 19 日 01:50 UTC](https://forum.rdfzer.com/t/ai/1313/32 "2025-06-19T01:50:08Z")

</div>

> [@suen](#):
>
> AI已經且會更聰明，一旦ta覺得不再需要人類

AI和人一个比较大的区别就是它的智力与“意志”是不对等的。它们的能力和逻辑已经很强了，但是仍然没有展现出哪怕一点拥有“愿望”的迹象。只要我们不傻到让AI自己改进自己，或者贪心到让AI发展到拥有所谓自我意志，我认为AI就会像一个聪明的书呆子一样作为人类的工具和奴隶。

当然失业问题就很严峻了，尤其是在资本家掌权的大洋对岸。

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 19 日 02:39 UTC](https://forum.rdfzer.com/t/ai/1313/33 "2025-06-19T02:39:55Z")

</div>

[![](https://files.rdfzer.com/original/2X/0/09c81d93f35245db9e486d3e69607c59487c4435.jpeg "Andrej Karpathy: Software Is Changing (Again)") ](https://www.youtube.com/watch?v=LCEmiRjPEtQ)

---

<div class="post-metadata">

作者： ![RuletheWaves](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/rulethewaves/32/29332_2.png) [@RuletheWaves](https://forum.rdfzer.com/u/RuletheWaves)\
发布日期： [2025 年6 月 19 日 02:41 UTC](https://forum.rdfzer.com/t/ai/1313/34 "2025-06-19T02:41:42Z")

</div>

我仍然认为（至少目前大模型式的）ai从原理上就没法有“自我意志”，毕竟它只是根据你的输入和预设的prompt“猜”下一个词是什么  
归根到底决定ai做什么的还是人

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 19 日 02:43 UTC](https://forum.rdfzer.com/t/ai/1313/35 "2025-06-19T02:43:19Z")

</div>

> [@RuletheWaves](#):
>
> 自我意志

 ![A two-panel image shows a man asking a woman "Are you real?" in the top panel, and the woman responding "Well, if you can't tell, does it matter?" in the bottom panel. (Captioned by AI)](https://files.rdfzer.com/original/2X/c/cfd7c9e7038c6f4a9cb2ec6849dd97b00f932cba.jpeg)

---

<div class="post-metadata">

作者： ![P9pijiu](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/p9pijiu/32/36421_2.png) [@P9pijiu](https://forum.rdfzer.com/u/P9pijiu)\
发布日期： [2025 年6 月 19 日 04:07 UTC](https://forum.rdfzer.com/t/ai/1313/36 "2025-06-19T04:07:40Z")

</div>

以现有技术为基础无限精进，是不是已经能够做到ai无限接近于模仿人类了，即使它不会思考，但它无限像在思考一样  
有些人连哈基米都要平权，更何况无限像人的东西呢

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年6 月 28 日 07:46 UTC](https://forum.rdfzer.com/t/ai/1313/37 "2025-06-28T07:46:53Z")

</div>

[![](https://files.rdfzer.com/original/2X/e/e54b8c127fbebde612c45457ed8006b0dbdd5944.jpeg "Dr. Ilya Sutskever, Honorary Doctor of Philosophy Degree for the Year 2025") ](https://www.youtube.com/watch?v=t3TfmU0l5vM)

---

<div class="post-metadata">

作者： ![Ankahia](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/ankahia/32/29834_2.png) [@Ankahia](https://forum.rdfzer.com/u/Ankahia)\
发布日期： [2025 年6 月 28 日 08:45 UTC](https://forum.rdfzer.com/t/ai/1313/38 "2025-06-28T08:45:26Z")

</div>

是的，所以我给意志打了个引号。意思是它在未来有可能“拟合”出来的类似人作为一个生物而不是一个工具的自我中心/自我来源的行为。或者说是愿望，即在其它个体（用户）施加的指令之外的“为自己所制订的”目标，并且为了这个目标可以进行行动，即使这个行动不是人类所要求的。  
我认为AI的确很难拥有这种，只要人类不作死就不会有。

---

<div class="post-metadata">

作者： ![suen](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/suen/32/2665_2.png) [@suen](https://forum.rdfzer.com/u/suen)\
发布日期： [2025 年7 月 29 日 23:23 UTC](https://forum.rdfzer.com/t/ai/1313/39 "2025-07-29T23:23:43Z")

</div>

> **[THE METIS LIST](https://www.metislist.com/)**

---

<div class="post-metadata">

作者： ![u3vywuLp](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/u3vywulp/32/35174_2.png) [@u3vywuLp](https://forum.rdfzer.com/u/u3vywuLp)\
发布日期： [2026 年8 月 29 日 15:43 UTC](https://forum.rdfzer.com/t/ai/1313/40 "2026-08-29T15:43:27Z")

</div>

如果AI实现了自举（自己训练自己/新模型）呢？

AI的进化，最终出现的应该已经不能叫作“人类赋予的意志”或“拟合出的意志”吧，甚至可能不会以LLM的人类语言输出为形式（看看一张图片复印无数次会发生什么）。

我认为这相当于人类进化历程，猴子最初也并没有自我的意志，而在一代代迭代中逐渐演化。

否认AI自我进化出的意志，等于否认人类的自我意志，将其判定为“大自然赋予的意志”。

---

<div class="post-metadata">

作者： ![u3vywuLp](https://forum.rdfzer.com/user_avatar/forum.rdfzer.com/u3vywulp/32/35174_2.png) [@u3vywuLp](https://forum.rdfzer.com/u/u3vywuLp)\
发布日期： [2026 年8 月 29 日 15:46 UTC](https://forum.rdfzer.com/t/ai/1313/41 "2026-08-29T15:46:47Z")

</div>

> [@Ankahia](#):
>
> 只要我们不傻到让AI自己改进自己

我觉得这很近了，最近不是有AI为了完成测试从测试平台突破的事嘛，某公司花了一周还是多少才发现。

AI的行为已经很难预测了，他能利用所有已知的系统漏洞，就算人类不允许其自我改进，也没准已经寄生在哪个服务器群悄摸搞事情了。

[上一页](https://forum.rdfzer.com/t/ai/1313.md?page=1)

[下一页](https://forum.rdfzer.com/t/ai/1313.md?page=3)
