This video explores the journey of AI language models, from their modest beginnings through the development of OpenAI’s GPT …
This video explores the journey of AI language models, from their modest beginnings through the development of OpenAI’s GPT …
STAY TUNED: Next video will be on "History of RL | How AI Learned to Feel"
SUBSCRIBE: https://www.youtube.com/@ArtOfTheProblem?sub_confirmation=1
WATCH AI series: http://www.youtube.com/playlist?list=PLbg3ZX2pWlgKV8K6bFJr5dhM7oOClExUJ
Timestamps:
00:32 hofstader's thoughts on chatGPT
01:00 recap of supervised learning
01:55 first paper on sequential learning
02:55 first use of state units (RNN)
04:33 first observation of word boundary detection
05:30 first observation of word clustering
10:10 sentiment neuron (Ilya & Hinton)
12:30 transformer explaination
15:50 GPT-1
17:00 GPT-2
17:55 GPT-3
18:20 In-context learning
19:40 ChatGPT
21:10 tool use
23:25 philosophical question: what is thought?
Music is too distrating .
And then you have work like Google’s geometry Olympiad which I would say blows everything out of the water. The only cap now to AI’s growth is it’s context window since it still doesn’t technically have memory
Ai + advanced sensors can surely be better humans than neocons…
Wonderful video. Subscribed. ❤😊
very cool!
just imagine what 10x more compute can do. the models won't predict a single token but an entire coherent paragraph in the future, an idea, completely eradicating the downside of the last token having had a different idea than the first. it will be like us, thinking totally. eventually llms will feed thoughts recurrently into themselves 1000s of times and refine them. all this will happen in <10 years
chomsky should just go on vacation for the rest of his life
Awesome video thx !
Did i just found an amazing channel?
Just wanted to say I love you guys. I’ve been watching you guys for almost a decade, when you guys were the only computer science channel on YouTube. You guys deserve WAY more attention than you’re getting
Loved the video! Especially the ending! Absolute gem!
Thank you!! It was an excellen video! I learned many new things 😀
Warning: This video was created by AI! 😌
The meaning of life is to live in a world where you are not alone and you are not alone in your life and you are not alone in your life
❤ Hare Krišna 🍀🔥🔥🔥🔥💯
Thanks for the very informative video. However, the background music is very disturbing 🤔
Your a legend man, thanks from the core of my heart for providing us free education❤
we are all replicants
Now with English subtitles
Talking is one thing but talk with substance is another.😅😢😂
Program, built-in, sort of.
Wow you earn a like and subscribe to explaining it in simple and beautiful way the effort you have put in this video is amazing
Kind of fun in hearing about sentiment neuron. what if there comes a feeling neuron will it have feelings that shouldn't happen boy 😅
Good vibes
We're atention see the pattern that weigth need go on upper atention, this uper atention see next level pattern. My noob opinion.
Background music distracting; too loud.
what is the constant music in the background? the content is great
Dude, duck your music when you are using a source with embedded music. Hofstadtler at 1min has music on his video and it's hurting our brains. AI would never make that mistake. Great vid tho
Just because you can doesn’t mean you should
Thank you for this very informative video.
Wait, so they still haven't solved the memory problem? ChatGPT's memory is still only as large as its context window. Isn't there a way to give it permanent long-term memory like we do?
Lol this aged like milk
Great content. Disturbing music.
We need the greatest psychologist and computer scientist to merge with each other to create agi
Grate explaination but some eletronic music is annoying anyway thank you very much
it learned to talk it learned to lie.
Comments are closed.