Grant Sanderson on Neural Networks and GPT

Individual journals about topics not specifically related to hang gliding.
Post a reply

Grant Sanderson on Neural Networks and GPT

Postby Bob Kuczewski » Thu Apr 18, 2024 11:18 pm

This is an excellent series of videos developed by Grant Sanderson.

But what is a neural network?
https://www.youtube.com/watch?v=aircAruvnKk




Gradient descent, how neural networks learn
https://www.youtube.com/watch?v=IHZwWFHWa-w




What is backpropagation really doing?
https://www.youtube.com/watch?v=Ilg3gGewQ5U




Backpropagation calculus
https://www.youtube.com/watch?v=tIeHLnjs5U8




But what is a GPT? Visual intro to transformers
https://www.youtube.com/watch?v=wjZofJX0v4M

Join a National Hang Gliding Organization: US Hawks at ushawks.org
View my rating at: US Hang Gliding Rating System
Every human at every point in history has an opportunity to choose courage over cowardice. Look around and you will find that opportunity in your own time.
User avatar
Bob Kuczewski
Contributor
Contributor
 
Posts: 8397
Joined: Fri Aug 13, 2010 2:40 pm
Location: San Diego, CA
Top

Re:Grant Sanderson on Neural Networks and GPT

Postby Bob Kuczewski » Thu Apr 18, 2024 11:51 pm

Attention in transformers, visually explained
https://www.youtube.com/watch?v=eMlx5fFNoYc




How might LLMs store facts
https://www.youtube.com/watch?v=9-Jl0dxWQs8

Join a National Hang Gliding Organization: US Hawks at ushawks.org
View my rating at: US Hang Gliding Rating System
Every human at every point in history has an opportunity to choose courage over cowardice. Look around and you will find that opportunity in your own time.
User avatar
Bob Kuczewski
Contributor
Contributor
 
Posts: 8397
Joined: Fri Aug 13, 2010 2:40 pm
Location: San Diego, CA
Top
Post a reply

Return to Non-HG Blogs

Who is online

Users browsing this forum: No registered users and 6 guests

Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
ProNight Style by ModphpBB3