ML Scalability & Performance Reading Group Session 4: Ring Attention
![](https://i.ytimg.com/vi/azUufxKe5RE/mqdefault.jpg)
1:08:16
ML Scalability & Performance Reading Group Session 3: ZeRO
![](https://i.ytimg.com/vi/eMlx5fFNoYc/mqdefault.jpg)
26:10
Attention in transformers, step-by-step | DL6
![](https://i.ytimg.com/vi/-9evrZnBorM/mqdefault.jpg)
40:13
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
![](https://i.ytimg.com/vi/F2x6QnOtOOE/mqdefault.jpg)
54:44
Chip Huyen: AI Engineering - Part 13
![](https://i.ytimg.com/vi/KJtZARuO3JY/mqdefault.jpg)
57:45
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
![](https://i.ytimg.com/vi/1XSBnIU_5ps/mqdefault.jpg)
13:18
Trump Joined by Suck-Up Elon Musk in Oval Office, Gets Tough on Straws & Doesn’t Endorse JD Vance
![](https://i.ytimg.com/vi/4wTuGkiob7o/mqdefault.jpg)
1:17:14
ML Scalability & Performance Reading Group Session 6: Zero Bubble Pipeline Parallelism
![](https://i.ytimg.com/vi/kfIfqWeY-Og/mqdefault.jpg)
22:41