33:39

Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou

35:53

Accelerating LLM Inference with vLLM

32:27

NVIDIA Triton Inference Server and its use in Netflix's Model Scoring Service

38:25

AI Hardware: Training, Inference, Devices and Model Optimization

44:06

LLM inference optimization: Architecture, KV cache and Flash attention

3:31:24

Deep Dive into LLMs like ChatGPT

31:49

Scaling AI Workloads with Kubernetes: Sharing GPU Resources Across Multiple Containers - Jack Ong

23:33

vLLM: Easy, Fast, and Cheap LLM Serving for Everyone - Woosuk Kwon & Xiaoxuan Liu, UC Berkeley