In this PyTorch Foundation Spotlight, Simon Mo shares why vLLM became a PyTorch Foundation project in May 2025 and how the project has been built on PyTorch from the beginning. He discusses vLLM’s role within a broader ecosystem of model builders and hardware providers, its focus on ease of use and efficiency, and how the project helps users get value quickly while continuing to improve inference efficiency and cost. 🎥 Watch the Spotlight: https://youtu.be/P7Y8cn9varU #PyTorch #vLLM #AIInfrastr
1:18
In this PyTorch Foundation Spotlight, Simon Mo shares why v…
489 views2 weeks ago
FacebookPyTorch
3.6K views · 111 reactions | 8 GPUs in one box. Four Maxsun dual B60 cards in the lab, 192GB total VRAM. Running Intel Battle Matrix with the LLM Scaler stack for multi-GPU vLLM, pipeline or tensor parallel, speculative decoding, and smart quantization. #AI #LocalInference #LLM #IntelArc #BattleMatrix #vLLM #WorkstationAI #GPUs #OnPrem #RAG #LabLife | StorageReview | Facebook
1:17
3.6K views · 111 reactions | 8 GPUs in one box. Four Maxsun dual B6…
5.7K views1 week ago
FacebookStorageReview
vLLM Meetup: Beijing
3:55:50
vLLM Meetup: Beijing
238 views3 weeks ago
YouTubeRed Hat
vLlama: Ollama + vLLM: Hybrid Local Inference Server
8:17
vLlama: Ollama + vLLM: Hybrid Local Inference Server
5.4K views1 month ago
YouTubeFahd Mirza
vLLM vs Llama cpp - Which one is better? (2025 Guide)
3:30
vLLM vs Llama cpp - Which one is better? (2025 Guide)
39 views3 months ago
YouTubeTheTutorialHut
GLM 4 6V: The Ultimate Guide to Local Deployment, VRAM Specs, and Benchmarks
15:39
GLM 4 6V: The Ultimate Guide to Local Deployment, VRAM Specs, a…
254 views3 weeks ago
YouTubeBinary Verse AI
vLLM on Dual AMD Radeon 9700 AI PRO: Tutorials, Benchmarks (vs RTX 5090/5000/4090/3090/A100)
23:39
vLLM on Dual AMD Radeon 9700 AI PRO: Tutorials, Benchmarks (vs R…
5.5K views2 weeks ago
YouTubeDonato Capitella
26:12
High-Performance LLM Serving on Intel: vLLM for XPU, HPU & CPU | …
134 views1 month ago
YouTubeAnyscale
7:01
vLLM: Secrets to State-of-the-Art LLM Throughput
9 views1 month ago
YouTubeEddy Says Hi
15:40
How Coinbase Uses Ray, vLLM & LiteLLM to Power Secure LLM Ser…
281 views3 weeks ago
YouTubeAnyscale
19:05
Private LLM Server in 10 Minutes with vLLM for GDPR Compliance
2 views1 month ago
YouTubeBrainqub3
6:56
Deploying Local LLM but It Is Slow? Here's How to Fix It (Hopefully) | L…
404 views1 month ago
YouTubeVenelin Valkov
5:31
Ollama vs VLLM vs Llama.cpp: Superior Local AI Platform in 2025?
67 views1 month ago
YouTubeYourTechGuru
0:51
vLLM Just Hit 1.0: Why It's the Fastest LLM Server Right Now ⚡
165 views1 month ago
YouTubeDevOps@Work
2:20
vLLM Vs llama.cpp | Which Local Based LLM Model Is Better?
3 views1 month ago
YouTubeHow To Thomas
13:51
AWS + vLLM: Building the Future of Open, Fast LLM Serving | Ray Su…
38 views1 month ago
YouTubeAnyscale
3:42
Vllm vs Triton - Which one is better? (2025 Guide)
3 months ago
YouTubeTheTutorialHut
7:02
vLLM vs Llama.cpp vs Ollama: Local LLM Engine Comparison for 2025
13 views3 months ago
YouTubeDaxon Creed
7:11
🚀 KV Cache Explained: Why Your LLM is 10X Slower (And How to Fi…
82 views2 months ago
YouTubeMahendra Medapati
11:08
Install and Run Locally LLMs using vLLM library on Linux Ubuntu
1.2K views1 month ago
YouTubeAleksandar Haber PhD
5:47
Installing LLVM
26.8K viewsDec 20, 2020
YouTubeCompilersLab
Vllm Vs Triton | Which Open Source Library is BETTER in 2025?
4.8K views8 months ago
YouTubeTobi Teaches
Vllm vs TGI vs Triton | Which Open Source Library is BETTER in 2025?
494 views8 months ago
YouTubeTobi Teaches
15:19
vLLM: Easily Deploying & Serving LLMs
21.4K views4 months ago
YouTubeNeuralNine
6:37
nano vLLM The Real Story
8 views1 month ago
YouTubeEddy Says Hi #EddySaysHi
8:55
vLLM - Turbo Charge your LLM Inference
20.1K viewsJul 7, 2023
YouTubeSam Witteveen
27:31
vLLM on Kubernetes in Production
8.6K viewsMay 17, 2024
YouTubeKubesimplify
35:23
The State of vLLM | Ray Summit 2024
4.8K viewsOct 18, 2024
YouTubeAnyscale
12:07
Deploy vLLM on Supermicro Gaudi® 3
336 views8 months ago
YouTubeSupermicro
7:03
vLLM: Introduction and easy deploying
676 views1 month ago
YouTubeDigitalOcean
See more videos
Static thumbnail place holder