Comment by baggiponte - Hacker Neue

baggiponte Aug 9, 2025 parent

Yeah. The docs tell you that you should build it yourself, but…

tough Aug 10, 2025

but unlike cuda there's no custom kernels for inference in vllm repo...

I think

This item has no comments currently.

It looks like you have JavaScript disabled. This web app requires that JavaScript is enabled. Please enable JavaScript to use this site (or just go read Hacker News).