195 points Apr 1, 2024 Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally? 88 comments js98 There are many options and opinions about, what is currently the recommended approach for running an LLM locally (e.g., on my 3090 24Gb)? Are options ‘idiot proof’ yet?