https://www.ahmadosman.com/tags/r1/ Recent content in R1 on Osman's Odyssey: Byte & Build https://www.ahmadosman.com/logo/byte-and-build.png https://www.ahmadosman.com/logo/byte-and-build.png Hugo -- 0.145.0 en-us Fri, 14 Feb 2025 02:56:56 -0600 https://www.ahmadosman.com/blog/r1-ktransformers-inference-livestream/ Fri, 14 Feb 2025 02:56:56 -0600 https://www.ahmadosman.com/blog/r1-ktransformers-inference-livestream/ Key takeaways from livestreaming DeepSeek R-1 671B (4-bit) on a 14x RTX 3090 basement AI server. See how KTransformers crushed llama.cpp in prompt eval speeds, compare setups, and get real-world insights into massive LLM inference with vLLM, ExLlamaV2, and more.