https://www.ahmadosman.com/tags/ai/ Recent content in AI on Osman's Odyssey: Byte & Build https://www.ahmadosman.com/logo/byte-and-build.png https://www.ahmadosman.com/logo/byte-and-build.png Hugo -- 0.145.0 en-us Sat, 21 Jun 2025 07:08:00 -0500 https://www.ahmadosman.com/blog/software-engineers-arent-getting-automated-local-ai-has-to-win/ Sat, 21 Jun 2025 07:08:00 -0500 https://www.ahmadosman.com/blog/software-engineers-arent-getting-automated-local-ai-has-to-win/ Stop worrying about AI replacing you—the real threat is losing technical depth. As cloud dependence grows and platforms get more opaque, local-first AI, open weights, and full-stack ownership are the only safety nets left. Why the future belongs to those who can build, debug, and own their tools from the metal up. Trust no corporate overlord. https://www.ahmadosman.com/blog/just-like-gpus-we-need-to-be-stress-tested-101-days-of-blogging/ Wed, 18 Jun 2025 23:02:02 -0500 https://www.ahmadosman.com/blog/just-like-gpus-we-need-to-be-stress-tested-101-days-of-blogging/ Why 101 days of daily tech blogging? A raw, open challenge on AI, LLMs, self-hosted experiments, knowledge distillation, and why consistency beats talent. Expect rants, technical breakdowns, open hardware journeys, memes, and daily accountability from the basement AI server guy. https://www.ahmadosman.com/blog/once-undesirable-now-undeniable/ Wed, 30 Apr 2025 15:46:46 -0500 https://www.ahmadosman.com/blog/once-undesirable-now-undeniable/ How taking risks, building in public, and refusing to play a losing game flipped the script—and why sometimes you have to become undeniable before you ever become accepted. https://www.ahmadosman.com/blog/build-your-local-privat-ai-screenshot-organizer-with-lmstudio/ Tue, 22 Apr 2025 08:56:56 -0500 https://www.ahmadosman.com/blog/build-your-local-privat-ai-screenshot-organizer-with-lmstudio/ Build a local, privacy-first screenshot organizer using LMStudio’s Python SDK and Gemma 3 multimodal models. Keep your data off the cloud, automate screenshot categorization, and leverage the power of open-source AI—all running from your own PC. Step-by-step guide, code walkthrough, and a practical use-case for local LLMs. https://www.ahmadosman.com/blog/do-not-use-llama-cpp-or-ollama-on-multi-gpus-setups-use-vllm-or-exllamav2/ Fri, 07 Feb 2025 05:06:36 -0600 https://www.ahmadosman.com/blog/do-not-use-llama-cpp-or-ollama-on-multi-gpus-setups-use-vllm-or-exllamav2/ Exploring the intricacies of Inference Engines and why llama.cpp should be avoided when running Multi-GPU setups. Learn about Tensor Parallelism, the role of vLLM in batch inference, and why ExLlamaV2 has been a game-changer for GPU-optimized AI serving since it introduced Tensor Parallelism. https://www.ahmadosman.com/blog/deepseek-r1-space/ Sun, 02 Feb 2025 15:35:35 -0600 https://www.ahmadosman.com/blog/deepseek-r1-space/ A curated collection of links, books, tools, and benchmarks discussed during the February 2nd, 2025 Twitter/X Audio Space on LLMs and AI. Includes practical resources, RAG leaderboards, toolkits, and perspectives on AI adoption in the Middle East and globally. https://www.ahmadosman.com/blog/taleb-antifragile-ai-insights/ Tue, 03 Dec 2024 04:21:55 -0600 https://www.ahmadosman.com/blog/taleb-antifragile-ai-insights/ Explore how AI systems can become antifragile, harnessing uncertainty to thrive. Learn about the shift and acceleration from traditional software to AI agentic systems and their implications for the future. https://www.ahmadosman.com/blog/serving-ai-from-the-basement-part-ii/ Wed, 18 Sep 2024 05:57:26 -0500 https://www.ahmadosman.com/blog/serving-ai-from-the-basement-part-ii/ SWE Agentic Framework, MoEs, Quantizations & Mixed Precision, Batch Inference, LLM Architectures, vLLM, DeepSeek v2.5, Embedding Models, and Speculative Decoding: An LLM Brain Dump... I have been working on a multi-agent system that simulates a team of Software Engineers; this system assigns projects, creates teams and adds members to them based on areas of expertise and need, and asks team members to build features, assign story points, have pair programming sessions together, etc. https://www.ahmadosman.com/blog/serving-ai-from-the-basement-part-i/ Fri, 06 Sep 2024 16:37:23 -0500 https://www.ahmadosman.com/blog/serving-ai-from-the-basement-part-i/ Dedicated LLM server powered by 8x RTX 3090 Graphic Cards, boasting a total of 192GB of VRAM.