http://blog.hellonico.info/tags/machine-learning/ Recent content in Machine-Learning on NicoLabs Hugo en Tue, 28 Jul 2026 10:00:00 +0900 http://blog.hellonico.info/posts/coni/running-gguf-natively-in-coni/ Tue, 28 Jul 2026 10:00:00 +0900 http://blog.hellonico.info/posts/coni/running-gguf-natively-in-coni/ <p>Picture this: You see a shiny new Open Source LLM drop on HuggingFace. It promises to be the next big thing in local reasoning. You want to try it out on your MacBook. So you spin up your terminal.</p> <p>You <code>pip install</code> some packages. You get an error about <code>torch</code> being compiled without Metal support. You switch to <code>conda</code>. You update your environment. You wait 15 minutes for 4 gigabytes of dependencies to download. You run the Python script. You get a <code>ValueError: weight shape mismatch</code> because your <code>transformers</code> library is exactly 0.0.1 versions out of date. You update <code>transformers</code>, which breaks <code>accelerate</code>.</p>