a3r.network

INCREDIBLE Someone on r/LocalLLaMA did an incredibly practical thing They took a tiny 0.6B model that was trash at task (Text2SQL) Created a knowledge distiliation agent with a Claude Code skill And made the 0.6B model behave like a specialist using 100 examples The problem >...

We got Claude to teach open models how to write CUDA kernels. This blog post walks you through transferring hard capabilities (like kernel writing) between models with agents skills. Here's the process: - get a powerful model (like Claude Opus 4.5 or OpenAI GPT-5.2) to solve a...

OSINT + AI 🧠 @vyntral's God’s Eye integrates local AI via Ollama for vuln analysis and reporting. No cloud. No APIs. Fully private. Free. AI is becoming a default layer in open source tooling, not a premium feature. Try it here: https://t.co/pL3X97qOsB https://t.co/OhlZP6gaOM

AI phones - large models or small models? We recently open-sourced OpenPhone📱— a 3B parameter mobile agent foundation model! After a year of trial and error, here's what we learned about AI phones ✨ Open-Sourced AI Phone Agents: https://t.co/7qF3qItBvC 🤔 How do AI phones...

- local llms 101 - running a model = inference (using model weights) - inference = predicting the next token based on your input plus all tokens generated so far - together, these make up the "sequence" - tokens ≠ words - they're the chunks representing the text a model sees -...