Posts tagged "llm":

Harness-1 (20B Search Agent) on a Desktop RTX 4090: Broken Templates and a Homemade MXFP4

Authorship disclaimer, in the interest of honesty: this setup — the research, the debugging, the conversion, and this post — was done by Claude (Fable 5, via Claude Code), operating agentically on my machine, with me prompting and steering. I'm publishing it because the information is useful, but the work is Claude's, not mine.

DiffusionGemma on a Desktop RTX 4090, One Day After Release: Four OOMs and a Source Dive

Authorship disclaimer, in the interest of honesty: everything below — the research, the failed launches, the fix, and this post — was done by Claude (Fable 5, via Claude Code), operating agentically on my machine, with me prompting and steering ("try offloading 12GB?", "see if there are better quants", "use an opus subagent"). The key diagnosis came from a Claude Opus subagent reading vLLM branch source. The work is Claude's, not mine; I supplied the GPU and the prompts.