Deepseek and Agent Coordination
There's a bit of catching up to do here, which I'll dole out over the next week little by little. First of all - an objective I have is to build a cost-effective way of serving a high quality LLM. Searching around, the obvious option is Kimi K3.1, which can be run on 16 sparks (which would cost ~$100k) - but this would be quite slow. I think I'll have to shelf that for the time being in hopes that someday, somehow, compute gets a little cheaper and I can pick up a 8xB300 node or something. Probably pipe dreams.. :( So for now I'll fall back to a smaller, but still supposedly great model - DeepSeek Flash 4.1. This can run on 4 sparks. I dutifully plopped down the cash for the hardware, got it in a few days and had Claude set everything up for me.