Excellent, thanks for the explanation!

. Gemma and Qwen I run locally on a strix halo framework desktop

So, CPU only?

nanogpt

Do you know how nanogpt compares with openrouter? Why did you pick nanogpt?

How do you get your LLM credits? Or do you run Gemma and Qwen locally? With which hardware?

You can use opencode with a lot of different setups though, you don’t need to go for their subscription model.

Thank you!

What hardware do you use? How fast is it?

That’s true, but there are also massive economies of scale when you can afford the big Nvidia gpus and share them among many people.

I agree. I use openrouter myself.

In general I agree with you, but llms are the one exception where it’s not practical and not cost effective to run them locally. If you want to use them, the better option is by far to pay someone for the service.

Rust, haskell, python, c++ are all interesting choices. I would argue that c# is too close to what you already know to be interesting.

If I were you though, I’d pick a project first, then decide what language makes sense for it.