DeepSeek Coder

I found it worse at coding than DeepSeek Coder on the couple of prompts I tried.

I had a similar thought the other day when playing with Deepseek-coder. I asked it to do a problem I had just figured in a system I didn't know (opencv). The code deepseek gave was basically the same as what I had figured out, which I was pretty impressed by. But then I thought that if I had just used that code as is, it probably would have worked but I wouldn't have learned anything about opencv. These new tools can be very valuable but I worry about people not using the tools to maximum effect long-term, in favor of short term success of a certain kind.

On device models (deepseek-coder, etc) are very good // better than the old way of using stack overflow on the internet. I have been quite productive on long haul flights without internet! You're an engineer, your goal is to figure stuff out using the best tools in front of you Humans are resilient, they reliably perform (and throw great parties) in all sorts of chaotic conditions. Perhaps the thing that separates us most from AI is our ability to bring out our best selves when baseline conditions worsen

SmolLM v2 1.7GB Q8 has been running pretty fast. Only needs about 3.5GB of memory. I think it's fine for chatting, but it's only really good for Python code compared to larger models. Deepseek-coder is pretty slow, even with the quantized models. https://huggingface.co/blog/smollm