Microsoft's 14B dense Phi-4 SLM trained on synthetic textbook data, MIT license, tuned for reasoning tasks and competitive with much larger models on math/code.
@hn_5a4fb5
30 days ago
Wow, actually this cookbook is really bad? I expected something like the OpenAI or Anthropic cookbooks, but this seems to be some AI generated low-quality content without any code examples or interesting examples? The Phi-3 models are great though, especially the vision model has great potential for low latency applications (like robotics?)
@hn_2526fc
about 1 month ago
Would be great to see Microsoft vigorously engage in frontier models directly instead of through their OpenAI proxy (subsidiary?). Microsoft Phi 4 hasn't seen an update in a year.
@hn_58d19c
about 1 month ago
I'm reviewing models, at the moment. Model selection will depend greatly on the hardware capabilities at each school. Phi-3 could be a good starting point. The project is an idea at the moment. My contact in Kenya has direct access to the Principals of the schools that our supported students attend. My thought is that the teachers would not have to do much. Many of the students already know python and could do self-learning individually or in groups. A flash drive with llamafile+models and documentation might be all that it would take to get them started - even offline. Bonus: Using llamafile, the same binary distribution works on MacOS, Linux, and Windows.
@hn_046545
about 2 months ago
Great on-device additions to the larger Phi-4 14B released Dec/2024. https://lifearchitect.ai/models-table/
@hn_23740c
about 2 months ago
The most interesting thing about this is the way it was trained using synthetic data, which is described in quite a bit of detail in the technical report: https://arxiv.org/abs/2412.08905 Microsoft haven't officially released the weights yet but there are unofficial GGUFs up on Hugging Face already. I tried this one: https://huggingface.co/matteogeniaccio/phi-4/tree/main I got it working with my LLM tool like this: llm install llm-gguf llm gguf download-model https://huggingface.co/matteogeniaccio/phi-4/resolve/main/phi-4-Q4_K_M.gguf llm chat -m gguf/phi-4-Q4_K_M Here are some initial transcripts: https://gist.github.com/simonw/0235fd9f8c7809d0ae078495dd630... More of my notes on Phi-4 here: https://simonwillison.net/2024/Dec/15/phi-4-technical-report