o4-mini

Public discussion, not a rating submitted on Rate My AI.

I had an interesting one yesterday where I was building out some code on the Unreal engine and I gave o4-mini-high links to the documentation, a class header, and a blog with an example project. I asked it to create some boilerplate and it presented me with a class function that I knew did not exist; though like many hallucinations it would have been very beneficial if it did. So, instead of just pointing out that it didn't exist and getting the usual "Oh you're right, that function does not exist so use this function instead", I asked it why it gave me that function given that it has access to the header and an example project. It doubled down and stated that the function was in the header and the example project, even presenting a code sample it claimed was from the example project with the fake function. It felt like a step up from the confidently incorrect state I'd seen before to a level where if it weren't for the fact that I'm knowledgeable enough about the class in question (or my ability to be able to check) then I'd possibly start questioning myself.

Public discussion, not a rating submitted on Rate My AI.

Testing the limits of vibe coding. Created a programming language 100% via prompting a o4-mini-high, but did carefully review the code. https://github.com/ryanmcdermott/spress

Public discussion, not a rating submitted on Rate My AI.

It's the naming. He is confusing 4o/4o-mini with o4-mini, the latter is a pretty strong model and it's also one of the newest. Oh and it's cheaper than the non-mini 4o.

Public discussion, not a rating submitted on Rate My AI.

Even o4-mini (free) uses web searches and runs Python scripts very eagerly. I'm not sure how long they'll be able to afford giving all of that away.