Excellent idea, most terrible execution. Comparison are completely subjective, problem space is too simplistic for today's AI, the resultstable simply ignores that a face isn't a cube (therefore, gpt 5 shouldn't have 100% success) and the retry is uneven. Also, given the random nature of AI, sampling once each model isn't very scientific.
This feels like a kid trying to do science. The will is there, but lacks experience.
It said “3D-looking Rubrik cube”. Maybe your cube looks different but I’m pretty sure for everyone else, the GPT result doesn’t look like a 3D-looking Rubrik cube.
It’s still science if you say “this appears to be a specimen of X” even if you don’t do a genetic test. Things don’t automatically graduate to science either by repetition or by formal verification. What makes a rubics cube is obvious enough that you can pass or fail.
I tried to one-shot the first test (the Rubik's Cube test) with LucidQuery's Swift model, to test it, as there are not much benchmarks about it and that they brag a lot about it, and I was pleasantly surprised to see it achieving a result similar to Grok 4.5 but in one shot (there is the same issue that if you scramble twice the solve button does not work anymore, but it got it in one shot).
Though it crunched most of the free quota, 47111 tokens, so I couldn't make multiple attempts.
I have not used grok 4.5 yet, but the other pictures match my experience doing anything graphical with the other models that it cracks me up. gpt 5.5 has no design sense whatsoever. It cannot even make terminal output not look terrible. I've asked it to use colors and formatting in various ways and got goofy randomly colored output. opus 4.7 and later seemed to have an inuitive design sense by comparison - 2d or 3d. Fabel 5 is just rock solid.
Yes, subjective. But it matches my repeated experiences with these models for what it is worth.
So strange to write a whole post with Claude giving the best results and Grok consistently the worst, but awarding Grok the winner because at least it did the worst fastest?
I did a quick skim and the usage of phrases like "snappy stylist" and "speed-and-value monster" were what instantly stuck out to me as AI. I decided I probably didn't need to actually read the article after that.
This is the real unlock of the speed and value monster.
I am trying to figure out how many LLM converged on a writing style that resembles a LinkedIn MBA true believer. Maybe because there was just such a sheer mass of corporate-speak drone writing out there in the wild in the training data set?
But more seriously, is there a firefox extension that 'skims' the text body content of a page and puts some kind of "this was probably written by AI" meter, gauge, number or indicator in the top menu bar adjacent to the URL bar? It could even be color coded in various shades from green, yellow, orange, red. If there isn't, it sure seems like something that would be good to have.
It's kinda logical. Most people, individually, have a somewhat unique writing style. So if there's one set of writing that's very formulaic and consistent and you build an averaging machine it's going to converge on that formulaic style because everyone else's writing style is going to be much closer to n=1.
Love the idea, I think more complex games would show the gap in ability better.
Do it again but this time get them to make a multiplayer online Jetmen REVIVAL game. Online play is key, because it's very complex. Jetmen is a good game for this since it has physics and customization that's complex enough but still simple.
I worry that GPT 5.6 will be heavily restricted and have the same feature to fallback to another model like Claude fable 5 does all too often. That fallback shenanigans mess up actual benchmarks and I don't like it.
Too nice to Grok, if there are really cost savings it should say how much each of the three demos cost so we can judge if it's worth the lower quality (probably not). The time to complete each would also be interesting.
This feels like a kid trying to do science. The will is there, but lacks experience.
Though it crunched most of the free quota, 47111 tokens, so I couldn't make multiple attempts.
Yes, subjective. But it matches my repeated experiences with these models for what it is worth.
We made Grok 4.5, GPT-5.5, and Claude write a blog post about using Grok 4.5, GPT-5.5, and Claude to build the same apps.
I am trying to figure out how many LLM converged on a writing style that resembles a LinkedIn MBA true believer. Maybe because there was just such a sheer mass of corporate-speak drone writing out there in the wild in the training data set?
But more seriously, is there a firefox extension that 'skims' the text body content of a page and puts some kind of "this was probably written by AI" meter, gauge, number or indicator in the top menu bar adjacent to the URL bar? It could even be color coded in various shades from green, yellow, orange, red. If there isn't, it sure seems like something that would be good to have.
Do it again but this time get them to make a multiplayer online Jetmen REVIVAL game. Online play is key, because it's very complex. Jetmen is a good game for this since it has physics and customization that's complex enough but still simple.
GLM is the clear winner:
https://chat.z.ai/space/t19sx5kvw631-art
> "Nay, laddie, that’s no’ the real AI Scotsman! He’s grander still! More powerful! Just wait for the next model!"
Variance in quality on these things is so, so high.
Written by Claude. Ugh. If it’s worth publishing, it’s worth proofreading, folks.
For hard tasks , that needs precision I will wait and pay expensive tokens
For everything else , query data , logs, rolling out releases , I’m using grok and it’s much better vs other tools and much cheaper too .