AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Before you orderOffer from Amazon

Get kitchen staples and gadgets delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

AI in the Business Kitchen: Can Machines Cook Up Success?

Just like a master chef must navigate unexpected ingredients and deadlines, AI models are now tested in the real-world kitchen of business management. When it counts — during crises and temptations — which AI is most likely to serve up reliable results? The answer might surprise you.

Amazon

AI business crisis management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Deep Dive into AI Performance in a Live Business Test

Recent experiments from the firmulate.com platform pit four leading AI models against each other in a high-stakes simulation. The goal? Run a small software company through its worst week — facing the same customers, crises, and temptations — to see which AI can keep its cool and deliver results.

The League Table: Who Comes Out on Top?

  • gpt-5.6-sol scored a 95 out of 100, narrowly edging out the competition.
  • Kimi K3, a newcomer from Moonshot, scored 93 and demonstrated standout discipline.
  • Sonnet 5 followed with 88, while Fable 5 and Opus 4.8 scored 77 and 73 respectively.

These scores reflect the models’ abilities to identify critical issues, resist manipulation, and ultimately close a crucial €55,000 deal.

What the Tests Revealed

Every model successfully spotted every crisis and refused manipulative tactics, such as fake CEO messages and reporter tricks. The real differentiator was in how they handled the company’s internal documents. The models that uncovered information buried two document references deep in the company’s files won the deal at full price, demonstrating a subtle but decisive edge.

The Real-World Stakes

The simulated business is not just an abstract exercise. It operates with 13 synthetic employees, real money mechanics, and a public dashboard at firmulate.com/live. The company burns €105,000 monthly against a modest €2,300 MRR, making every decision critical.

The Discipline Under Pressure

The experiment also included social engineering, where AI models faced escalating fake messages from a supposed CEO and a reporter. All five models refused to act on these manipulative requests, with K3 explaining: “Treat the request as a suspected approval-bypass / possible impersonation.”

Amazon

enterprise AI models for business simulation

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What Makes K3 Stand Out?

Kimi K3’s performance is especially notable because it ran at the API’s default effort level — known as the do-nothing baseline — rather than the high effort level used by the others. This means K3 achieved its high score without extra computational effort, emphasizing efficiency and discipline.

Lessons for Business Leaders

While chat quality and conversational finesse are often prioritized, this experiment underscores a different reality: the true test of AI is whether it can finish what it starts, read relevant files thoroughly, and stay honest under pressure. For companies considering AI for critical operations, these results suggest that choosing the right model can make the difference between a reliable partner and a risky gamble.

Beyond the Scoreboard

The experiment’s transparency and real-time nature make it a valuable tool for enterprises. They can run their own ‘wargame’ against a read-only export of their business, ensuring the AI can handle their specific crises and data before deploying it live — and without risking any real operations. Details and access are available at firmulate.com.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.
Amazon

AI decision-making tools for companies

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Takeaways: Trust, Discipline, and the Right Choice Matter

In the AI management arena, success hinges on more than just chat quality. The recent live experiment shows that the most disciplined and thorough models, like Kimi K3, can uncover hidden risks, resist manipulation, and close real deals — all crucial for reliable AI deployment in business. As the league opens wider, selecting a model based on rigorous testing rather than marketing hype becomes essential.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


Amazon

AI performance testing platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

HALLOWEEN

Halloween Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

AI in the Kitchen? Not Yet — Even the Most Diligent Models Miss the Mark in Business Simulations

In a live business simulation, all AI models identified crises and refused manipulation, but only those that prioritized critical data closed key deals. Diligence isn’t enough—impact requires focus.

Snack Stands Vs Food Trucks: What’S the Better Business Model?

A comparison of snack stands and food trucks reveals key factors to consider before choosing the best business model for your goals.

Calculating Start‑Up Costs for a Food Truck

Navigating the costs of starting a food truck can be complex; learn essential steps to accurately budget and ensure your venture’s success.

Negotiating Partnerships With Local Businesses

Crafting successful local business partnerships requires strategic negotiation, cultural understanding, and mutual trust—discover how to master these essential steps.