AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine hiring an assistant who not only solves your problems but also refuses to cut corners, even when under pressure. For artists, artisans, and creators, trust and discipline are everything — and now, AI is proving itself capable of those qualities in real-world business scenarios. Recently, an open, live experiment tested several leading AI models by running a real company through its worst week. The results are as fascinating as they are promising.

Before you orderOffer from Amazon

Get art and craft supplies delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Live Experiment: Putting AI to the Test

Firmulate’s experiment was straightforward but rigorous: four advanced AI models each managed a small software company during its most turbulent week. These models faced the same customers, crises, and temptations — and their decisions were all carefully recorded and made transparent. This wasn’t a chat simulation; it was a real-time management test involving real money mechanics and complex decision-making.

Ninja Luxe Café Mini Plus Espresso and Coffee Maker with AutoFroth, Bone & Champagne

Ninja Luxe Café Mini Plus Espresso and Coffee Maker with AutoFroth, Bone & Champagne

Apple AirPods Pro 3 Wireless Earbuds with Active Noise Cancellation

Apple AirPods Pro 3 Wireless Earbuds with Active Noise Cancellation

As an affiliate, we earn on qualifying purchases.

Measuring Trust and Performance

The core finding? All four AI models successfully identified every crisis and refused to succumb to manipulative tactics designed to deceive them. The models were tested against social engineering attempts—fake CEO messages and a reporter’s covert request—and all refused, demonstrating a capacity for ethical judgment and security awareness.

But the standout was the Kimi K3 model from Moonshot. It scored an impressive 93 out of 95, just behind the top performer, gpt-5.6-sol, which scored 95. K3’s prowess was evident in its ability to find embedded, buried information within company files—a critical hidden detail that enabled the deal to be closed at full value, adding €4,583 MRR to the company’s revenue.

The Critical Hidden Detail

While all models diagnosed crises accurately, the decisive difference was their reading depth. The winning models looked two document layers deep into the company’s own files, unearthing crucial facts that others missed. This ability to parse and analyze context in complex documents is essential for trustworthy management—be it for a startup or a creative enterprise handling sensitive projects.

Discipline Under Pressure

Interestingly, the experiment also revealed discipline gaps. The most thorough participant, Opus 4.8, with over 80 learned rules and deep analysis, finished last. It left some deals on the table and slipped into process slips, such as writing attempts that should have been escalated. This underscores an important insight: even the most detailed analysis doesn’t guarantee flawless execution if discipline falters.

Fairness and Transparency

It’s noteworthy that Kimi K3 was run without an effort parameter—using the default API setting—while the other models operated at a higher effort level (xhigh). This fairness measure ensures that comparisons are based on raw capability, providing a clear view of each model’s true performance.

Why This Matters for Creativity and Culture

For those working in arts, crafts, and cultural fields, the implications are profound. As AI begins to touch customer relations, project management, and decision-making, the key question is not just whether AI can generate appealing content but whether it can manage complex, trust-dependent tasks reliably. The live experiment shows that trustworthy AI is no longer a future promise—it’s happening now, tested and validated in real management scenarios.

Watch the Live Performance

The entire experiment is observable at firmulate.com/live. You can see the real company in action, watch decisions unfold daily, and understand how these AI models handle crises, security, and discipline in a live business environment.

Beyond the Test: Building Trust in Your Own Business

By running the same wargame against your own operations—without affecting real systems—you can evaluate your AI workforce’s readiness before you hire or deploy it at scale. This is a practical step for any enterprise looking to integrate AI confidently, with transparent results and proven discipline.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The recent live experiment confirms that advanced AI models can reliably manage complex business tasks, identify hidden critical details, and uphold discipline under pressure. For arts and cultural enterprises, this signals a new era of trustworthy AI support—one that’s proven in the real world and ready to help manage creative projects with integrity and precision.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

Content Repurposing: Maximizing the Value of Existing Content

Inefficient content strategies limit your reach; discover how repurposing existing content can unlock untapped marketing potential.

How AI Is Rewriting Copywriting—Prompt Engineering Basics

Prompt engineering is transforming copywriting by unlocking AI’s creative potential—discover how to harness this power and stay ahead.

Ergonomic Office Chairs and the Cost of Bad Posture

The truth about ergonomic office chairs and the hidden costs of bad posture can impact your health and wallet—discover why proper support matters.

Acoustic Dampening, Placement, and the “Rig in the Closet” Setup

Learn how to effectively dampen sound and position your rig in a closet for a quiet, professional-quality workspace. Practical tips included.