Incentive gradients and The Midas Project’s theory of change
Why start an industry watchdog organization calling out irresponsible AI developers?
3
min read

Why start an industry watchdog organization calling out irresponsible AI developers?
Companies move along incentive gradients. Imagine this as a 3D landscape with peaks and valleys, downward slopes and upward climbs.
Companies move along this landscape. They want to follow the path of least resistance. They’re constantly moving in the easiest, cheapest direction, just as a ball is drawn toward rolling down a hill.
When it comes to growing quickly and making shareholders a boatload of money, this is great. But when it comes to making responsible and pro-social decisions, things get more complicated.
See, taking corporate social responsibility seriously is often costly and difficult, akin to pushing the company up a steep hill. At any moment, the company may be tempted to simply give up — to save themselves the time, energy, and money — and let gravity pull them downward in an endless race-to-the-bottom. The financial incentives are simply too strong for multi-billion dollar corporations to be expected to always do the right thing, first try, by default.
One role of government and civil society is to shift this incentive gradient.
For example, the potential sanctions imposed by regulators increase the costs of behaving irresponsibly — whether it’s polluting waterways or acting monopolistically — and this helps ensure that markets are serving the interests of everyone, not just corporate shareholders. In essence, it’s leveling the terrain of the incentive gradient, raising the valleys and lowering the mountains.
But regulations can’t address everything. They move slowly. They’re often reactive, rather than proactive. And ask anyone who has worked in politics: achieving bipartisan consensus on even the most bare-minimum of regulations can be a challenge.
That’s why nonprofit industry watchdog groups, like The Midas Project, have a critical role to play.
It’s only in the darkness that corporations feel comfortable cutting corners, taking risks, and neglecting social responsibility. If they knew there is a public interest group watching them, capable of bringing to light all the ways they are taking unnecessary risks, externalizing costs, and harming the world, the incentive gradient shifts. Acting irresponsibly becomes more costly. Acting ethically may indeed become the path of least resistance.
We fear that the current incentive gradient for AI developers is leading us toward an AI catastrophe, a valley which we find ourselves rolling down faster and faster every year. In their race to build smarter-than-human artificial intelligence, we’re already seeing AI companies cutting corners: rushing through safety testing, stealing copyright material, lobbying against regulation, and silencing whistleblowers.
The Midas Project has one goal: hold those companies accountable, and make it so that an AI catastrophe is no longer the path of least resistance — no longer the default outcome of a profit-driven race to the bottom.
How are we doing this? By shining a light on corporate misbehavior.
Research, updates, and insights from the frontlines of AI accountability.
We lead strategic initiatives to monitor tech companies, counter corporate propaganda.
5
min read
A pro-AI, dark-money group tied to David Sacks appears linked to a new astroturfing campaign
5
min read
SpaceXAI just released Grok 4.5. It may have broken California’s AI law in the process.
5
min read
A Pro-AI Super PAC's Secret Meme Sockpuppets

3
min read
The Midas Project Joins Coalition Warning about xAI’s Track Record in light of SpaceX’s IPO
The Midas Project, alongside a coalition including Encode, Legal Advocates for Safe Science and Technology, and Guidelight AI Standards, released "xAI: The Unpriced Risk in SpaceX's IPO."
Frequently asked questions
Have more questions? Our team is happy to help, contact us.
We engage in a combination of research, outreach, and public advocacy to ensure that AI companies are meeting public expectations, and living up to their past promises, when it comes to ensuring responsible AI development and deployment.
The most important component of our work is helping to identify and disseminate industry best practices for AI development. We review technical literature, regulatory guidance, and case studies to distill concrete measures—such as frontier-model risk assessments, red-teaming requirements, audit regimes, and whistle-blower protections—and advocate for the most important voluntary steps that companies can take today to ensure they are acting responsible.
We also monitor whether companies follow their stated policies and industry norms. When evidence shows back-tracking or inadequate controls, we document these gaps and publicly press for corrective action—mobilizing employees, customers, and civil-society allies until the company adopts the necessary safeguards.
Finally, we publicize our research to help ensure the public is aware of how AI developers stack up on safety and responsibility. We release concise scorecards, incident analyses, and memos so that regulators, investors, and the wider public can see how individual developers perform on safety and responsibility.
Various AI experts including Nick Bostrom and Stuart Russell have compared the development of advanced AI to the myth of King Midas.
According to the legend, King Midas once asked a powerful satyr to make it so that whatever he touched instantly turned into gold. At first, he was thrilled with his new powers. But the King soon discovered that he couldn’t touch food, water, or even his family without instantly turning them to metal. In other words, the sudden attainment of an incredible power with insufficiently well-specified goals and safeguards led to a terrible tragedy.
Much like King Midas, tech companies are now eagerly pursuing incredible wealth and power by developing artificial intelligence, a technology that will change our world forever. But how will we know that it is designed in alignment with our collective human values? If we misspecify even a single goal or safeguard for these systems, how will we prevent them from causing an incredible catastrophe?
In the words of Stuart Russell, “If you continue on the current path, the better AI gets, the worse things get for us. For any given incorrectly stated objective, the better a system achieves that objective, the worse it is.”
The Midas Project is a nonprofit organization founded in early 2024 by Tyler Johnston. Our work is supported by a small core team and a wider base of volunteers and supporters. We are a nonprofit, tax-exempt, 501(c)(3) organization that relies on donations from the public.
No. One of our central values is a pro-technology attitude.
Progress in technology has improved lives for millions of people around the globe (after all, without it, we wouldn’t have penicillin, air conditioning, or the internet). Artificial intelligence is already being used by millions to help improve medicine, education, and overall living standards. We believe this progress should continue, and we hope AI will be a positive force in the world.
However, we are also realists — and skeptical realists at that. We believe advanced AI systems may be a “dual-use” technology that can be used for harm as well. In order to avert social inequality, concentration of power, or AI-driven catastrophes, everybody needs to have a voice at the table when decisions about development and deployment are being made.
Currently, the vast majority of these decisions about the future of AI are being made in shadowy corporate boardrooms with little oversight and accountability. That’s why The Midas Project is committed to raising awareness about the risks of AI, and ensuring that global citizens are given a chance to make their voice heard.
If you’d like to get involved, consider signing up for our newsletter, joining as an official volunteer, or making a charitable donation today.
You can email us at info@themidasproject.com, or reach out via the form on our contact page.