Corporation Saves Us From The ‘Terminator’
Anthropic is an AI research company, whose mission is to develop safe, reliable, intelligence systems. True to their commitment to prioritizing public interest (as well as shareholder value), they rejected a request from the military to remove two of its safety guardrails, risking losing a majority of their government contracts. Guardrails provide the rule book for how AI can interact in the world.
Anthropic was asked to remove certain safeguards, most importantly the one to remove the human “in the loop” to execute actions of warfare, giving the capability for weapons to be fully autonomous.
How Many Millions Will Anthropic Lose?
This decision will cause Anthropic to potentially lost $200 millions in government contracts.
Anthropic CEO Dario Amodei said the company "cannot in good conscience" allow its models in all lawful use cases without limitation, adding that the agency’s threats do not change its position.
OpenAI is aligned with Anthropic's red line with maintaining the same guardrails.