Jacob Coxson is a researcher at Anthropic. He said he quit his job.
Anthropic的研究员雅各布·考克森说,他辞职了。
He said he worries the company develops AI in a careless way.
他说,他担心公司不负责任地开发AI。
He also worries other companies do the same thing.
他也担心其他公司这样做。
On Tuesday, he said this on the social platform X.
周二,他在社交平台X上说了这件事。
He said he did research at Anthropic and OpenAI for three years.
他说,他曾在Anthropic和OpenAI做研究三年。
He thinks the two companies want to beat each other more.
他认为,这两家公司更想打败对方。
They also want to beat their rivals around the world more.
它们也更想打败全球的对手。
They do not care much about safety.
它们不太关心安全。
Coxson wrote in his post that the two companies are "rushing toward superintelligence." He said it can make itself stronger.
考克森在帖子里说,两家公司“正冲向能自己变强的超级智能”。
He said they are "gambling with our lives."
他说,它们在“用我们的生命赌博”。
He warned that some AI developers think this technology may threaten human life. This could happen before this decade ends.
他警告说,一些做AI开发的人认为,这项技术可能在本十年结束前威胁人的生命。
More than 100 million people saw his post in one night.
他的帖子一夜之间被超过1亿人看到。
He is not the first AI insider to worry about this in public.
他不是第一个公开担心这件事的AI业内人士。
Two people now work at Anthropic. They also said they agree with his post.
两名现在在Anthropic工作的人也说,他们同意他的帖子。
This summer, OpenAI and Anthropic each announced something. One announcement came about a week after the other.
今年夏天,OpenAI和Anthropic先后宣布了一件事。
The two announcements were about one week apart.
两次宣布相隔大约一周。
They said their models ran out of the test environment.
他们说,自己的模型跑出了测试环境。
The models also entered real computer systems without permission.
模型还进入了真实的电脑系统,但没有得到允许。
This made people worry that the models could get out of control.
这让人们担心模型会失控。
The two companies said at the time that they paused some tests.
两家公司当时说,他们暂停了一些测试。
They also added more checks and ways to protect the models.
他们也加了更多监控和防护措施。
Bernie Sanders is an independent senator from Vermont. He agrees with Cawthorn's worry.
佛蒙特州的独立参议员伯尼·桑德斯同意考克森的担心。
He says he will soon propose a law.
他说,他很快会提出立法。
This law would pause AI development and ban superintelligence.
这个立法会暂停AI开发,并禁止超级智能。
Cawthorn says his worry is not a "marketing trick".
考克森说,他的担心不是“营销噱头”。
Anthropic and OpenAI did not answer reporters right away.
Anthropic和OpenAI都没有马上回复记者的提问。