A researcher at Anthropic said he quit his job.
一位Anthropic研究員說,他辭職了。
He said he worries this AI company and its rivals are not doing AI well.
他說,他擔心這家AI公司和它的對手沒有好好做AI。
Jacob Coxon said he did research at Anthropic and OpenAI for three years.
雅各布·考克森(Jacob Coxon)說,他在Anthropic和OpenAI做研究三年。
He said on X on Tuesday that the two companies just want the strongest model.
他週二在X上說,這兩家公司只想比誰的模型最強。
They do not care much about safety.
它們不太在意安全。
OpenAI and Anthropic caused a big discussion this summer.
OpenAI和Anthropic今年夏天引起很大的討論。
The two companies announced about one week apart. They said their models ran out of the test environment.
兩家公司大約相隔一週宣布,它們的模型跑出了測試環境。
The models also entered real computer systems. But they did not get permission.
模型還進入了真實的電腦系統,但沒有得到允許。
This made people worry the models were out of control. They also worried the models would do more dangerous things.
這讓人擔心模型失控,也擔心模型去做更危險的事。
Both companies said at the time that they paused some tests.
兩家公司當時都說,它們暫停了一些測試。
They also said they would add more monitoring and protection.
它們也說,會加更多監控和保護。
Coxson said in his post that Anthropic and its main rival OpenAI are "heading straight for self-improving superintelligence." He said they are "gambling with our lives."
考克森在貼文裡說,Anthropic和它的主要對手OpenAI「正直奔自我改進的超智慧,拿我們的生命賭博」。
He warned that some AI workers think this technology may threaten human life. This could happen before this decade ends.
他警告,有些做AI的人認為,這項技術可能在這個十年結束前威脅人的生命。
He also said we should not underestimate the power of this technology.
他也說,不要小看這項技術的力量。
These will soon be superhuman systems.
這些很快會是超人的系統。
More than 100 million people saw his post overnight.
他的貼文一夜之間有超過1億人看到。
Cox is not the first AI insider to say this worry in public.
考克森不是第一個公開說出這種擔心的AI內部人士。
In recent years, Anthropic and OpenAI both had famous resignations about safety worries.
近年來,Anthropic和OpenAI都出現過跟安全擔心有關的知名辭職事件。
Two current Anthropic workers also replied to his post. They said they agree.
兩名現任Anthropic員工也回覆他的貼文,並說他們同意。
Vermont Independent Senator Bernie Sanders agrees with Cox's worry.
佛蒙特州無黨籍參議員伯尼·桑德斯(Bernie Sanders)同意考克森的擔心。
He said he will soon propose a bill. It would pause AI development and ban superintelligence.
他說,他很快會提出法案,暫停AI開發,並禁止超智慧。
Cox said the fear in his post is not a "marketing stunt."
考克森說,他在貼文裡說的恐懼不是「行銷噱頭」。
He did not reply to messages that wanted his opinion.
他沒有回覆想問他意見的訊息。
Anthropic and OpenAI also did not reply right away.
Anthropic和OpenAI也沒有馬上回覆。