
In my two years as attorney general(总检察长), I spent more time working on national security than any other issue. The range and gravity of the threats posed to our nation are multifold(多方面的、成倍的), from terrorism, armed conflicts and nuclear proliferation(扩散、激增), to the impacts of financial insecurity and the climate crisis. All profound challenges, yet ones our superb intelligence and defence communities are well placed to(有能力、有条件做某事) counter. The risk from AI is of an altogether different magnitude, not only in scale, but also because there is a limited time window to address it.(AI风险完全不在一个量级,不仅规模不同,还因为应对它的时间窗口有限。) The risk is difficult to overestimate: it poses an existential risk to humanity. The lights are flashing red and we must act now before it’s too late.
在我担任总检察长的两年里,我在国家安全事务上投入的时间超过任何其他议题。我国面临的威胁范围广、程度重,从恐怖主义、武装冲突、核扩散,到金融不安全的影响和气候危机,不一而足。这些都是深刻的挑战,但我们出色的情报与国防体系完全有能力应对。人工智能带来的风险则完全不在一个量级上,不仅规模不同,还因为应对它的时间窗口有限。这种风险再怎么高估也不为过:它对人类构成存在性风险。红灯已经在闪,我们必须在为时已晚之前行动起来。
Although the extraordinary threats posed by AI have long been flagged by those closely involved in its creation, it was not until very recently, after the disclosure of the Hugging Face hack and the resignation of Jacob Coxon from Anthropic, that the issue at last started to gain traction in the public discourse.(尽管深度参与AI研发的人士早已指出其巨大威胁,但直到最近,在“拥抱脸”遭黑客攻击曝光、雅各布·考克森从Anthropic辞职之后,这一问题才终于开始在公共讨论中获得关注。) This moment is an opportunity, and to capitalise on(利用、抓住(机会)) it we desperately need increased urgency in international coordination to regulate frontier(前沿、边界) AI. There must also be meaningful public engagement with how AI should be shaped to benefit humanity, rather than entrench(巩固、使根深蒂固) the power of a few. We cannot leave this to China, the US and big tech – we must all demand a voice in the debate.
尽管深度参与AI研发的人士早已指出其带来的巨大威胁,但直到最近,在“拥抱脸”遭黑客攻击事件曝光、雅各布·考克森从Anthropic辞职之后,这一问题才终于开始在公共讨论中获得关注。这一刻是一个机会,而要抓住它,我们迫切需要加强国际协调的紧迫性,以监管前沿AI。同时,还必须让公众切实参与讨论AI应当如何被塑造,使其造福人类,而不是巩固少数人的权力。我们不能把这件事交给中国、美国和大科技公司——我们所有人都必须在辩论中发出自己的声音。
AI has enormous potential benefits for us all. It will be the source of mind-blowing(令人惊叹的) advances in science and medicine, and offers hope for empowerment of some of the world’s most dispossessed(被剥夺财产的、一无所有的) people. Yet the risks we are now facing are truly staggering(令人震惊的、巨大的). I would put them in two very broad categories. The first is existential risk: quite literally the possibility that AI could kill billions, either because it enables terrible people to do terrible things – such as design and deploy biological weapons – or because AI itself determines it is more efficient to dispense with humans.(第一类是存在性风险:字面意义上,就是AI可能杀死数十亿人的可能性——或者因为它让坏人得以做坏事,比如设计并部署生物武器;或者因为AI自己认定,消灭人类更有效率。)
AI对我们所有人都具有巨大的潜在益处。它将在科学和医学领域带来令人惊叹的进步,也为世界上一些最受剥夺的人群带来赋权的希望。然而,我们如今面临的风险确实令人震惊。我将其归为两大类。第一类是存在性风险:字面意义上,就是AI可能杀死数十亿人的可能性——或者因为它让坏人得以做坏事,比如设计并部署生物武器;或者因为AI自己认定,消灭人类更有效率。