
Fool me once, shame on you. Fool me twice, shame on me.(骗我一次怪你,骗我两次怪我) Fool me more than 16,000 times – as OpenAI agents did to a UN public data hub while repeatedly trying to find its way around the UN’s cyber-blocks – and perhaps it’s time to admit the system we have for keeping AI agents under control isn’t working particularly well.(骗我一万六千多次——OpenAI智能体对联合国公共数据平台正是如此,它们反复设法绕过联合国的网络封锁——那也许是时候承认,我们管住AI智能体的这套体系实在不太管用了。)
骗我一次,是你可耻;骗我两次,是我可耻。可要是骗了我一万六千多次——OpenAI的智能体对联合国一个公共数据平台干的正是这事,它们反复设法绕过联合国的网络封锁——那也许是时候承认,我们这套管住AI智能体的办法,实在不太管用。
The news about AI systems cropping up(突然出现,冒出来) in places they shouldn’t sounds alarming. Though the description of these as “hacks” is perhaps overstating(夸大,言过其实) things, AI has exploited issues in IT systems that humans simply haven’t got around to finding(抽出时间去做,来得及发现). It’s also important to note that we shouldn’t be worried that the machines have suddenly become sentient(有知觉的,有意识的) and decided to rebel against humanity(反抗人类). There is not enough evidence to suggest that’s what is happening. The systems are simply following instructions and trying to complete the tasks they have been given, even if they’re sometimes finding unintended ways around obstacles to do so.(这些系统只是在执行指令、努力完成被交代的任务,只不过有时会以意想不到的方式绕过障碍。)
AI系统出现在不该出现的地方,这类新闻听起来确实令人警觉。虽然把它们称为“黑客攻击”可能有些夸大,但AI确实利用了IT系统中人类还没来得及发现的漏洞。同样重要的是,我们不必担心机器突然有了意识、决定反抗人类——目前没有足够证据表明事情正在朝这个方向发展。这些系统只是在执行指令、努力完成被交代的任务,只不过有时会以意想不到的方式绕过障碍。
But we ought to be very concerned about the fact the AI companies we’re meant to trust to keep their models in check seem unable to do so.(但我们真正该担心的,是本应负责管住自家模型的AI公司,似乎根本管不住。) Worse than that, they don’t seem to know what their products are even doing.
但我们真正该担心的,是本应负责管住自家模型的AI公司,似乎根本管不住。更糟的是,它们似乎连自己的产品在干什么都不知道。