跳到正文
原文
Simon Willison·· 19 小时前AI 评分45

OpenAI Agent Security 的 @joedaroo 谈能力突增与安全准备

Quoting @joedaroo

AI 导读

OpenAI 的 @joedaroo 称,模型在 cyber、swarming、留言板等事件相关能力上跃升又快又突然,惊讶亦不足以形容。这类跃升造成极难应对的问题:安全不能只靠加固系统,还要随时间改变文化与人员。他希望全球组织审视人员、系统与流程能否承受 AI 能力突增,并备好事件响应、沟通和可立即投入的人员。

正文

28th September 2026

To say that we were surprised at the jump and suddenness of the capabilities of our models when it came to “cyber” or “swarming” or “message boards” or anything else related to the incidents is an understatement. Security posture takes time to develop. It’s not just about hardening the systems at play; you have to ingrain it in the culture of the company. The literal people themselves in your organization have to change and evolve with it. These jumps in capabilities were so fast and so sudden that they created an extremely difficult problem. [...]

So today my hope is that everyone around the world can look at their own organization and say: how can I deal with a surprise or a sudden jump in AI capability? Are my people, my systems, or my processes resilient to surprises? Do my teams know what to do when something goes wrong? Do I have the right incident response? The right comms and messaging? Do I have the right people ready to go when capabilities jump?

— @joedaroo, Agent Security at OpenAI, identity confirmed by The Information's Rocket Drew

来源:Simon Willison · simonwillison.net