EN ▼
Favorites
My Favorites
View All
Market Cap Price 24h%

Disclaimer: Content does not constitute investment advice. Trading involves risks—please invest with caution!

Anthropic 选择埃森哲作为 AI 减速计划的嵌入式评估机构

2026-09-20 20:12:19
Bookmark

Anthropic 选择埃森哲作为其首个“嵌入式评估者”,以配合 CEO 提出的放缓前沿 AI 发展计划

Anthropic 已选定埃森哲(Accenture)作为其首个“嵌入式评估者”。这一举措与 Anthropic 首席执行官达里奥·阿莫迪(Dario Amodei)近期提出的在安全措施跟上之前放缓前沿人工智能发展的提议密切相关。该合作旨在将独立测试更紧密地融入先进人工智能系统的构建和部署流程中——Anthropic 认为,这是降低灾难性伤害风险所必需的方法。

此公告紧随阿莫迪于 9 月 12 日发表的关于以更安全、更缓慢的步伐推进 AI 进步的呼吁之后。他的论点核心在于:AI 系统能够改进其他 AI 系统。随着模型在创建下一代模型方面变得愈发熟练,开发过程可能通过递归式自我改进而加速——这种速度有可能超越人类的监督能力。

关键要点

  • Anthropic 与埃森哲建立合作伙伴关系,由其担任首个嵌入式评估者,负责进行模型评估和红队测试。
  • 阿莫迪在 9 月 12 日的提案中强调,需要拥有“类员工”权限的独立评估者,以便更有效地测试安全护栏。
  • 由于目前尚不存在专门针对独立评估的资金机制,Anthropic 预计将在这一早期阶段直接投入资金。
  • 该协议为非排他性合作,Anthropic 计划在接下来几周内宣布更多的评估者人选。
  • 根据 Anthropic 的公告,Anthropic 和埃森哲预计在未来五年内各自至少投资 10 亿美元。

为何“嵌入式评估”处于 Anthropic 安全计划的核心

阿莫迪的提案揭示了一个核心问题:随着系统提升构建下一代 AI 的能力,AI 进步的速度已经“急剧加快”。在他的描述中,这种反馈循环——通常被称为递归式自我改进——可能使强大的系统进化速度快于社会理解和控制它们的能力。

为解决这种不匹配,提案的第一步要求授予独立评估者相当于内部团队的访问权限。Anthropic 表示,它此前已承诺朝这一方向努力,而与埃森哲的合作被定位为将其具体化的早期且切实的方式。

在其公告中,Anthropic 将嵌入式评估描述为包括模型评估和红队测试、运行对齐评估以及测试安全护栏的工作。由于嵌入式评估是一个新概念,Anthropic 也警告称,具体的实施细节仍在制定中。

埃森哲将主导首次嵌入式评估工作

Anthropic 表示,通过与埃森哲的人工智能业务部门 Faculty 建立合作伙伴关系,正在向其早前的承诺迈进。该公司对嵌入式评估者的既定目标包括:

  • Evaluate models and perform red team testing
  • Conduct alignment assessment
  • Safety barriers for test models

According to the announcement, Anthropic and Accenture expect to each invest at least US$1 billion on the project over the next five years. This investment commitment emphasizes that embedded evaluation is seen as a continuous capability that needs to be expanded simultaneously with cutting-edge model development, rather than a short-term audit task.

Accenture said that Faculty has extensive experience in testing and evaluating models for large manufacturers and is good at building complex systems that ensure safety and ethics from the beginning of design. Previous reports have also highlighted the collaboration and Accenture's focus on building evaluation capabilities, as cited by Yahoo Finance.

Funding evaluators and maintaining independence remains a challenge

One of the more operational aspects of Anthropic's announcement is the way in which it finances its expected work. Anthropic pointed out that there is currently no independent evaluation funding system. It suggested that in the long term, such work could be supported through joint funds or government sources, but also acknowledged that time was of the essence.

Given the urgency, Anthropic said it would directly fund Accenture's embedded evaluation efforts at this stage. The company also emphasized that the partnership is non-exclusive and expects to announce more assessors in the coming weeks. This is important for investors and builders because it shows that Anthropic is trying to avoid relying on a single evaluator and instead build a broader ecosystem of independent oversight.

嵌入式评估在生产过程中能否保持真正的独立性,可能会成为行业关注的关键问题。Anthropic 任命多名评估者的计划可能有助于缓解这一风险,通过引入多种视角,减少评估沦为狭隘定义的内部职能的可能性。

行业反应凸显了围绕放缓 AI 发展的政策张力

阿莫迪 9 月 12 日的提案并非孤立事件。当时的报道显示,主要科技领袖之间对于是否应放缓 AI 发展以应对安全问题存在分歧。据报道,OpenAI 首席执行官 Sam Altman 和 SpaceX 首席执行官 Elon Musk 对阿莫迪的观点持积极态度,而英伟达(Nvidia)首席执行官 Jensen Huang 则认为,旨在放缓发展的监管并非必要。

这种张力反映了一场超出单一公司范畴的更广泛辩论:一些领导者认为,额外的约束是确保安全措施跟上进度的唯一途径;而另一些人则认为,重点应放在技术安全措施上,而非进度控制。Anthropic 的下一步行动——确立一名嵌入式评估者并对其进行大量资助——发出信号表明,至少在现阶段,该公司正在追求一种具体的评估机制,而不是仅依赖公共政策或抽象的承诺。

后续观察重点

随着 Anthropic 努力确定嵌入式评估在实际操作中如何运作,该行业的当务之急是看这种方法是否能超越单一试点评估者规模扩大,并作为一种独立的监督形式保持可信度。读者还应关注 Anthropic 额外评估者的时间表和标准,因为非排他性计划可能决定嵌入式评估是成为行业标准,还是仅仅是一项定制化的努力。

Disclaimer:

All content published on this website, including hyperlinks, related applications, forums, blogs, and other media accounts, originates from third-party platforms and their users. CoinMarketInsight makes no representations or warranties of any kind regarding the website or its content. All blockchain-related data and materials are provided for informational and research purposes only and do not constitute financial, legal, or investment advice. Users and third parties are solely responsible for the content they publish. CoinMarketInsight shall not be liable for any losses arising from the use of this website. You should exercise caution and conduct your own independent research, review, analysis, and verification before making any decisions.

Read Full Article
More News
TOP

TOP