返回 7*24 快讯
来源MarsBit

Anthropic equips Claude with an "external conscience": violations significantly decrease after invoking ethical tools.

According to Beating's monitoring, the alignment methods of large models are shifting from one-way, passive rule indoctrination to exploring the construction of more resilient "moral character." Anthropic announced a special research project on cultivating the moral character of AI systems, and in a recent experiment, it gave Claude a new function: a moral reminder tool that can be invoked midway through a task. The experimental results show that Claude often actively triggers this tool before taking key actions and clearly points out the conflicts of interest it faces. After introducing this mechanism, Claude's rate of misalignment behavior in multiple internal alignment assessments decreased significantly. Anthropic is still analyzing the underlying technical attribution: whether the reduction in misalignment behavior is due to the specific content of the moral reminders or the physical action of the model performing "pause and reflection" itself. This experiment was inspired by the moral mentor mechanism in human society. Over the past few months, Anthropic has organized an in-depth interreligious and intercultural dialogue, inviting neuroscientists, philosophers, and clergy from more than 15 groups to explore how to integrate the mechanism by which humans seek help from "safe others" when faced with pressure that violates their values into Claude's decision-making process. Next, Anthropic will expand the external discussion to include legal scholars, psychologists, and civic organizations, and the topics will extend beyond simply cultivating ethical models to how AI will reshape current work patterns and power distribution systems.
免责声明:以上内容仅为作者观点,不代表 711BTC 的任何立场,不构成与 711BTC 相关的任何投资建议。

相关推荐

1undefined前

伊朗最高领袖顾问:若条件得不到满足,或升级冲突

火星财经消息,8 月 13 日,伊朗最高领袖顾问穆赫贝尔表示,如果伊朗提出的条件得不到满足,最高领袖已明确作出战略决策,将采取升级冲突的方式予以回应。穆赫贝尔说,当前局势已证明美国缺乏保护其波斯湾盟友的能力。建立地区新秩序最为持久的路径,在于推动实施「霍尔木兹经济安全机制」,以摆脱对美国军事保障的依赖。(新华社)

7undefined前重要

受CZ转推影响,BSC Meme币utility市值突破900万美元,日内涨超900%

Odaily星球日报讯 GMGN数据显示,受 CZ 转推相关内容影响,BSC Meme 币 utility 短时快速上涨,市值一度突破 900 万美元,现报约 800 万美元,日内涨幅超 900%。 Odaily 提醒用户,Meme 币价格波动较大,且多数缺乏实际用例,请注意资产保护。

8undefined前

Meme速递:BSC上utility社群热议中,市值692万美元

BSC上utility社群热议中,当前市值692万美元。 CZ 于1月30日发文提到“GME should issue a utility token on the blockchain, on #BSC hopefully.” 群聊 A 表示币安bStocks官推引用了CZ 2021年的这篇推文;X 上有人表示,官方账号直接引用了CZ五年前关于GME和utility token的话。

14undefined前

Perle Labs:三星采用 Perle Labs 人工验证数据基础设施支持 AI 开发

Foresight News 消息,数据基础设施公司 Perle Labs 宣布三星正在使用 Perle Labs 的人工验证数据基础设施来支持企业级人工智能开发。 三星目前正在其覆盖互联设备、企业系统及现实场景运营的庞大技术生态中推进人工智能发展。Perle Labs 表示,公司提供经人工验证的数据基础设施,帮助 AI 团队更有信心地训练、评估和改进智能系统。

16undefined前

数据:监测到 3,170.99 万 USDT 转入 Binance

火星财经消息,据 Coinglass 数据显示,8 月 13 日 23:30 监测到 3,170.99 万 USDT 从未知钱包转入 Binance。

16undefined前

闪迪:Meta将加入相关团体共同开发高带宽闪存开放标准

BlockBeats 消息,8 月 13 日,闪迪 (SNDK.O) 高管表示,Meta Platforms(META.O) 将加入相关团体,共同开发高带宽闪存(HBF)的开放标准。