跳到正文
原文
Rohan Paul· @rohanpaul_ai · X·· 12 天前AI 评分56
AI 导读

Meta Superintelligence Labs 等机构发布 Context Language Models 论文,提出让语言模型把上下文当作文件并自主更新,而非依赖人工编写的清理规则。

正文

Meta dropped a great paper.

AI agents perform better and cost less when they manage their own context, so stop hard-coding the rules for what they keep.

Right now, most AI agents follow rules you write to decide what to forget when their context fills up, like "summarize everything when it's full."
This paper shows you can delete those rules and let the model clean up its own context, and it does a better job with less compute, even with today's models and no training

Since the model understands the task, it can judge what still matters, keep exactly that, and throw out the rest.

On a deep-research benchmark, it scored 11.4% higher than Codex-style summarization while using 21.5% less compute.

For long-running agents, let a strong model manage its own context before writing more cleanup rules.

引用Rulin Shao@RulinShao
‼️The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA! Introducing 🩵Context Language Models (CLMs)🩵 - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness
在 X 查看被引用的帖子

来源:Rohan Paul · x.com