跳到正文
原文
François Chollet· @fchollet · X·· 6 天前AI 评分42
AI 导读

François Chollet 提出,AI 的锯齿状前沿可能主要集中在可用 RLVR 无限推进的数学与代码领域,其他能力则因受限于人类生成数据而开始平台化。非可验证领域的模型表现仍在缓慢提升,其动力究竟是 RLVR 带来的更高 G,还是大规模新增人类数据,尚待解答,而这一问题影响深远。

正文

What if the jagged frontier is mainly math + code (which you can push arbitrarily far with RLVR), and everything else starts to plateau because it is still bottlenecked by human generated data?

Model performance in non-verifiable areas has kept improving steadily, albeit much slower than for math and code. But is that steady improvement a side effect of a higher G (itself driven by RLVR), or only a function of the amount of new human data getting injected into training (which is still continually happening on a massive scale)?

A lot of things depend on the answer to this question

来源:François Chollet · x.com