Overmind基于用户生产trace微调小型开源模型，并用同一真实任务构建eval与现有模型对比。其公开对比为经Overmind调优的Qwen3.5 9B对标GPT5.6 Luna，公司称法律合同中虚构条款减少20至30倍、逐字引用条款准确率提升7倍。最终产出用户拥有权重的小型开源模型，可托管在Overmind或自行运行。
A frontier model reading a contract will sometimes cite a clause that isn't there.
Overmind fine-tunes a small open model on your own production traces, then scores it against your current model on evals built from those same real tasks.
Their published comparison is Qwen3.5 9B tuned through Overmind against GPT5.6 Luna. The company reports 20 to 30x fewer phantom clauses in legal contracts and 7x better accuracy at quoting a clause word for word.
Here the observability layer and the training layer share the same data. The traces that show you where the agent fails become the dataset, and the evals are built from real tasks rather than a public benchmark.
The output is a smaller open model with weights you own. You can host it on Overmind or run it yourself.
Overmind turns anyone into an AI lab. • Builds a context graph from code and traces • Curates training and eval datasets • Evaluates prompts and models • Trains smaller, specialized models https://github.com/overmind-core/overmind在 X 查看被引用的帖子
来源：Rohan Paul · x.com