跳到正文
原文
elvis· @omarsar0 · X·· 10 天前AI 评分39
AI 导读

OpenAI DevDay 分享指出,构建智能体应用时优化成本与性能的四大关键杠杆为 prompt caching、reasoning effort、programmatic tool calling 与 batch request。相关细节可查阅 OpenAI 开发文档,并应使用 evals 对这些优化手段进行测量。

正文

Sharing some notes from OpenAI DevDay in parts.

The first part matters, since it's on everyone's mind.

How do you optimize for cost and performance?

If you are building agentic applications today, these are 4 of the most important levers you absolutely must try:

- prompt caching
- reasoning effort
- programmatic tool calling
- batch request

The OpenAI dev docs have plenty of information, but these alone are good starting points for optimizing your agentic applications.

Familiarize yourself with these and measure them with evals.

来源:elvis · x.com