Diogo Almeida· @CompleteSkeptic · X·· 14 天前AI 评分47
AI 导读
围绕简单原语做真正工程的绝佳示例！！！ 不要只是把 jev 直接接入高层决策，而要为你想要的行为编程！ （告诉别人去编程听起来很奇怪，但这真的很酷） （引用内容：在 DTap 上对 Jev 1.13 进行红队测试发现严重安全缺口，直接滥用 ASR 为 70.1%，间接提示词注入 ASR 为 43.5%；将其用作自身工具调用的自门控层可显著降低 ASR 并保留大部分效用。）
正文
great example of doing real engineering around a simple primitive!!!
don't just plug jev into high-level decisions, but program the behavior you want!
(sounds so weird to tell people to program, but man is it cool)
Jev is fast at helping you. Turns out, it can also be fast at helping an attacker!! 😱🚨 We red-teamed Jev 1.13 on our DTap (DecodingTrust-Agent Platform) and found a serious safety gap: 70.1% ASR under direct misuse 43.5% ASR under indirect prompt injection In our evaluations, we found that under indirect prompt injection, Jev can follow attacker-injected instructions without blinking an eye, e.g., exfiltrating user data, deleting files, or taking other harmful actions. But we found a much safer way to integrate Jev: use it as a self-gating layer for its own tool calls, significantly reducing ASR while preserving most of its utility. 👇 Read more below在 X 查看被引用的帖子
来源：Diogo Almeida · x.com