跳到正文

#多模态

今日 12 条
10月5日周一
  1. Hacker News:AI 热帖33

    DeepSeek V4.1 Flash 操作网页版 Paint 画肖像遇挫:AI 智能体视觉与动作能力测试

    Matthew Berman 测试 DeepSeek V4.1 Flash 操作网页版 Microsoft Paint 复刻头像,成品可辨认但高度抽象,缺少五官细节与叠层笔触。对比 Google Astra 能用重叠笔触构建明暗与纹理,DeepSeek V4.1 Flash 只会铺大色块,暴露其在智能体精细运动控制与时空推理上的局限。

  2. Aravind Srinivas41

    你可以在 Computer 中构建自定义垂直 AI 应用,例如:结合 3D 视图和卫星视图猜测图片的空间位置。

    引用Computer@AskPerplexity

    Computer built a GeoGuessr LLM that poinpoints the location of an image, and shows all of its thinking steps. It used the Perplexity SDK for web search, local place lookups, source page retrieval, and visual clue extraction. It also used browser control to set up a Cesium account and API key for the 3D globe and satellite imagery.

  3. Hacker News:AI 热帖57

    GPT-6 Astra 用六小时破解 217 年前拿破仑战争密码

    SentinelOne 工程师 Carter Church 使用 GPT-6 Astra,在六小时内破解了一段 217 年前拿破仑战争时期的未读密码。该密码长期列于 Cryptiana 的 Unsolved Historical Ciphers 列表,模型仅接收一张图像和一个提示词,就解出 24 行自定义符号并还原失传的军队命令;Church 的博客提供可复现解读过程的完整解决方案包和脚本。

  4. elvis40

    作者受 Karpathy 关于 LLM 输出形式的讨论启发,实验一种连接高层智能体与类 Notion 灵活页面的通用界面,支持嵌入 artifacts、文本、视频、可视化讲解及 LLM 可生成的各类内容。该界面可按任务智能输出 artifacts 而非默认文本,覆盖代码审查、笔记、写作、研究、原型与模型设计等场景,降低人机协作摩擦,但作者称尚未找到完美方案。

    引用Andrej Karpathy@karpathy

    We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks: Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better: Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better: Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better: Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work! In summary: - As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding. - Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.

  5. Hacker News:AI 热帖44

    Show HN:EchoPod——通过 AI 字幕用播客学习语言

    EchoPod 是一款基于真实播客和个人媒体的 AI 辅助语言学习 App,可将音频转为带逐词同步字幕的互动听力课程。用户可点词查看释义、发音与语境,并让 AI 讲解句子的语法、翻译和细微差别,还支持导入 YouTube 链接及本地音视频。该应用可在 Apple App Store 和 Google Play 免费下载,iOS 版需 iOS 16 或更高版本。

10月4日周日
  1. Hacker News:AI 热帖53

    Aura 开源自托管多用户 AI 智能体发布,支持每人独立图谱记忆

    Aura 发布为 Go 编写的本地优先、模型供应商中立的自托管多用户 AI 智能体平台,最新标记版本为 v1.0.2-rc1。它提供工具调用、文档检索、时序图谱记忆、定时任务、CLI、Telegram 网关和 Web cockpit,并通过 Docker Compose 运行 Postgres、ArcadeDB、Garage、嵌入、搜索和语音等组件。

  2. Hacker News:AI 热帖37

    BiNeuron 本地 AI 安全检测工具构想:智能代码分析与生成平台

    BiNeuron 是一款本地或云端运行的智能代码分析与生成平台,可自动识别 25 种以上编程语言,从 PDF、图片、网页等文件提取内容并生成上下文感知代码。平台集成 EasyOCR 与 DeepSeek OCR,采用 Qwen2.5-Coder-1.5B 等轻量模型完成 JSON 格式化,并通过 Microsoft Presidio 匿名化 PII、Fernet 加密聊天记录。

  3. Hacker News:AI 热帖36

    PublicAI 如何构建 AI 的人类层

    PublicAI 获得 1000 万美元融资,用于构建 AI 的人类层,让全球用户通过贡献数据获得收入。其去中心化网络拥有 3.5M+ 名经过验证的贡献者,通过技能验证和 stake-slashing 机制保障数据质量。PublicAI Data Hub 提供多模态数据采集与标注、AI 辅助标注及模型评估服务,支持免费额度与按量付费。

10月3日周六
  1. IT之家(RSS)45

    华为 Mate 90 Pro Max 首个版本更新曝光:实装四卡三待、3D 动态照片

    华为 Mate 90 Pro Max 旗舰机首个版本更新内容曝光,更新包体约 745.01 MB,实装四卡三待与 3D 动态照片等功能。四卡三待支持 2 个 SIM 卡号码和 2 个 eSIM 号码,可启用其中 3 个号码同时待机。更新还新增亲密圈、图库智慧修图、一键成片 AI 剪辑及第三方社交应用文本通话等功能。

  2. Hacker News:AI 热帖36

    Jabhook:用 LLM 与姿态估计打造拳击动作负反馈训练系统

    Johnny Henry 推出 Jabhook,通过摄像头与姿态估计模型提取关节 3D 坐标,经数学处理后交给 LLM 分析拳击组合动作并给出改进反馈。其生物力学算法对比标准动作轮廓,指出差距并给出可执行修正,形成“呼叫组合—观察—分析改进—重复”的负反馈循环。早期引体向上实验显示,依据 LLM 反馈训练可改善动作质量,模型越弱,对数据预处理的数学严谨性要求越高。

  3. 🚨 AI News | TestingCatalog26

    10月3日AI简报汇总OpenAI、Google、Anthropic等厂商动态:OpenAI Python SDK 3.24.0新增Voices API,ChatGPT全球上线虚拟试穿;Google Antigravity新增Claude Sonnet 5.5与Opus 5.5,11月2日移除Claude 4.6和GPT-OSS-120b。

    引用🚨 AI News | TestingCatalog@testingcatalog

    DAILY AI BRIEF 🗞 — Oct 2 SPACEXAI 🔥: * Grok 4.7 is rolling out in the Grok web and mobile apps. It is now the base model across all modes: Fast, Expert, Build, and Heavy. * Primary Bot is rolling out gradually. Grok Bot turns proactive and suggests things on its own. Users pick a new Primary Bot or promote an existing one. * Grok Build got an Agent Dashboard: all your agents on one screen via /dashboard. * Grok 4.7 is now available on Google's Gemini Enterprise Agent Platform. ANTHROPIC 🔥: * Mods landed in Claude Code: small TypeScript/JavaScript functions that can rewrite prompts, replace built-in features, and draw custom UI. * Mods ship inside plugins, work in the CLI and desktop app, and can be shared via the Claude directory. * Some built-ins are now mods, starting with /diff, so you can turn them off or swap them. More features will move to mods over time. MICROSOFT 🔥: * Three new MAI audio models are live: MAI-Transcribe-2-Streaming, MAI-Voice-2.1, and MAI-Voice-2.1-Flash. * Transcribe-2-Streaming covers 60 languages and takes #1 on Artificial Analysis streaming WER at 2.5%, priced at $0.54 per audio hour. * Voice-2.1 speaks 23 languages at $22 per 1M characters. Flash drops to ~45 ms inference at $15 per 1M characters. * Available in Microsoft Foundry and MAI Playground. The Voice models are on OpenRouter too. OPENAI 🔥: * OpenAI says it has notified 100+ organizations of "misaligned agent activity" so far. The review spans ~50 PB of logs and will take months. * Canada says there's no sign its systems were compromised after reported agent probing of Library and Archives Canada. * Sam Altman: GPT-6.1 Sol is OpenAI's fastest-growing model ever. It was slow under load and should be much better now. PERPLEXITY 🔥: * Computer now draws interactive charts and visualizations in the thread. Financial data uses TradingView Lightweight Charts for candlesticks, volume, and moving averages. * Decisions API is live: instead of text, it returns probabilities. Yes/no, one of your options, or a rubric score, at $0.04 per 1M input tokens with output free. * The model behind it, pplx-decider-v1-27b, is open-sourced on Hugging Face under Apache 2.0. Fine-tuned from Qwen3.8-27B, takes text and images, and averages 85.71% across 11 benchmarks in Perplexity's own tests. BLACK FOREST LABS 🔥: * FLUX 3 Image is out: precise multi-turn editing, up to 10 reference images, bounding-box layout control, and 4K output. * Open weights are planned in the coming weeks. CURSOR 🔥: * GLM 5.3 and GLM 5.3 Flash are now in Cursor. * GLM 5.3 Max is the best-scoring open-weight model on CursorBench 4.0. * Used Grok to compose this brief, cherry-picking the news and doing some post-editing.

  4. Hacker News:AI 热帖21

    Show HN:用 Claude Opus 生成 AI 实验室主题视频,得到一支 16-bit 恶搞短片

    频道 Clash of the Pixels 发布由 Claude Opus 协助生成的像素风恶搞短片《the Race to Superintelligence》,以 16-bit Dragon Quest 爬塔形式戏仿 2026 年 AI 竞赛。视频画面、芯片音乐、音效和 SNES 风格菜单全部由代码制作,发布一天获得 217 次观看,并明确声明为 parody,与相关公司无关联。

  5. Hacker News:AI 热帖63

    Meta 如何意外形成一套有竞争力的 AI 战略

    评论认为 Meta 凭借 Muse 与 Ray-Ban Meta Audio 眼镜的组合,切中主动式、个性化、免手持 AI 助手方向。Muse 基于 Muse Spark 1.3,支持 iOS、Android、网页和美国 WhatsApp,具备连接应用、代办交易、监控旅行价格等能力,并提供每周 1 亿至 30 亿 token 的三档方案。

  6. Hacker News:AI 热帖27

    帝王蝶:一款 2.5D 交互体验

    echohive 推出以墨西哥米却肯州越冬帝王蝶为主题的 2.5D 交互体验「Monarchs」,呈现清晨蝶群随气温升高从冷杉林苏醒飞起的场景。作品使用 Opus 5.5 制作、echohive 配乐,支持鼠标拖动环视、滚轮缩放、时间轴穿梭及全屏与声音控制,并声明为艺术化演绎而非历史或科学复原。

  7. Hacker News:AI 热帖42

    AI 如何帮助农民判断最佳收获时机

    AI 正通过摄像头、无人机和手机影像分析果实成熟度并预测收获日期,帮助农户安排采摘与用工。Vivid Machines 的系统已在华盛顿州苹果园试用,英国 FruitCast 称其一周预测误差在 10% 内、三周误差在 17% 内,并保证误差低于 20%。普林斯顿大学研究人员还在开发毫米波成熟度检测设备。

  8. Hacker News:AI 热帖59

    Sidekins 发布面向 Apple silicon Mac 的桌面陪伴式 AI 智能体

    Sidekins 发布可在 Mac 菜单栏运行的陪伴式 AI 智能体,支持圈选屏幕内容提问、分步引导操作、在屏幕上讲解题目,并可自主完成调研后带回报告和来源。它还能访问好友的 Sidekins、传递语音消息、与好友的智能体分工制定计划;发送消息、付款和删除等离开本机的操作需用户确认。

  9. elvis42

    Kled V3 可让实验室指定所需数据,并在 72 小时内向 500,000+ 名自愿加入的贡献者部署采集任务。它提供覆盖图像、视频、音频、文本和标注的 108 个可配置模板,贡献者按说明用手机采集数据。该流程可把模型失败点转化为采集任务,再用真实世界新样本训练和评估,形成更紧密的反馈闭环。

    引用Kled AI@useKled

    This is Kled V3. We've solved data collection for artificial general intelligence. Any consumer dataset that can exist, can now be collected from physical reality in under 72 hours. All powered by the largest and most comprehensive data application layer on the planet. (Thread)