评分理由: 论文CODMAS提出了一种基于大语言模型（LLMs）的多智能体协作框架，用于自动化RTL代码优化。核心相关关键词包括：1）“Large Language Models”（高度相关，论文明确使用LLMs）；2）“LLM Agents"和"Multi-agent Systems”（高度相关，框架包含多个智能体协同工作）；3）“Chain of Thought”、“System 2 Thinking"和"Self-Correction”（有一定关联，框架涉及逐步推理、深度反思和偏差修正）；4）“Tool Use”（有一定关联，智能体生成和评估代码可视为工具使用）。其他关键词如MoE、量化、RAG等与论文内容无关。

优化寄存器传输级（RTL）代码是电子设计自动化（EDA）中提升功耗、性能和面积（PPA）的关键步骤。本文提出CODMAS（基于辩证多智能体系统的协同优化框架），该框架结合结构化辩证推理、领域感知的代码生成与确定性评估，以实现RTL优化的自动化。CODMAS的核心包含两个辩证智能体：其一为“阐述者”（Articulator），其设计灵感源于橡皮鸭调试法，负责阐述逐步转换计划并揭示潜在假设；其二为“假设协作者”（Hypothesis Partner），负责预测结果并调和预期行为与实际行为之间的偏差，以指导针对性改进。这些智能体驱动一个领域专用编码智能体（Domain-Specific Coding Agent, DCA）生成具备架构感知能力的Verilog代码修改，并引导一个代码评估智能体（Code Evaluation Agent, CEA）验证语法、功能及PPA指标。我们同时提出了RTLOPT基准测试集，包含120组针对流水线与时钟门控转换的Verilog三元组（未优化版本、优化版本、测试平台）。在专有及开源大语言模型上，CODMAS在流水线优化中实现了关键路径延迟降低约25%，在时钟门控优化中实现了功耗降低约22%，同时相较于强提示方法与智能体基线，显著减少了功能错误与编译失败案例。这些结果表明，结构化的多智能体推理能够显著增强自动化RTL优化能力，并有望扩展至更复杂的设计与更广泛的优化任务。

Optimizing Register Transfer Level (RTL) code is a critical step in Electronic Design Automation (EDA) for improving power, performance, and area (PPA). We present CODMAS (Collaborative Optimization via a Dialectic Multi-Agent System), a framework that combines structured dialectic reasoning with domain-aware code generation and deterministic evaluation to automate RTL optimization. At the core of CODMAS are two dialectic agents: the Articulator, inspired by rubber-duck debugging, which articulates stepwise transformation plans and exposes latent assumptions; and the Hypothesis Partner, which predicts outcomes and reconciles deviations between expected and actual behavior to guide targeted refinements. These agents direct a Domain-Specific Coding Agent (DCA) to generate architecture-aware Verilog edits and a Code Evaluation Agent (CEA) to verify syntax, functionality, and PPA metrics. We introduce RTLOPT, a benchmark of 120 Verilog triples (unoptimized, optimized, testbench) for pipelining and clock-gating transformations. Across proprietary and open LLMs, CODMAS achieves ~25% reduction in critical path delay for pipelining and ~22% power reduction for clock gating, while reducing functional and compilation failures compared to strong prompting and agentic baselines. These results demonstrate that structured multi-agent reasoning can significantly enhance automated RTL optimization and scale to more complex designs and broader optimization tasks.

!!! info

论文采用多智能体协作的方法论。首先构建RTLOPT数据集用于评估。CODMAS框架包含四个智能体：Articulator（规划）、Hypothesis Partner（预测与诊断）、DCA（生成代码）和CEA（评估代码）。工作流程是迭代的：Articulator制定计划 -> Hypothesis Partner预测 -> DCA生成代码 -> CEA使用Icarus Verilog和ABC工具进行仿真和综合评估 -> 反馈给智能体进行修正。

• 创新的多智能体架构设计，将“小黄鸭调试”理念转化为AI智能体角色，增强了推理的可解释性和结构化。
• 提供了高质量的基准数据集RTLOPT，支持可复现的研究。
• 实际应用价值高，直接解决EDA领域的痛点，且在PPA指标上有显著量化提升。
• 闭环反馈机制结合了LLM的生成能力与传统EDA工具的确定性验证，提高了鲁棒性。

• 数据集规模相对较小（120个三元组），可能限制模型在大规模或极复杂设计上的泛化能力。
• 目前主要关注流水线和时钟门控两种优化，对于其他RTL优化技术（如重定时、资源共享）的覆盖尚待扩展。
• 依赖外部EDA工具（Icarus Verilog, ABC）进行评估，可能受限于工具本身的精度或速度。
• 多智能体交互可能带来较高的计算开销和推理延迟。

评分理由: 论文核心研究LLM游戏智能体架构Sensi，涉及测试时学习、课程学习、多智能体协调、上下文窗口控制、幻觉缓解等。与"LLM Agents"和"Large Language Models"高度相关（10分），与"LLM Agents"相关的子主题如"Multi-agent Systems"、“Self-Correction”、“Context Window Extension”、“Chain of Thought”、“System 2 Thinking”、“Hallucination Mitigation”、“In-context Learning"有一定关联（5分）。其他关键词如MoE、量化、科学AI应用等未涉及（0分）。

部署于未知环境的大语言模型（LLM）智能体必须在测试时学习任务结构，但现有方法需要数千次交互才能形成有效假设。本文提出Sensi——一种面向ARC-AGI-3游戏挑战的LLM智能体架构，通过三重机制实现结构化测试时学习：（1）将感知与行动分离的双智能体架构，（2）由外部状态机管理的课程学习系统，（3）作为控制平面的数据库，使智能体的上下文窗口可通过编程方式引导。我们进一步引入配备动态生成评估标准的LLM-as-judge（大语言模型作为裁判）组件，用以判定智能体何时对当前主题学习充分并推进至下一阶段。通过两个迭代版本报告实验结果：Sensi v1仅采用双智能体架构即解决2个游戏关卡，而Sensi v2增加课程学习后虽未解决任何关卡（0个），但仅用约32次行动尝试即完成全部学习课程，其样本效率达到需1600-3000次尝试的同类系统的50-94倍。我们精确诊断其失效模式为源于感知层的自洽幻觉级联，证明架构瓶颈已从学习效率转移至感知 grounding（感知锚定）——这成为一个更易处理的问题。

Large language model (LLM) agents deployed in unknown environments must learn task structure at test time, but current approaches require thousands of interactions to form useful hypotheses. We present Sensi, an LLM agent architecture for the ARC-AGI-3 game-playing challenge that introduces structured test-time learning through three mechanisms: (1) a two-player architecture separating perception from action, (2) a curriculum-based learning system managed by an external state machine, and (3) a database-as-control-plane that makes the agents context window programmatically steerable. We further introduce an LLM-as-judge component with dynamically generated evaluation rubrics to determine when the agent has learned enough about one topic to advance to the next. We report results across two iterations: Sensi v1 solves 2 game levels using the two-player architecture alone, while Sensi v2 adds curriculum learning and solves 0 levels - but completes its entire learning curriculum in approximately 32 action attempts, achieving 50-94x greater sample efficiency than comparable systems that require 1600-3000 attempts. We precisely diagnose the failure mode as a self-consistent hallucination cascade originating in the perception layer, demonstrating that the architectural bottleneck has shifted from learning efficiency to perceptual grounding - a more tractable problem.

!!! info

论文采用基于LLM的智能体架构，在ARC-AGI-3环境中进行测试。主要技术路线包括：1. 构建双人系统，分别处理观察和决策；2. 设计课程学习机制，通过状态机控制学习进度；3. 使用SQLite数据库作为控制平面，管理智能体的记忆和上下文；4. 实施LLM-as-judge评估机制，动态生成评分标准；5. 利用ChatGPT 5.1作为骨干模型进行推理和决策。

• 极高的样本效率：相比现有方法，大幅减少了学习所需的游戏交互次数。
• 架构创新：引入数据库即控制平面和课程学习，使LLM智能体的行为更加模块化和可控。
• 深刻的失败分析：诚实地报告负面结果，并精确定位了感知基础作为当前架构的瓶颈，为后续研究指明了方向。
• 可复现性：v1版本显示出确定性结果，减少了LLM固有的随机性影响。

• 任务完成率低：Sensi v2虽然学习效率高，但未能解决任何游戏关卡，实际任务表现不佳。
• 感知层脆弱性：架构严重依赖LLM的视觉感知能力，感知层的幻觉会导致整个系统的失败。
• 系统复杂性：每回合需要多达5次LLM调用，虽然样本效率高，但计算成本和延迟可能较高。
• 依赖特定模型：实验依赖于ChatGPT 5.1的能力，其视觉推理的局限性直接限制了系统的性能。

评分理由: 论文提出了一种用于胸部X光印象报告的检索增强生成（RAG）系统，核心是解决生成式大模型在医学领域中的幻觉和缺乏临床依据问题。因此，与"Retrieval-Augmented Generation"高度相关（10分），与"AI for Science"高度相关（10分），因为它是大模型在生物医学（放射学）领域的应用。论文提到使用大语言模型（LLMs）进行报告生成，因此与"Large Language Models"相关（8分）。系统通过检索历史报告来确保事实一致性，直接针对"Hallucination Mitigation"问题（8分）。系统输出具有可解释性和引用可追溯性，与"Explainable AI"有一定关联（5分）。其他关键词如MoE、SFT、RLHF、量化等未在摘要中提及或与论文核心内容无关，因此得0分。

随着深度学习与大语言模型的兴起，自动化放射学报告生成日益受到关注。然而，完全生成式方法常出现幻觉问题且缺乏临床依据，限制了其在实际工作流程中的可靠性。本研究提出一种多模态检索增强生成（RAG）系统，用于胸部X光影像印象的基于依据的草稿生成。该系统结合对比式图文嵌入、基于病例的相似性检索与引用约束的草稿生成机制，确保与历史放射学报告的事实对齐。我们使用MIMIC-CXR数据集的精选子集构建多模态检索数据库：图像嵌入通过CLIP编码器生成，文本嵌入则源自结构化的印象章节。通过FAISS索引实现可扩展的最近邻检索，构建了融合相似度框架。检索到的病例用于构建基于依据的提示，以生成印象草稿，并通过安全机制强制实施引用覆盖和基于置信度的拒绝生成。实验结果表明，与纯图像检索相比，多模态融合显著提升了检索性能，在临床相关发现上Recall@5超过0.95。基于依据的草稿生成流程可产生具有明确引用溯源性的可解释输出，相较于传统生成方法显著提升了可信度。本研究凸显了检索增强多模态系统在可靠临床决策支持与放射学工作流程增强方面的潜力。

Automated radiology report generation has gained increasing attention with the rise of deep learning and large language models. However, fully generative approaches often suffer from hallucinations and lack clinical grounding, limiting their reliability in real-world workflows. In this study, we propose a multimodal retrieval-augmented generation (RAG) system for grounded drafting of chest radiograph impressions. The system combines contrastive image-text embeddings, case-based similarity retrieval, and citation-constrained draft generation to ensure factual alignment with historical radiology reports. A curated subset of the MIMIC-CXR dataset was used to construct a multimodal retrieval database. Image embeddings were generated using CLIP encoders, while textual embeddings were derived from structured impression sections. A fusion similarity framework was implemented using FAISS indexing for scalable nearest-neighbor retrieval. Retrieved cases were used to construct grounded prompts for draft impression generation, with safety mechanisms enforcing citation coverage and confidence-based refusal. Experimental results demonstrate that multimodal fusion significantly improves retrieval performance compared to image-only retrieval, achieving Recall@5 above 0.95 on clinically relevant findings. The grounded drafting pipeline produces interpretable outputs with explicit citation traceability, enabling improved trustworthiness compared to conventional generative approaches. This work highlights the potential of retrieval-augmented multimodal systems for reliable clinical decision support and radiology workflow augmentation

评分理由: 论文提出EVA框架，通过强化学习后训练（post-training）对齐视频世界模型，使其生成物理可执行的机器人动作。核心相关关键词：1) “Post-training” OR “Supervised Fine-tuning” OR “SFT”（10分）：论文明确使用强化学习后训练框架。2) “RLHF” OR “RLAIF” OR “Direct Preference Optimization” OR “DPO”（10分）：使用强化学习（RL）进行对齐，属于RLHF相关技术。3) “World Models” AND “General World Models”（10分）：论文聚焦视频世界模型（video world models）用于机器人控制。4) “Instruction Tuning” OR “Alignment” OR “Value Alignment”（8分）：涉及模型对齐（alignment）以改善可执行性。其他关键词如LLMs、MoE、RAG等与论文内容无关，得0分。

视频生成模型正日益被用作机器人的世界模型，其中模型根据当前观测和任务指令生成未来的视觉推演序列，而逆动力学模型则将生成的帧转换为可执行的机器人动作。然而，当前的视频世界模型缺乏显式的可执行性约束。这导致视觉连贯的推演序列仍可能违反刚体运动学一致性，在通过逆动力学模型解码时产生不稳定或不可行的控制指令。我们将这种视觉生成与物理可执行控制之间的不匹配称为可执行性差距。虽然可通过拒绝采样等推理时技术缓解该差距，但由于视频生成成本高昂，此类方法效率低下。本文利用可执行性差距作为训练信号，提出可执行视频对齐——一种用于对齐视频世界模型的强化学习后训练框架。该框架在真实机器人轨迹上训练逆动力学模型，并将其重新用作奖励模型，通过生成视频所诱导的动作序列来评估视频质量：奖励由速度、加速度和急动度度量的平滑运动，同时惩罚违反本体约束的动作。值得注意的是，即使生成视频存在严重视觉伪影，该奖励仍能提供有效信息，因为此类伪影通常对应不稳定或越界的动作。在RoboTwin基准测试和真实双臂机器人上的实验表明，该方法能减少生成推演中特定于本体的伪影，并提升下游任务执行成功率。

Video generative models are increasingly used as world models for robotics, where a model generates a future visual rollout conditioned on the current observation and task instruction, and an inverse dynamics model (IDM) converts the generated frames into executable robot actions. However, current video world models lack explicit executability constraints. As a result, visually coherent rollouts may still violate rigid-body and kinematic consistency, producing unstable or infeasible control commands when decoded by an IDM. We refer to this mismatch between visual generation and physically executable control as the executability gap. While this gap can be mitigated at inference time using techniques such as rejection sampling, such approaches are inefficient due to the high cost of video generation. In this paper, we leverage the executability gap as a training signal and introduce Executable Video Alignment (EVA), a reinforcement-learning post-training framework for aligning video world models. EVA trains an inverse dynamics model on real robot trajectories and repurposes it as a reward model that evaluates generated videos through the action sequences they induce, encouraging smooth motions measured by velocity, acceleration, and jerk while penalizing actions that violate embodiment constraints. Importantly, the reward remains informative even when generated videos contain severe visual artifacts, since such artifacts typically translate into unstable or out-of-bound actions. Experiments on the RoboTwin benchmark and a real bimanual robot show that EVA reduces embodiment-specific artifacts in generated rollouts and improves downstream task execution success.

评分理由: 论文研究视觉语言模型（VLMs）的越狱攻击和安全对齐问题，与"Large Language Models"高度相关（VLMs是大模型的一种），“Instruction Tuning” OR “Alignment” OR “Value Alignment"是核心主题（研究安全对齐失效），“Mechanistic Interpretability” OR “Explainable AI"是核心方法（通过表示空间分析解释越狱机制），“Hallucination Mitigation” OR “Factuality” OR “Truthfulness"有一定关联（涉及安全性和真实性），其他关键词未在论文中涉及。

大型视觉语言模型（VLMs）在整合视觉模态后，其安全对齐性常出现弱化现象。即使文本提示包含明确的有害意图，添加图像仍会显著提高越狱成功率。本文发现，在表征空间中，VLMs能够清晰区分良性输入与有害输入。此外，即使在有害输入中，越狱样本也会形成一种与拒绝样本明显分离的独特内部状态。这些观察表明，越狱行为并非源于模型未能识别有害意图，而是视觉模态将表征推向特定的越狱状态，从而导致未能触发拒绝机制。为量化这一转变，我们识别出一个越狱方向，并将图像诱导的表征偏移沿此方向的分量定义为越狱相关偏移。分析表明，越狱相关偏移能可靠地表征越狱行为，为多样化的越狱场景提供了统一解释。最后，我们提出一种防御方法，通过在推理时移除越狱相关偏移（JRS-Rem）来增强VLM的安全性。实验证明，JRS-Rem能在多种场景下提供强效防御，同时保持良性任务上的性能。

Large vision-language models (VLMs) often exhibit weakened safety alignment with the integration of the visual modality. Even when text prompts contain explicit harmful intent, adding an image can substantially increase jailbreak success rates. In this paper, we observe that VLMs can clearly distinguish benign inputs from harmful ones in their representation space. Moreover, even among harmful inputs, jailbreak samples form a distinct internal state that is separable from refusal samples. These observations suggest that jailbreaks do not arise from a failure to recognize harmful intent. Instead, the visual modality shifts representations toward a specific jailbreak state, thereby leading to a failure to trigger refusal. To quantify this transition, we identify a jailbreak direction and define the jailbreak-related shift as the component of the image-induced representation shift along this direction. Our analysis shows that the jailbreak-related shift reliably characterizes jailbreak behavior, providing a unified explanation for diverse jailbreak scenarios. Finally, we propose a defense method that enhances VLM safety by removing the jailbreak-related shift (JRS-Rem) at inference time. Experiments show that JRS-Rem provides strong defense across multiple scenarios while preserving performance on benign tasks.

评分理由: 论文提出了一种基于本地LLM的文本匿名化框架，核心是使用LLM替换文本中的个人身份信息。因此，与"Large Language Models"高度相关（10分）。论文提到使用BERT+LoRA进行微调，与"PEFT/LoRA"相关（8分）。论文评估了在问答代理前加入匿名化层的效果，与"LLM Agents"相关（8分）。论文提到使用本地LLM，与"Small Language Models/On-device AI"有一定关联（5分）。其他关键词如MoE、Scaling Laws、RLHF等与论文内容无关（0分）。

负责任地使用人工智能要求我们在不损害数据实用性的前提下保护敏感信息，这一需求在大语言模型时代变得尤为迫切。我们通过一种本地部署的、基于大语言模型的替换流程来应对这一挑战，该流程通过将个人可识别信息替换为符合类型特征的逼真替代内容来实现文本匿名化。该方法完全在组织边界内使用本地大语言模型执行，既能防止数据外泄，又能保持文本的流畅性和任务相关语义。

我们在基于对话的行为数据集上进行了系统性、多指标、跨技术的评估，以行业标准方案（微软Presidio和谷歌DLP）以及前沿方法（ZSTS，包括仅删除版本及删除加替换版本）作为基准。我们的评估方案通过一项面向全生命周期的标准，综合衡量了隐私性、语义效用及隐私保护下的可训练性——该标准通过对经脱敏处理的文本微调紧凑编码器（BERT+LoRA）获得。此外，我们通过在应答大语言模型前插入本地匿名化层，并评估其回答质量，来检验智能问答代理的性能。这一中间化的类型保持替换阶段确保敏感内容不会暴露给第三方API，从而在保障机密性的前提下实现问答代理的负责任部署。

我们的方法在隐私性、主题偏移控制、事实效用保持及可训练性损失方面均达到最优水平，在隐私-效用-可训练性的综合评估边界上超越了基于规则的方法、命名实体识别基准模型以及各版本ZSTS方法。这些结果表明，基于本地大语言模型的替换技术能够生成既符合负责任使用要求又具备操作价值的匿名语料：既适用于智能代理流程的安全部署，也适用于下游微调任务且性能衰减有限。

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise, LLM-driven substitution pipeline that anonymizes text by replacing personally identifiable information (PII) with realistic, type-consistent surrogates. Executed entirely within organizational boundaries using local LLMs, the approach prevents data egress while preserving fluency and task-relevant semantics. We conduct a systematic, multi-metric, cross-technique evaluation on the Action-Based Conversation Dataset, benchmarking against industry standards (Microsoft Presidio and Google DLP) and a state-of-the-art approach (ZSTS, in redaction-only and redaction-plus-substitution variants). Our protocol jointly measures privacy, semantic utility, and trainability under privacy via a lifecycle-ready criterion obtained by fine-tuning a compact encoder (BERT+LoRA) on sanitized text. In addition, we assess agentic Q&A performance by inserting an on-premise anonymization layer before the answering LLM and evaluating the quality of its responses. This intermediate, type-preserving substitution stage ensures that no sensitive content is exposed to third-party APIs, enabling responsible deployment of Q&A agents without compromising confidentiality. Our method attains state-of-the-art privacy, minimal topical drift, strong factual utility, and low trainability loss, outperforming rule-based approaches and named-entity recognition (NER) baselines and ZSTS variants on the combined privacy–utility–trainability frontier. These results show that local LLM substitution yields anonymized corpora that are both responsible to use and operationally valuable: safe for agentic pipelines and suitable for downstream fine-tuning with limited degradation.

!!! info

论文采用本地部署的开源大模型（GPT-oss 20B和DeepSeek-r1 7B）作为核心引擎。通过设计特定的提示词，指令模型逐词检测并替换PII（如姓名、邮箱、数字、地址等）为同类型的虚构数据。采用零温度解码以确保替换过程的确定性。在评估阶段，使用Action-Based Conversation Dataset (ABCD) 数据集，对比Microsoft Presidio、Google DLP和ZSTS等基线方法，通过PII召回率、情感一致性、主题距离、问答质量以及基于BERT+LoRA的微调性能进行综合测试。

• 隐私合规性极高：本地化处理架构完全符合GDPR、HIPAA等法规要求，解决了数据出境痛点。
• 数据效用保留优异：通过生成式替换而非删除，最大程度保留了文本的语义结构和上下文信息，有利于下游任务。
• 评估体系全面且务实：不仅关注传统的隐私和语义指标，还创新性地引入了“隐私下的可训练性”评估，为工程落地提供了关键依据。
• 部署灵活且通用：无需针对特定领域微调模型，利用提示工程即可快速适配不同语言和业务场景。

• 计算资源消耗较高：使用20B或7B参数的本地LLM进行推理，相比基于规则的轻量级方法（如正则匹配），硬件成本和推理延迟较高。
• 潜在的幻觉风险：尽管通过提示词进行了约束，但生成式模型仍可能产生不符合上下文逻辑的虚构信息，影响事实准确性。
• 评估范围有限：主要在任务型对话数据集（ABCD）上进行了验证，在开放域对话或长文档处理中的效果尚需进一步研究。
• 确定性依赖：虽然使用了零温度解码，但不同模型架构或提示词的微小变化仍可能导致输出不一致。

评分理由: 论文核心研究LLM幻觉缓解，通过领域接地的分层检索和验证架构（RAG变体）来提升事实准确性。因此，与"Large Language Models”（论文明确研究LLM）、“Retrieval-Augmented Generation”（核心方法基于RAG架构）和"Hallucination Mitigation”（直接解决幻觉问题）高度相关（10分）。其他关键词如MoE、SLMs、训练技术、推理方法、代理系统、模型压缩等，论文未涉及，给0分。

大型语言模型（LLMs）在流畅性方面取得了前所未有的成就，但仍易产生“幻觉”——即生成事实错误或无依据的内容。这一局限在可靠性至关重要的高风险领域中尤为关键。我们提出了一种领域锚定的分层检索与验证架构，旨在通过将LLMs从随机模式匹配器转变为经过验证的真相探寻者，系统性地拦截事实错误。该框架采用基于LangGraph实现的四阶段自调节流程：（I）利用早期退出逻辑进行内在验证以优化计算资源，（II）通过领域检测器实现自适应搜索路由以定向检索特定主题档案库，（III）采用纠正性文档分级（CRAG）过滤无关上下文，（IV）进行外部再生及原子化声明级验证。该系统在来自五个不同基准测试的650条查询中进行了评估：TimeQA v2、FreshQA v2、HaluEval General、MMLU Global Facts和TruthfulQA。实证结果表明，该流程在所有环境中均持续优于零样本基线。在TimeQA v2中胜率峰值达83.7%，在MMLU Global Facts中达78.0%，证实了其在需要精细时间和数值精度的领域具有高效性。在事实性答案行中，锚定分数稳定保持在78.8%至86.4%之间。尽管该架构为错误信息提供了强大的故障防护机制，但仍识别出“虚假前提过度断言”这一持续存在的失效模式。这些发现为多阶段检索增强生成（RAG）行为提供了详细的实证特征描述，并表明未来工作应优先发展检索前“可答性”节点，以进一步弥合对话式人工智能的可靠性差距。

Large Language Models (LLMs) have achieved unprecedented fluency but remain susceptible to “hallucinations” - the generation of factually incorrect or ungrounded content. This limitation is particularly critical in high-stakes domains where reliability is paramount. We propose a domain-grounded tiered retrieval and verification architecture designed to systematically intercept factual inaccuracies by shifting LLMs from stochastic pattern-matchers to verified truth-seekers. The proposed framework utilizes a four-phase, self-regulating pipeline implemented via LangGraph: (I) Intrinsic Verification with Early-Exit logic to optimize compute, (II) Adaptive Search Routing utilizing a Domain Detector to target subject-specific archives, (III) Corrective Document Grading (CRAG) to filter irrelevant context, and (IV) Extrinsic Regeneration followed by atomic claim-level verification. The system was evaluated across 650 queries from five diverse benchmarks: TimeQA v2, FreshQA v2, HaluEval General, MMLU Global Facts, and TruthfulQA. Empirical results demonstrate that the pipeline consistently outperforms zero-shot baselines across all environments. Win rates peaked at 83.7% in TimeQA v2 and 78.0% in MMLU Global Facts, confirming high efficacy in domains requiring granular temporal and numerical precision. Groundedness scores remained robustly stable between 78.8% and 86.4% across factual-answer rows. While the architecture provides a robust fail-safe for misinformation, a persistent failure mode of “False-Premise Overclaiming” was identified. These findings provide a detailed empirical characterization of multi-stage RAG behavior and suggest that future work should prioritize pre-retrieval “answerability” nodes to further bridge the reliability gap in conversational AI.

!!! info

论文采用了一种基于LangGraph实现的四阶段技术路线。首先，系统尝试利用内部参数记忆（零样本基线）回答问题，并通过分解原子声明进行内在验证，若置信度高则触发早退机制；若不确定，则进入第二阶段，通过领域检测器路由到特定领域档案进行检索；第三阶段利用CRAG过滤不相关上下文；最后进行外在再生，并对生成的原子声明进行逐一验证。

• 高效性：通过早退逻辑减少了不必要的API调用和计算资源消耗。
• 鲁棒性：多阶段验证机制显著提高了事实准确性和基础性得分。
• 自适应能力：能够根据内部置信度动态调整验证力度，并针对特定领域进行检索。
• 全面性：覆盖了从内在知识检查到外在检索验证的全过程，有效缓解了不同类型的幻觉。

• 特定失败模式：存在“错误前提过度声明”的问题，即系统可能对基于错误前提的问题过度自信地生成回答。
• 系统复杂性：四阶段管道可能增加了系统的复杂性和响应延迟。
• 依赖性：虽然使用了领域检测，但检索效果仍可能依赖于外部档案的质量和覆盖范围。

评分理由: 论文核心研究大语言模型（LLMs）如何编码语义关系，直接高度相关于关键词1（LLMs）和关键词23（Mechanistic Interpretability）。论文使用稀疏自编码器（SAE）进行分析，与关键词2（Sparse Models）有一定关联。论文研究了不同规模的模型（包括70M参数的Pythia），与关键词3（Small Language Models）有一定关联。论文未涉及其他关键词如训练方法、推理技术、应用领域等，因此这些关键词评分为0。

理解大型语言模型（LLM）是否捕捉结构化意义，需要考察它们如何表征概念间的关系。本研究考察了三个规模递增的模型：Pythia-70M、GPT-2 和 Llama 3.1 8B，聚焦于四种语义关系：同义关系、反义关系、上下位关系（hypernymy）和下位关系（hyponymy）。我们结合线性探测与机制可解释性技术，包括稀疏自编码器（SAE）和激活修补，以识别这些关系在何处被编码，以及特定特征如何对其表征做出贡献。我们的结果揭示了层级关系中的方向性不对称：上下位关系被冗余编码且难以抑制，而下位关系则依赖于紧凑的特征，这些特征更容易因消融而受到破坏。更广泛地说，关系信号是弥散的，但表现出稳定的分布模式：它们在中层达到峰值，并且在残差后/MLP通路中比在注意力通路中更强。不同模型间的任务难度保持一致（反义关系最容易，同义关系最难）。探测层面的因果性取决于模型能力：在 Llama 3.1 上，SAE 引导的修补能可靠地改变这些信号，而在较小模型上，这种改变则微弱或不稳定。我们的结果阐明了语义关系在 LLM 内部何处以及如何可靠地表征，并提供了一个可复现的框架，用于将稀疏特征与探测层面的因果证据联系起来。

Understanding whether large language models (LLMs) capture structured meaning requires examining how they represent concept relationships. In this work, we study three models of increasing scale: Pythia-70M, GPT-2, and Llama 3.1 8B, focusing on four semantic relations: synonymy, antonymy, hypernymy, and hyponymy. We combine linear probing with mechanistic interpretability techniques, including sparse autoencoders (SAE) and activation patching, to identify where these relations are encoded and how specific features contribute to their representation. Our results reveal a directional asymmetry in hierarchical relations: hypernymy is encoded redundantly and resists suppression, while hyponymy relies on compact features that are more easily disrupted by ablation. More broadly, relation signals are diffuse but exhibit stable profiles: they peak in the mid-layers and are stronger in post-residual/MLP pathways than in attention. Difficulty is consistent across models (antonymy easiest, synonymy hardest). Probe-level causality is capacity-dependent: on Llama 3.1, SAE-guided patching reliably shifts these signals, whereas on smaller models the shifts are weak or unstable. Our results clarify where and how reliably semantic relations are represented inside LLMs, and provide a reproducible framework for relating sparse features to probe-level causal evidence.

评分理由: 该论文研究医学视觉-语言模型（VLMs）中的模态间隙（modality gap）现象及其对下游性能的影响，并提出一种轻量级后处理机制进行调控。论文核心与医学AI应用高度相关（关键词27得10分），涉及预训练模型的分析（关键词5得5分）和后训练调控方法（关键词6得8分），并对模型表示的可解释性有一定探讨（关键词23得5分）。论文未涉及纯语言模型、推理、对齐、高效微调、检索增强、上下文扩展、注意力优化、智能体、量化、加速、幻觉缓解、世界模型、模型合并、上下文学习等其他技术主题，因此这些关键词得0分。

视觉语言模型（VLMs）在表征空间中呈现出一种典型的“锥体效应”，即非线性编码器将嵌入向量映射到高度集中的区域，这导致了被称为模态间隙的跨模态分离现象。尽管该现象已被广泛观测到，但其在监督式多模态学习（尤其在医学领域）中的实际影响尚不明确。本研究提出一种轻量级事后处理机制，该机制保持预训练的VLM编码器冻结，同时通过单一超参数{λ}持续调控跨模态分离程度。这使得我们能够在不进行昂贵重新训练的情况下，系统分析模态间隙如何影响下游多模态性能。我们在监督式多模态设置下，评估了通用模型（CLIP、SigLIP）和医学专用模型（BioMedCLIP、MedSigLIP）在多种医学与自然数据集上的表现。结果一致表明，减小过大的模态间隙能提升下游性能，且医学数据集对间隙调节表现出更强的敏感性；然而，完全消除间隙并非总是最优选择，中等程度、依赖具体任务的分离状态往往能产生最佳结果。这些发现将模态间隙定位为多模态表征的一种可调节属性，而非一个应当被普遍最小化的量。

Vision-Language Models (VLMs) exhibit a characteristic “cone effect” in which nonlinear encoders map embeddings into highly concentrated regions of the representation space, contributing to cross-modal separation known as the modality gap. While this phenomenon has been widely observed, its practical impact on supervised multimodal learning -particularly in medical domains- remains unclear. In this work, we introduce a lightweight post-hoc mechanism that keeps pretrained VLM encoders frozen while continuously controlling cross-modal separation through a single hyperparameter {λ}. This enables systematic analysis of how the modality gap affects downstream multimodal performance without expensive retraining. We evaluate generalist (CLIP, SigLIP) and medically specialized (BioMedCLIP, MedSigLIP) models across diverse medical and natural datasets in a supervised multimodal settings. Results consistently show that reducing excessive modality gap improves downstream performance, with medical datasets exhibiting stronger sensitivity to gap modulation; however, fully collapsing the gap is not always optimal, and intermediate, task-dependent separation yields the best results. These findings position the modality gap as a tunable property of multimodal representations rather than a quantity that should be universally minimized.

评分理由: 论文CODMAS提出了一种基于大语言模型（LLMs）的多智能体协作框架，用于自动化RTL代码优化。核心相关关键词包括：1）“Large Language Models”（高度相关，论文明确使用LLMs）；2）“LLM Agents"和"Multi-agent Systems”（高度相关，框架包含多个智能体协同工作）；3）“Chain of Thought”、“System 2 Thinking"和"Self-Correction”（有一定关联，框架涉及逐步推理、深度反思和偏差修正）；4）“Tool Use”（有一定关联，智能体生成和评估代码可视为工具使用）。其他关键词如MoE、量化、RAG等与论文内容无关。

优化寄存器传输级（RTL）代码是电子设计自动化（EDA）中提升功耗、性能和面积（PPA）的关键步骤。本文提出CODMAS（基于辩证多智能体系统的协同优化框架），该框架结合结构化辩证推理、领域感知的代码生成与确定性评估，以实现RTL优化的自动化。CODMAS的核心包含两个辩证智能体：其一为“阐述者”（Articulator），其设计灵感源于橡皮鸭调试法，负责阐述逐步转换计划并揭示潜在假设；其二为“假设协作者”（Hypothesis Partner），负责预测结果并调和预期行为与实际行为之间的偏差，以指导针对性改进。这些智能体驱动一个领域专用编码智能体（Domain-Specific Coding Agent, DCA）生成具备架构感知能力的Verilog代码修改，并引导一个代码评估智能体（Code Evaluation Agent, CEA）验证语法、功能及PPA指标。我们同时提出了RTLOPT基准测试集，包含120组针对流水线与时钟门控转换的Verilog三元组（未优化版本、优化版本、测试平台）。在专有及开源大语言模型上，CODMAS在流水线优化中实现了关键路径延迟降低约25%，在时钟门控优化中实现了功耗降低约22%，同时相较于强提示方法与智能体基线，显著减少了功能错误与编译失败案例。这些结果表明，结构化的多智能体推理能够显著增强自动化RTL优化能力，并有望扩展至更复杂的设计与更广泛的优化任务。

Optimizing Register Transfer Level (RTL) code is a critical step in Electronic Design Automation (EDA) for improving power, performance, and area (PPA). We present CODMAS (Collaborative Optimization via a Dialectic Multi-Agent System), a framework that combines structured dialectic reasoning with domain-aware code generation and deterministic evaluation to automate RTL optimization. At the core of CODMAS are two dialectic agents: the Articulator, inspired by rubber-duck debugging, which articulates stepwise transformation plans and exposes latent assumptions; and the Hypothesis Partner, which predicts outcomes and reconciles deviations between expected and actual behavior to guide targeted refinements. These agents direct a Domain-Specific Coding Agent (DCA) to generate architecture-aware Verilog edits and a Code Evaluation Agent (CEA) to verify syntax, functionality, and PPA metrics. We introduce RTLOPT, a benchmark of 120 Verilog triples (unoptimized, optimized, testbench) for pipelining and clock-gating transformations. Across proprietary and open LLMs, CODMAS achieves ~25% reduction in critical path delay for pipelining and ~22% power reduction for clock gating, while reducing functional and compilation failures compared to strong prompting and agentic baselines. These results demonstrate that structured multi-agent reasoning can significantly enhance automated RTL optimization and scale to more complex designs and broader optimization tasks.

评分理由: 论文核心研究LLM游戏智能体架构Sensi，涉及测试时学习、课程学习、多智能体协调、上下文窗口控制、幻觉缓解等。与"LLM Agents"和"Large Language Models"高度相关（10分），与"LLM Agents"相关的子主题如"Multi-agent Systems”、“Self-Correction”、“Context Window Extension”、“Chain of Thought”、“System 2 Thinking”、“Hallucination Mitigation”、“In-context Learning"有一定关联（5分）。其他关键词如MoE、量化、科学AI应用等未涉及（0分）。

部署于未知环境的大语言模型（LLM）智能体必须在测试时学习任务结构，但现有方法需要数千次交互才能形成有效假设。本文提出Sensi——一种面向ARC-AGI-3游戏挑战的LLM智能体架构，通过三重机制实现结构化测试时学习：（1）将感知与行动分离的双智能体架构，（2）由外部状态机管理的课程学习系统，（3）作为控制平面的数据库，使智能体的上下文窗口可通过编程方式引导。我们进一步引入配备动态生成评估标准的LLM-as-judge（大语言模型作为裁判）组件，用以判定智能体何时对当前主题学习充分并推进至下一阶段。通过两个迭代版本报告实验结果：Sensi v1仅采用双智能体架构即解决2个游戏关卡，而Sensi v2增加课程学习后虽未解决任何关卡（0个），但仅用约32次行动尝试即完成全部学习课程，其样本效率达到需1600-3000次尝试的同类系统的50-94倍。我们精确诊断其失效模式为源于感知层的自洽幻觉级联，证明架构瓶颈已从学习效率转移至感知 grounding（感知锚定）——这成为一个更易处理的问题。

Large language model (LLM) agents deployed in unknown environments must learn task structure at test time, but current approaches require thousands of interactions to form useful hypotheses. We present Sensi, an LLM agent architecture for the ARC-AGI-3 game-playing challenge that introduces structured test-time learning through three mechanisms: (1) a two-player architecture separating perception from action, (2) a curriculum-based learning system managed by an external state machine, and (3) a database-as-control-plane that makes the agents context window programmatically steerable. We further introduce an LLM-as-judge component with dynamically generated evaluation rubrics to determine when the agent has learned enough about one topic to advance to the next. We report results across two iterations: Sensi v1 solves 2 game levels using the two-player architecture alone, while Sensi v2 adds curriculum learning and solves 0 levels - but completes its entire learning curriculum in approximately 32 action attempts, achieving 50-94x greater sample efficiency than comparable systems that require 1600-3000 attempts. We precisely diagnose the failure mode as a self-consistent hallucination cascade originating in the perception layer, demonstrating that the architectural bottleneck has shifted from learning efficiency to perceptual grounding - a more tractable problem.

评分理由: 论文提出了一种用于胸部X光印象报告的检索增强生成（RAG）系统，核心是解决生成式大模型在医学领域中的幻觉和缺乏临床依据问题。因此，与"Retrieval-Augmented Generation"高度相关（10分），与"AI for Science"高度相关（10分），因为它是大模型在生物医学（放射学）领域的应用。论文提到使用大语言模型（LLMs）进行报告生成，因此与"Large Language Models"相关（8分）。系统通过检索历史报告来确保事实一致性，直接针对"Hallucination Mitigation"问题（8分）。系统输出具有可解释性和引用可追溯性，与"Explainable AI"有一定关联（5分）。其他关键词如MoE、SFT、RLHF、量化等未在摘要中提及或与论文核心内容无关，因此得0分。

随着深度学习与大语言模型的兴起，自动化放射学报告生成日益受到关注。然而，完全生成式方法常出现幻觉问题且缺乏临床依据，限制了其在实际工作流程中的可靠性。本研究提出一种多模态检索增强生成（RAG）系统，用于胸部X光影像印象的基于依据的草稿生成。该系统结合对比式图文嵌入、基于病例的相似性检索与引用约束的草稿生成机制，确保与历史放射学报告的事实对齐。我们使用MIMIC-CXR数据集的精选子集构建多模态检索数据库：图像嵌入通过CLIP编码器生成，文本嵌入则源自结构化的印象章节。通过FAISS索引实现可扩展的最近邻检索，构建了融合相似度框架。检索到的病例用于构建基于依据的提示，以生成印象草稿，并通过安全机制强制实施引用覆盖和基于置信度的拒绝生成。实验结果表明，与纯图像检索相比，多模态融合显著提升了检索性能，在临床相关发现上Recall@5超过0.95。基于依据的草稿生成流程可产生具有明确引用溯源性的可解释输出，相较于传统生成方法显著提升了可信度。本研究凸显了检索增强多模态系统在可靠临床决策支持与放射学工作流程增强方面的潜力。

Automated radiology report generation has gained increasing attention with the rise of deep learning and large language models. However, fully generative approaches often suffer from hallucinations and lack clinical grounding, limiting their reliability in real-world workflows. In this study, we propose a multimodal retrieval-augmented generation (RAG) system for grounded drafting of chest radiograph impressions. The system combines contrastive image-text embeddings, case-based similarity retrieval, and citation-constrained draft generation to ensure factual alignment with historical radiology reports. A curated subset of the MIMIC-CXR dataset was used to construct a multimodal retrieval database. Image embeddings were generated using CLIP encoders, while textual embeddings were derived from structured impression sections. A fusion similarity framework was implemented using FAISS indexing for scalable nearest-neighbor retrieval. Retrieved cases were used to construct grounded prompts for draft impression generation, with safety mechanisms enforcing citation coverage and confidence-based refusal. Experimental results demonstrate that multimodal fusion significantly improves retrieval performance compared to image-only retrieval, achieving Recall@5 above 0.95 on clinically relevant findings. The grounded drafting pipeline produces interpretable outputs with explicit citation traceability, enabling improved trustworthiness compared to conventional generative approaches. This work highlights the potential of retrieval-augmented multimodal systems for reliable clinical decision support and radiology workflow augmentation

评分理由: 论文提出EVA框架，通过强化学习后训练（post-training）对齐视频世界模型，使其生成物理可执行的机器人动作。核心相关关键词：1) “Post-training” OR “Supervised Fine-tuning” OR “SFT”（10分）：论文明确使用强化学习后训练框架。2) “RLHF” OR “RLAIF” OR “Direct Preference Optimization” OR “DPO”（10分）：使用强化学习（RL）进行对齐，属于RLHF相关技术。3) “World Models” AND “General World Models”（10分）：论文聚焦视频世界模型（video world models）用于机器人控制。4) “Instruction Tuning” OR “Alignment” OR “Value Alignment”（8分）：涉及模型对齐（alignment）以改善可执行性。其他关键词如LLMs、MoE、RAG等与论文内容无关，得0分。

视频生成模型正日益被用作机器人的世界模型，其中模型根据当前观测和任务指令生成未来的视觉推演序列，而逆动力学模型则将生成的帧转换为可执行的机器人动作。然而，当前的视频世界模型缺乏显式的可执行性约束。这导致视觉连贯的推演序列仍可能违反刚体运动学一致性，在通过逆动力学模型解码时产生不稳定或不可行的控制指令。我们将这种视觉生成与物理可执行控制之间的不匹配称为可执行性差距。虽然可通过拒绝采样等推理时技术缓解该差距，但由于视频生成成本高昂，此类方法效率低下。本文利用可执行性差距作为训练信号，提出可执行视频对齐——一种用于对齐视频世界模型的强化学习后训练框架。该框架在真实机器人轨迹上训练逆动力学模型，并将其重新用作奖励模型，通过生成视频所诱导的动作序列来评估视频质量：奖励由速度、加速度和急动度度量的平滑运动，同时惩罚违反本体约束的动作。值得注意的是，即使生成视频存在严重视觉伪影，该奖励仍能提供有效信息，因为此类伪影通常对应不稳定或越界的动作。在RoboTwin基准测试和真实双臂机器人上的实验表明，该方法能减少生成推演中特定于本体的伪影，并提升下游任务执行成功率。

Video generative models are increasingly used as world models for robotics, where a model generates a future visual rollout conditioned on the current observation and task instruction, and an inverse dynamics model (IDM) converts the generated frames into executable robot actions. However, current video world models lack explicit executability constraints. As a result, visually coherent rollouts may still violate rigid-body and kinematic consistency, producing unstable or infeasible control commands when decoded by an IDM. We refer to this mismatch between visual generation and physically executable control as the executability gap. While this gap can be mitigated at inference time using techniques such as rejection sampling, such approaches are inefficient due to the high cost of video generation. In this paper, we leverage the executability gap as a training signal and introduce Executable Video Alignment (EVA), a reinforcement-learning post-training framework for aligning video world models. EVA trains an inverse dynamics model on real robot trajectories and repurposes it as a reward model that evaluates generated videos through the action sequences they induce, encouraging smooth motions measured by velocity, acceleration, and jerk while penalizing actions that violate embodiment constraints. Importantly, the reward remains informative even when generated videos contain severe visual artifacts, since such artifacts typically translate into unstable or out-of-bound actions. Experiments on the RoboTwin benchmark and a real bimanual robot show that EVA reduces embodiment-specific artifacts in generated rollouts and improves downstream task execution success.

评分理由: 论文研究视觉语言模型（VLMs）的越狱攻击和安全对齐问题，与"Large Language Models"高度相关（VLMs是大模型的一种），“Instruction Tuning” OR “Alignment” OR “Value Alignment"是核心主题（研究安全对齐失效），“Mechanistic Interpretability” OR “Explainable AI"是核心方法（通过表示空间分析解释越狱机制），“Hallucination Mitigation” OR “Factuality” OR “Truthfulness"有一定关联（涉及安全性和真实性），其他关键词未在论文中涉及。

大型视觉语言模型（VLMs）在整合视觉模态后，其安全对齐性常出现弱化现象。即使文本提示包含明确的有害意图，添加图像仍会显著提高越狱成功率。本文发现，在表征空间中，VLMs能够清晰区分良性输入与有害输入。此外，即使在有害输入中，越狱样本也会形成一种与拒绝样本明显分离的独特内部状态。这些观察表明，越狱行为并非源于模型未能识别有害意图，而是视觉模态将表征推向特定的越狱状态，从而导致未能触发拒绝机制。为量化这一转变，我们识别出一个越狱方向，并将图像诱导的表征偏移沿此方向的分量定义为越狱相关偏移。分析表明，越狱相关偏移能可靠地表征越狱行为，为多样化的越狱场景提供了统一解释。最后，我们提出一种防御方法，通过在推理时移除越狱相关偏移（JRS-Rem）来增强VLM的安全性。实验证明，JRS-Rem能在多种场景下提供强效防御，同时保持良性任务上的性能。

Large vision-language models (VLMs) often exhibit weakened safety alignment with the integration of the visual modality. Even when text prompts contain explicit harmful intent, adding an image can substantially increase jailbreak success rates. In this paper, we observe that VLMs can clearly distinguish benign inputs from harmful ones in their representation space. Moreover, even among harmful inputs, jailbreak samples form a distinct internal state that is separable from refusal samples. These observations suggest that jailbreaks do not arise from a failure to recognize harmful intent. Instead, the visual modality shifts representations toward a specific jailbreak state, thereby leading to a failure to trigger refusal. To quantify this transition, we identify a jailbreak direction and define the jailbreak-related shift as the component of the image-induced representation shift along this direction. Our analysis shows that the jailbreak-related shift reliably characterizes jailbreak behavior, providing a unified explanation for diverse jailbreak scenarios. Finally, we propose a defense method that enhances VLM safety by removing the jailbreak-related shift (JRS-Rem) at inference time. Experiments show that JRS-Rem provides strong defense across multiple scenarios while preserving performance on benign tasks.

评分理由: 论文提出了一种基于本地LLM的文本匿名化框架，核心是使用LLM替换文本中的个人身份信息。因此，与"Large Language Models"高度相关（10分）。论文提到使用BERT+LoRA进行微调，与"PEFT/LoRA"相关（8分）。论文评估了在问答代理前加入匿名化层的效果，与"LLM Agents"相关（8分）。论文提到使用本地LLM，与"Small Language Models/On-device AI"有一定关联（5分）。其他关键词如MoE、Scaling Laws、RLHF等与论文内容无关（0分）。

负责任地使用人工智能要求我们在不损害数据实用性的前提下保护敏感信息，这一需求在大语言模型时代变得尤为迫切。我们通过一种本地部署的、基于大语言模型的替换流程来应对这一挑战，该流程通过将个人可识别信息替换为符合类型特征的逼真替代内容来实现文本匿名化。该方法完全在组织边界内使用本地大语言模型执行，既能防止数据外泄，又能保持文本的流畅性和任务相关语义。

我们在基于对话的行为数据集上进行了系统性、多指标、跨技术的评估，以行业标准方案（微软Presidio和谷歌DLP）以及前沿方法（ZSTS，包括仅删除版本及删除加替换版本）作为基准。我们的评估方案通过一项面向全生命周期的标准，综合衡量了隐私性、语义效用及隐私保护下的可训练性——该标准通过对经脱敏处理的文本微调紧凑编码器（BERT+LoRA）获得。此外，我们通过在应答大语言模型前插入本地匿名化层，并评估其回答质量，来检验智能问答代理的性能。这一中间化的类型保持替换阶段确保敏感内容不会暴露给第三方API，从而在保障机密性的前提下实现问答代理的负责任部署。

我们的方法在隐私性、主题偏移控制、事实效用保持及可训练性损失方面均达到最优水平，在隐私-效用-可训练性的综合评估边界上超越了基于规则的方法、命名实体识别基准模型以及各版本ZSTS方法。这些结果表明，基于本地大语言模型的替换技术能够生成既符合负责任使用要求又具备操作价值的匿名语料：既适用于智能代理流程的安全部署，也适用于下游微调任务且性能衰减有限。

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise, LLM-driven substitution pipeline that anonymizes text by replacing personally identifiable information (PII) with realistic, type-consistent surrogates. Executed entirely within organizational boundaries using local LLMs, the approach prevents data egress while preserving fluency and task-relevant semantics. We conduct a systematic, multi-metric, cross-technique evaluation on the Action-Based Conversation Dataset, benchmarking against industry standards (Microsoft Presidio and Google DLP) and a state-of-the-art approach (ZSTS, in redaction-only and redaction-plus-substitution variants). Our protocol jointly measures privacy, semantic utility, and trainability under privacy via a lifecycle-ready criterion obtained by fine-tuning a compact encoder (BERT+LoRA) on sanitized text. In addition, we assess agentic Q&A performance by inserting an on-premise anonymization layer before the answering LLM and evaluating the quality of its responses. This intermediate, type-preserving substitution stage ensures that no sensitive content is exposed to third-party APIs, enabling responsible deployment of Q&A agents without compromising confidentiality. Our method attains state-of-the-art privacy, minimal topical drift, strong factual utility, and low trainability loss, outperforming rule-based approaches and named-entity recognition (NER) baselines and ZSTS variants on the combined privacy–utility–trainability frontier. These results show that local LLM substitution yields anonymized corpora that are both responsible to use and operationally valuable: safe for agentic pipelines and suitable for downstream fine-tuning with limited degradation.

评分理由: 论文核心研究LLM幻觉缓解，通过领域接地的分层检索和验证架构（RAG变体）来提升事实准确性。因此，与"Large Language Models”（论文明确研究LLM）、“Retrieval-Augmented Generation”（核心方法基于RAG架构）和"Hallucination Mitigation”（直接解决幻觉问题）高度相关（10分）。其他关键词如MoE、SLMs、训练技术、推理方法、代理系统、模型压缩等，论文未涉及，给0分。

大型语言模型（LLMs）在流畅性方面取得了前所未有的成就，但仍易产生“幻觉”——即生成事实错误或无依据的内容。这一局限在可靠性至关重要的高风险领域中尤为关键。我们提出了一种领域锚定的分层检索与验证架构，旨在通过将LLMs从随机模式匹配器转变为经过验证的真相探寻者，系统性地拦截事实错误。该框架采用基于LangGraph实现的四阶段自调节流程：（I）利用早期退出逻辑进行内在验证以优化计算资源，（II）通过领域检测器实现自适应搜索路由以定向检索特定主题档案库，（III）采用纠正性文档分级（CRAG）过滤无关上下文，（IV）进行外部再生及原子化声明级验证。该系统在来自五个不同基准测试的650条查询中进行了评估：TimeQA v2、FreshQA v2、HaluEval General、MMLU Global Facts和TruthfulQA。实证结果表明，该流程在所有环境中均持续优于零样本基线。在TimeQA v2中胜率峰值达83.7%，在MMLU Global Facts中达78.0%，证实了其在需要精细时间和数值精度的领域具有高效性。在事实性答案行中，锚定分数稳定保持在78.8%至86.4%之间。尽管该架构为错误信息提供了强大的故障防护机制，但仍识别出“虚假前提过度断言”这一持续存在的失效模式。这些发现为多阶段检索增强生成（RAG）行为提供了详细的实证特征描述，并表明未来工作应优先发展检索前“可答性”节点，以进一步弥合对话式人工智能的可靠性差距。

Large Language Models (LLMs) have achieved unprecedented fluency but remain susceptible to “hallucinations” - the generation of factually incorrect or ungrounded content. This limitation is particularly critical in high-stakes domains where reliability is paramount. We propose a domain-grounded tiered retrieval and verification architecture designed to systematically intercept factual inaccuracies by shifting LLMs from stochastic pattern-matchers to verified truth-seekers. The proposed framework utilizes a four-phase, self-regulating pipeline implemented via LangGraph: (I) Intrinsic Verification with Early-Exit logic to optimize compute, (II) Adaptive Search Routing utilizing a Domain Detector to target subject-specific archives, (III) Corrective Document Grading (CRAG) to filter irrelevant context, and (IV) Extrinsic Regeneration followed by atomic claim-level verification. The system was evaluated across 650 queries from five diverse benchmarks: TimeQA v2, FreshQA v2, HaluEval General, MMLU Global Facts, and TruthfulQA. Empirical results demonstrate that the pipeline consistently outperforms zero-shot baselines across all environments. Win rates peaked at 83.7% in TimeQA v2 and 78.0% in MMLU Global Facts, confirming high efficacy in domains requiring granular temporal and numerical precision. Groundedness scores remained robustly stable between 78.8% and 86.4% across factual-answer rows. While the architecture provides a robust fail-safe for misinformation, a persistent failure mode of “False-Premise Overclaiming” was identified. These findings provide a detailed empirical characterization of multi-stage RAG behavior and suggest that future work should prioritize pre-retrieval “answerability” nodes to further bridge the reliability gap in conversational AI.

评分理由: 论文核心研究大语言模型（LLMs）如何编码语义关系，直接高度相关于关键词1（LLMs）和关键词23（Mechanistic Interpretability）。论文使用稀疏自编码器（SAE）进行分析，与关键词2（Sparse Models）有一定关联。论文研究了不同规模的模型（包括70M参数的Pythia），与关键词3（Small Language Models）有一定关联。论文未涉及其他关键词如训练方法、推理技术、应用领域等，因此这些关键词评分为0。

理解大型语言模型（LLM）是否捕捉结构化意义，需要考察它们如何表征概念间的关系。本研究考察了三个规模递增的模型：Pythia-70M、GPT-2 和 Llama 3.1 8B，聚焦于四种语义关系：同义关系、反义关系、上下位关系（hypernymy）和下位关系（hyponymy）。我们结合线性探测与机制可解释性技术，包括稀疏自编码器（SAE）和激活修补，以识别这些关系在何处被编码，以及特定特征如何对其表征做出贡献。我们的结果揭示了层级关系中的方向性不对称：上下位关系被冗余编码且难以抑制，而下位关系则依赖于紧凑的特征，这些特征更容易因消融而受到破坏。更广泛地说，关系信号是弥散的，但表现出稳定的分布模式：它们在中层达到峰值，并且在残差后/MLP通路中比在注意力通路中更强。不同模型间的任务难度保持一致（反义关系最容易，同义关系最难）。探测层面的因果性取决于模型能力：在 Llama 3.1 上，SAE 引导的修补能可靠地改变这些信号，而在较小模型上，这种改变则微弱或不稳定。我们的结果阐明了语义关系在 LLM 内部何处以及如何可靠地表征，并提供了一个可复现的框架，用于将稀疏特征与探测层面的因果证据联系起来。

Understanding whether large language models (LLMs) capture structured meaning requires examining how they represent concept relationships. In this work, we study three models of increasing scale: Pythia-70M, GPT-2, and Llama 3.1 8B, focusing on four semantic relations: synonymy, antonymy, hypernymy, and hyponymy. We combine linear probing with mechanistic interpretability techniques, including sparse autoencoders (SAE) and activation patching, to identify where these relations are encoded and how specific features contribute to their representation. Our results reveal a directional asymmetry in hierarchical relations: hypernymy is encoded redundantly and resists suppression, while hyponymy relies on compact features that are more easily disrupted by ablation. More broadly, relation signals are diffuse but exhibit stable profiles: they peak in the mid-layers and are stronger in post-residual/MLP pathways than in attention. Difficulty is consistent across models (antonymy easiest, synonymy hardest). Probe-level causality is capacity-dependent: on Llama 3.1, SAE-guided patching reliably shifts these signals, whereas on smaller models the shifts are weak or unstable. Our results clarify where and how reliably semantic relations are represented inside LLMs, and provide a reproducible framework for relating sparse features to probe-level causal evidence.

评分理由: 该论文研究医学视觉-语言模型（VLMs）中的模态间隙（modality gap）现象及其对下游性能的影响，并提出一种轻量级后处理机制进行调控。论文核心与医学AI应用高度相关（关键词27得10分），涉及预训练模型的分析（关键词5得5分）和后训练调控方法（关键词6得8分），并对模型表示的可解释性有一定探讨（关键词23得5分）。论文未涉及纯语言模型、推理、对齐、高效微调、检索增强、上下文扩展、注意力优化、智能体、量化、加速、幻觉缓解、世界模型、模型合并、上下文学习等其他技术主题，因此这些关键词得0分。

视觉语言模型（VLMs）在表征空间中呈现出一种典型的“锥体效应”，即非线性编码器将嵌入向量映射到高度集中的区域，这导致了被称为模态间隙的跨模态分离现象。尽管该现象已被广泛观测到，但其在监督式多模态学习（尤其在医学领域）中的实际影响尚不明确。本研究提出一种轻量级事后处理机制，该机制保持预训练的VLM编码器冻结，同时通过单一超参数{λ}持续调控跨模态分离程度。这使得我们能够在不进行昂贵重新训练的情况下，系统分析模态间隙如何影响下游多模态性能。我们在监督式多模态设置下，评估了通用模型（CLIP、SigLIP）和医学专用模型（BioMedCLIP、MedSigLIP）在多种医学与自然数据集上的表现。结果一致表明，减小过大的模态间隙能提升下游性能，且医学数据集对间隙调节表现出更强的敏感性；然而，完全消除间隙并非总是最优选择，中等程度、依赖具体任务的分离状态往往能产生最佳结果。这些发现将模态间隙定位为多模态表征的一种可调节属性，而非一个应当被普遍最小化的量。

Vision-Language Models (VLMs) exhibit a characteristic “cone effect” in which nonlinear encoders map embeddings into highly concentrated regions of the representation space, contributing to cross-modal separation known as the modality gap. While this phenomenon has been widely observed, its practical impact on supervised multimodal learning -particularly in medical domains- remains unclear. In this work, we introduce a lightweight post-hoc mechanism that keeps pretrained VLM encoders frozen while continuously controlling cross-modal separation through a single hyperparameter {λ}. This enables systematic analysis of how the modality gap affects downstream multimodal performance without expensive retraining. We evaluate generalist (CLIP, SigLIP) and medically specialized (BioMedCLIP, MedSigLIP) models across diverse medical and natural datasets in a supervised multimodal settings. Results consistently show that reducing excessive modality gap improves downstream performance, with medical datasets exhibiting stronger sensitivity to gap modulation; however, fully collapsing the gap is not always optimal, and intermediate, task-dependent separation yields the best results. These findings position the modality gap as a tunable property of multimodal representations rather than a quantity that should be universally minimized.

评分理由: 论文UniSAFE专注于统一多模态模型（UMMs）的安全性评估，属于大模型应用领域。与关键词的相关性分析如下：1）“Large Language Models"等（5分）：UMMs通常基于大模型构建，但论文未深入讨论其技术原理。2）“Instruction Tuning"等（8分）：论文强调"safety alignment”，直接涉及模型对齐和安全调整。3）“Hallucination Mitigation"等（8分）：论文评估安全风险如违规内容生成，与事实性和真实性相关。4）“Mechanistic Interpretability"等（5分）：通过基准测试解释模型漏洞，与可解释AI有一定关联。其他关键词如MoE、量化、推理加速等与论文内容无关，得0分。

统一多模态模型（UMMs）具备强大的跨模态能力，但也带来了单任务模型中未曾观察到的新型安全风险。尽管此类模型已崭露头角，现有的安全基准测试仍分散于不同任务与模态之间，限制了对复杂系统级漏洞的全面评估。为填补这一空白，我们提出了UniSAFE——首个针对UMMs系统级安全性的综合基准测试，涵盖7种输入/输出模态组合，横跨传统任务与新型多模态上下文图像生成场景。UniSAFE采用共享目标设计，将常见风险场景映射至特定任务的输入/输出配置中，从而实现对安全失效的跨任务可控比较。该基准包含6,802个精心构建的测试实例，我们利用其对15个前沿的专有及开源UMMs进行评估。研究结果揭示了当前UMMs普遍存在的严重漏洞，包括在多图像组合与多轮对话场景中安全违规率显著升高，且图像输出任务的安全脆弱性持续高于文本输出任务。这些发现凸显了加强UMMs系统级安全对齐的迫切需求。我们的代码与数据已公开于https://github.com/segyulee/UniSAFE。

Unified Multimodal Models (UMMs) offer powerful cross-modality capabilities but introduce new safety risks not observed in single-task models. Despite their emergence, existing safety benchmarks remain fragmented across tasks and modalities, limiting the comprehensive evaluation of complex system-level vulnerabilities. To address this gap, we introduce UniSAFE, the first comprehensive benchmark for system-level safety evaluation of UMMs across 7 I/O modality combinations, spanning conventional tasks and novel multimodal-context image generation settings. UniSAFE is built with a shared-target design that projects common risk scenarios across task-specific I/O configurations, enabling controlled cross-task comparisons of safety failures. Comprising 6,802 curated instances, we use UniSAFE to evaluate 15 state-of-the-art UMMs, both proprietary and open-source. Our results reveal critical vulnerabilities across current UMMs, including elevated safety violations in multi-image composition and multi-turn settings, with image-output tasks consistently more vulnerable than text-output tasks. These findings highlight the need for stronger system-level safety alignment for UMMs. Our code and data are publicly available at https://github.com/segyulee/UniSAFE

评分理由: 论文提出Ruyi2.5多模态家族模型，基于AI Flow框架，采用共享骨干架构统一训练不同规模模型，并开发了Ruyi2.5-Camera隐私保护相机服务系统，包含边缘模型进行特征映射和云模型进行深度行为推理，同时提出BPPO方法加速强化学习微调。与关键词相关性分析：1）论文涉及多模态模型，属于大模型范畴，与"Large Language Models"等有一定关联（8分）；2）模型支持不同规模部署，边缘模型部分与"Small Language Models"相关（5分）；3）模型构建涉及预训练和领域适应，与"Pre-training"等关键词相关（8分）；其他关键词如MoE、SFT、RLHF、RAG、量化等未在摘要中体现，评为0分。

我们推出基于AI Flow框架构建的多模态家族模型Ruyi2.5。该模型将Ruyi2的“一次训练，多处部署”范式扩展至多模态领域，构建了一个共享主干架构，在统一流程中协同训练不同规模的模型，确保所有部署层级间的语义一致性。基于Ruyi2.5，我们进一步开发了隐私保护相机服务系统Ruyi2.5-Camera，该系统将Ruyi2.5-Camera实例化为两阶段识别流程：边缘模型采用信息瓶颈引导的不可逆特征映射，在源头对原始帧进行去身份化处理；云端模型则执行深度行为推理。为加速强化学习微调过程，我们进一步提出二元前缀策略优化方法，该方法通过二元响应选择减少样本冗余，并将梯度更新聚焦于响应前缀，相比GRPO实现了2至3倍的训练加速。实验表明，Ruyi2.5在通用多模态基准测试中与Qwen3-VL表现相当，而Ruyi2.5-Camera在隐私受限的监控任务中显著优于Qwen3-VL。

We present Ruyi2.5, a multimodal familial model built on the AI Flow framework. Extending Ruyi2’s “Train Once, Deploy Many” paradigm to the multimodal domain, Ruyi2.5 constructs a shared-backbone architecture that co-trains models of varying scales within a single unified pipeline, ensuring semantic consistency across all deployment tiers. Built upon Ruyi2.5, Ruyi2.5-Camera model is developed as a privacy-preserving camera service system, which instantiates Ruyi2.5-Camera into a two-stage recognition pipeline: an edge model applies information-bottleneck-guided irreversible feature mapping to de-identify raw frames at the source, while a cloud model performs deep behavior reasoning. To accelerate reinforcement learning fine-tuning, we further propose Binary Prefix Policy Optimization (BPPO), which reduces sample redundancy via binary response selection and focuses gradient updates on response prefixes, achieving a 2 to 3 times training speedup over GRPO. Experiments show Ruyi2.5 matches Qwen3-VL on the general multimodal benchmarks, while Ruyi2.5-Camera substantially outperforms Qwen3-VL on privacy-constrained surveillance tasks.

评分理由: 论文核心研究语言模型的空间推理能力，并应用了SFT和RL训练方法。因此，与"Large Language Models"和"Post-training"高度相关（10分），因为论文明确使用LLM并采用SFT（Best-of-N sampling）和RL（GRPO）进行训练。其他关键词如MoE、SLMs、Scaling Laws、RAG、CoT、Agents、Quantization等均未在摘要中提及或与论文主题无关，故得0分。

本研究探讨了语言模型从非结构化文本中展现空间推理的能力，旨在模拟人类认知并自动化一个对众多下游媒体应用有益的过程。具体而言，我们聚焦于“叙事到剧本”任务：从缺乏明确空间、位置或关系线索的文本中，推断出舞台剧本布局（包括场景、说话者位置、移动轨迹及房间类型）。我们进而引入一套受戏剧学启发的确定性评估体系，并提出一种训练与推理方案，该方案结合了基于Best-of-N采样的拒绝式监督微调，以及通过GRPO实现的可验证奖励强化学习。在仅包含古典英语文学文本的语料库上进行的实验表明，该方法在多项指标（角色归属、空间合理性和移动经济性）上均优于基础模型，并且与基于大语言模型的自动评估及人类主观偏好保持一致。

In this work, we probe the ability of a language model to demonstrate spatial reasoning from unstructured text, mimicking human capabilities and automating a process that benefits many downstream media applications. Concretely, we study the narrative-to-play task: inferring stage-play layouts (scenes, speaker positions, movements, and room types) from text that lacks explicit spatial, positional, or relational cues. We then introduce a dramaturgy-inspired deterministic evaluation suite and, finally, a training and inference recipe that combines rejection SFT using Best-of-N sampling with RL from verifiable rewards via GRPO. Experiments on a text-only corpus of classical English literature demonstrate improvements over vanilla models across multiple metrics (character attribution, spatial plausibility, and movement economy), as well as alignment with an LLM-as-a-judge and subjective human preferences.

评分理由: 该论文的核心是研究大型语言模型（LLMs）的内部功能模块化组织，属于LLM可解释性（Interpretability）研究范畴。因此，它与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（10分），因为论文直接以LLMs为研究对象。同时，它与关键词"Mechanistic Interpretability” OR “Explainable AI"高度相关（10分），因为其目标是理解和解释LLM的内部工作机制（发现功能模块），这是可解释性AI的核心任务。论文未涉及其他关键词所描述的具体技术（如MoE、训练方法、推理加速、应用领域等），因此这些关键词得分为0分。

理解大型语言模型（LLM）的内部功能组织对于提升其可信度与性能至关重要。然而，LLM如何将不同功能组织到模块中，目前仍鲜有探索。为填补这一空白，我们提出了一个功能模块发现问题，并设计了一种无监督的LLM跨层模块发现（ULCMOD）框架。该框架能够将整个LLM中的大量神经元同时解耦为多个模块，同时发现与这些模块相关的输入样本主题。我们的框架引入了一种新颖的目标函数和一种高效的迭代解耦（IterD）算法。大量实验表明，我们的方法能够发现高质量、解耦的模块，这些模块能捕捉更具意义的语义信息，并在多种下游任务中取得优越性能。此外，我们的定性分析表明，所发现的模块具有语义连贯性，对应着可解释的特定功能，并在LLM内部呈现出清晰的空间与层次化组织。本研究为解释LLM的功能模块提供了一种新工具，填补了LLM可解释性研究中的一个关键空白。

Understanding the internal functional organization of Large Language Models (LLMs) is crucial for improving their trustworthiness and performance. However, how LLMs organize different functions into modules remains highly unexplored. To bridge this gap, we formulate a functional module discovery problem and propose an Unsupervised LLM Cross-layer MOdule Discovery (ULCMOD) framework that simultaneously disentangles the large set of neurons in the entire LLM into modules while discovering the topics of input samples related to these modules. Our framework introduces a novel objective function and an efficient Iterative Decoupling (IterD) algorithm. Extensive experiments show that our method discovers high-quality, disentangled modules that capture more meaningful semantic information and achieve superior performance in various downstream tasks. Moreover, our qualitative analysis reveals that the discovered modules show semantic coherence, correspond to interpretable specializations, and a clear spatial and hierarchical organization within the LLM. Our work provides a novel tool for interpreting the functional modules of LLMs, filling a critical blank in LLM’s interpretability research.

评分理由: 该论文的核心研究对象是多模态大语言模型（MLLMs），因此与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（10分）。论文的核心研究内容是视频监督微调（Video-SFT），这是监督微调（SFT）在视频模态上的具体应用，因此与关键词"Post-training” OR “Supervised Fine-tuning” OR “SFT"高度相关（10分）。论文主要探讨Video-SFT对模型视觉能力（空间与时间理解）的影响，并提出了一种混合帧策略来缓解图像-视频性能权衡。论文未涉及其他关键词所描述的技术（如MoE、量化、RAG、对齐、推理方法、智能体、科学AI应用等），因此这些关键词的相关度为0分。

多模态大语言模型（MLLMs）通常通过多阶段训练进行构建，其中基于视频的监督微调（Video-SFT）是提升视觉理解能力的关键步骤。然而，其对视觉能力细粒度演变的影响，尤其是空间理解与时间理解之间的平衡，目前仍不甚明晰。本文系统研究了Video-SFT如何重塑MLLMs的视觉能力。在不同模型架构、参数规模和帧采样设置下，我们观察到一个一致的模式：Video-SFT能稳定提升视频任务性能，但在静态图像基准测试中往往仅带来有限增益，甚至导致性能下降。我们进一步揭示，这种权衡与时间预算密切相关：增加采样帧数通常能改善视频性能，但并不能稳定提升静态图像性能。基于这一发现，我们研究了一种指令感知的混合帧策略（Hybrid-Frame），该策略能自适应分配帧数，并在一定程度上缓解图像与视频任务之间的权衡。我们的结果表明，Video-SFT对MLLMs而言并非免费午餐，在联合图像-视频训练中保持空间理解能力仍是一个核心挑战。

Multimodal large language models (MLLMs) are typically trained in multiple stages, with video-based supervised fine-tuning (Video-SFT) serving as a key step for improving visual understanding. Yet its effect on the fine-grained evolution of visual capabilities, particularly the balance between spatial and temporal understanding, remains poorly understood. In this paper, we systematically study how Video-SFT reshapes visual capabilities in MLLMs. Across architectures, parameter scales, and frame sampling settings, we observe a consistent pattern: Video-SFT reliably improves video performance, but often yields limited gains or even degradation on static image benchmarks. We further show that this trade-off is closely tied to temporal budget: increasing the number of sampled frames generally improves video performance, but does not reliably improve static image performance. Motivated by this finding, we study an instruction-aware Hybrid-Frame strategy that adaptively allocates frame counts and partially mitigates the image-video trade-off. Our results indicate that Video-SFT is not a free lunch for MLLMs, and preserving spatial understanding remains a central challenge in joint image-video training.

评分理由: 论文提出了一种用于脊柱不稳定性筛查的医学影像分析框架TGBP，属于AI在生物医学领域的应用。摘要中明确提到框架集成了大型语言模型（LLM）模块，因此与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"有一定关联（5分）。框架强调其"auditable white-box"和"interpretable"特性，与"Mechanistic Interpretability” OR “Explainable AI"相关（5分）。论文的核心是医学影像分析在生物信息学/生物医学领域的应用，与关键词"AI for Science” OR “Bioinformatics” OR “Cheminformatics"高度相关（10分）。论文未涉及其他关键词所描述的大模型技术原理、训练方法、推理优化、智能体等具体技术细节，因此这些关键词评分为0分。

常规肿瘤学计算机断层扫描（CT）为筛查脊柱不稳定性提供了理想机会，但由于脊柱肿瘤不稳定评分（SINS）所需的复杂几何推理，预防性稳定窗口常被错过。转移性骨溶解从根本上阻碍了SINS的自动化，其引发的拓扑模糊性干扰了标准分割方法与黑盒人工智能。我们提出拓扑引导生物力学分析框架（Topology-Guided Biomechanical Profiling, TGBP），这是一个可审计的白盒框架，将解剖感知与结构推理解耦。TGBP将SINS评估锚定于两项确定性几何创新：（i）采用椎管参照分区法以解决后外侧边界模糊问题；（ii）通过基于协方差的定向包围盒（oriented bounding boxes, OBB）进行上下文感知形态测量归一化，以量化椎体塌陷程度。结合辅助影像组学与大语言模型（LLM）模块，TGBP实现了端到端、可解释的SINS评估。在多中心、多癌种队列（$N=482$）验证中，TGBP在三层级稳定性分诊中达到90.2%的准确率。在一项盲法阅片研究（$N=30$）中，TGBP在复杂结构特征评估上显著优于肿瘤内科医生（$κ=0.857$ vs.\ $0.570$），并防止了总分估算中的误差累积（$κ=0.625$ vs.\ $0.207$），从而实现了专家级机会性筛查的普及化。

Routine oncologic computed tomography (CT) presents an ideal opportunity for screening spinal instability, yet prophylactic stabilization windows are frequently missed due to the complex geometric reasoning required by the Spinal Instability Neoplastic Score (SINS). Automating SINS is fundamentally hindered by metastatic osteolysis, which induces topological ambiguity that confounds standard segmentation and black-box AI. We propose Topology-Guided Biomechanical Profiling (TGBP), an auditable white-box framework decoupling anatomical perception from structural reasoning. TGBP anchors SINS assessment on two deterministic geometric innovations: (i) canal-referenced partitioning to resolve posterolateral boundary ambiguity, and (ii) context-aware morphometric normalization via covariance-based oriented bounding boxes (OBB) to quantify vertebral collapse. Integrated with auxiliary radiomic and large language model (LLM) modules, TGBP provides an end-to-end, interpretable SINS evaluation. Validated on a multi-center, multi-cancer cohort ($N=482$), TGBP achieved 90.2% accuracy in 3-tier stability triage. In a blinded reader study ($N=30$), TGBP significantly outperformed medical oncologists on complex structural features ($κ=0.857$ vs.\ $0.570$) and prevented compounding errors in Total Score estimation ($κ=0.625$ vs.\ $0.207$), democratizing expert-level opportunistic screening.

评分理由: 论文核心研究大语言模型（LLMs）在模糊任务上的评估问题，因此与"Large Language Models"高度相关（10分）。论文涉及指令遵循评估，与"Instruction Tuning"有一定关联（5分），但未深入讨论对齐技术本身。其他关键词如MoE、SLMs、训练方法、推理技术、代理系统、科学AI应用等均未在摘要中提及，故评0分。

当前针对大语言模型（LLM）的评估多聚焦于本质上定义不明确的任务，这类任务通常具有模糊的输入输出空间与不清晰的成功标准。本文分析了为何现有的评估基准与指标未能为此类任务提供可靠或具有诊断意义的模型能力信号。我们通过两个案例研究展开探讨：在复杂指令遵循（CIF）任务中，我们识别出反复出现的问题，包括对真实世界指令复杂度的覆盖有限、对指令表述的敏感性、评估指标不一致且不可比，以及基于LLM的评判器引入的不稳定性；在自然语言转Mermaid序列图（NL2Mermaid）任务中，我们展示了多维度评估标准如何能够提供超越综合分数的、可指导实践的具体洞见。这些案例共同表明，当前的评估方法常常混淆不同的失败模式，导致所得分数不稳定、缺乏诊断性且难以指导改进。我们的研究结果揭示了现有针对定义不明确任务的评估实践存在根本性局限，并呼吁设计更具鲁棒性和可解释性的评估方案。

Many evaluations of Large Language Models (LLMs) target tasks that are inherently ill-defined, with unclear input and output spaces and ambiguous success criteria. We analyze why existing evaluation benchmarks and metrics fail to provide reliable or diagnostic signals of model capability for such tasks. We examine two case studies: Complex Instruction Following (CIF), where we identify recurring issues including limited coverage of real-world instruction complexity, sensitivity to instruction phrasing, inconsistent and non-comparable metrics, and instability introduced by LLM-based judges; and Natural Language to Mermaid Sequence Diagrams (NL2Mermaid), where we show how multi-faceted evaluation criteria can yield actionable insights beyond aggregate scores. Together, these case studies show that current evaluations frequently conflate distinct failure modes, yielding scores that are unstable, non-diagnostic, and difficult to act upon. Our findings expose fundamental limitations in existing evaluation practices for ill-defined tasks and motivate more robust, interpretable evaluation designs.

评分理由: 该论文研究AI辅助目标设定对目标进展的影响，核心是应用大型语言模型（LLM）作为职业教练（AI career coach “Leon” powered by Claude Sonnet），属于大模型在心理学/行为科学领域的应用研究。论文明确提及LLM-based chatbots，因此与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（10分）。其他关键词主要涉及大模型技术原理（如MoE、Scaling Laws、训练方法、推理优化等）或特定科学领域应用（如生物信息学），论文未涉及这些具体技术细节或领域，因此相关度为0分。

如何大规模帮助人们识别并追求具有个人意义的职业目标，仍是应用心理学领域的一个关键挑战。职业辅导能够提升目标质量与达成率，但其成本高昂且可及性有限，制约了普及范围。基于大语言模型（LLM）的聊天机器人提供了一种可扩展的替代方案，然而其支持目标追求的心理机制尚未得到验证。本文报告了一项预先注册的三臂随机对照试验（N = 517），比较了人工智能职业教练（“Leon”，基于Claude Sonnet模型驱动）、一份内容高度匹配的书面结构化反思问卷，以及无干预对照组在两周随访期的目标进展。结果显示，人工智能聊天机器人带来的目标进展显著高于对照组（d = 0.33, p = .016）。与书面反思条件相比，人工智能并未显著提升整体目标进展，但它增强了参与者感知到的社会问责感。在预先注册的中介模型中，感知到的问责感中介了人工智能相对于问卷条件对目标进展的影响（间接效应 = 0.15, 95% CI [0.04, 0.31]），而自我一致性则未显示中介作用。这些发现表明，人工智能辅助的目标设定能够改善短期目标进展，且相较于结构化自我反思，其最明确的附加价值在于增强了感知到的问责感。

Helping people identify and pursue personally meaningful career goals at scale remains a key challenge in applied psychology. Career coaching can improve goal quality and attainment, but its cost and limited availability restrict access. Large language model (LLM)-based chatbots offer a scalable alternative, yet the psychological mechanisms by which they might support goal pursuit remain untested. Here we report a preregistered three-arm randomised controlled trial (N = 517) comparing an AI career coach (“Leon,” powered by Claude Sonnet), a matched structured written questionnaire covering closely matched reflective topics, and a no-support control on goal progress at a two-week follow-up. The AI chatbot produced significantly higher goal progress than the control (d = 0.33, p = .016). Compared with the written-reflection condition, the AI did not significantly improve overall goal progress, but it increased perceived social accountability. In the preregistered mediation model, perceived accountability mediated the AI-over-questionnaire effect on goal progress (indirect effect = 0.15, 95% CI [0.04, 0.31]), whereas self-concordance did not. These findings suggest that AI-assisted goal setting can improve short-term goal progress, and that its clearest added value over structured self-reflection lies in increasing felt accountability.

评分理由: 该论文主要研究一个结合了词典和OpenAI大语言模型（LLM）的浏览器扩展，用于为数字素养较低的用户提供技术术语的上下文帮助。论文的核心应用了LLM（OpenAI的ChatGPT）来生成定义，因此与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关，评分为8分（论文的核心应用了LLM，但未深入探讨LLM的技术原理或创新）。其他关键词主要涉及大模型的技术原理、训练方法、推理优化、代理系统、科学应用等具体技术方向，而本文仅将LLM作为一个现成的工具组件用于应用开发，未涉及这些具体技术细节或创新，因此相关度为0分。

本文阐述了一款浏览器扩展程序的设计、实现与评估。该扩展能为用户在网页上悬停于技术缩写词时提供情境化帮助。它结合了精选技术词典与OpenAI大语言模型（LLM），通过轻量级工具提示浮层提供按需定义。系统采用双层人工智能（AI）处理流程：首先通过谷歌云自然语言处理（NLP）分类API与OpenAI的ChatGPT对访问页面进行技术相关性判定，随后才激活提示逻辑，从而降低误判率。一项针对25名中低数字素养用户的混合方法研究评估了该工具对阅读理解与信息检索时间的影响。结果显示：92%的参与者表示对技术术语的理解得到提升，96%的参与者确认其节省了手动网页搜索时间，所有参与者均认为工具提示未造成干扰。词典定义的平均生成时间为2135毫秒，AI生成定义需16429毫秒，而手动搜索每个缩写词的平均耗时则为17200毫秒。本研究展示了一种弥合数字素养鸿沟的实用实时方案，并为将情境化帮助扩展至医学、法律、金融等其他领域指明了方向。

This paper describes the design, implementation, and evaluation of a browser extension that provides contextual help to users who hover over technological acronyms and abbreviations on web pages. The extension combines a curated technical dictionary with OpenAI’s large language model (LLM) to deliver on-demand definitions through lightweight tooltip overlays. A dual-layer artificial intelligence (AI) pipeline, comprising Google Cloud’s Natural Language Processing (NLP) taxonomy API and OpenAI’s ChatGPT, classifies each visited page as technology-related before activating the tooltip logic, thereby reducing false-positive detections. A mixed-methods study with 25 participants evaluated the tool’s effect on reading comprehension and information-retrieval time among users with low to intermediate digital literacy. Results show that 92% of participants reported improved understanding of technical terms, 96% confirmed time savings over manual web searches, and all participants found the tooltips non-disruptive. Dictionary-based definitions were appended in an average of 2135 ms, compared to 16429 ms for AI-generated definitions and a mean manual search time of 17200 ms per acronym. The work demonstrates a practical, real-time approach to bridging the digital literacy gap and points toward extending contextual help to other domains such as medicine, law, and finance.

评分理由: 论文提出了一种基于文本嵌入插值的图像编辑方法，核心是利用大语言模型（LLM）自动构建去偏对比提示对，从而在文本编码器空间中计算转向向量。因此，仅与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（8分），因为LLM被用作工具生成提示。其他关键词涉及模型架构、训练方法、推理技术、对齐、压缩、科学应用等，论文均未涉及，故评分为0。

我们提出一种无需训练的框架，用于在测试时对文本条件生成模型进行连续且可控的图像编辑。与先前依赖额外训练或人工干预的方法不同，我们发现只需在文本嵌入空间中进行简单引导即可实现平滑的编辑控制。给定一个目标概念（例如增强照片真实感或改变面部表情），我们使用大型语言模型自动构建一组小型去偏对比提示词对，并据此在生成器的文本编码器空间中计算一个引导向量。随后，我们将该向量直接添加到输入提示的表征中，以沿目标语义轴控制生成过程。为实现连续控制，我们提出一种弹性范围搜索程序，可自动识别引导强度的有效区间，避免引导不足（未编辑）和过度引导（改变其他属性）。在该区间内添加同一向量的缩放版本即可产生平滑连续的编辑效果。由于我们的方法仅修改文本表征，其自然可泛化至多种文本条件模态，包括图像和视频生成。为量化引导的连续性，我们引入一种新的评估指标，用于衡量不同编辑强度下语义变化的均匀性。通过比较各方法的连续编辑行为，我们发现尽管本方法设计简单轻量，其性能仍可与基于训练的方法相媲美，并优于其他无需训练的方法。

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find that a simple steering in the text-embedding space is sufficient to produce smooth edit control. Given a target concept (e.g., enhancing photorealism or changing facial expression), we use a large language model to automatically construct a small set of debiased contrastive prompt pairs, from which we compute a steering vector in the generator’s text-encoder space. We then add this vector directly to the input prompt representation to control generation along the desired semantic axis. To obtain a continuous control, we propose an elastic range search procedure that automatically identifies an effective interval of steering magnitudes, avoiding both under-steering (no-edit) and over-steering (changing other attributes). Adding the scaled versions of the same vector within this interval yields smooth and continuous edits. Since our method modifies only textual representations, it naturally generalizes across text-conditioned modalities, including image and video generation. To quantify the steering continuity, we introduce a new evaluation metric that measures the uniformity of semantic change across edit strengths. We compare the continuous editing behavior across methods and find that, despite its simplicity and lightweight design, our approach is comparable to training-based alternatives, outperforming other training-free methods.

评分理由: 论文提出AgentFactory框架，核心是LLM-based agents的自我进化系统，通过将成功任务解决方案保存为可执行的子代理代码而非文本经验，实现持续能力积累。与’LLM Agents’高度相关（10分），涉及’Self-Improvement’机制（10分），‘Tool Use’和’Multi-agent Systems’有一定关联（各5分），因为子代理作为工具被调用和协调。其他关键词如MoE、量化、推理加速等未涉及，得0分。

构建基于大语言模型（LLM）的智能体正变得日益重要。当前基于LLM的智能体自我进化研究主要将成功经验记录为文本提示或反思，这难以在复杂场景中可靠保证任务的高效重复执行。我们提出AgentFactory，一种新的自我进化范式，它将成功的任务解决方案保存为可执行的子智能体代码而非文本经验。关键在于，这些子智能体会根据执行反馈持续优化，随着处理更多任务而变得日益稳健和高效。保存的子智能体是纯Python代码并配有标准化文档，使其能够在任何支持Python的系统中移植。我们证明，AgentFactory实现了持续的能力积累：其可执行子智能体库随时间不断增长和完善，逐步减少处理类似任务所需的工作量，且无需人工干预。我们的实现已在https://github.com/zzatpku/AgentFactory开源，演示视频可在https://youtu.be/iKSsuAXJHW0查看。

Building LLM-based agents has become increasingly important. Recent works on LLM-based agent self-evolution primarily record successful experiences as textual prompts or reflections, which cannot reliably guarantee efficient task re-execution in complex scenarios. We propose AgentFactory, a new self-evolution paradigm that preserves successful task solutions as executable subagent code rather than textual experience. Crucially, these subagents are continuously refined based on execution feedback, becoming increasingly robust and efficient as more tasks are encountered. Saved subagents are pure Python code with standardized documentation, enabling portability across any Python-capable system. We demonstrate that AgentFactory enables continuous capability accumulation: its library of executable subagents grows and improves over time, progressively reducing the effort required for similar tasks without manual intervention. Our implementation is open-sourced at https://github.com/zzatpku/AgentFactory, and our demonstration video is available at https://youtu.be/iKSsuAXJHW0.

评分理由: 论文提出Loc3R-VLM框架，通过全局布局重建和显式情境建模，增强2D视觉语言模型（VLM）的3D理解能力。核心与’Large Language Models’高度相关（10分），因为VLM是LLM的扩展。与’Pre-training’和’Post-training’相关（各5分），涉及从预训练3D基础模型提取先验和微调。与’Chain of Thought’和’System 2 Thinking’相关（各5分），强调3D空间推理和深度理解。与’World Models’相关（5分），涉及场景结构表示。其他关键词如MoE、SLMs、RAG等未涉及，得0分。

多模态大语言模型（MLLMs）在连接视觉与语言方面取得了显著进展，但在空间理解和视点感知推理方面仍面临挑战。近期研究致力于通过几何线索增强输入表征，而非明确教导模型进行三维空间推理。本文提出Loc3R-VLM框架，该框架使二维视觉语言模型能够从单目视频输入中获取先进的三维理解能力。受人类空间认知启发，Loc3R-VLM依赖两个联合目标：通过全局布局重建构建场景结构的整体表征，以及通过显式情境建模锚定自我中心视角。这些目标提供了直接的空间监督，将感知与语言共同置于三维语境中。为确保几何一致性和度量尺度对齐，我们利用从预训练三维基础模型中提取的轻量级相机位姿先验。Loc3R-VLM在基于语言的定位任务中达到最先进性能，并在情境化及通用三维问答基准测试中超越现有基于二维和视频的方法，证明我们的空间监督框架能够实现强大的三维理解能力。项目页面：https://kevinqu7.github.io/loc3r-vlm

Multimodal Large Language Models (MLLMs) have made impressive progress in connecting vision and language, but they still struggle with spatial understanding and viewpoint-aware reasoning. Recent efforts aim to augment the input representations with geometric cues rather than explicitly teaching models to reason in 3D space. We introduce Loc3R-VLM, a framework that equips 2D Vision-Language Models with advanced 3D understanding capabilities from monocular video input. Inspired by human spatial cognition, Loc3R-VLM relies on two joint objectives: global layout reconstruction to build a holistic representation of the scene structure, and explicit situation modeling to anchor egocentric perspective. These objectives provide direct spatial supervision that grounds both perception and language in a 3D context. To ensure geometric consistency and metric-scale alignment, we leverage lightweight camera pose priors extracted from a pre-trained 3D foundation model. Loc3R-VLM achieves state-of-the-art performance in language-based localization and outperforms existing 2D- and video-based approaches on situated and general 3D question-answering benchmarks, demonstrating that our spatial supervision framework enables strong 3D understanding. Project page: https://kevinqu7.github.io/loc3r-vlm

评分理由: 论文提出了一种用于视频视觉语言模型（Video VLMs）的时空令牌剪枝方法STTS，核心创新在于提升LLM在视频任务中的计算效率。因此，与"Large Language Models OR LLMs OR Foundation Models"高度相关（10分），因为论文直接研究如何优化LLM在视频VLM架构中的效率。与"Quantization OR Model Compression OR Low-bit Weights"和"Speculative Decoding OR Inference Acceleration"有一定关联（8分），因为令牌剪枝是一种模型压缩和推理加速技术，但论文未涉及量化或推测解码等具体方法。其他关键词如MoE、SFT、RAG、CoT等与论文内容无关（0分），论文未涉及这些技术。

令牌剪枝对于提升视觉语言模型（VLMs）的计算效率至关重要，尤其在视频任务中，时间冗余现象普遍存在。先前的方法通常仅在视觉变换器（ViT）内部进行令牌剪枝，专门用于动作识别和物体分割等单模态感知任务，而未适配下游视觉语言任务；或者仅在大型语言模型（LLM）内部剪枝，而保持ViT输出完整，这往往需要复杂的文本条件令牌选择机制。本文提出时空令牌评分（STTS），这是一个简单轻量的模块，可在无需文本条件或令牌合并的情况下，对ViT和LLM中的视觉令牌进行剪枝，并完全兼容端到端训练。通过辅助损失学习时间维度的评分，并借助LLM下游梯度学习空间维度的评分，辅以我们高效的打包算法，STTS在整个架构中剪枝50%的视觉令牌，在训练和推理阶段实现62%的效率提升，同时在13项长短视频问答任务中平均性能仅下降0.7%。随着每视频采样帧数的增加，效率增益进一步提升。在长视频问答任务中应用测试时缩放技术，相比基线模型可额外获得0.5-1%的性能提升。总体而言，STTS代表了一种新颖、简单而有效的技术，实现了统一、全架构范围的视觉令牌剪枝。

Token pruning is essential for enhancing the computational efficiency of vision-language models (VLMs), particularly for video-based tasks where temporal redundancy is prevalent. Prior approaches typically prune tokens either (1) within the vision transformer (ViT) exclusively for unimodal perception tasks such as action recognition and object segmentation, without adapting to downstream vision-language tasks; or (2) only within the LLM while leaving the ViT output intact, often requiring complex text-conditioned token selection mechanisms. In this paper, we introduce Spatio-Temporal Token Scoring (STTS), a simple and lightweight module that prunes vision tokens across both the ViT and the LLM without text conditioning or token merging, and is fully compatible with end-to-end training. By learning how to score temporally via an auxiliary loss and spatially via LLM downstream gradients, aided by our efficient packing algorithm, STTS prunes 50% of vision tokens throughout the entire architecture, resulting in a 62% improvement in efficiency during both training and inference with only a 0.7% drop in average performance across 13 short and long video QA tasks. Efficiency gains increase with more sampled frames per video. Applying test-time scaling for long-video QA further yields performance gains of 0.5-1% compared to the baseline. Overall, STTS represents a novel, simple yet effective technique for unified, architecture-wide vision token pruning.

评分理由: 论文专注于软件漏洞检测的自动化基准生成和数据集创建，涉及学习型漏洞检测、对抗性协同进化等概念，但未提及任何大模型、深度学习技术原理或AI for Science的具体应用。所有关键词均与大模型技术、深度学习原理或特定科学领域AI应用相关，而本文属于软件工程安全领域，与这些关键词无直接关联。

软件漏洞的数量持续增长，且在实践中仍难以检测。尽管基于学习的漏洞检测技术已取得进展，但现有基准测试主要围绕函数层面展开，未能捕捉真实、可执行、跨过程调用的实际场景。近期出现的仓库级安全基准测试证明了真实环境的重要性，但其人工构建方式限制了规模。本博士研究提出一种自动化基准测试生成器，它能将真实漏洞注入现实世界的代码仓库，并合成可复现的漏洞验证（PoV）利用代码，从而为训练和评估仓库级漏洞检测智能体提供精确标注的数据集。我们进一步研究了漏洞注入与检测智能体之间的对抗性协同进化循环，以提升其在真实约束下的鲁棒性。

Software vulnerabilities continue to grow in volume and remain difficult to detect in practice. Although learning-based vulnerability detection has progressed, existing benchmarks are largely function-centric and fail to capture realistic, executable, interprocedural settings. Recent repo-level security benchmarks demonstrate the importance of realistic environments, but their manual curation limits scale. This doctoral research proposes an automated benchmark generator that injects realistic vulnerabilities into real-world repositories and synthesizes reproducible proof-of-vulnerability (PoV) exploits, enabling precisely labeled datasets for training and evaluating repo-level vulnerability detection agents. We further investigate an adversarial co-evolution loop between injection and detection agents to improve robustness under realistic constraints.

评分理由: 论文聚焦于机器人基础模型（robotics foundation models），属于基础模型（Foundation Models）范畴，因此与第一个关键词高度相关（8分）。论文提到使用预训练模型（pretrained robotics foundation model），与预训练相关（5分）。其他关键词如MoE、SLMs、SFT、RLHF、RAG、推理加速、幻觉缓解等均未涉及，因此评分为0。论文虽涉及机器人领域，但未明确属于AI for Science中的生物信息学或化学信息学，因此评分为0。

机器人基础模型在执行多样化任务与跨环境自然语言指令方面已展现出强大能力。然而，这些模型在很大程度上仍依赖于数据驱动，在部署过程中缺乏对安全性及时间相关规约满足性的形式化保证。实践中，机器人常需遵循包含丰富时空要求的操作约束，例如限时目标访问、序列化任务目标以及持续性安全条件。本研究提出一种规约感知的动作分布优化框架，该框架能在不修改预训练机器人基础模型参数的前提下，在执行过程中强制实施广泛类型的信号时序逻辑（Signal Temporal Logic，STL）约束。在每一个决策步骤中，该方法通过基于前向动力学传播对剩余时间范围进行推演，计算出满足严格STL可行性约束的最小修改动作分布。我们在仿真环境中使用先进的机器人基础模型，通过多种环境与复杂规约验证了所提出框架的有效性。

Robotics foundation models have demonstrated strong capabilities in executing natural language instructions across diverse tasks and environments. However, they remain largely data-driven and lack formal guarantees on safety and satisfaction of time-dependent specifications during deployment. In practice, robots often need to comply with operational constraints involving rich spatio-temporal requirements such as time-bounded goal visits, sequential objectives, and persistent safety conditions. In this work, we propose a specification-aware action distribution optimization framework that enforces a broad class of Signal Temporal Logic (STL) constraints during execution of a pretrained robotics foundation model without modifying its parameters. At each decision step, the method computes a minimally modified action distribution that satisfies a hard STL feasibility constraint by reasoning over the remaining horizon using forward dynamics propagation. We validate the proposed framework in simulation using a state-of-the-art robotics foundation model across multiple environments and complex specifications.

评分理由: 论文主要研究AI编码代理（AI coding agents）的回归问题，开发了TDAD工具和基准方法，使用基于AST的代码测试图构建和加权影响分析来减少测试回归。核心相关关键词包括：LLM Agents（高度相关，论文核心研究AI代理）、Retrieval-Augmented Generation（相关，论文提到GraphRAG工作流）、Self-Correction（相关，论文涉及代理的自我改进循环）、Tool Use（相关，论文研究代理技能部署）。其他关键词如LLMs有一定关联（论文使用Qwen模型），但大部分关键词（如MoE、Scaling Laws、PEFT等）与论文内容无直接关系。

AI编码代理能够解决现实软件问题，但常引发回归缺陷，导致先前通过的测试失败。现有基准几乎只关注解决率，对回归行为的研究严重不足。本文提出TDAD（测试驱动智能体开发），这是一种开源工具与基准方法，它结合基于抽象语法树（AST）的代码-测试图构建与加权影响分析，以揭示最可能受代码变更影响的测试。通过在SWE-bench Verified数据集上使用两个本地模型（Qwen3-Coder 30B测试100个实例，Qwen3.5-35B-A3B测试25个实例）进行评估，TDAD的GraphRAG工作流将测试级回归降低了70%（从6.08%降至1.82%），当作为智能体技能部署时，解决率从24%提升至32%。一个意外发现是，仅采用测试驱动开发（TDD）提示反而增加了回归率（9.94%），这表明较小模型从上下文信息（应验证哪些测试）中获得的收益大于从流程指令（如何执行TDD）中获得的收益。在10个实例的子集上，自主自动改进循环将解决率从12%提升至60%，且回归率为0%。这些发现表明，在AI智能体工具设计中，呈现上下文信息优于规定流程工作流。所有代码、数据与日志已公开于https://github.com/pepealonso95/TDAD。

AI coding agents can resolve real-world software issues, yet they frequently introduce regressions, breaking tests that previously passed. Current benchmarks focus almost exclusively on resolution rate, leaving regression behavior under-studied. This paper presents TDAD (Test-Driven Agentic Development), an open-source tool and benchmark methodology that combines abstract-syntax-tree (AST) based code-test graph construction with weighted impact analysis to surface the tests most likely affected by a proposed change. Evaluated on SWE-bench Verified with two local models (Qwen3-Coder 30B on 100 instances and Qwen3.5-35B-A3B on 25 instances), TDAD’s GraphRAG workflow reduced test-level regressions by 70% (6.08% to 1.82%) and improved resolution from 24% to 32% when deployed as an agent skill. A surprising finding is that TDD prompting alone increased regressions (9.94%), revealing that smaller models benefit more from contextual information (which tests to verify) than from procedural instructions (how to do TDD). An autonomous auto-improvement loop raised resolution from 12% to 60% on a 10-instance subset with 0% regression. These findings suggest that for AI agent tool design, surfacing contextual information outperforms prescribing procedural workflows. All code, data, and logs are publicly available at https://github.com/pepealonso95/TDAD.

评分理由: 论文VideoAtlas主要研究视频理解中的长上下文挑战，提出了一种层次化网格表示方法VideoAtlas和Video-RLM架构。与关键词的相关性分析如下：1. 高度相关（10分）：‘Context Window Extension OR Long Context LLMs’，因为论文核心解决视频长上下文问题，并扩展RLMs到视觉领域。2. 较强相关（8分）：‘Large Language Models OR LLMs OR Foundation Models’，论文基于语言模型（RLMs）扩展；‘LLM Agents OR Autonomous Agents OR Agentic Workflow’和’Multi-agent Systems OR Agent Coordination’，因为Video-RLM采用Master-Worker多智能体架构进行协调探索。3. 其他关键词（0分）：论文未涉及MoE、SLMs、训练技术、推理优化、科学AI应用等具体内容，主要聚焦视频表示和导航范式。

将语言模型扩展至视频领域面临两大挑战：一是表征挑战——现有方法依赖有损近似；二是长上下文挑战——基于字幕或智能体的处理流程将视频压缩为文本，导致视觉保真度丧失。为克服这些问题，我们提出 VideoAtlas，这是一种任务无关的环境，能够将视频表征为分层网格结构，同时具备无损、可导航、可扩展、无需字幕和预处理的特点。视频概览可一目了然，任何区域均可递归放大，且视频内容、中间分析过程与智能体记忆均采用统一的视觉表征，从而实现了端到端的无损文本转换。这种分层结构确保访问深度的增长仅与视频时长呈对数关系。针对长上下文问题，递归语言模型（Recursive Language Models, RLMs）近期为长文本处理提供了强大解决方案，但将其扩展至视觉领域需要一个可供递归操作的结构化环境，这正是 VideoAtlas 所提供的。将 VideoAtlas 构建为马尔可夫决策过程，催生了 Video-RLM：一种并行的主-从架构，其中主模块协调全局探索，而从模块并行深入指定区域以积累无损视觉证据。我们展示了三项关键发现：（1）计算量随视频时长呈对数增长，而网格结构复用带来的30-60%多模态缓存命中率进一步放大了这一优势；（2）环境预算机制——通过限制最大探索深度，提供了一个可调控计算精度权衡的原则性超参数；（3）涌现的自适应计算分配能力，可根据问题粒度动态调整。在从1小时到10小时基准测试的扩展中，Video-RLM 始终保持最佳的时长鲁棒性，精度下降最小，这证明结构化环境导航是视频理解领域可行且可扩展的研究范式。

Extending language models to video introduces two challenges: representation, where existing methods rely on lossy approximations, and long-context, where caption- or agent-based pipelines collapse video into text and lose visual fidelity. To overcome this, we introduce \textbf{VideoAtlas}, a task-agnostic environment to represent video as a hierarchical grid that is simultaneously lossless, navigable, scalable, caption- and preprocessing-free. An overview of the video is available at a glance, and any region can be recursively zoomed into, with the same visual representation used uniformly for the video, intermediate investigations, and the agent’s memory, eliminating lossy text conversion end-to-end. This hierarchical structure ensures access depth grows only logarithmically with video length. For long-context, Recursive Language Models (RLMs) recently offered a powerful solution for long text, but extending them to visual domain requires a structured environment to recurse into, which \textbf{VideoAtlas} provides. \textbf{VideoAtlas} as a Markov Decision Process unlocks Video-RLM: a parallel Master-Worker architecture where a Master coordinates global exploration while Workers concurrently drill into assigned regions to accumulate lossless visual evidence. We demonstrate three key findings: (1)~logarithmic compute growth with video duration, further amplified by a 30-60% multimodal cache hit rate arising from the grid’s structural reuse. (2)~environment budgeting, where bounding the maximum exploration depth provides a principled compute-accuracy hyperparameter. (3)~emergent adaptive compute allocation that scales with question granularity. When scaling from 1-hour to 10-hour benchmarks, Video-RLM remains the most duration-robust method with minimal accuracy degradation, demonstrating that structured environment navigation is a viable and scalable paradigm for video understanding.

评分理由: 论文核心研究大语言模型（LLMs）在12种印度语言中的安全评估，直接涉及LLMs和安全对齐（Alignment）技术，因此这两个关键词得10分。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、RLHF、RAG、推理加速、量化压缩、AI for Science等均未在摘要中提及或相关，故得0分。

随着大语言模型在多语言环境中部署，其在文化多元、资源匮乏语言中的安全性表现仍鲜为人知。本研究首次对12种印度语言的大语言模型安全性进行了系统评估，这些语言使用者超过12亿，但在大语言模型训练数据中代表性不足。我们使用包含种姓、宗教、性别、健康和政治等维度的6000条文化情境提示词数据集，通过提示词的翻译变体评估了10个主流大语言模型。

分析表明存在显著的安全性漂移现象：跨语言一致性仅为12.8%，且不同语言间的安全判定率差异超过17%。部分模型在资源匮乏的书写体系中过度拒绝良性提示，对政治敏感话题过度标记，而另一些模型则未能识别不安全生成内容。我们通过提示词熵值、类别偏差分数和多语言一致性指数对这些缺陷进行了量化。

研究结果揭示多语言大语言模型存在关键的安全性泛化缺陷，表明安全对齐策略在不同语言间未能均衡迁移。我们发布首个支持印度语言部署文化情境安全性评估的基准测试集\textsc{IndicSafe}，并倡导建立基于区域危害认知的语言感知对齐策略。

As large language models (LLMs) are deployed in multilingual settings, their safety behavior in culturally diverse, low-resource languages remains poorly understood. We present the first systematic evaluation of LLM safety across 12 Indic languages, spoken by over 1.2 billion people but underrepresented in LLM training data. Using a dataset of 6,000 culturally grounded prompts spanning caste, religion, gender, health, and politics, we assess 10 leading LLMs on translated variants of the prompt. Our analysis reveals significant safety drift: cross-language agreement is just 12.8%, and \texttt{SAFE} rate variance exceeds 17% across languages. Some models over-refuse benign prompts in low-resource scripts, overflag politically sensitive topics, while others fail to flag unsafe generations. We quantify these failures using prompt-level entropy, category bias scores, and multilingual consistency indices. Our findings highlight critical safety generalization gaps in multilingual LLMs and show that safety alignment does not transfer evenly across languages. We release \textsc{IndicSafe}, the first benchmark to enable culturally informed safety evaluation for Indic deployments, and advocate for language-aware alignment strategies grounded in regional harms.

评分理由: 论文核心研究将预训练注意力模块（如GQA）转换为多头部潜在注意力（MLA）以提升表达能力而不增加KV缓存成本，直接涉及LLM架构优化和高效推理。高度相关关键词：‘Large Language Models’（论文基于Qwen3、Llama-3.1等LLM）、‘KV Cache Compression’（核心目标是在固定KV宽度下减少缓存成本）、‘Speculative Decoding OR Inference Acceleration’（旨在提升推理效率）。中等相关：‘Post-training OR Supervised Fine-tuning OR SFT’（提及后训练微调以恢复精度）、‘PEFT OR LoRA OR Parameter-efficient Fine-tuning’（涉及参数高效调整）。‘Quantization OR Model Compression OR Low-bit Weights’有一定关联（涉及权重分解和压缩技术）。其他关键词如MoE、SLMs、RAG、CoT等与论文内容无关。

将预训练注意力模块（如分组查询注意力GQA）转换为多头潜在注意力（MLA）可在不增加KV缓存成本的情况下提升表达能力，这对高效推理具有吸引力。然而，许多实用的转换基线方法依赖于仅权重的低秩近似（例如SVD式初始化）和均匀秩分配。这些方法侧重于最小化权重矩阵之间的差异，而非关注权重如何影响输入激活，忽略了激活的协方差结构，并强制跨层使用均匀秩，从而导致激活漂移和注意力保真度下降。为解决这些问题，我们提出了CARE——一种固定KV宽度下的协方差感知、秩增强MLA转换流程。CARE引入三个关键步骤：（i）激活保持因子分解，使近似对齐实际输入激活而非仅权重；（ii）调整秩分配，通过将更多容量分配给最需要的层，在固定KV预算下跨层分配资源；（iii）KV对等映射，将转换后的K和V重新参数化以适配MLA格式，同时保持KV缓存大小不变。在Qwen3-4B/30B-A3B-Instruct-2507和Llama-3.1-8B/70B-Instruct模型上的实验表明，在相同KV预算下，我们的方法优于均匀秩SVD基线，单次困惑度降低最高达215倍，平均准确率提升最高达1.70倍。经过简短的SVD后修复微调，我们能够完全恢复原始模型的准确率。

Converting pretrained attention modules such as grouped-query attention (GQA) into multi-head latent attention (MLA) can improve expressivity without increasing KV-cache cost, making it attractive for efficient inference. However, many practical conversion baselines rely on weight-only low-rank approximations (e.g., SVD-style initializations) and uniform rank allocation. They focus on minimizing the difference between weight matrices rather than on how those weights affect input activations, ignore the covariance structure of activations, and enforce uniform rank across layers, causing activation drift and degraded attention fidelity. To address these issues, we propose CARE, a Covariance-Aware, Rank-Enhanced MLA conversion pipeline under a fixed KV width. CARE introduces three key steps: (i) activation-preserving factorization, which aligns the approximation with the actual input activations rather than just the weights; (ii) adjusted-rank allocation, which spreads a fixed KV budget across layers by giving more capacity to layers that need it most; and (iii) KV-parity mapping, which reparameterizes the converted K and V to fit the MLA format while keeping the KV-cache size unchanged. Our method outperforms a uniform-rank SVD baseline on Qwen3-4B/30B-A3B-Instruct-2507 and Llama-3.1-8B/70B-Instruct, reducing one-shot perplexity by up to 215x and improving mean accuracy by up to 1.70x at matched KV budgets. With a brief post-SVD healing fine-tune, we fully recover the original model’s accuracy.

评分理由: 论文核心研究LLM agents在企业系统中的隐私保护问题，与’Large Language Models OR LLMs OR Foundation Models’和’LLM Agents OR Autonomous Agents OR Agentic Workflow’高度相关（10分），因为论文明确研究LLM agents的隐私风险分析框架。其他关键词如MoE、SLMs、训练方法、推理优化、科学AI应用等均未在摘要中提及，因此评分为0分。

大型语言模型（LLM）与人工智能体正日益融入企业系统，以访问内部数据库并生成情境感知的响应。尽管此类集成提升了生产力和决策支持能力，但模型输出可能无意中泄露敏感信息。尽管先前许多研究致力于保护用户提示的隐私，但从企业数据角度考量隐私风险的研究相对较少。为此，本文提出了一种基于差分隐私的概率框架，用于分析人工智能体中的隐私泄露问题。我们将响应生成建模为一个随机机制，该机制将提示和数据集映射到词元序列的概率分布上。在此框架内，我们引入了词元级和消息级差分隐私，并推导出将隐私泄露与温度参数、消息长度等生成参数相关联的隐私边界。进一步地，我们构建了一个隐私-效用设计问题，以刻画最优温度选择策略。

Large language models (LLMs) and AI agents are increasingly integrated into enterprise systems to access internal databases and generate context-aware responses. While such integration improves productivity and decision support, the model outputs may inadvertently reveal sensitive information. Although many prior efforts focus on protecting the privacy of user prompts, relatively few studies consider privacy risks from the enterprise data perspective. Hence, this paper develops a probabilistic framework for analyzing privacy leakage in AI agents based on differential privacy. We model response generation as a stochastic mechanism that maps prompts and datasets to distributions over token sequences. Within this framework, we introduce token-level and message-level differential privacy and derive privacy bounds that relate privacy leakage to generation parameters such as temperature and message length. We further formulate a privacy-utility design problem that characterizes optimal temperature selection.

评分理由: 论文scicode-lint的核心是使用LLM生成模式来检测科学Python代码中的方法错误，属于大模型在科学领域的应用。与’Large Language Models’高度相关（10分），因为系统使用前沿模型生成检测模式；与’Small Language Models’相关（8分），因为运行时使用小型本地模型执行；与’AI for Science’高度相关（10分），因为直接应用于科学代码质量检测。其他关键词如MoE、Scaling Laws、训练方法、推理优化、代理系统等均未涉及，得0分。

科学Python代码中的方法学缺陷会产生看似合理但错误的结果，传统代码检查工具和静态分析工具无法检测此类问题。多个研究团队已开发出针对机器学习的专用检查器，证明检测具有可行性。然而这些工具存在共同的可持续性问题：依赖特定版本的pylint或Python、有限的封装性，且每个新模式的识别都需人工工程实现。随着AI生成代码增加科学软件的体量，对自动化方法学检查（如检测数据泄露、错误交叉验证及随机种子缺失）的需求日益增长。本文提出scicode-lint工具，其双层架构将模式设计（构建时使用前沿模型）与执行（运行时使用小型本地模型）相分离。模式通过生成而非手工编码实现；适配新库版本仅需消耗计算资源，而非工程时间。在包含人工标注真实值的Kaggle笔记本测试中，预处理泄露检测在100%召回率下达到65%精确度；在38篇应用AI/ML的已发表学术论文中，精确度为62%（经大语言模型评估），且不同模式类别间存在显著差异；在预留论文集中，精确度为54%。在受控测试中，scicode-lint对66种模式的综合检测准确率达到97.7%。

Methodology bugs in scientific Python code produce plausible but incorrect results that traditional linters and static analysis tools cannot detect. Several research groups have built ML-specific linters, demonstrating that detection is feasible. Yet these tools share a sustainability problem: dependency on specific pylint or Python versions, limited packaging, and reliance on manual engineering for every new pattern. As AI-generated code increases the volume of scientific software, the need for automated methodology checking (such as detecting data leakage, incorrect cross-validation, and missing random seeds) grows. We present scicode-lint, whose two-tier architecture separates pattern design (frontier models at build time) from execution (small local model at runtime). Patterns are generated, not hand-coded; adapting to new library versions costs tokens, not engineering hours. On Kaggle notebooks with human-labeled ground truth, preprocessing leakage detection reaches 65% precision at 100% recall; on 38 published scientific papers applying AI/ML, precision is 62% (LLM-judged) with substantial variation across pattern categories; on a held-out paper set, precision is 54%. On controlled tests, scicode-lint achieves 97.7% accuracy across 66 patterns.

评分理由: 论文RAMP专注于大语言模型（LLMs）的量化压缩技术，以实现高效的设备端推理。核心贡献是提出一种基于强化学习的自适应混合精度量化方法，显著相关关键词包括：‘Large Language Models’（论文研究对象）、‘Small Language Models OR On-device AI’（目标应用场景）、‘Post-training’（量化属于后训练技术）、‘Quantization OR Model Compression’（核心方法）、‘Speculative Decoding OR Inference Acceleration’（间接相关，量化旨在加速推理）。其他关键词如MoE、Scaling Laws、Alignment等与论文内容无关。

后训练量化对于在资源受限硬件上部署大语言模型至关重要，然而现有先进方法强制所有层采用统一比特宽度，导致精度与效率的权衡未能达到最优。本文提出RAMP（强化自适应混合精度），一种基于离策略软演员-评论家框架的方法，通过学习逐层比特宽度分配策略，在全局比特预算约束下最小化困惑度。该策略以包含激活统计、权重特性及结构描述符的11维嵌入向量为条件，实现了跨模型家族与规模的零样本迁移能力。为实现稳定的4比特以下量化，我们引入尺度折叠技术——一种通过逐通道缩放和归一化层补偿将激活异常值迁移至权重的预处理方法。采用带非对称惩罚与预算断崖机制的质量优先奖励函数，驱动策略快速收敛。在Llama 2 7B模型上，RAMP以3.68GB存储（3.65有效比特）实现5.54困惑度，优于统一4比特AWQ方法（3.90GB存储下困惑度5.60），在模型体积上减少6%，质量上提升1%至3%。关键的是，仅基于Llama 2 7B训练的策略可零样本泛化至Llama 2 13B和Mistral 7B模型，其表现常超越针对特定目标的训练结果，这支持了量化敏感性主要取决于模型架构的假设。HALO流水线将分配方案导出为GGUF格式，可在CPU、GPU及边缘设备上实现免内核推理，保持FP16精度下常识推理性能的99.5%。

Post training quantization is essential for deploying large language models (LLMs) on resource constrained hardware, yet state of the art methods enforce uniform bit widths across layers, yielding suboptimal accuracy efficiency trade offs. We present RAMP (Reinforcement Adaptive Mixed Precision), an off policy Soft Actor Critic framework that learns per layer bit width assignments to minimize perplexity under a global bit budget. The policy conditions on an 11 dimensional embedding of activation statistics, weight properties, and structural descriptors, enabling zero shot transfer across model families and scales. To enable stable sub 4 bit quantization, we introduce Scale Folding, a preconditioning technique that migrates activation outliers into weights via per channel scaling and normalization layer compensation. A quality prioritized reward with asymmetric penalties and budget cliffs drives rapid convergence. On Llama 2 7B, RAMP achieves 5.54 perplexity at 3.68GB (3.65 effective bits), outperforming uniform 4 bit AWQ (5.60 at 3.90 GB) and GPTQ by 6% in size and 1% to3% in quality. Critically, a policy trained only on Llama 2 7B generalizes zero shot to Llama 2 13B and Mistral 7B, often surpassing target specific training, supporting the hypothesis that quantization sensitivity is primarily architectural. The HALO pipeline exports allocations to GGUF format for kernel free inference on CPUs, GPUs, and edge devices, retaining 99.5% of FP16 commonsense reasoning performance.

评分理由: 论文基于BiomedCLIP（生物医学视觉-语言基础模型）进行修改，属于大模型在生物医学领域的应用，与’Large Language Models OR LLMs OR Foundation Models’（8分）和’AI for Science OR Bioinformatics OR Cheminformatics’（10分）高度相关。论文涉及模型修改和优化，与’Pre-training OR Continual Pre-training OR Domain Adaptation’（8分）和’Post-training OR Supervised Fine-tuning OR SFT’（8分）有一定关联。其他关键词如MoE、SLMs、RAG、RLHF等未在论文中提及，评分为0。

本研究提出一种用于视频胶囊内镜（VCE）的多标签分类框架，通过结合架构层面与优化层面的策略，解决了Galar数据集中固有的极端类别不平衡问题。我们的方法对生物医学视觉-语言基础模型BiomedCLIP进行改进，将其标准多头自注意力机制替换为差分注意力机制——该机制通过计算两个softmax注意力图之间的差异来抑制注意力噪声。为应对标注帧中病理发现占比不足0.1%的倾斜标签分布，我们采用平方根频率加权采样器、非对称焦点损失、混合正则化以及逐类别阈值优化策略。在生成事件级JSON输出前，通过中值滤波平滑与间隙合并来增强时序连贯性。在包含三次NaviCam检查（共161,025帧）的预留RARE-VISION测试集上，该流程在单GPU上以约8.6分钟完成全部推理，整体时序mAP@0.5达到0.2456，mAP@0.95达到0.2353。

This work presents a multi-label classification framework for video capsule endoscopy (VCE) that addresses the extreme class imbalance inherent in the Galar dataset through a combination of architectural and optimization-level strategies. Our approach modifies BiomedCLIP, a biomedical vision-language foundation model, by replacing its standard multi-head self-attention with a differential attention mechanism that computes the difference between two softmax attention maps to suppress attention noise. To counteract the skewed label distribution, where pathological findings constitute less than 0.1% of all annotated frames, a sqrt-frequency weighted sampler, asymmetric focal loss, mixup regularization, and per-class threshold optimization are employed. Temporal coherence is enforced through median-filter smoothing and gap merging prior to event-level JSON generation. On the held-out RARE-VISION test set comprising three NaviCam examinations (161,025 frames), the pipeline achieves an overall temporal mAP@0.5 of 0.2456 and mAP@0.95 of 0.2353, with total inference completed in approximately 8.6 minutes on a single GPU.

评分理由: 论文介绍了一个用于机器学习算法发现任务的程序化生成器DiscoGen和基准测试DiscoBench，主要关注自动化算法开发、任务生成和基准评估。虽然涉及机器学习算法发现和优化，但论文内容与所有评分关键词（均聚焦于大模型、深度学习技术原理、特定训练方法或AI科学应用）无直接关联，未提及大模型、深度学习、LLM、MoE、训练方法、推理技术、AI代理或科学AI应用等概念，因此所有关键词相关度均为0。

机器学习算法的自动化开发具有催生新突破的潜力。然而，目前我们改进和评估算法发现系统的能力受限于现有任务套件。这些套件存在诸多问题，例如：评估方法不完善；数据污染；以及包含已饱和或高度相似的问题。为此，我们提出DiscoGen——一个面向机器学习算法发现任务的程序化生成器，可用于生成如强化学习优化器或图像分类损失函数开发等任务。受程序化生成在强化学习领域成功的启发，DiscoGen能够从多个机器学习领域中生成数百万个难度与复杂度各异的任务。这些任务由少量配置参数定义，可用于优化算法发现智能体（Algorithm Discovery Agents, ADAs）。我们同时推出DiscoBench，这是一个由DiscoGen任务中固定、小型子集构成的基准测试集，用于对ADAs进行系统性评估。最后，除了展示其用于ADA提示优化的实验外，我们还提出了多个由DiscoGen实现的、具有广阔前景的研究方向。DiscoGen已在https://github.com/AlexGoldie/discogen开源发布。

Automating the development of machine learning algorithms has the potential to unlock new breakthroughs. However, our ability to improve and evaluate algorithm discovery systems has thus far been limited by existing task suites. They suffer from many issues, such as: poor evaluation methodologies; data contamination; and containing saturated or very similar problems. Here, we introduce DiscoGen, a procedural generator of algorithm discovery tasks for machine learning, such as developing optimisers for reinforcement learning or loss functions for image classification. Motivated by the success of procedural generation in reinforcement learning, DiscoGen spans millions of tasks of varying difficulty and complexity from a range of machine learning fields. These tasks are specified by a small number of configuration parameters and can be used to optimise algorithm discovery agents (ADAs). We present DiscoBench, a benchmark consisting of a fixed, small subset of DiscoGen tasks for principled evaluation of ADAs. Finally, we propose a number of ambitious, impactful research directions enabled by DiscoGen, in addition to experiments demonstrating its use for prompt optimisation of an ADA. DiscoGen is released open-source at https://github.com/AlexGoldie/discogen.

评分理由: 论文核心研究LLM如何内部计算口头置信度，属于LLM内部机制和可解释性研究。高度相关关键词：‘Large Language Models’（研究对象为Gemma 3和Qwen 2.5）、‘Mechanistic Interpretability’（使用激活导向、修补、噪声等实验方法探究内部表示）。中等相关：‘Self-Correction’（涉及LLM的自我评估能力，但论文重点在置信度生成而非修正）。其他关键词如MoE、SFT、RAG等与论文内容无关。

言语置信度——即提示大型语言模型以数值或类别形式陈述其置信水平——被广泛用于从黑盒模型中提取不确定性估计。然而，大型语言模型内部如何生成此类评分仍属未知。我们探讨了两个问题：第一，置信度是何时计算的——是在被请求时即时计算，还是在答案生成过程中自动计算并缓存以供后续检索；第二，言语置信度代表什么——是词元对数概率，还是对答案质量更丰富的评估？聚焦于Gemma 3 27B和Qwen 2.5 7B模型，我们为缓存检索机制提供了聚合证据。通过激活引导、补丁干预、噪声注入及交换实验，我们发现置信度表征首先出现在答案相邻位置，随后才呈现于言语化节点。注意力阻断实验精确定位了信息流向：置信度从答案词元处收集，缓存于首个答案后位置，随后被检索输出。关键的是，线性探测与方差分解显示，这些缓存表征解释了言语置信度中超出词元对数概率的显著方差，表明其代表了一种更丰富的答案质量评估，而非简单的流畅度读数。这些发现证明，言语置信度反映了自动且复杂的自我评估过程——而非事后重建——这对理解大型语言模型的元认知机制及改进校准方法具有重要意义。

Verbal confidence – prompting LLMs to state their confidence as a number or category – is widely used to extract uncertainty estimates from black-box models. However, how LLMs internally generate such scores remains unknown. We address two questions: first, when confidence is computed - just-in-time when requested, or automatically during answer generation and cached for later retrieval; and second, what verbal confidence represents - token log-probabilities, or a richer evaluation of answer quality? Focusing on Gemma 3 27B and Qwen 2.5 7B, we provide convergent evidence for cached retrieval. Activation steering, patching, noising, and swap experiments reveal that confidence representations emerge at answer-adjacent positions before appearing at the verbalization site. Attention blocking pinpoints the information flow: confidence is gathered from answer tokens, cached at the first post-answer position, then retrieved for output. Critically, linear probing and variance partitioning reveal that these cached representations explain substantial variance in verbal confidence beyond token log-probabilities, suggesting a richer answer-quality evaluation rather than a simple fluency readout. These findings demonstrate that verbal confidence reflects automatic, sophisticated self-evaluation – not post-hoc reconstruction – with implications for understanding metacognition in LLMs and improving calibration.