评分理由: 论文UniCreative提出了一种用于创意写作的统一强化学习框架，核心贡献是AC-GenRM奖励模型和ACPO优化算法，旨在解决长文本连贯性与短文本表达性之间的平衡问题。该研究与LLM高度相关（10分），因为它专注于大模型在创意写作中的应用；与Alignment和RLHF/DPO高度相关（10分），因为它提出了无参考的强化学习对齐方法；与Post-training/SFT相关（8分），因为它涉及模型对齐而不依赖监督微调；与Long Context LLMs相关（8分），因为它处理长文本生成中的规划问题；与CoT Reasoning、System 2 Thinking和Self-Correction有一定关联（5分），因为模型展现出元认知能力，能区分任务类型。其他关键词如MoE、SLMs、Scaling Laws、PEFT、RAG等未在论文中涉及，得0分。

创造性写作的一个根本性挑战在于调和长文本叙事所需的全局连贯性与短文本创作所追求的局部表现力之间的固有张力。长文本生成需要明确的宏观规划，而短篇创作则往往要求自发且无约束的表达。然而，现有的对齐范式通常采用静态奖励信号，并严重依赖高质量监督数据，这类数据成本高昂且难以扩展。为此，我们提出了 \textbf{UniCreative}，一个统一的无需参考的强化学习框架。我们首先引入了 \textbf{AC-GenRM}，这是一个自适应约束感知奖励模型，它能动态合成针对特定查询的评判标准，以提供细粒度的偏好判断。利用这些信号，我们提出了 \textbf{ACPO}，一种策略优化算法，该算法能够在无需监督微调和真实参考文本的情况下，使模型在内容质量和结构范式两方面与人类偏好对齐。实证结果表明，AC-GenRM 与专家评估高度一致，而 ACPO 则能显著提升模型在多样化写作任务上的性能。关键的是，我们的分析揭示了一种新兴的元认知能力：模型学会了自主区分需要严格规划的任务与适合直接生成的任务，从而验证了我们直接对齐方法的有效性。

A fundamental challenge in creative writing lies in reconciling the inherent tension between maintaining global coherence in long-form narratives and preserving local expressiveness in short-form texts. While long-context generation necessitates explicit macroscopic planning, short-form creativity often demands spontaneous, constraint-free expression. Existing alignment paradigms, however, typically employ static reward signals and rely heavily on high-quality supervised data, which is costly and difficult to scale. To address this, we propose \textbf{UniCreative}, a unified reference-free reinforcement learning framework. We first introduce \textbf{AC-GenRM}, an adaptive constraint-aware reward model that dynamically synthesizes query-specific criteria to provide fine-grained preference judgments. Leveraging these signals, we propose \textbf{ACPO}, a policy optimization algorithm that aligns models with human preferences across both content quality and structural paradigms without supervised fine-tuning and ground-truth references. Empirical results demonstrate that AC-GenRM aligns closely with expert evaluations, while ACPO significantly enhances performance across diverse writing tasks. Crucially, our analysis reveals an emergent meta-cognitive ability: the model learns to autonomously differentiate between tasks requiring rigorous planning and those favoring direct generation, validating the effectiveness of our direct alignment approach.

评分理由: 论文提出JCQL框架，结合LLM和SLM解决知识库补全(KBC)和知识库问答(KBQA)的联合任务。核心相关关键词：LLMs（10分，论文核心使用LLM进行推理）、SLMs（10分，论文核心使用SLM进行KBC）、LLM Agents（10分，明确使用LLM agent-based KBQA模型）、Hallucination Mitigation（10分，明确解决LLM幻觉问题）。中等相关关键词：Supervised Fine-tuning（5分，提到增量微调KBC模型）、Chain of Thought（5分，涉及推理路径）、Tool Use（5分，将KBC模型作为agent动作使用）。其他关键词与论文内容无直接关联，得0分。

知识库（Knowledge Bases，KBs）在各种应用中发挥着关键作用。作为两项具有代表性的知识库相关任务，知识库补全（Knowledge Base Completion，KBC）与知识库问答（Knowledge Base Question Answering，KBQA）紧密关联且本质互补。因此，联合解决KBC与KBQA任务以使其相互促进将大有裨益。然而，现有研究通常依赖小语言模型（Small Language Model，SLM）来联合增强这两项任务，而忽略了大语言模型（Large Language Model，LLM）强大的推理能力。本文通过结合LLM与SLM的优势，提出了一种新颖的框架JCQL，该框架能够以迭代方式使这两项任务相互增强。为使KBC增强KBQA，我们通过将基于SLM训练的KBC模型作为智能体的一项行动，来增强基于LLM智能体的KBQA模型的推理路径，从而缓解LLM在KBQA中存在的幻觉问题与高计算成本问题。为使KBQA增强KBC，我们利用KBQA的推理路径作为补充训练数据，对KBC模型进行增量微调，从而提升SLM在KBC任务中的能力。在两个公开基准数据集上的大量实验表明，JCQL在KBC与KBQA任务上均超越了所有基线方法。

Knowledge Bases (KBs) play a key role in various applications. As two representative KB-related tasks, knowledge base completion (KBC) and knowledge base question answering (KBQA) are closely related and inherently complementary with each other. Thus, it will be beneficial to solve the task of joint KBC and KBQA to make them reinforce each other. However, existing studies usually rely on the small language model (SLM) to enhance them jointly, and the large language model (LLM)’s strong reasoning ability is ignored. In this paper, by combining the strengths of the LLM with the SLM, we propose a novel framework JCQL, which can make these two tasks enhance each other in an iterative manner. To make KBC enhance KBQA, we augment the LLM agent-based KBQA model’s reasoning paths by incorporating an SLM-trained KBC model as an action of the agent, alleviating the LLM’s hallucination and high computational costs issue in KBQA. To make KBQA enhance KBC, we incrementally fine-tune the KBC model by leveraging KBQA’s reasoning paths as its supplementary training data, improving the ability of the SLM in KBC. Extensive experiments over two public benchmark data sets demonstrate that JCQL surpasses all baselines for both KBC and KBQA tasks.

评分理由: 论文核心研究稀疏内存微调（SMF）方法，直接涉及LLMs、稀疏模型、参数高效微调（PEFT/LoRA）和微调（SFT）等关键词，其中LLMs、PEFT和SFT是核心内容（10分），稀疏模型相关（8分），小模型和预训练/适应有一定关联（5分），其余关键词如对齐、推理、代理等未涉及（0分）。

大型语言模型（LLMs）通常在训练后处于静态，而实际应用需要持续适应新知识，同时不削弱现有能力。更新模型的标准方法（如全参数微调或参数高效方法，例如LoRA）面临一个根本性的权衡：灾难性遗忘。这些方法修改了共享的稠密表征，导致任务间相互干扰。稀疏记忆微调（Sparse Memory Finetuning, SMF）通过将更新定位到显式记忆层中的一小部分参数，提供了一种有前景的替代方案。在本工作中，我们提出了一个开源流程，为现有的预训练模型（Qwen-2.5-0.5B）加装稀疏记忆模块，从而能够在消费级硬件上实现有效的持续学习。我们通过引入一种基于库尔巴克-莱布勒（Kullback-Leibler, KL）散度、具有理论依据的槽位选择机制，扩展了先前的工作。该机制优先针对相对于背景分布信息上“意外”的标记进行记忆更新。我们的实验表明，经过改装的模型能够以对保留能力的最小遗忘来获取新的事实知识，从而在实际场景中验证了稀疏更新假说。

Large Language Models (LLMs) are typically static after training, yet real-world applications require continual adaptation to new knowledge without degrading existing capabilities. Standard approaches to updating models, like full finetuning or parameter-efficient methods (e.g., LoRA), face a fundamental trade-off: catastrophic forgetting. They modify shared dense representations, causing interference across tasks. Sparse Memory Finetuning (SMF) offers a promising alternative by localizing updates to a small subset of parameters in explicit memory layers. In this work, we present an open-source pipeline to retrofit existing pretrained models (Qwen-2.5-0.5B) with sparse memory modules, enabling effective continual learning on consumer hardware. We extend prior work by introducing a theoretically grounded slot-selection mechanism based on Kullback-Leibler (KL) divergence, which prioritizes memory updates for informationally “surprising” tokens relative to a background distribution. Our experiments demonstrate that our retrofitted models can acquire new factual knowledge with minimal forgetting of held-out capabilities, validating the sparse update hypothesis in a practical setting.

评分理由: 论文BiMind专注于错误信息检测，提出了一种双头推理框架，结合了内容内部推理和知识增强推理。与关键词的相关性分析如下：1）与"Large Language Models"有一定关联（5分），因为该研究属于大模型在信息验证领域的应用，但未明确使用LLMs；2）与"Retrieval-Augmented Generation"（8分）高度相关，因为论文提出了自检索知识机制，通过kNN检索构建语义记忆；3）与"Chain of Thought"和"System 2 Thinking"（各8分）相关，因为双头推理框架体现了多步推理和深度推理思想；4）与"Hallucination Mitigation"（10分）高度相关，因为错误信息检测直接针对事实性和真实性验证；5）与"Mechanistic Interpretability"（8分）相关，因为论文提出了可解释性诊断和VoX度量。其他关键词如MoE、量化、指令调优等与论文内容无关，得0分。

错误信息通过破坏内容的真实性与完整性构成重大挑战，然而多数检测方法难以在注意力几何结构坍塌的情况下，协同平衡文本内容验证与外部知识修正。为解决此问题，我们提出一种双头推理框架BiMind，该框架将内容内部推理与知识增强推理进行解耦。在BiMind中，我们引入了三项核心创新：（i）注意力几何适配器，通过令牌条件偏移重塑注意力逻辑值并缓解注意力坍塌；（ii）自检索知识机制，通过k近邻检索构建领域内语义记忆，并借助特征级线性调制注入检索到的邻近信息；（iii）不确定性感知融合策略，包括熵门控融合与可训练的共识头，并通过对称KL散度共识正则化器进行稳定。为量化知识贡献，我们定义了一种新颖的指标——经验价值，用于度量知识增强推理带来的实例级逻辑值增益。在公开数据集上的实验结果表明，我们的BiMind模型优于先进的检测方法，并能对知识何时及为何重要提供可解释的诊断分析。

Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.

评分理由: 论文核心研究大语言模型（LLMs）在心理健康领域的应用评估，因此与"Large Language Models"和"AI for Science"高度相关（10分）。提出的CARE框架包含知识蒸馏的链式思维推理，与"Chain of Thought"高度相关（10分）。论文涉及评估AI响应与治疗原则的"Alignment"，以及框架中的对比范例检索与"Retrieval-Augmented Generation"概念相关，各给5分。框架的推理过程涉及深度分析，与"System 2 Thinking"有一定关联（5分）。其他关键词如MoE、SFT、RLHF等未在论文中涉及，给0分。

大型语言模型在心理健康应用中的日益普及，要求建立能够超越表层流畅性、评估其与心理治疗最佳实践契合度的原则性评估框架。尽管现有系统展现出对话能力，但它们缺乏结构化机制来评估其对核心治疗原则的遵循程度。本文研究了如何评估人工智能生成的治疗师式回应在临床基础上的适当性与有效性。我们依据一个细粒度序数量表，从六项治疗原则维度评估每个治疗师话语：非评判性接纳、温暖、尊重自主性、积极倾听、反思性理解以及情境适当性。我们提出了FAITH-M基准数据集，该数据集包含专家标注的序数评分，并提出了CARE评估框架——一个整合了对话内部语境、对比范例检索以及知识蒸馏链式思维推理的多阶段评估框架。实验表明，CARE的F1分数达到63.34，而作为其基础模型的强基线Qwen3的F1分数为38.56，这代表了64.26%的性能提升，表明性能增益源于结构化推理与语境建模，而非仅依赖基础模型能力。专家评估及外部数据集测试进一步证明了该框架在领域转移下的鲁棒性，同时也凸显了在建模隐含临床细微差别方面存在的挑战。总体而言，CARE为评估人工智能心理健康系统的治疗保真度提供了一个基于临床的框架。

The increasing use of large language models in mental health applications calls for principled evaluation frameworks that assess alignment with psychotherapeutic best practices beyond surface-level fluency. While recent systems exhibit conversational competence, they lack structured mechanisms to evaluate adherence to core therapeutic principles. In this paper, we study the problem of evaluating AI-generated therapist-like responses for clinically grounded appropriateness and effectiveness. We assess each therapists utterance along six therapeutic principles: non-judgmental acceptance, warmth, respect for autonomy, active listening, reflective understanding, and situational appropriateness using a fine-grained ordinal scale. We introduce FAITH-M, a benchmark annotated with expert-assigned ordinal ratings, and propose CARE, a multi-stage evaluation framework that integrates intra-dialogue context, contrastive exemplar retrieval, and knowledge-distilled chain-of-thought reasoning. Experiments show that CARE achieves an F-1 score of 63.34 versus the strong baseline Qwen3 F-1 score of 38.56 which is a 64.26 improvement, which also serves as its backbone, indicating that gains arise from structured reasoning and contextual modeling rather than backbone capacity alone. Expert assessment and external dataset evaluations further demonstrate robustness under domain shift, while highlighting challenges in modelling implicit clinical nuance. Overall, CARE provides a clinically grounded framework for evaluating therapeutic fidelity in AI mental health systems.

评分理由: 论文专注于医学视觉语言模型（Med-VLMs）的专家-大众语义对齐，属于大模型在生物医学领域的应用。核心贡献是MedLayBench-V基准数据集，用于训练和评估能弥合临床专家与患者沟通鸿沟的下一代Med-VLMs。因此，与"AI for Science"高度相关（10分），涉及医学AI应用。与"Alignment"相关（8分），因为研究专家与大众语义对齐。与"Hallucination Mitigation"相关（8分），因为数据集构建方法（SCGR）旨在避免简化导致的幻觉风险。与"Large Language Models"、“Pre-training”、“Post-training"有一定关联（各5分），因Med-VLMs基于大模型技术，且基准用于模型训练（包括预训练和微调）。其他关键词如MoE、量化、推理加速等未涉及，得0分。

医学视觉-语言模型（Med-VLMs）在解读诊断影像方面已达到专家水平。然而，当前模型主要基于专业文献进行训练，限制了其以患者为中心护理所需的通俗表达方式传递发现结果的能力。尽管以文本为中心的研究已积极开发简化医学术语的资源，但目前仍严重缺乏旨在促进通俗化医学图像理解的大规模多模态基准。为填补这一资源空白，我们推出了MedLayBench-V——首个致力于专家-通俗语义对齐的大规模多模态基准。与可能产生幻觉的简单简化方法不同，我们的数据集通过结构化概念锚定优化（SCGR）流程构建。该方法通过整合统一医学语言系统（UMLS）概念唯一标识符（CUIs）与微观实体约束，强制实现严格的语义等效性。MedLayBench-V为训练和评估新一代Med-VLMs提供了经过验证的基础，这些模型将能够弥合临床专家与患者之间的沟通鸿沟。

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate findings in the lay register required for patient-centered care. While text-centric research has actively developed resources for simplifying medical jargon, there is a critical absence of large-scale multimodal benchmarks designed to facilitate lay-accessible medical image understanding. To bridge this resource gap, we introduce MedLayBench-V, the first large-scale multimodal benchmark dedicated to expert-lay semantic alignment. Unlike naive simplification approaches that risk hallucination, our dataset is constructed via a Structured Concept-Grounded Refinement (SCGR) pipeline. This method enforces strict semantic equivalence by integrating Unified Medical Language System (UMLS) Concept Unique Identifiers (CUIs) with micro-level entity constraints. MedLayBench-V provides a verified foundation for training and evaluating next-generation Med-VLMs capable of bridging the communication divide between clinical experts and patients.

评分理由: 论文核心研究KV缓存压缩技术以提升多模态大语言模型推理效率，与关键词"KV Cache Compression"高度相关（15分），直接解决大模型推理中的内存和延迟问题，属于大模型技术原理创新。论文涉及大模型（10分）和推理加速（10分），与模型压缩有一定关联（5分）。其他关键词如MoE、SLMs、对齐、RAG等均未在论文中涉及，得0分。

多模态大语言模型（MLLMs）在文本、图像和视频的统一推理方面取得了进展，但其推理过程受到键值（KV）缓存快速增长的阻碍。每个视觉输入会扩展为数千个标记，导致缓存随上下文长度线性增长，并在整个解码过程中驻留在GPU内存中，这即使在高端GPU上也会带来极高的内存开销和延迟。一种常见的解决方案是在固定的分配预算下以不同粒度压缩缓存：标记级均匀丢弃重要性较低的标记，层级在不同层间调整保留比例，而头级则在各个注意力头之间重新分配预算。然而，这些方法仅停留在分配层面，忽视了注意力头具有异质性行为，需要不同的压缩策略。我们提出了HybridKV，一种混合KV缓存压缩框架，它在三个阶段整合了互补策略：首先使用以文本为中心的注意力将头部分为静态或动态类型；然后采用自上而下的预算分配方案分层分配KV预算；最后，静态头通过文本优先剪枝进行压缩，动态头则通过分块检索进行压缩。在Qwen2.5-VL-7B模型上对11个多模态基准进行的实验表明，HybridKV将KV缓存内存降低了高达$7.9\times$，解码速度提升了$1.52\times$，且相较于全缓存MLLM，性能几乎无下降甚至有所提升。

Multimodal Large Language Models (MLLMs) have advanced unified reasoning over text, images, and videos, but their inference is hindered by the rapid growth of key-value (KV) caches. Each visual input expands into thousands of tokens, causing caches to scale linearly with context length and remain resident in GPU memory throughout decoding, which leads to prohibitive memory overhead and latency even on high-end GPUs. A common solution is to compress caches under a fixed allocated budget at different granularities: token-level uniformly discards less important tokens, layer-level varies retention across layers, and head-level redistributes budgets across heads. Yet these approaches stop at allocation and overlook the heterogeneous behaviors of attention heads that require distinct compression strategies. We propose HybridKV, a hybrid KV cache compression framework that integrates complementary strategies in three stages: heads are first classified into static or dynamic types using text-centric attention; then a top-down budget allocation scheme hierarchically assigns KV budgets; finally, static heads are compressed by text-prior pruning and dynamic heads by chunk-wise retrieval. Experiments on 11 multimodal benchmarks with Qwen2.5-VL-7B show that HybridKV reduces KV cache memory by up to $7.9\times$ and achieves $1.52\times$ faster decoding, with almost no performance drop or even higher relative to the full-cache MLLM.

评分理由: 论文提出RATNet，一个用于胃肠道内窥镜诊断的基础模型，属于大模型在生物医学领域的应用。核心相关关键词：1）“Large Language Models” OR “LLMs” OR “Foundation Models”：论文明确开发了一个基础模型（foundation model），高度相关（10分）。2）“Pre-training” OR “Continual Pre-training” OR “Domain Adaptation”：论文采用循环预训练策略（cyclic pre-training strategy）从异构数据中获取知识，高度相关（10分）。3）“Post-training” OR “Supervised Fine-tuning” OR “SFT”：模型支持微调（fine-tuning），高度相关（10分）。4）“AI for Science” OR “Bioinformatics” OR “Cheminformatics”：论文专注于胃肠道疾病诊断的AI应用，属于生物信息学/科学AI范畴，高度相关（10分）。其他关键词如MoE、量化、推理加速、幻觉缓解等，论文未涉及，给0分。

胃肠道疾病正日益加重全球健康负担，而内窥镜检查是早期诊断的主要工具。然而，常规内窥镜图像解读仍存在病变漏检和效率有限的问题。尽管人工智能辅助诊断展现出潜力，但由于医学数据有限、领域偏移以及标注异质性，现有模型往往缺乏泛化性、适应性、鲁棒性和可扩展性。为应对这些挑战，我们开发了RATNet——一个基于类比推理的胃肠道内窥镜影像基础模型。RATNet通过循环预训练策略，从五个胃肠道内窥镜数据集的异质性专家标注中获取并迁移知识。其架构包含编码器、关联知识获取与迁移（Relevance-knowledge Acquisition and Transfer, RAT）模块、投影器以及多任务头，支持微调、线性探测和零样本迁移。评估表明，在六种场景下——常见胃肠道疾病诊断、罕见疾病的少样本学习、向新医疗机构的零样本迁移、长尾疾病分布下的鲁棒性、对新疾病的适应性，以及通过联邦学习实现隐私保护部署——RATNet均优于包括GastroNet和GastroVision在内的现有基础模型。其优势源于类比推理机制：该机制将图像衍生的后验知识与学习到的先验知识库进行匹配，并迁移关联知识以指导诊断，从而提升泛化能力并增强对偏见的抵抗性。RATNet具有开放性和成本效益，支持自动整合异质性标注而无需人工标签统一，同时降低了数据获取成本，这使其成为智能胃肠道诊断——特别是在资源有限环境中——的实用基础框架。

Gastrointestinal diseases impose a growing global health burden, and endoscopy is a primary tool for early diagnosis. However, routine endoscopic image interpretation still suffers from missed lesions and limited efficiency. Although AI-assisted diagnosis has shown promise, existing models often lack generalizability, adaptability, robustness, and scalability because of limited medical data, domain shift, and heterogeneous annotations. To address these challenges, we develop RATNet, a foundation model for gastrointestinal endoscopy imaging based on analogical reasoning. RATNet acquires and transfers knowledge from heterogeneous expert annotations across five gastrointestinal endoscopy datasets through a cyclic pre-training strategy. Its architecture consists of an encoder, a relevance-knowledge acquisition and transfer (RAT) module, a projector, and a multi-task head, and supports fine-tuning, linear probing, and zero-shot transfer. Evaluations show that RATNet outperforms existing foundation models, including GastroNet and GastroVision, across six scenarios: diagnosis of common gastrointestinal diseases, few-shot learning for rare diseases, zero-shot transfer to new medical sites, robustness under long-tailed disease distributions, adaptation to novel diseases, and privacy-preserving deployment via federated learning. Its advantage comes from an analogical reasoning mechanism that matches image-derived posterior knowledge to a learned prior knowledge base and transfers relative knowledge to guide diagnosis, improving generalization and resistance to bias. RATNet is open and cost-effective, supports automatic integration of heterogeneous annotations without manual label unification, and reduces data acquisition costs, making it a practical foundation for intelligent gastrointestinal diagnosis, especially in resource-limited settings.

评分理由: 论文核心研究大语言模型（LLMs）的知识编辑问题，特别是解决多步推理中的"推理鸿沟”。因此，与"Large Language Models"高度相关（10分）。论文专注于多步推理链（multi-step reasoning chains），与"Chain of Thought"和"System 2 Thinking"高度相关（各10分）。论文提出基于机制电路（mechanistic circuit）的方法，与"Mechanistic Interpretability"高度相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、Alignment、RAG、Quantization、AI for Science等，论文未涉及，故给0分。

在现实动态环境中部署大语言模型（LLM）带来了更新其预训练知识的挑战。现有的知识编辑方法虽然能够可靠地修正孤立事实，但常常面临“推理鸿沟”问题：模型能回忆起被编辑的事实，却无法在多步推理链中有效运用该事实。为弥合这一鸿沟，我们提出MCircKE（基于机理电路的知识编辑），这是一种新颖的框架，能够实现精确的“定位-适配”编辑流程。MCircKE首先识别负责特定推理任务的因果电路，该电路既捕获事实的存储，也捕捉其逻辑结论的传递路径；随后，仅在此定位出的电路内部进行精准的参数更新。在MQuAKE-3K基准测试上的大量实验表明，该方法在知识编辑的多跳推理任务中具有显著有效性。

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from a “Reasoning Gap”, where the model recalls the edited fact but fails to utilize it in multi-step reasoning chains. To bridge this gap, we introduce MCircKE (\underline{M}echanistic \underline{Circ}uit-based \underline{K}nowledge \underline{E}diting), a novel framework that enables a precise “map-and-adapt” editing procedure. MCircKE first identifies the causal circuits responsible for a specific reasoning task, capturing both the storage of the fact and the routing of its logical consequences. It then surgically update parameters exclusively within this mapped circuit. Extensive experiments on the MQuAKE-3K benchmark demonstrate the effectiveness of the proposed method for multi-hop reasoning in knowledge editing.

评分理由: 论文核心研究科学基础模型（特别是生物学和物理学领域）中连续几何表示与离散标记化之间的根本矛盾，提出了"几何对齐税"概念。与"Foundation Models"高度相关（10分），因为论文明确研究科学基础模型；与"AI for Science"高度相关（10分），因为研究生物学和物理学领域的AI应用；与"Mechanistic Interpretability"高度相关（10分），因为论文深入分析模型内部表示和几何失真问题；与"Pre-training"有一定关联（5分），因为涉及模型训练和表示学习；其他关键词如MoE、SFT、RAG等与论文内容无关（0分）。

生物学与物理学基础模型虽能优化预测准确性，但其内部表征系统性地无法保持所建模系统的连续几何结构。我们揭示了根本原因：几何对齐税——即强制将连续流形通过离散分类瓶颈所产生的固有代价。在合成动力系统上的受控消融实验表明，在相同编码器上用连续输出头替代交叉熵损失，可将几何失真降低高达8.5倍；而学习得到的码本则呈现非单调的双重约束现象：更精细的量化虽能改善重建效果，却会恶化几何保持。在连续目标下，三种架构的差异仅为1.3倍；而在离散标记化条件下，其差异扩大至3000倍。通过率失真理论与互信息神经估计（MINE）对14个生物基础模型进行评估，我们识别出三种失效机制：局部-全局解耦、表征压缩与几何空泛。受控实验证实，Evo 2模型在真实DNA数据上表现出的反向互补稳健性反映的是保守的序列组成特征，而非习得的对称性。所有模型均未能同时实现低失真、高互信息与全局连贯性。

Foundation models for biology and physics optimize predictive accuracy, but their internal representations systematically fail to preserve the continuous geometry of the systems they model. We identify the root cause: the Geometric Alignment Tax, an intrinsic cost of forcing continuous manifolds through discrete categorical bottlenecks. Controlled ablations on synthetic dynamical systems demonstrate that replacing cross-entropy with a continuous head on an identical encoder reduces geometric distortion by up to 8.5x, while learned codebooks exhibit a non-monotonic double bind where finer quantization worsens geometry despite improving reconstruction. Under continuous objectives, three architectures differ by 1.3x; under discrete tokenization, they diverge by 3,000x. Evaluating 14 biological foundation models with rate-distortion theory and MINE, we identify three failure regimes: Local-Global Decoupling, Representational Compression, and Geometric Vacuity. A controlled experiment confirms that Evo 2’s reverse-complement robustness on real DNA reflects conserved sequence composition, not learned symmetry. No model achieves simultaneously low distortion, high mutual information, and global coherence.

评分理由: 论文专注于Agentic AI系统的治理和控制框架，与"LLM Agents/Autonomous Agents/Agentic Workflow"高度相关（10分），因为这是论文的核心研究对象。与"Tool Use/Function Calling/API Tool Use"相关（8分），因为论文提到Agentic AI系统使用工具并产生外部影响。与"Large Language Models/LLMs/Foundation Models"和"Instruction Tuning/Alignment/Value Alignment"有一定关联（各5分），因为Agentic AI通常基于大模型，且治理涉及价值对齐。与"Multi-agent Systems/Agent Coordination"有一定关联（5分），因为治理框架可能适用于多代理系统。其他关键词如MoE、Scaling Laws、训练方法、推理技术、模型压缩等与论文的治理和控制主题无关，得0分。

具身化人工智能系统能够进行规划、使用工具、维持状态，并产生具有外部效应的多步骤轨迹。这些特性催生了一个与单轮生成式人工智能存在本质差异的治理问题：重大风险在执行过程中涌现，而不仅仅出现在模型开发或部署阶段。因此，诸如ISO/IEC 42001、ISO/IEC 23894、ISO/IEC 42005、ISO/IEC 5338、ISO/IEC 38507等标准以及NIST人工智能风险管理框架与具身化AI高度相关，但它们本身并不能直接转化为可实施的运行时护栏。本文提出一种分层转化方法，将源于标准的治理目标连接到四个控制层：治理目标、设计时约束、运行时协调以及保障反馈。该方法区分了治理目标、技术控制、运行时护栏和保障证据；引入了用于层级分配的控制元组和运行时可执行性评估准则；并通过一个采购代理案例研究展示了该方法。核心主张是审慎的：标准应指导控制在架构、运行时策略、人工介入升级和审计等环节的部署，而运行时护栏应仅保留给那些具备可观测性、确定性和足够时效性，从而有理由在执行时进行干预的控制措施。

Agentic AI systems plan, use tools, maintain state, and produce multi-step trajectories with external effects. Those properties create a governance problem that differs materially from single-turn generative AI: important risks emerge dur- ing execution, not only at model development or deployment time. Governance standards such as ISO/IEC 42001, ISO/IEC 23894, ISO/IEC 42005, ISO/IEC 5338, ISO/IEC 38507, and the NIST AI Risk Management Framework are therefore highly relevant to agentic AI, but they do not by themselves yield implementable runtime guardrails. This paper proposes a layered translation method that connects standards-derived governance objectives to four control layers: governance objectives, design- time constraints, runtime mediation, and assurance feedback. It distinguishes governance objectives, technical controls, runtime guardrails, and assurance evidence; introduces a control tuple and runtime-enforceability rubric for layer assignment; and demonstrates the method in a procurement-agent case study. The central claim is modest: standards should guide control placement across architecture, runtime policy, human escalation, and audit, while runtime guardrails are reserved for controls that are observable, determinate, and time-sensitive enough to justify execution-time intervention.

评分理由: 论文UniCreative提出了一种用于创意写作的统一强化学习框架，核心贡献是AC-GenRM奖励模型和ACPO优化算法，旨在解决长文本连贯性与短文本表达性之间的平衡问题。该研究与LLM高度相关（10分），因为它专注于大模型在创意写作中的应用；与Alignment和RLHF/DPO高度相关（10分），因为它提出了无参考的强化学习对齐方法；与Post-training/SFT相关（8分），因为它涉及模型对齐而不依赖监督微调；与Long Context LLMs相关（8分），因为它处理长文本生成中的规划问题；与CoT Reasoning、System 2 Thinking和Self-Correction有一定关联（5分），因为模型展现出元认知能力，能区分任务类型。其他关键词如MoE、SLMs、Scaling Laws、PEFT、RAG等未在论文中涉及，得0分。

创造性写作的一个根本性挑战在于调和长文本叙事所需的全局连贯性与短文本创作所追求的局部表现力之间的固有张力。长文本生成需要明确的宏观规划，而短篇创作则往往要求自发且无约束的表达。然而，现有的对齐范式通常采用静态奖励信号，并严重依赖高质量监督数据，这类数据成本高昂且难以扩展。为此，我们提出了 \textbf{UniCreative}，一个统一的无需参考的强化学习框架。我们首先引入了 \textbf{AC-GenRM}，这是一个自适应约束感知奖励模型，它能动态合成针对特定查询的评判标准，以提供细粒度的偏好判断。利用这些信号，我们提出了 \textbf{ACPO}，一种策略优化算法，该算法能够在无需监督微调和真实参考文本的情况下，使模型在内容质量和结构范式两方面与人类偏好对齐。实证结果表明，AC-GenRM 与专家评估高度一致，而 ACPO 则能显著提升模型在多样化写作任务上的性能。关键的是，我们的分析揭示了一种新兴的元认知能力：模型学会了自主区分需要严格规划的任务与适合直接生成的任务，从而验证了我们直接对齐方法的有效性。

A fundamental challenge in creative writing lies in reconciling the inherent tension between maintaining global coherence in long-form narratives and preserving local expressiveness in short-form texts. While long-context generation necessitates explicit macroscopic planning, short-form creativity often demands spontaneous, constraint-free expression. Existing alignment paradigms, however, typically employ static reward signals and rely heavily on high-quality supervised data, which is costly and difficult to scale. To address this, we propose \textbf{UniCreative}, a unified reference-free reinforcement learning framework. We first introduce \textbf{AC-GenRM}, an adaptive constraint-aware reward model that dynamically synthesizes query-specific criteria to provide fine-grained preference judgments. Leveraging these signals, we propose \textbf{ACPO}, a policy optimization algorithm that aligns models with human preferences across both content quality and structural paradigms without supervised fine-tuning and ground-truth references. Empirical results demonstrate that AC-GenRM aligns closely with expert evaluations, while ACPO significantly enhances performance across diverse writing tasks. Crucially, our analysis reveals an emergent meta-cognitive ability: the model learns to autonomously differentiate between tasks requiring rigorous planning and those favoring direct generation, validating the effectiveness of our direct alignment approach.

评分理由: 论文提出JCQL框架，结合LLM和SLM解决知识库补全(KBC)和知识库问答(KBQA)的联合任务。核心相关关键词：LLMs（10分，论文核心使用LLM进行推理）、SLMs（10分，论文核心使用SLM进行KBC）、LLM Agents（10分，明确使用LLM agent-based KBQA模型）、Hallucination Mitigation（10分，明确解决LLM幻觉问题）。中等相关关键词：Supervised Fine-tuning（5分，提到增量微调KBC模型）、Chain of Thought（5分，涉及推理路径）、Tool Use（5分，将KBC模型作为agent动作使用）。其他关键词与论文内容无直接关联，得0分。

知识库（Knowledge Bases，KBs）在各种应用中发挥着关键作用。作为两项具有代表性的知识库相关任务，知识库补全（Knowledge Base Completion，KBC）与知识库问答（Knowledge Base Question Answering，KBQA）紧密关联且本质互补。因此，联合解决KBC与KBQA任务以使其相互促进将大有裨益。然而，现有研究通常依赖小语言模型（Small Language Model，SLM）来联合增强这两项任务，而忽略了大语言模型（Large Language Model，LLM）强大的推理能力。本文通过结合LLM与SLM的优势，提出了一种新颖的框架JCQL，该框架能够以迭代方式使这两项任务相互增强。为使KBC增强KBQA，我们通过将基于SLM训练的KBC模型作为智能体的一项行动，来增强基于LLM智能体的KBQA模型的推理路径，从而缓解LLM在KBQA中存在的幻觉问题与高计算成本问题。为使KBQA增强KBC，我们利用KBQA的推理路径作为补充训练数据，对KBC模型进行增量微调，从而提升SLM在KBC任务中的能力。在两个公开基准数据集上的大量实验表明，JCQL在KBC与KBQA任务上均超越了所有基线方法。

Knowledge Bases (KBs) play a key role in various applications. As two representative KB-related tasks, knowledge base completion (KBC) and knowledge base question answering (KBQA) are closely related and inherently complementary with each other. Thus, it will be beneficial to solve the task of joint KBC and KBQA to make them reinforce each other. However, existing studies usually rely on the small language model (SLM) to enhance them jointly, and the large language model (LLM)’s strong reasoning ability is ignored. In this paper, by combining the strengths of the LLM with the SLM, we propose a novel framework JCQL, which can make these two tasks enhance each other in an iterative manner. To make KBC enhance KBQA, we augment the LLM agent-based KBQA model’s reasoning paths by incorporating an SLM-trained KBC model as an action of the agent, alleviating the LLM’s hallucination and high computational costs issue in KBQA. To make KBQA enhance KBC, we incrementally fine-tune the KBC model by leveraging KBQA’s reasoning paths as its supplementary training data, improving the ability of the SLM in KBC. Extensive experiments over two public benchmark data sets demonstrate that JCQL surpasses all baselines for both KBC and KBQA tasks.

评分理由: 论文核心研究稀疏内存微调（SMF）方法，直接涉及LLMs、稀疏模型、参数高效微调（PEFT/LoRA）和微调（SFT）等关键词，其中LLMs、PEFT和SFT是核心内容（10分），稀疏模型相关（8分），小模型和预训练/适应有一定关联（5分），其余关键词如对齐、推理、代理等未涉及（0分）。

大型语言模型（LLMs）通常在训练后处于静态，而实际应用需要持续适应新知识，同时不削弱现有能力。更新模型的标准方法（如全参数微调或参数高效方法，例如LoRA）面临一个根本性的权衡：灾难性遗忘。这些方法修改了共享的稠密表征，导致任务间相互干扰。稀疏记忆微调（Sparse Memory Finetuning, SMF）通过将更新定位到显式记忆层中的一小部分参数，提供了一种有前景的替代方案。在本工作中，我们提出了一个开源流程，为现有的预训练模型（Qwen-2.5-0.5B）加装稀疏记忆模块，从而能够在消费级硬件上实现有效的持续学习。我们通过引入一种基于库尔巴克-莱布勒（Kullback-Leibler, KL）散度、具有理论依据的槽位选择机制，扩展了先前的工作。该机制优先针对相对于背景分布信息上“意外”的标记进行记忆更新。我们的实验表明，经过改装的模型能够以对保留能力的最小遗忘来获取新的事实知识，从而在实际场景中验证了稀疏更新假说。

Large Language Models (LLMs) are typically static after training, yet real-world applications require continual adaptation to new knowledge without degrading existing capabilities. Standard approaches to updating models, like full finetuning or parameter-efficient methods (e.g., LoRA), face a fundamental trade-off: catastrophic forgetting. They modify shared dense representations, causing interference across tasks. Sparse Memory Finetuning (SMF) offers a promising alternative by localizing updates to a small subset of parameters in explicit memory layers. In this work, we present an open-source pipeline to retrofit existing pretrained models (Qwen-2.5-0.5B) with sparse memory modules, enabling effective continual learning on consumer hardware. We extend prior work by introducing a theoretically grounded slot-selection mechanism based on Kullback-Leibler (KL) divergence, which prioritizes memory updates for informationally “surprising” tokens relative to a background distribution. Our experiments demonstrate that our retrofitted models can acquire new factual knowledge with minimal forgetting of held-out capabilities, validating the sparse update hypothesis in a practical setting.

评分理由: 论文BiMind专注于错误信息检测，提出了一种双头推理框架，结合了内容内部推理和知识增强推理。与关键词的相关性分析如下：1）与"Large Language Models"有一定关联（5分），因为该研究属于大模型在信息验证领域的应用，但未明确使用LLMs；2）与"Retrieval-Augmented Generation"（8分）高度相关，因为论文提出了自检索知识机制，通过kNN检索构建语义记忆；3）与"Chain of Thought"和"System 2 Thinking"（各8分）相关，因为双头推理框架体现了多步推理和深度推理思想；4）与"Hallucination Mitigation"（10分）高度相关，因为错误信息检测直接针对事实性和真实性验证；5）与"Mechanistic Interpretability"（8分）相关，因为论文提出了可解释性诊断和VoX度量。其他关键词如MoE、量化、指令调优等与论文内容无关，得0分。

错误信息通过破坏内容的真实性与完整性构成重大挑战，然而多数检测方法难以在注意力几何结构坍塌的情况下，协同平衡文本内容验证与外部知识修正。为解决此问题，我们提出一种双头推理框架BiMind，该框架将内容内部推理与知识增强推理进行解耦。在BiMind中，我们引入了三项核心创新：（i）注意力几何适配器，通过令牌条件偏移重塑注意力逻辑值并缓解注意力坍塌；（ii）自检索知识机制，通过k近邻检索构建领域内语义记忆，并借助特征级线性调制注入检索到的邻近信息；（iii）不确定性感知融合策略，包括熵门控融合与可训练的共识头，并通过对称KL散度共识正则化器进行稳定。为量化知识贡献，我们定义了一种新颖的指标——经验价值，用于度量知识增强推理带来的实例级逻辑值增益。在公开数据集上的实验结果表明，我们的BiMind模型优于先进的检测方法，并能对知识何时及为何重要提供可解释的诊断分析。

Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.

评分理由: 论文核心研究大语言模型（LLMs）在心理健康领域的应用评估，因此与"Large Language Models"和"AI for Science"高度相关（10分）。提出的CARE框架包含知识蒸馏的链式思维推理，与"Chain of Thought"高度相关（10分）。论文涉及评估AI响应与治疗原则的"Alignment"，以及框架中的对比范例检索与"Retrieval-Augmented Generation"概念相关，各给5分。框架的推理过程涉及深度分析，与"System 2 Thinking"有一定关联（5分）。其他关键词如MoE、SFT、RLHF等未在论文中涉及，给0分。

大型语言模型在心理健康应用中的日益普及，要求建立能够超越表层流畅性、评估其与心理治疗最佳实践契合度的原则性评估框架。尽管现有系统展现出对话能力，但它们缺乏结构化机制来评估其对核心治疗原则的遵循程度。本文研究了如何评估人工智能生成的治疗师式回应在临床基础上的适当性与有效性。我们依据一个细粒度序数量表，从六项治疗原则维度评估每个治疗师话语：非评判性接纳、温暖、尊重自主性、积极倾听、反思性理解以及情境适当性。我们提出了FAITH-M基准数据集，该数据集包含专家标注的序数评分，并提出了CARE评估框架——一个整合了对话内部语境、对比范例检索以及知识蒸馏链式思维推理的多阶段评估框架。实验表明，CARE的F1分数达到63.34，而作为其基础模型的强基线Qwen3的F1分数为38.56，这代表了64.26%的性能提升，表明性能增益源于结构化推理与语境建模，而非仅依赖基础模型能力。专家评估及外部数据集测试进一步证明了该框架在领域转移下的鲁棒性，同时也凸显了在建模隐含临床细微差别方面存在的挑战。总体而言，CARE为评估人工智能心理健康系统的治疗保真度提供了一个基于临床的框架。

The increasing use of large language models in mental health applications calls for principled evaluation frameworks that assess alignment with psychotherapeutic best practices beyond surface-level fluency. While recent systems exhibit conversational competence, they lack structured mechanisms to evaluate adherence to core therapeutic principles. In this paper, we study the problem of evaluating AI-generated therapist-like responses for clinically grounded appropriateness and effectiveness. We assess each therapists utterance along six therapeutic principles: non-judgmental acceptance, warmth, respect for autonomy, active listening, reflective understanding, and situational appropriateness using a fine-grained ordinal scale. We introduce FAITH-M, a benchmark annotated with expert-assigned ordinal ratings, and propose CARE, a multi-stage evaluation framework that integrates intra-dialogue context, contrastive exemplar retrieval, and knowledge-distilled chain-of-thought reasoning. Experiments show that CARE achieves an F-1 score of 63.34 versus the strong baseline Qwen3 F-1 score of 38.56 which is a 64.26 improvement, which also serves as its backbone, indicating that gains arise from structured reasoning and contextual modeling rather than backbone capacity alone. Expert assessment and external dataset evaluations further demonstrate robustness under domain shift, while highlighting challenges in modelling implicit clinical nuance. Overall, CARE provides a clinically grounded framework for evaluating therapeutic fidelity in AI mental health systems.

评分理由: 论文专注于医学视觉语言模型（Med-VLMs）的专家-大众语义对齐，属于大模型在生物医学领域的应用。核心贡献是MedLayBench-V基准数据集，用于训练和评估能弥合临床专家与患者沟通鸿沟的下一代Med-VLMs。因此，与"AI for Science"高度相关（10分），涉及医学AI应用。与"Alignment"相关（8分），因为研究专家与大众语义对齐。与"Hallucination Mitigation"相关（8分），因为数据集构建方法（SCGR）旨在避免简化导致的幻觉风险。与"Large Language Models"、“Pre-training”、“Post-training"有一定关联（各5分），因Med-VLMs基于大模型技术，且基准用于模型训练（包括预训练和微调）。其他关键词如MoE、量化、推理加速等未涉及，得0分。

医学视觉-语言模型（Med-VLMs）在解读诊断影像方面已达到专家水平。然而，当前模型主要基于专业文献进行训练，限制了其以患者为中心护理所需的通俗表达方式传递发现结果的能力。尽管以文本为中心的研究已积极开发简化医学术语的资源，但目前仍严重缺乏旨在促进通俗化医学图像理解的大规模多模态基准。为填补这一资源空白，我们推出了MedLayBench-V——首个致力于专家-通俗语义对齐的大规模多模态基准。与可能产生幻觉的简单简化方法不同，我们的数据集通过结构化概念锚定优化（SCGR）流程构建。该方法通过整合统一医学语言系统（UMLS）概念唯一标识符（CUIs）与微观实体约束，强制实现严格的语义等效性。MedLayBench-V为训练和评估新一代Med-VLMs提供了经过验证的基础，这些模型将能够弥合临床专家与患者之间的沟通鸿沟。

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate findings in the lay register required for patient-centered care. While text-centric research has actively developed resources for simplifying medical jargon, there is a critical absence of large-scale multimodal benchmarks designed to facilitate lay-accessible medical image understanding. To bridge this resource gap, we introduce MedLayBench-V, the first large-scale multimodal benchmark dedicated to expert-lay semantic alignment. Unlike naive simplification approaches that risk hallucination, our dataset is constructed via a Structured Concept-Grounded Refinement (SCGR) pipeline. This method enforces strict semantic equivalence by integrating Unified Medical Language System (UMLS) Concept Unique Identifiers (CUIs) with micro-level entity constraints. MedLayBench-V provides a verified foundation for training and evaluating next-generation Med-VLMs capable of bridging the communication divide between clinical experts and patients.

评分理由: 论文核心研究KV缓存压缩技术以提升多模态大语言模型推理效率，与关键词"KV Cache Compression"高度相关（15分），直接解决大模型推理中的内存和延迟问题，属于大模型技术原理创新。论文涉及大模型（10分）和推理加速（10分），与模型压缩有一定关联（5分）。其他关键词如MoE、SLMs、对齐、RAG等均未在论文中涉及，得0分。

多模态大语言模型（MLLMs）在文本、图像和视频的统一推理方面取得了进展，但其推理过程受到键值（KV）缓存快速增长的阻碍。每个视觉输入会扩展为数千个标记，导致缓存随上下文长度线性增长，并在整个解码过程中驻留在GPU内存中，这即使在高端GPU上也会带来极高的内存开销和延迟。一种常见的解决方案是在固定的分配预算下以不同粒度压缩缓存：标记级均匀丢弃重要性较低的标记，层级在不同层间调整保留比例，而头级则在各个注意力头之间重新分配预算。然而，这些方法仅停留在分配层面，忽视了注意力头具有异质性行为，需要不同的压缩策略。我们提出了HybridKV，一种混合KV缓存压缩框架，它在三个阶段整合了互补策略：首先使用以文本为中心的注意力将头部分为静态或动态类型；然后采用自上而下的预算分配方案分层分配KV预算；最后，静态头通过文本优先剪枝进行压缩，动态头则通过分块检索进行压缩。在Qwen2.5-VL-7B模型上对11个多模态基准进行的实验表明，HybridKV将KV缓存内存降低了高达$7.9\times$，解码速度提升了$1.52\times$，且相较于全缓存MLLM，性能几乎无下降甚至有所提升。

Multimodal Large Language Models (MLLMs) have advanced unified reasoning over text, images, and videos, but their inference is hindered by the rapid growth of key-value (KV) caches. Each visual input expands into thousands of tokens, causing caches to scale linearly with context length and remain resident in GPU memory throughout decoding, which leads to prohibitive memory overhead and latency even on high-end GPUs. A common solution is to compress caches under a fixed allocated budget at different granularities: token-level uniformly discards less important tokens, layer-level varies retention across layers, and head-level redistributes budgets across heads. Yet these approaches stop at allocation and overlook the heterogeneous behaviors of attention heads that require distinct compression strategies. We propose HybridKV, a hybrid KV cache compression framework that integrates complementary strategies in three stages: heads are first classified into static or dynamic types using text-centric attention; then a top-down budget allocation scheme hierarchically assigns KV budgets; finally, static heads are compressed by text-prior pruning and dynamic heads by chunk-wise retrieval. Experiments on 11 multimodal benchmarks with Qwen2.5-VL-7B show that HybridKV reduces KV cache memory by up to $7.9\times$ and achieves $1.52\times$ faster decoding, with almost no performance drop or even higher relative to the full-cache MLLM.

评分理由: 论文提出RATNet，一个用于胃肠道内窥镜诊断的基础模型，属于大模型在生物医学领域的应用。核心相关关键词：1）“Large Language Models” OR “LLMs” OR “Foundation Models”：论文明确开发了一个基础模型（foundation model），高度相关（10分）。2）“Pre-training” OR “Continual Pre-training” OR “Domain Adaptation”：论文采用循环预训练策略（cyclic pre-training strategy）从异构数据中获取知识，高度相关（10分）。3）“Post-training” OR “Supervised Fine-tuning” OR “SFT”：模型支持微调（fine-tuning），高度相关（10分）。4）“AI for Science” OR “Bioinformatics” OR “Cheminformatics”：论文专注于胃肠道疾病诊断的AI应用，属于生物信息学/科学AI范畴，高度相关（10分）。其他关键词如MoE、量化、推理加速、幻觉缓解等，论文未涉及，给0分。

胃肠道疾病正日益加重全球健康负担，而内窥镜检查是早期诊断的主要工具。然而，常规内窥镜图像解读仍存在病变漏检和效率有限的问题。尽管人工智能辅助诊断展现出潜力，但由于医学数据有限、领域偏移以及标注异质性，现有模型往往缺乏泛化性、适应性、鲁棒性和可扩展性。为应对这些挑战，我们开发了RATNet——一个基于类比推理的胃肠道内窥镜影像基础模型。RATNet通过循环预训练策略，从五个胃肠道内窥镜数据集的异质性专家标注中获取并迁移知识。其架构包含编码器、关联知识获取与迁移（Relevance-knowledge Acquisition and Transfer, RAT）模块、投影器以及多任务头，支持微调、线性探测和零样本迁移。评估表明，在六种场景下——常见胃肠道疾病诊断、罕见疾病的少样本学习、向新医疗机构的零样本迁移、长尾疾病分布下的鲁棒性、对新疾病的适应性，以及通过联邦学习实现隐私保护部署——RATNet均优于包括GastroNet和GastroVision在内的现有基础模型。其优势源于类比推理机制：该机制将图像衍生的后验知识与学习到的先验知识库进行匹配，并迁移关联知识以指导诊断，从而提升泛化能力并增强对偏见的抵抗性。RATNet具有开放性和成本效益，支持自动整合异质性标注而无需人工标签统一，同时降低了数据获取成本，这使其成为智能胃肠道诊断——特别是在资源有限环境中——的实用基础框架。

Gastrointestinal diseases impose a growing global health burden, and endoscopy is a primary tool for early diagnosis. However, routine endoscopic image interpretation still suffers from missed lesions and limited efficiency. Although AI-assisted diagnosis has shown promise, existing models often lack generalizability, adaptability, robustness, and scalability because of limited medical data, domain shift, and heterogeneous annotations. To address these challenges, we develop RATNet, a foundation model for gastrointestinal endoscopy imaging based on analogical reasoning. RATNet acquires and transfers knowledge from heterogeneous expert annotations across five gastrointestinal endoscopy datasets through a cyclic pre-training strategy. Its architecture consists of an encoder, a relevance-knowledge acquisition and transfer (RAT) module, a projector, and a multi-task head, and supports fine-tuning, linear probing, and zero-shot transfer. Evaluations show that RATNet outperforms existing foundation models, including GastroNet and GastroVision, across six scenarios: diagnosis of common gastrointestinal diseases, few-shot learning for rare diseases, zero-shot transfer to new medical sites, robustness under long-tailed disease distributions, adaptation to novel diseases, and privacy-preserving deployment via federated learning. Its advantage comes from an analogical reasoning mechanism that matches image-derived posterior knowledge to a learned prior knowledge base and transfers relative knowledge to guide diagnosis, improving generalization and resistance to bias. RATNet is open and cost-effective, supports automatic integration of heterogeneous annotations without manual label unification, and reduces data acquisition costs, making it a practical foundation for intelligent gastrointestinal diagnosis, especially in resource-limited settings.

评分理由: 论文核心研究大语言模型（LLMs）的知识编辑问题，特别是解决多步推理中的"推理鸿沟”。因此，与"Large Language Models"高度相关（10分）。论文专注于多步推理链（multi-step reasoning chains），与"Chain of Thought"和"System 2 Thinking"高度相关（各10分）。论文提出基于机制电路（mechanistic circuit）的方法，与"Mechanistic Interpretability"高度相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、Alignment、RAG、Quantization、AI for Science等，论文未涉及，故给0分。

在现实动态环境中部署大语言模型（LLM）带来了更新其预训练知识的挑战。现有的知识编辑方法虽然能够可靠地修正孤立事实，但常常面临“推理鸿沟”问题：模型能回忆起被编辑的事实，却无法在多步推理链中有效运用该事实。为弥合这一鸿沟，我们提出MCircKE（基于机理电路的知识编辑），这是一种新颖的框架，能够实现精确的“定位-适配”编辑流程。MCircKE首先识别负责特定推理任务的因果电路，该电路既捕获事实的存储，也捕捉其逻辑结论的传递路径；随后，仅在此定位出的电路内部进行精准的参数更新。在MQuAKE-3K基准测试上的大量实验表明，该方法在知识编辑的多跳推理任务中具有显著有效性。

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from a “Reasoning Gap”, where the model recalls the edited fact but fails to utilize it in multi-step reasoning chains. To bridge this gap, we introduce MCircKE (\underline{M}echanistic \underline{Circ}uit-based \underline{K}nowledge \underline{E}diting), a novel framework that enables a precise “map-and-adapt” editing procedure. MCircKE first identifies the causal circuits responsible for a specific reasoning task, capturing both the storage of the fact and the routing of its logical consequences. It then surgically update parameters exclusively within this mapped circuit. Extensive experiments on the MQuAKE-3K benchmark demonstrate the effectiveness of the proposed method for multi-hop reasoning in knowledge editing.

评分理由: 论文核心研究科学基础模型（特别是生物学和物理学领域）中连续几何表示与离散标记化之间的根本矛盾，提出了"几何对齐税"概念。与"Foundation Models"高度相关（10分），因为论文明确研究科学基础模型；与"AI for Science"高度相关（10分），因为研究生物学和物理学领域的AI应用；与"Mechanistic Interpretability"高度相关（10分），因为论文深入分析模型内部表示和几何失真问题；与"Pre-training"有一定关联（5分），因为涉及模型训练和表示学习；其他关键词如MoE、SFT、RAG等与论文内容无关（0分）。

生物学与物理学基础模型虽能优化预测准确性，但其内部表征系统性地无法保持所建模系统的连续几何结构。我们揭示了根本原因：几何对齐税——即强制将连续流形通过离散分类瓶颈所产生的固有代价。在合成动力系统上的受控消融实验表明，在相同编码器上用连续输出头替代交叉熵损失，可将几何失真降低高达8.5倍；而学习得到的码本则呈现非单调的双重约束现象：更精细的量化虽能改善重建效果，却会恶化几何保持。在连续目标下，三种架构的差异仅为1.3倍；而在离散标记化条件下，其差异扩大至3000倍。通过率失真理论与互信息神经估计（MINE）对14个生物基础模型进行评估，我们识别出三种失效机制：局部-全局解耦、表征压缩与几何空泛。受控实验证实，Evo 2模型在真实DNA数据上表现出的反向互补稳健性反映的是保守的序列组成特征，而非习得的对称性。所有模型均未能同时实现低失真、高互信息与全局连贯性。

Foundation models for biology and physics optimize predictive accuracy, but their internal representations systematically fail to preserve the continuous geometry of the systems they model. We identify the root cause: the Geometric Alignment Tax, an intrinsic cost of forcing continuous manifolds through discrete categorical bottlenecks. Controlled ablations on synthetic dynamical systems demonstrate that replacing cross-entropy with a continuous head on an identical encoder reduces geometric distortion by up to 8.5x, while learned codebooks exhibit a non-monotonic double bind where finer quantization worsens geometry despite improving reconstruction. Under continuous objectives, three architectures differ by 1.3x; under discrete tokenization, they diverge by 3,000x. Evaluating 14 biological foundation models with rate-distortion theory and MINE, we identify three failure regimes: Local-Global Decoupling, Representational Compression, and Geometric Vacuity. A controlled experiment confirms that Evo 2’s reverse-complement robustness on real DNA reflects conserved sequence composition, not learned symmetry. No model achieves simultaneously low distortion, high mutual information, and global coherence.

评分理由: 论文专注于Agentic AI系统的治理和控制框架，与"LLM Agents/Autonomous Agents/Agentic Workflow"高度相关（10分），因为这是论文的核心研究对象。与"Tool Use/Function Calling/API Tool Use"相关（8分），因为论文提到Agentic AI系统使用工具并产生外部影响。与"Large Language Models/LLMs/Foundation Models"和"Instruction Tuning/Alignment/Value Alignment"有一定关联（各5分），因为Agentic AI通常基于大模型，且治理涉及价值对齐。与"Multi-agent Systems/Agent Coordination"有一定关联（5分），因为治理框架可能适用于多代理系统。其他关键词如MoE、Scaling Laws、训练方法、推理技术、模型压缩等与论文的治理和控制主题无关，得0分。

具身化人工智能系统能够进行规划、使用工具、维持状态，并产生具有外部效应的多步骤轨迹。这些特性催生了一个与单轮生成式人工智能存在本质差异的治理问题：重大风险在执行过程中涌现，而不仅仅出现在模型开发或部署阶段。因此，诸如ISO/IEC 42001、ISO/IEC 23894、ISO/IEC 42005、ISO/IEC 5338、ISO/IEC 38507等标准以及NIST人工智能风险管理框架与具身化AI高度相关，但它们本身并不能直接转化为可实施的运行时护栏。本文提出一种分层转化方法，将源于标准的治理目标连接到四个控制层：治理目标、设计时约束、运行时协调以及保障反馈。该方法区分了治理目标、技术控制、运行时护栏和保障证据；引入了用于层级分配的控制元组和运行时可执行性评估准则；并通过一个采购代理案例研究展示了该方法。核心主张是审慎的：标准应指导控制在架构、运行时策略、人工介入升级和审计等环节的部署，而运行时护栏应仅保留给那些具备可观测性、确定性和足够时效性，从而有理由在执行时进行干预的控制措施。

Agentic AI systems plan, use tools, maintain state, and produce multi-step trajectories with external effects. Those properties create a governance problem that differs materially from single-turn generative AI: important risks emerge dur- ing execution, not only at model development or deployment time. Governance standards such as ISO/IEC 42001, ISO/IEC 23894, ISO/IEC 42005, ISO/IEC 5338, ISO/IEC 38507, and the NIST AI Risk Management Framework are therefore highly relevant to agentic AI, but they do not by themselves yield implementable runtime guardrails. This paper proposes a layered translation method that connects standards-derived governance objectives to four control layers: governance objectives, design- time constraints, runtime mediation, and assurance feedback. It distinguishes governance objectives, technical controls, runtime guardrails, and assurance evidence; introduces a control tuple and runtime-enforceability rubric for layer assignment; and demonstrates the method in a procurement-agent case study. The central claim is modest: standards should guide control placement across architecture, runtime policy, human escalation, and audit, while runtime guardrails are reserved for controls that are observable, determinate, and time-sensitive enough to justify execution-time intervention.

评分理由: 论文核心是开发一个用于临床信息提取的LLM验证框架，属于LLM在生物医学领域的应用。因此，与"Large Language Models"和"AI for Science"高度相关（10分）。论文关注验证和减少错误，与"Hallucination Mitigation"有一定关联（5分）。其他关键词涉及具体技术细节（如MoE、SFT、RAG等）或推理方法（如CoT、MCTS），论文未涉及，得0分。

大型语言模型（LLM）在从非结构化健康记录中提取具有临床意义的信息方面展现出潜力，但其在真实场景中的应用因缺乏可扩展且可信赖的验证方法而受到限制。传统评估方法严重依赖标注密集的参考标准或不完整的结构化数据，限制了在人群规模上的可行性。我们提出了一种基于LLM的临床信息提取多阶段验证框架，该框架能够在弱监督下实现严格评估。该框架整合了提示校准、基于规则的合理性过滤、语义基础性评估、使用独立高性能裁判LLM进行的针对性验证性评估、选择性专家评审以及外部预测效度分析，从而无需大量人工标注即可量化不确定性并描述错误模式。我们将此框架应用于从919,783份临床记录中提取涵盖11种物质类别的物质使用障碍（SUD）诊断。基于规则的过滤和语义基础性评估移除了14.59%缺乏支持、不相关或结构上不合理的LLM阳性提取结果。对于高不确定性案例，裁判LLM的评估结果与领域专家评审显示出高度一致性（Gwet’s AC1=0.80）。以裁判评估的输出为参考，主LLM在宽松匹配标准下实现了0.80的F1分数。LLM提取的SUD诊断在预测后续参与SUD专科治疗方面，也比基于结构化数据的基线方法更准确（AUC=0.80）。这些发现表明，无需依赖标注密集的评估，即可实现基于LLM的临床信息提取的可扩展且可信赖的部署。

Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is constrained by the lack of scalable and trustworthy validation approaches. Conventional evaluation methods rely heavily on annotation-intensive reference standards or incomplete structured data, limiting feasibility at population scale. We propose a multi-stage validation framework for LLM-based clinical information extraction that enables rigorous assessment under weak supervision. The framework integrates prompt calibration, rule-based plausibility filtering, semantic grounding assessment, targeted confirmatory evaluation using an independent higher-capacity judge LLM, selective expert review, and external predictive validity analysis to quantify uncertainty and characterize error modes without exhaustive manual annotation. We applied this framework to extraction of substance use disorder (SUD) diagnoses across 11 substance categories from 919,783 clinical notes. Rule-based filtering and semantic grounding removed 14.59% of LLM-positive extractions that were unsupported, irrelevant, or structurally implausible. For high-uncertainty cases, the judge LLM’s assessments showed substantial agreement with subject matter expert review (Gwet’s AC1=0.80). Using judge-evaluated outputs as references, the primary LLM achieved an F1 score of 0.80 under relaxed matching criteria. LLM-extracted SUD diagnoses also predicted subsequent engagement in SUD specialty care more accurately than structured-data baselines (AUC=0.80). These findings demonstrate that scalable, trustworthy deployment of LLM-based clinical information extraction is feasible without annotation-intensive evaluation.

评分理由: 该论文核心研究指令调优（Instruction Tuning）在大型语言模型（LLMs）中的工作机制，直接高度相关于关键词"Instruction Tuning"和"Large Language Models"。论文通过诊断性探测、因果消融等方法探究模型内部机制，与"Mechanistic Interpretability"有一定关联。论文未涉及其他关键词如MoE、SFT、RAG、推理方法、代理、压缩等具体技术或应用领域。

指令调优通常被认为赋予了语言模型遵循指令的领域通用能力，但其内在机制仍不甚明晰。指令遵循究竟依赖于一种通用机制，还是组合性技能的调用？我们通过在三个经过指令调优的模型中，对九项不同任务进行诊断性探测来研究此问题。 我们的分析提供了反对通用机制存在的聚合证据。首先，在所有任务上训练的通用探测器的表现持续低于针对特定任务的专用探测器，这表明表征共享有限。其次，跨任务迁移能力较弱，且依据技能相似性形成聚类。第三，因果消融实验揭示了稀疏且不对称的依赖关系，而非共享表征。此外，任务依据复杂度在不同网络层中分层呈现：结构性约束在早期层形成，而语义任务在较深层显现。最后，时序分析表明，约束满足在生成过程中作为动态监控运作，而非在生成前进行规划。 这些发现表明，将指令遵循理解为多种语言能力的熟练协调，而非调用单一的抽象约束检查过程，是更为准确的描述。

Instruction tuning is commonly assumed to endow language models with a domain-general ability to follow instructions, yet the underlying mechanism remains poorly understood. Does instruction-following rely on a universal mechanism or compositional skill deployment? We investigate this through diagnostic probing across nine diverse tasks in three instruction-tuned models. Our analysis provides converging evidence against a universal mechanism. First, general probes trained across all tasks consistently underperform task-specific specialists, indicating limited representational sharing. Second, cross-task transfer is weak and clustered by skill similarity. Third, causal ablation reveals sparse asymmetric dependencies rather than shared representations. Tasks also stratify by complexity across layers, with structural constraints emerging early and semantic tasks emerging late. Finally, temporal analysis shows constraint satisfaction operates as dynamic monitoring during generation rather than pre-generation planning. These findings indicate that instruction-following is better characterized as skillful coordination of diverse linguistic capabilities rather than deployment of a single abstract constraint-checking process.

评分理由: 论文核心研究LLMs在工业应用（如医疗、教育）中的安全问题，提出了一种新的机器遗忘方法（Exclusive Unlearning）来广泛移除有害内容，同时保留特定领域（如医学、数学）的知识。因此，与"Large Language Models"高度相关（10分），因为论文明确研究LLMs的应用挑战和解决方案；与"Instruction Tuning"或"Alignment"有一定关联（5分），因为涉及模型安全对齐和指令响应；与"Hallucination Mitigation"或"Factuality"有一定关联（5分），因为处理有害内容生成与事实性风险；与"AI for Science"或"Bioinformatics"有一定关联（5分），因为论文提到医疗等科学领域应用。其他关键词如MoE、SFT、RAG等未在摘要中提及或无关，得0分。

将大型语言模型（LLM）引入医疗、教育等工业应用时，生成有害内容的风险成为重大挑战。尽管现有的机器遗忘方法能够消除特定的有害知识与表达，但有害内容的多样性使得全面清除变得困难。本研究并未逐一列举需要遗忘的目标，而是提出了排他性遗忘（Exclusive Unlearning, EU），该方法旨在通过广泛遗忘我们希望保留的知识与表达之外的所有内容，实现广泛的有害信息移除。我们证明，通过排他性遗忘，可以获得一个能够确保对包括越狱攻击在内的广泛输入保持安全性，同时维持对医学、数学等特定领域多样化指令响应能力的模型。

When introducing Large Language Models (LLMs) into industrial applications, such as healthcare and education, the risk of generating harmful content becomes a significant challenge. While existing machine unlearning methods can erase specific harmful knowledge and expressions, diverse harmful content makes comprehensive removal difficult. In this study, instead of individually listing targets for forgetting, we propose Exclusive Unlearning (EU), which aims for broad harm removal by extensively forgetting everything except for the knowledge and expressions we wish to retain. We demonstrate that through Exclusive Unlearning, it is possible to obtain a model that ensures safety against a wide range of inputs, including jailbreaks, while maintaining the ability to respond to diverse instructions related to specific domains such as medicine and mathematics.

评分理由: 论文提出FoleyDesigner框架，用于电影剪辑的沉浸式立体声Foley生成。核心相关性在于：1）明确使用large language model (LLM)驱动混合机制（摘要中提到），因此与"Large Language Models"相关度8分；2）采用多智能体架构（multi-agent architecture）进行时空分析，与"LLM Agents"和"Multi-agent Systems"相关度各8分。其他关键词如MoE、Scaling Laws、RLHF、RAG等均未在论文中涉及，相关度为0。论文属于大模型在音频生成领域的应用，符合研究背景中"大模型在不同领域的研究应用"的要求。

拟音艺术在提升电影沉浸式听觉体验中起着关键作用，但手动创作时空对齐的音频仍是一项劳动密集型任务。我们提出FoleyDesigner——一个受专业拟音工作流程启发的新型框架，集成了影片片段分析、时空可控的拟音生成以及专业音频混音能力。该框架采用多智能体架构以实现精确的时空分析，通过基于视频帧提取的时空线索训练的潜在扩散模型实现时空对齐，并结合由大语言模型驱动的混合机制来模拟电影行业后期制作实践。针对电影领域高质量立体声音频数据集的缺乏，我们推出了FilmStereo——首个包含空间元数据、精确时间戳及八类常见拟音类别语义标注的专业立体声音频数据集。在应用层面，该框架支持交互式用户控制，同时保持与专业制作流程的无缝集成，包括符合ITU-R BS.775标准的5.1声道杜比全景声系统，从而提供广泛的创作灵活性。大量实验表明，相较于现有基线方法，我们的方案在时空对齐方面表现更优，且能无缝兼容专业电影制作标准。项目页面详见：https://gekiii996.github.io/FoleyDesigner/。

Foley art plays a pivotal role in enhancing immersive auditory experiences in film, yet manual creation of spatio-temporally aligned audio remains labor-intensive. We propose FoleyDesigner, a novel framework inspired by professional Foley workflows, integrating film clip analysis, spatio-temporally controllable Foley generation, and professional audio mixing capabilities. FoleyDesigner employs a multi-agent architecture for precise spatio-temporal analysis. It achieves spatio-temporal alignment through latent diffusion models trained on spatio-temporal cues extracted from video frames, combined with large language model (LLM)-driven hybrid mechanisms that emulate post-production practices in film industry. To address the lack of high-quality stereo audio datasets in film, we introduce FilmStereo, the first professional stereo audio dataset containing spatial metadata, precise timestamps, and semantic annotations for eight common Foley categories. For applications, the framework supports interactive user control while maintaining seamless integration with professional pipelines, including 5.1-channel Dolby Atmos systems compliant with ITU-R BS.775 standards, thereby offering extensive creative flexibility. Extensive experiments demonstrate that our method achieves superior spatio-temporal alignment compared to existing baselines, with seamless compatibility with professional film production standards. The project page is available at https://gekiii996.github.io/FoleyDesigner/ .

评分理由: 论文核心研究LLMs的安全防护机制，提出Gradient-Controlled Decoding (GCD)方法防御jailbreak和prompt-injection攻击，因此与"Large Language Models"高度相关（10分）。论文涉及模型安全对齐和有害内容防范，与"Instruction Tuning" OR “Alignment"有一定关联（5分），与"Hallucination Mitigation” OR “Factuality"有较强关联（8分），因为都关注输出可靠性和安全性。其他关键词如MoE、Scaling Laws、Pre-training等未在论文中涉及，均为0分。

大型语言模型（LLMs）仍易受到越狱攻击和直接提示注入攻击的影响，而最强的防御过滤器往往过度拒绝良性查询，损害用户体验。先前关于越狱和提示注入检测的研究（如GradSafe）通过单一的“全接受”锚定标记（“Sure”）来检测不安全提示，但其阈值较为脆弱，且无法在解码开始后确定性地保证不生成有害内容。我们提出梯度控制解码（Gradient-Controlled Decoding, GCD），这是一种无需训练的防护机制，它结合了接受锚定标记（“Sure”）和拒绝锚定标记（“Sorry”），从而收紧决策边界并显著降低误报率。在缓解阶段，若提示被标记为有害，GCD会在自回归解码恢复前预设注入一个或两个拒绝标记（“Sorry, I can’t…"），确保无论采用何种采样策略，首个生成标记的安全性。在ToxicChat、XSTest-v2和AdvBench测试集上，GCD在召回率相当的情况下将误报率较GradSafe降低了52%，攻击成功率较最强的纯解码基线降低了最高10%，在V100实例上平均增加低于15-20毫秒的延迟，可迁移至LLaMA-2-7B、Mixtral-8x7B和Qwen-2-7B模型，且仅需20个示例模板。

Large language models (LLMs) remain susceptible to jailbreak and direct prompt-injection attacks, yet the strongest defensive filters frequently over-refuse benign queries and degrade user experience. Previous work on jailbreak and prompt injection detection such as GradSafe, detects unsafe prompts with a single “accept all” anchor token, but its threshold is brittle and it offers no deterministic guarantee that harmful content will not be emitted once decoding begins. We introduce Gradient-Controlled Decoding (GCD), a training-free guardrail that combines an acceptance anchor token (“Sure”) and refusal anchor token (“Sorry”) tightening the decision boundary and significantly lowering false positives. In the mitigation stage, if a prompt is flagged, GCD preset-injects one or two refusal tokens (“Sorry, I can’t…”) before autoregressive decoding resumes, guaranteeing first-token safety regardless of sampling strategy. On ToxicChat, XSTest-v2, and AdvBench, GCD reduces false positives by 52% vs. GradSafe at comparable recall, lowers attack success rate by up to 10% vs. the strongest decoding-only baseline, adds under 15-20 ms latency on an average on V100 instances, transfers to LLaMA-2-7B, Mixtral-8x7B, and Qwen-2-7B, and requires only 20 demonstration templates.

评分理由: 论文核心研究LLM在自动程序修复（APR）中的应用，特别是故障定位（FL）上下文的作用，因此与"Large Language Models"高度相关（10分）。研究涉及检索不同级别的上下文（文件、元素、行）来增强LLM的修复能力，这与"Retrieval-Augmented Generation"有一定关联（5分），因为RAG也涉及检索外部信息来增强生成，但论文更侧重于特定上下文的检索而非一般RAG。论文评估LLM在不同上下文配置下的性能，这隐含了上下文学习的概念，与"In-context Learning"有一定关联（5分）。其他关键词如MoE、SFT、对齐等未在论文中涉及，均为0分。

故障定位（Fault Localization, FL）是基于大语言模型（Large Language Model, LLM）的自动程序修复（Automated Program Repair, APR）的关键组成部分，但其影响尚未得到充分探究。具体而言，目前尚不清楚需要多大程度的定位、超出预测错误位置之外的额外上下文是否有益，以及应如何检索此类上下文。我们使用GPT-5-mini对500个SWE-bench Verified实例进行了大规模实证研究，评估了61种不同配置，这些配置在文件级、元素级和行级上下文上有所变化。我们的结果表明，增加上下文并不能持续提升修复性能。文件级定位是主导因素，相较于无文件基线实现了15-17倍的性能提升。扩展文件上下文通常与性能改善相关，在包含约6-10个相关文件的配置中最常观察到成功修复。元素级上下文扩展提供了有条件的增益，其效果高度依赖于文件上下文的质量，而行级上下文扩展则常因噪声放大而导致性能下降。基于LLM的检索方法通常优于结构性启发式方法，同时使用更少的文件和令牌。总体而言，最有效的故障定位上下文策略通常结合了较高抽象层次的广泛语义理解与精确的行级定位。这些发现挑战了我们关于增加定位上下文会统一提升自动程序修复性能的假设，并为设计基于大语言模型的故障定位策略提供了实用指导。

Fault Localization (FL) is a key component of Large Language Model (LLM)-based Automated Program Repair (APR), yet its impact remains underexplored. In particular, it is unclear how much localization is needed, whether additional context beyond the predicted buggy location is beneficial, and how such context should be retrieved. We conduct a large-scale empirical study on 500 SWE-bench Verified instances using GPT-5-mini, evaluating 61 configurations that vary file-level, element-level, and line-level context. Our results show that more context does not consistently improve repair performance. File-level localization is the dominant factor, yielding a 15-17x improvement over a no-file baseline. Expanding file context is often associated with improved performance, with successful repairs most commonly observed in configurations with approximately 6-10 relevant files. Element-level context expansion provides conditional gains that depend strongly on the file context quality, while line-level context expansion frequently degrades performance due to noise amplification. LLM-based retrieval generally outperforms structural heuristics while using fewer files and tokens. Overall, the most effective FL context strategy typically combines a broad semantic understanding at higher abstraction levels with precise line-level localization. These findings challenge our assumption that increasing the localization context uniformly improves APR, and provide practical guidance for designing LLM-based FL strategies.

评分理由: 论文《Disentangling MLP Neuron Weights in Vocabulary Space》提出了一种名为ROTATE的数据无关方法，用于在权重空间中解耦MLP神经元，以解释语言模型中的信息编码。该研究直接针对大语言模型（Llama-3.1-8B-Instruct和Gemma-2-2B-it）进行实验，因此与"Large Language Models"高度相关（10分）。同时，论文的核心是模型解释性，属于"Mechanistic Interpretability"范畴，因此也高度相关（10分）。其他关键词如MoE、SLMs、训练方法、推理加速、AI for Science等均未在论文中涉及或提及，因此评分为0分。

解读模型权重中编码的信息始终是机制可解释性领域的核心挑战。本研究提出ROTATE（权重空间中的旋转优化词元对齐），这是一种无需前向传播、直接在权重空间中解耦MLP神经元的无数据方法。我们的方法基于一个关键统计现象：当编码连贯、单义概念的神经元投影到模型的词汇空间时，会呈现出高峰态特征。通过优化神经元权重的旋转以最大化其在词汇空间中的峰度，本方法能够提取稀疏且可解释的方向向量，我们将其命名为词汇通道。在Llama-3.1-8B-Instruct和Gemma-2-2B-it模型上的实验表明，ROTATE能够稳定地还原出与神经元行为高度一致的词汇通道。对单个通道进行消融会选择性抑制相应的输入激活或阻碍特定概念的生成。此外，聚合通道层面的描述可生成全面的神经元解释，在直接对比评估中，其性能较基于激活优化的基线方法提升2-3倍。通过提供神经元权重的无数据分解方案，ROTATE为大规模语言模型（LMs）的可解释性研究提供了可扩展、细粒度的基础构建模块。

Interpreting the information encoded in model weights remains a fundamental challenge in mechanistic interpretability. In this work, we introduce ROTATE (Rotation-Optimized Token Alignment in weighT spacE), a data-free method requiring no forward passes that disentangles MLP neurons directly in weight space. Our approach relies on a key statistical observation: neurons that encode coherent, monosemantic concepts exhibit high kurtosis when projected onto the model’s vocabulary. By optimizing rotations of neuron weights to maximize their vocabulary-space kurtosis, our method recovers sparse, interpretable directions which we name vocabulary channels. Experiments on Llama-3.1-8B-Instruct and Gemma-2-2B-it demonstrate that ROTATE consistently recovers vocabulary channels that are faithful to the neuron’s behavior. ablating individual channels selectively disables corresponding input activations or the promotion of specific concepts. Moreover, aggregating channel-level descriptions yields comprehensive neuron descriptions that outperform optimized activation-based baselines by 2-3x in head-to-head comparisons. By providing a data-free decomposition of neuron weights, ROTATE offers a scalable, fine-grained building block for interpreting LMs.

评分理由: 该论文的核心贡献是开发了一个名为OpenCEM的仿真器和数据集，旨在将丰富的非结构化上下文信息（如事件日程、系统日志、用户意图）与可再生能源系统的定量动态相结合，以促进智能、上下文感知的能源管理研究。论文摘要中明确提到该平台特别适用于利用大型语言模型（LLMs）开发新型控制算法和预测模型，因此与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（10分）。同时，该研究属于大模型在科学领域（具体为能源系统管理）的应用，与关键词"AI for Science” OR “Bioinformatics” OR “Cheminformatics"高度相关（10分）。论文未涉及其他关键词所描述的具体技术原理、方法或应用场景（如MoE、量化、对齐、RAG等），因此这些关键词评分为0分。

针对可再生能源系统对智能、情境感知能源管理的迫切需求，我们推出 OpenCEM 模拟器与数据集：这是首个明确设计用于将丰富的非结构化情境信息与定量可再生能源动态相集成的开源数字孪生平台。传统能源管理严重依赖数值时间序列，从而忽视了人类生成情境（如事件日程、系统日志、用户意图）中所蕴含的重要预测能力。OpenCEM 通过提供一个独特平台来弥合这一差距，该平台包含来自真实世界光伏-电池微电网安装的、经过精细对齐且富含语言描述的数据集，以及一个能够原生处理这种多模态情境的模块化模拟器。OpenCEM 模拟器为开发和验证新型控制算法与预测模型（尤其是那些利用大语言模型的方法）提供了一个高保真环境。我们详细阐述了其基于组件的架构、混合数据驱动与基于物理的建模能力，并通过实际案例（包括情境感知负荷预测和在线最优电池充电控制策略的实现）展示了其实用性。通过公开此平台，OpenCEM 旨在加速对下一代智能、可持续且真正具备情境感知能力的能源系统的研究。

Addressing the critical need for intelligent, context-aware energy management in renewable systems, we introduce the \textbf{OpenCEM Simulator and Dataset}: the first open-source digital twin explicitly designed to integrate rich, unstructured contextual information with quantitative renewable energy dynamics. Traditional energy management relies heavily on numerical time series, thereby neglecting the significant predictive power embedded in human-generated context (e.g., event schedules, system logs, user intentions). OpenCEM bridges this gap by offering a unique platform comprising both a meticulously aligned, language-rich dataset from a real-world PV-and-battery microgrid installation and a modular simulator capable of natively processing this multi-modal context. The OpenCEM Simulator provides a high-fidelity environment for developing and validating novel control algorithms and prediction models, particularly those leveraging Large Language Models. We detail its component-based architecture, hybrid data-driven and physics-based modelling capabilities, and demonstrate its utility through practical examples, including context-aware load forecasting and the implementation of online optimal battery charging control strategies. By making this platform publicly available, OpenCEM aims to accelerate research into the next generation of intelligent, sustainable, and truly context-aware energy systems.

评分理由: 论文提出了一种新的强化学习方法TPO，用于优化语言模型的策略。与关键词"RLHF"等高度相关（10分），因为TPO是RLHF中策略优化阶段的一种替代方法，论文在LLM RLVR任务上进行了评估。与"Large Language Models"相关（8分），因为论文在billion-parameter LLM上进行了实验。其他关键词如MoE、SFT、RAG等与论文内容无关（0分）。

在强化学习中，给定一个提示，我们从模型中采样一组补全结果并为其评分。随之产生两个问题：哪些补全结果应获得概率质量的增加，以及参数应如何移动以实现这种变化？标准的策略梯度方法同时回答这两个问题，因此更新可能因学习率、裁剪和其他优化器选择而出现超调或欠调。我们引入\emph{目标策略优化}（Target Policy Optimization，TPO），它将这两个问题分离。给定已评分的补全结果，TPO构建一个目标分布$q_i \propto p_i^{,\mathrm{old}} \exp(u_i)$，并通过交叉熵将策略拟合至该分布。在采样补全对数上的损失梯度为$p^θ- q$，一旦策略与目标匹配，梯度即消失。在表格老虎机、Transformer序列任务以及数十亿参数大语言模型的RLVR任务中，TPO在简单任务上与PG、PPO、GRPO和DG表现相当，而在稀疏奖励条件下显著优于它们。代码发布于https://github.com/JeanKaddour/tpo。

In RL, given a prompt, we sample a group of completions from a model and score them. Two questions follow: which completions should gain probability mass, and how should the parameters move to realize that change? Standard policy-gradient methods answer both at once, so the update can overshoot or undershoot depending on the learning rate, clipping, and other optimizer choices. We introduce \emph{Target Policy Optimization} (TPO), which separates the two questions. Given scored completions, TPO constructs a target distribution $q_i \propto p_i^{,\mathrm{old}} \exp(u_i)$ and fits the policy to it by cross-entropy. The loss gradient on sampled-completion logits is $p^θ- q$, which vanishes once the policy matches the target. On tabular bandits, transformer sequence tasks, and billion-parameter LLM RLVR, TPO matches PG, PPO, GRPO, and DG on easy tasks and substantially outperforms them under sparse reward. Code is available at https://github.com/JeanKaddour/tpo.

评分理由: 论文研究连续扩散语言模型在少步采样下的自条件机制问题，提出FastDiSS训练框架以提高推理速度和样本质量。与关键词相关性分析：1）与"Large Language Models"有中等关联（5分），因论文研究扩散语言模型，属于大语言模型的一种变体；2）与"Speculative Decoding” OR “Inference Acceleration"高度相关（8分），因论文核心贡献是提升扩散模型的推理速度（400倍加速），直接对应推理加速主题；3）其他关键词（如MoE、SFT、RAG等）均未在论文中涉及，得0分。

自调节机制是连续扩散语言模型取得成功的关键，它使模型能够修正先前生成的错误。然而，该机制的性能恰恰在扩散模型最具部署吸引力的场景下出现退化：即采用少量步数采样以实现快速推理时。本研究表明，当模型仅进行少量去噪步骤时，不准确的自调节会导致显著的近似误差；这种错误会在去噪步骤中不断累积，最终主导生成样本的质量。为解决这一问题，我们提出了一种新颖的训练框架，该框架在学习过程中通过扰动自调节信号以匹配推理噪声，从而提升模型对先验估计误差的鲁棒性。此外，我们引入了一种词元级别的噪声感知机制，防止训练过程陷入饱和，进而优化模型训练效果。在多项条件生成基准测试上的广泛实验表明，我们的框架超越了标准连续扩散模型，同时实现了高达400倍的推理加速，并且与其他一步式扩散框架相比仍保持竞争力。

Self-conditioning has been central to the success of continuous diffusion language models, as it allows models to correct previous errors. Yet its ability degrades precisely in the regime where diffusion is most attractive for deployment: few-step sampling for fast inference. In this study, we show that when models only have a few denoising steps, inaccurate self-conditioning induces a substantial approximation gap; this mistake compounds across denoising steps and ultimately dominate the sample quality. To address this, we propose a novel training framework that handles these errors during learning by perturbing the self-conditioning signal to match inference noise, improving robustness to prior estimation errors. In addition, we introduce a token-level noise-awareness mechanism that prevents training from saturation, hence improving optimization. Extensive experiments across conditional generation benchmarks demonstrate that our framework surpasses standard continuous diffusion models while providing up to 400x faster inference speed, and remains competitive against other one-step diffusion frameworks.

评分理由: 论文研究Vision-Language-Action (VLA)模型在机器人操作中的鲁棒性测试，提出DAERT框架通过强化学习生成多样化对抗性指令来暴露模型对语言细微差别的脆弱性。与关键词的相关性分析：1) 与"Large Language Models"有一定关联（5分），因为VLA模型包含语言组件，但论文不聚焦于LLM本身的技术原理；2) 与"LLM Agents"高度相关（8分），因为论文研究的是具身AI代理（embodied AI agents）的安全测试和脆弱性发现，属于智能代理的研究范畴；3) 其他关键词（如MoE、Scaling Laws、RLHF等）均未在论文中涉及，得0分。论文主要贡献在于代理安全测试方法，而非大模型核心技术或科学应用。

视觉-语言-动作（Vision-Language-Action，VLA）模型在机器人操作任务中取得了显著成功。然而，其对语言细微差异的鲁棒性仍是一个关键且尚未充分探索的安全问题，这给实际部署带来了重大安全风险。红队测试（red teaming），即识别可能引发灾难性行为的环境场景，是确保具身人工智能（embodied AI）智能体安全部署的重要环节。强化学习（Reinforcement Learning，RL）已成为自动化红队测试中一种有前景的方法，旨在揭示这些潜在漏洞。然而，基于强化学习的标准对抗方法由于其奖励最大化的特性，常遭受严重的模式坍塌（mode collapse）问题，倾向于收敛到一组狭窄的、琐碎或重复的失败模式，从而无法揭示有意义风险的完整图景。为弥补这一差距，我们提出了一种新颖的多样性感知具身红队测试（Diversity-Aware Embodied Red Teaming，DAERT）框架，以暴露VLA模型在语言变化下的脆弱性。我们的设计基于评估一个均匀策略（uniform policy），该策略能够生成一系列多样化的、具有挑战性的指令，同时确保其攻击有效性（通过在物理模拟器中的执行失败率来衡量）。我们在多个机器人基准测试中，针对包括$π_0$和OpenVLA在内的两种先进VLA模型进行了广泛实验。我们的方法持续发现了更广泛且更有效的对抗性指令，将平均任务成功率从93.33%降低至5.85%，证明了一种可扩展的压力测试VLA智能体的方法，并能在实际部署前暴露关键的安全盲点。

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world deployment. Red teaming, or identifying environmental scenarios that elicit catastrophic behaviors, is an important step in ensuring the safe deployment of embodied AI agents. Reinforcement learning (RL) has emerged as a promising approach in automated red teaming that aims to uncover these vulnerabilities. However, standard RL-based adversaries often suffer from severe mode collapse due to their reward-maximizing nature, which tends to converge to a narrow set of trivial or repetitive failure patterns, failing to reveal the comprehensive landscape of meaningful risks. To bridge this gap, we propose a novel \textbf{D}iversity-\textbf{A}ware \textbf{E}mbodied \textbf{R}ed \textbf{T}eaming (\textbf{DAERT}) framework, to expose the vulnerabilities of VLAs against linguistic variations. Our design is based on evaluating a uniform policy, which is able to generate a diverse set of challenging instructions while ensuring its attack effectiveness, measured by execution failures in a physical simulator. We conduct extensive experiments across different robotic benchmarks against two state-of-the-art VLAs, including $π_0$ and OpenVLA. Our method consistently discovers a wider range of more effective adversarial instructions that reduce the average task success rate from 93.33% to 5.85%, demonstrating a scalable approach to stress-testing VLA agents and exposing critical safety blind spots before real-world deployment.

评分理由: 论文研究的是文本到图像（T2I）生成模型（特别是扩散模型）中交叉注意力图的解释性问题，提出了一种通过选择性聚合注意力头来提升视觉可解释性和分割性能的方法。该研究专注于计算机视觉领域的扩散模型，而非大语言模型（LLMs）或通用大模型。因此，绝大多数关键词（涉及LLMs、训练技术、推理、代理、压缩等）完全不相关，得0分。唯一相关的关键词是"Mechanistic Interpretability” OR “Explainable AI”，因为论文的核心是提升扩散模型的可解释性（通过注意力图分析），这属于可解释AI范畴，但并非针对LLMs的机制可解释性，故给予10分（高度相关，但非核心）。

大量关于文本到图像生成模型的研究已利用交叉注意力图来提升应用性能并解释模型行为。然而，不同注意力头所生成注意力图的独特特性仍未得到充分探索。本研究证明，选择性聚合与目标概念最相关的注意力头所产生的交叉注意力图，能够提升视觉可解释性。与基于扩散模型的分割方法DAAM相比，我们的方法获得了更高的平均交并比分数。我们还发现，最相关的注意力头比最不相关的注意力头能更准确地捕捉概念特定特征，且选择性聚合有助于诊断提示词的误解情况。这些发现表明，注意力头选择为提高文本到图像生成的可解释性与可控性提供了有前景的研究方向。

Numerous studies on text-to-image (T2I) generative models have utilized cross-attention maps to boost application performance and interpret model behavior. However, the distinct characteristics of attention maps from different attention heads remain relatively underexplored. In this study, we show that selectively aggregating cross-attention maps from heads most relevant to a target concept can improve visual interpretability. Compared to the diffusion-based segmentation method DAAM, our approach achieves higher mean IoU scores. We also find that the most relevant heads capture concept-specific features more accurately than the least relevant ones, and that selective aggregation helps diagnose prompt misinterpretations. These findings suggest that attention head selection offers a promising direction for improving the interpretability and controllability of T2I generation.

评分理由: 论文的核心是使用LLMs作为进化技能生成器来合成可解释的交通信号控制技能，因此与"Large Language Models"高度相关（10分）。论文未涉及其他关键词的具体技术细节，如MoE、SLMs、训练方法、推理优化、代理系统、模型压缩等，这些关键词评分为0分。

交通信号控制（Traffic Signal Control, TSC）需要兼具高效性与可解释性的策略以用于实际部署，然而强化学习生成的是不透明的神经策略，而程序合成则依赖于限制性强的领域特定语言。本文提出SIGNALCLAW框架，该框架利用大语言模型（Large Language Models, LLMs）作为进化技能生成器，以合成并优化用于自适应交通信号控制的可解释控制技能。每项技能均包含原理阐述、选择指导与可执行代码，从而使策略具备人类可检视性与自文档化特性。在每一代进化中，来自仿真指标（如排队百分位数、延误趋势与停滞状况）的进化信号被转化为自然语言反馈，以指导技能改进。SignalClaw还引入了事件驱动的组合式进化机制：通过TraCI，事件检测器可识别紧急车辆、公交优先、突发事件及拥堵状况；优先级调度器则据此选择专用技能。每项技能独立进化，并通过优先级链实现无需重新训练的运行时组合。我们在常规场景与事件注入的SUMO场景中，将SignalClaw与四种基线方法进行比较评估。在常规场景下，其平均延误为7.8至9.2秒，与最佳方法差距在3%至10%之间，且在不同随机种子下表现出低方差。在事件场景下，SignalClaw实现了最低的紧急车辆延误（11.2至18.5秒，而MaxPressure为42.3至72.3秒，DQN为78.5至95.3秒）与最低的公交乘客延误（9.8至11.5秒，而MaxPressure为38.7至45.2秒）。在混合事件场景中，调度器能有效组合技能，同时保持整体延误稳定。进化后的技能从简单的线性规则逐步发展为具有多特征交互的条件策略，同时保持完全的可解释性，并可由交通工程师直接修改。

Traffic signal control TSC requires strategies that are both effective and interpretable for deployment, yet reinforcement learning produces opaque neural policies while program synthesis depends on restrictive domain-specific languages. We present SIGNALCLAW, a framework that uses large language models LLMs as evolutionary skill generators to synthesize and refine interpretable control skills for adaptive TSC. Each skill includes rationale, selection guidance, and executable code, making policies human-inspectable and self-documenting. At each generation, evolution signals from simulation metrics such as queue percentiles, delay trends, and stagnation are translated into natural language feedback to guide improvement. SignalClaw also introduces event-driven compositional evolution: an event detector identifies emergency vehicles, transit priority, incidents, and congestion via TraCI, and a priority dispatcher selects specialized skills. Each skill is evolved independently, and a priority chain enables runtime composition without retraining. We evaluate SignalClaw on routine and event-injected SUMO scenarios against four baselines. On routine scenarios, it achieves average delay of 7.8 to 9.2 seconds, within 3 to 10 percent of the best method, with low variance across random seeds. Under event scenarios, it yields the lowest emergency delay 11.2 to 18.5 seconds versus 42.3 to 72.3 for MaxPressure and 78.5 to 95.3 for DQN, and the lowest transit person delay 9.8 to 11.5 seconds versus 38.7 to 45.2 for MaxPressure. In mixed events, the dispatcher composes skills effectively while maintaining stable overall delay. The evolved skills progress from simple linear rules to conditional strategies with multi-feature interactions, while remaining fully interpretable and directly modifiable by traffic engineers.

评分理由: 论文的核心是提出一个名为ContentFuzz的框架，该框架利用大型语言模型（LLM）来重写社交媒体帖子，以改变其被立场检测模型分类的标签，从而帮助内容突破信息茧房。因此，论文与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（评分为10分），因为LLM是该方法的核心工具。论文未涉及其他关键词所描述的具体技术（如MoE、量化、RAG、RLHF等）或应用领域（如生物信息学），也未提及任何指定的专家作者，因此这些关键词的评分均为0分。

社交媒体中的信息茧房限制了用户接触多元观点的内容。现代平台将立场检测作为推荐与排序流程的重要信号，这可能导致内容主要推送给观点相似的受众，从而减少跨立场内容的曝光。这种做法限制了异议观点的传播范围，并阻碍了建设性对话的开展。本研究从内容创作者视角出发，探讨如何通过内容修改使其突破现有的同质化受众圈层。我们提出了ContentFuzz——一个基于置信度引导的模糊测试框架，该框架能在保持人类可理解意图的前提下重写内容，并诱导机器学习模型生成不同的立场推断标签。ContentFuzz旨在帮助内容突破原始的信息茧房。我们的方法通过立场检测模型提供的置信度反馈，引导大语言模型生成保持原意的改写文本。通过在两种语言、三个数据集上对四个代表性立场检测模型的评估，ContentFuzz能有效改变机器分类的立场标签，同时保持与原始内容的语义完整性。

Information cocoons on social media limit users’ exposure to posts with diverse viewpoints. Modern platforms use stance detection as an important signal in recommendation and ranking pipelines, which can route posts primarily to like-minded audiences and reduce cross-cutting exposure. This restricts the reach of dissenting opinions and hinders constructive discourse. We take the creator’s perspective and investigate how content can be revised to reach beyond existing affinity clusters. We present ContentFuzz, a confidence-guided fuzzing framework that rewrites posts while preserving their human-interpreted intent and induces different machine-inferred stance labels. ContentFuzz aims to route posts beyond their original cocoons. Our method guides a large language model (LLM) to generate meaning-preserving rewrites using confidence feedback from stance detection models. Evaluated on four representative stance detection models across three datasets in two languages, ContentFuzz effectively changes machine-classified stance labels, while maintaining semantic integrity with respect to the original content.

评分理由: 该论文研究自然语言作为复杂系统的统计特性，使用基于Transformer的语言模型生成高维嵌入空间来表示文本，并分析其幂律谱特征。论文的核心是分析语言模型（特别是Transformer-based models）生成的上下文嵌入的统计规律，因此与"Large Language Models” OR “LLMs” OR “Foundation Models"有直接关联（评分8分）。论文未涉及其他关键词的具体技术、方法或应用，如MoE、训练技术、推理优化、对齐、代理、量化等，因此这些关键词评分为0分。论文属于基础研究，探讨语言模型的表示特性，而非具体的应用或技术创新。

自然语言是一个展现稳健统计规律性的复杂系统。本研究将文本表示为基于Transformer的语言模型生成的高维嵌入空间中的轨迹，并利用嵌入步长信号量化沿标记序列的尺度依赖性涨落。在多种语言与语料库中，所得功率谱在宽广的频率范围内呈现出稳健的幂律分布，其指数接近$5/3$。这种标度律在人类书写文本和人工智能生成文本的上下文嵌入中均被一致观测到，但在静态词嵌入中并不存在，且会因标记顺序随机化而被破坏。这些结果表明，观测到的标度特性反映的是多尺度、上下文依赖的组织方式，而非仅源于词汇统计。通过与湍流中的柯尔莫哥洛夫谱类比，我们的发现表明语义信息在语言尺度上以无标度、自相似的方式被整合，并为研究语言表征的复杂结构提供了一个定量化、模型无关的基准。

Natural language is a complex system that exhibits robust statistical regularities. Here, we represent text as a trajectory in a high-dimensional embedding space generated by transformer-based language models, and quantify scale-dependent fluctuations along the token sequence using an embedding-step signal. Across multiple languages and corpora, the resulting power spectrum exhibits a robust power law with an exponent close to $5/3$ over an extended frequency range. This scaling is observed consistently in contextual embeddings from both human-written and AI-generated text, but is absent in static word embeddings and is disrupted by randomization of token order. These results show that the observed scaling reflects multiscale, context-dependent organization rather than lexical statistics alone. By analogy with the Kolmogorov spectrum in turbulence, our findings suggest that semantic information is integrated in a scale-free, self-similar manner across linguistic scales, and provide a quantitative, model-agnostic benchmark for studying complex structure in language representations.

评分理由: 论文专注于多元时间序列预测，提出了一种基于检索增强的框架CRAFT。该研究属于传统机器学习/深度学习领域，而非大模型（LLM）研究。唯一相关的关键词是"Retrieval-Augmented Generation” OR “RAG” OR “Retrieval-Generation”，因为论文使用了检索增强技术（retrieval-augmented forecasting），但这是应用于时间序列预测，而非大语言模型的文本生成。其他所有关键词均与大模型技术原理、训练方法、对齐、推理优化、代理系统等无关。论文未涉及任何大模型、深度学习技术原理创新或科学AI应用。

多元时间序列预测常因固定的回看窗口而难以捕捉长期依赖关系。检索增强预测通过从记忆中检索历史片段来解决这一问题，但现有方法依赖于通道无关策略，即对所有变量应用相同的参考片段。这种做法忽略了变量间的异质性——不同通道往往表现出不同的周期性和频谱特征。本文提出CRAFT（通道式检索增强预测框架），这是一种为每个通道独立执行检索的新型框架。为确保效率，CRAFT采用两阶段流程：首先在时域构建稀疏关系图以剪枝无关候选片段，继而在频域通过频谱相似度对参考片段排序，强调主导周期成分并抑制噪声。在七个公开基准数据集上的实验表明，CRAFT在保持实用推理效率的同时，其预测精度超越了当前最先进的预测基线模型。

Multivariate time series forecasting often struggles to capture long-range dependencies due to fixed lookback windows. Retrieval-augmented forecasting addresses this by retrieving historical segments from memory, but existing approaches rely on a channel-agnostic strategy that applies the same references to all variables. This neglects inter-variable heterogeneity, where different channels exhibit distinct periodicities and spectral profiles. We propose CRAFT (Channel-wise retrieval-augmented forecasting), a novel framework that performs retrieval independently for each channel. To ensure efficiency, CRAFT adopts a two-stage pipeline: a sparse relation graph constructed in the time domain prunes irrelevant candidates, and spectral similarity in the frequency domain ranks references, emphasizing dominant periodic components while suppressing noise. Experiments on seven public benchmarks demonstrate that CRAFT outperforms state-of-the-art forecasting baselines, achieving superior accuracy with practical inference efficiency.

评分理由: 论文《Effective Dynamics and Transition Pathways from Koopman-Inspired Neural Learning of Collective Variables》提出了一种名为ISOKANN的数据驱动框架，用于从复杂分子系统中提取集体变量（CVs）和有效动力学。该研究结合了Koopman算子理论、类Krylov子空间算法和降维动力学建模，旨在描述高维系统中的亚稳态转变。论文的核心是分子动力学模拟、降维技术和计算化学，属于科学计算和计算物理/化学领域。所有关键词（共27个）中，只有第27个关键词“AI for Science” OR “Bioinformatics” OR “Cheminformatics”与论文有一定关联，因为论文属于AI在科学（具体是计算化学/分子动力学）中的应用，但论文并未明确涉及生物信息学或化学信息学，也未使用大语言模型（LLM）或深度学习技术，因此该关键词评分为5分（有一定关联）。其余26个关键词均与大语言模型、深度学习技术原理或应用直接相关，而本文未涉及这些内容，因此评分为0分（完全无关）。

ISOKANN（基于人工神经网络学习的库普曼算子不变子空间）框架提供了一种数据驱动方法，用于从复杂分子系统中提取集体变量与有效动力学。本研究将库普曼算子的理论基础与类克雷洛夫子空间算法及降维动力学建模相结合，构建了一个基于集体变量描述高维系统亚稳态转变的连贯理论体系。从基于主导不变子空间识别集体变量出发，我们推导了潜在空间上的对应有效动力学，并将其与跃迁速率、跃迁时间、承诺函数及转变路径相联系。基于库普曼算子的学习方法与降维有效动力学的结合，形成了一个从模拟数据计算跃迁速率与路径的理论框架。在一维、二维和三维基准势能面上的数值实验表明，ISOKANN能够重构粗粒化动力学，并复现跨越焓垒与熵垒的转变时间。

The ISOKANN (Invariant Subspaces of Koopman Operators Learned by Artificial Neural Networks) framework provides a data-driven route to extract collective variables (CVs) and effective dynamics from complex molecular systems. In this work, we integrate the theoretical foundation of Koopman operators with Krylov-like subspace algorithms, and reduced dynamical modeling to build a coherent picture of how to describe metastable transitions in high-dimensional systems based on CVs. Starting from the identification of CVs based on dominant invariant subspaces, we derive the corresponding effective dynamics on the latent space and connect these to transition rates and times, committor functions, and transition pathways. The combination of Koopman-based learning and reduced-dimensional effective dynamics yields a principled framework for computing transition rates and pathways from simulation data. Numerical experiments on one-, two-, and three-dimensional benchmark potentials illustrate the ability of ISOKANN to reconstruct the coarse-grained kinetics and reproduce transition times across enthalpic and entropic barriers.

评分理由: 论文MMEmb-R1主要研究多模态大语言模型（MLLMs）在嵌入任务中的应用，核心创新在于将思维链（Chain of Thought）推理机制引入多模态嵌入学习，并提出了自适应控制方法以减少不必要的推理开销。因此，与’Chain of Thought OR CoT Reasoning OR Multi-step Reasoning’高度相关（10分），与’System 2 Thinking OR Slow Thinking OR In-depth Reasoning’有一定关联（8分），因为论文涉及深度推理机制。论文基于MLLMs，与’Large Language Models OR LLMs OR Foundation Models’相关（8分）。论文提到减少推理延迟，与’Speculative Decoding OR Inference Acceleration’有弱关联（5分）。其他关键词如MoE、SLMs、Scaling Laws、Alignment、RAG等均未在论文中涉及，得0分。

多模态大语言模型（MLLMs）已成功应用于多模态嵌入任务，但其生成式推理能力仍未得到充分利用。将思维链推理直接引入嵌入学习面临两个根本性挑战。首先，实例级推理与成对对比监督之间的结构错位可能导致模型产生捷径行为，即仅学习推理的表面形式。其次，推理并非对所有嵌入任务均有益。强制对所有输入进行推理可能引入不必要的计算与延迟，甚至在处理简单案例时掩盖显著的语义信号。为解决这些问题，我们提出了MMEmb-R1——一种基于自适应推理的多模态嵌入框架。我们将推理建模为隐变量，并引入基于成对感知的推理选择机制，该机制利用反事实干预来识别有助于查询-目标对齐的推理路径。此外，我们采用强化学习方法，仅在必要时选择性调用推理。在MMEB-V2基准测试上的实验表明，我们的模型仅以40亿参数即获得71.2的评分，创造了新的最优性能记录，同时显著降低了推理开销与推断延迟。

MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental challenges. First, structural misalignment between instance-level reasoning and pairwise contrastive supervision may lead to shortcut behavior, where the model merely learns the superficial format of reasoning. Second, reasoning is not universally beneficial for embedding tasks. Enforcing reasoning for all inputs may introduce unnecessary computation and latency, and can even obscure salient semantic signals for simple cases. To address these issues, we propose MMEmb-R1, an adaptive reasoning-based multimodal embedding framework. We formulate reasoning as a latent variable and introduce pair-aware reasoning selection that employs counterfactual intervention to identify reasoning paths beneficial for query-target alignment. Furthermore, we adopt reinforcement learning to selectively invoke reasoning only when necessary. Experiments on the MMEB-V2 benchmark demonstrate that our model achieves a score of 71.2 with only 4B parameters, establishing a new state-of-the-art while significantly reducing reasoning overhead and inference latency.

评分理由: 论文DiffHDR专注于视频扩散模型在LDR到HDR转换中的应用，属于计算机视觉和视频处理领域。虽然使用了预训练的视频扩散模型（与’Pre-training OR Continual Pre-training OR Domain Adaptation’有一定关联，得5分），但论文核心并非大语言模型（LLMs）或深度学习技术原理的创新，而是应用现有扩散模型解决特定视觉任务。其他关键词均与大语言模型、推理、对齐、压缩、科学AI等主题无关，因此得0分。

大多数数字视频以8比特低动态范围（LDR）格式存储，由于饱和与量化，原始高动态范围（HDR）场景辐亮度的大量信息在此过程中丢失。这种高光与阴影细节的缺失阻碍了向HDR显示器准确映射亮度的可能，并限制了后期制作流程中有意义的再曝光操作。尽管已有技术提出通过动态范围扩展将LDR图像转换为HDR，但这些方法难以在过曝与欠曝区域恢复真实的细节。为此，我们提出DiffHDR框架，该框架将LDR到HDR的转换构建为视频扩散模型潜在空间中的生成式辐亮度修复任务。通过在Log-Gamma色彩空间中操作，DiffHDR利用预训练视频扩散模型的时空生成先验，在过曝与欠曝区域合成合理的HDR辐亮度，同时恢复量化像素的连续场景辐亮度。我们的框架进一步支持通过文本提示或参考图像引导的可控LDR到HDR视频转换。针对成对HDR视频数据稀缺的问题，我们开发了一套从静态HDRI（高动态范围图像）贴图合成高质量HDR视频训练数据的流程。大量实验表明，DiffHDR在辐亮度保真度与时间稳定性方面显著优于现有先进方法，能够生成具有充分再曝光余量的逼真HDR视频。

Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance is lost due to saturation and quantization. This loss of highlight and shadow detail precludes mapping accurate luminance to HDR displays and limits meaningful re-exposure in post-production workflows. Although techniques have been proposed to convert LDR images to HDR through dynamic range expansion, they struggle to restore realistic detail in the over- and underexposed regions. To address this, we present DiffHDR, a framework that formulates LDR-to-HDR conversion as a generative radiance inpainting task within the latent space of a video diffusion model. By operating in Log-Gamma color space, DiffHDR leverages spatio-temporal generative priors from a pretrained video diffusion model to synthesize plausible HDR radiance in over- and underexposed regions while recovering the continuous scene radiance of the quantized pixels. Our framework further enables controllable LDR-to-HDR video conversion guided by text prompts or reference images. To address the scarcity of paired HDR video data, we develop a pipeline that synthesizes high-quality HDR video training data from static HDRI maps. Extensive experiments demonstrate that DiffHDR significantly outperforms state-of-the-art approaches in radiance fidelity and temporal stability, producing realistic HDR videos with considerable latitude for re-exposure.

评分理由: 论文核心研究LLMs的Test-Time Training（TTT）框架，直接涉及LLMs和参数高效微调（PEFT）技术，并显著扩展上下文长度至128k，因此与’Large Language Models’（10分）、‘PEFT’（5分）和’Context Window Extension’（8分）高度相关。其他关键词如MoE、SLMs、Scaling Laws、RAG、RLHF等未在摘要中提及或与论文主题无关，故评0分。

静态的“训练后部署”范式从根本上限制了大语言模型（LLM）根据现实任务中固有的持续新信息流动态调整其权重的能力。测试时训练（Test-Time Training, TTT）提供了一种引人注目的替代方案，通过在推理时更新模型参数的一个子集（快速权重），但其在当前LLM生态系统中的潜力受到关键障碍的阻碍，包括架构不兼容、计算效率低下，以及用于语言建模的快速权重目标不匹配。在本工作中，我们提出了原位测试时训练（In-Place TTT），一个能够无缝赋予LLM测试时训练能力的框架。In-Place TTT将普遍存在的MLP模块中的最终投影矩阵作为其可适应的快速权重，从而实现对LLM的“即插即用”式增强，无需进行成本高昂的从头训练。此外，我们用一种定制的、有理论依据的目标取代了TTT通用的重构目标，该目标明确与主导自回归语言建模的下一个词元预测任务对齐。这一原则性目标，结合高效的块状更新机制，产生了一种高度可扩展且兼容上下文并行性的算法。大量实验验证了我们框架的有效性：作为一种原位增强，它使一个40亿参数的模型能够在长达128k上下文的任务上取得卓越性能；当从头开始预训练时，它持续优于相关的竞争性TTT方法。消融研究结果进一步为我们设计选择提供了更深入的见解。总体而言，我们的研究结果确立了In-Place TTT作为迈向LLM持续学习范式的一个有前景的步骤。

The static train then deploy" paradigm fundamentally limits Large Language Models (LLMs) from dynamically adapting their weights in response to continuous streams of new information inherent in real-world tasks. Test-Time Training (TTT) offers a compelling alternative by updating a subset of model parameters (fast weights) at inference time, yet its potential in the current LLM ecosystem is hindered by critical barriers including architectural incompatibility, computational inefficiency and misaligned fast weight objectives for language modeling. In this work, we introduce In-Place Test-Time Training (In-Place TTT), a framework that seamlessly endows LLMs with Test-Time Training ability. In-Place TTT treats the final projection matrix of the ubiquitous MLP blocks as its adaptable fast weights, enabling a drop-in" enhancement for LLMs without costly retraining from scratch. Furthermore, we replace TTT’s generic reconstruction objective with a tailored, theoretically-grounded objective explicitly aligned with the Next-Token-Prediction task governing autoregressive language modeling. This principled objective, combined with an efficient chunk-wise update mechanism, results in a highly scalable algorithm compatible with context parallelism. Extensive experiments validate our framework’s effectiveness: as an in-place enhancement, it enables a 4B-parameter model to achieve superior performance on tasks with contexts up to 128k, and when pretrained from scratch, it consistently outperforms competitive TTT-related approaches. Ablation study results further provide deeper insights on our design choices. Collectively, our results establish In-Place TTT as a promising step towards a paradigm of continual learning in LLMs.

评分理由: 论文核心是使用LLMs生成合成医患对话数据，用于长上下文音频摘要任务。与’Large Language Models’高度相关（10分），因为整个数据生成管道基于LLMs；与’Context Window Extension’高度相关（10分），因为论文明确针对长上下文音频推理问题；与’AI for Science’有一定关联（5分），因为涉及医疗领域应用；其他关键词如MoE、SFT、RAG等未在论文中涉及，均为0分。

长上下文音频推理在训练数据和评估方面均存在不足。现有基准主要针对短上下文任务，而与长上下文推理最相关的开放式生成任务对自动评估提出了众所周知的挑战。我们提出了一种合成数据生成流程，旨在同时作为训练资源和受控评估环境，并将其具体应用于以生成SOAP病历为任务的初诊医患对话场景。该流程包含三个阶段：基于人物设定的对话生成、包含重叠/停顿建模、房间声学及声音事件的多说话人音频合成，以及基于大语言模型的参考SOAP病历生成，整个流程完全基于开源模型构建。我们发布了8,800段合成对话，包含1.3千小时对应音频及参考病历。通过对当前开源系统的评估，我们发现级联方法仍显著优于端到端模型。

Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open-ended generation tasks most relevant to long-context reasoning pose well-known challenges for automatic evaluation. We propose a synthetic data generation pipeline designed to serve both as a training resource and as a controlled evaluation environment, and instantiate it for first-visit doctor-patient conversations with SOAP note generation as the task. The pipeline has three stages, persona-driven dialogue generation, multi-speaker audio synthesis with overlap/pause modeling, room acoustics, and sound events, and LLM-based reference SOAP note production, built entirely on open-weight models. We release 8,800 synthetic conversations with 1.3k hours of corresponding audio and reference notes. Evaluating current open-weight systems, we find that cascaded approaches still substantially outperform end-to-end models.

评分理由: 论文核心研究LLMs内部世界模型的一致性，直接涉及’Large Language Models’和’World Models’关键词（10分）。论文提出方法解决’structural hallucinations’，与’Hallucination Mitigation’相关（5分）。论文分析梯度归纳偏置和表示对齐，与’Mechanistic Interpretability’有一定关联（5分）。其他关键词如MoE、SFT、RAG、Agents等未在摘要中提及，评为0分。

大语言模型是否形成了连贯的内部世界模型，这一核心问题仍存争议。传统的下一词元预测侧重于单步监督，而多词元预测在学习结构化表征方面展现出潜力。本研究从理论视角分析了多词元预测的梯度归纳偏置，并结合实证证据表明，多词元预测通过梯度耦合诱导表征收缩性，从而促进模型向内部信念状态收敛。然而，我们发现标准多词元预测常存在结构性幻觉问题——离散词元监督会促使潜在空间中出现违反环境约束的非法捷径。为解决此问题，我们提出了一种新方法：潜在语义增强多词元预测，该方法将预测锚定在真实隐藏状态轨迹上。在合成图与真实世界曼哈顿出租车行程数据集上的实验表明，潜在语义增强多词元预测能有效弥合离散词元与连续状态表征之间的鸿沟，显著提升表征对齐度，减少结构性幻觉，并增强对扰动的鲁棒性。

Whether Large Language Models (LLMs) develop coherent internal world models remains a core debate. While conventional Next-Token Prediction (NTP) focuses on one-step-ahead supervision, Multi-Token Prediction (MTP) has shown promise in learning more structured representations. In this work, we provide a theoretical perspective analyzing the gradient inductive bias of MTP, supported by empirical evidence, showing that MTP promotes the convergence toward internal belief states by inducing representational contractivity via gradient coupling. However, we reveal that standard MTP often suffers from structural hallucinations, where discrete token supervision encourages illegal shortcuts in latent space that violate environmental constraints. To address this, we propose a novel method Latent Semantic Enhancement MTP (LSE-MTP), which anchors predictions to ground-truth hidden state trajectories. Experiments on synthetic graphs and real-world Manhattan Taxi Ride show that LSE-MTP effectively bridges the gap between discrete tokens and continuous state representations, enhancing representation alignment, reducing structural hallucinations, and improving robustness to perturbations.

评分理由: 论文专注于AI系统的机器身份治理、风险分类和监管框架，属于AI治理和政策领域，而非大模型技术原理、深度学习创新或科学应用。所有关键词均涉及大模型技术、训练方法、推理优化、应用部署等具体技术方面，与论文的治理主题完全无关。

人工智能治理存在一个盲区：人工智能系统用以执行操作的机器身份。当前在企业环境中，AI代理、服务账户、API令牌和自动化工作流的数量已超过人类身份，比例高达80:1以上，然而目前尚无综合框架对其进行治理。2024年CrowdStrike服务中断事件中，单个未受治理的自动化代理造成了54至100亿美元的损失；包括Silk Typhoon和Salt Typhoon在内的国家级行为体已将未受治理的机器凭证作为针对关键基础设施的主要间谍活动载体投入实战。本文提出四项原创贡献。其一，AI身份风险分类体系（AI-Identity Risk Taxonomy, AIRT）：一个涵盖八大领域、37个子风险类别的全面枚举框架，每个类别均基于已记录事件、监管认知、从业者普遍性数据及威胁情报建立。其二，机器身份治理分类体系（Machine Identity Governance Taxonomy, MIGT）：一个整合了六大领域的治理框架，能同时应对技术治理缺口、监管合规缺口及跨司法辖区协调缺口——这些缺口在现有框架中仅被孤立处理。其三，针对企业身份治理的外国国家级行为体威胁模型，论证了Silk Typhoon、Salt Typhoon、Volt Typhoon及朝鲜AI增强型身份欺诈行动已将AI身份漏洞作为活跃攻击载体投入实战。其四，跨司法辖区监管协调结构，同步映射欧盟、美国及中国框架下的企业AI身份治理义务，识别不可调和的冲突并提供管理这些冲突的治理机制。最后，通过四阶段实施路线图将MIGT转化为可执行的企业方案。

The governance of artificial intelligence has a blind spot: the machine identities that AI systems use to act. AI agents, service accounts, API tokens, and automated workflows now outnumber human identities in enterprise environments by ratios exceeding 80 to 1, yet no integrated framework exists to govern them. A single ungoverned automated agent produced $5.4-10 billion in losses in the 2024 CrowdStrike outage; nation-state actors including Silk Typhoon and Salt Typhoon have operationalized ungoverned machine credentials as primary espionage vectors against critical infrastructure. This paper makes four original contributions. First, the AI-Identity Risk Taxonomy (AIRT): a comprehensive enumeration of 37 risk sub-categories across eight domains, each grounded in documented incidents, regulatory recognition, practitioner prevalence data, and threat intelligence. Second, the Machine Identity Governance Taxonomy (MIGT): an integrated six-domain governance framework simultaneously addressing the technical governance gap, the regulatory compliance gap, and the cross-jurisdictional coordination gap that existing frameworks address only in isolation. Third, a foreign state actor threat model for enterprise identity governance, establishing that Silk Typhoon, Salt Typhoon, Volt Typhoon, and North Korean AI-enhanced identity fraud operations have already operationalized AI identity vulnerabilities as active attack vectors. Fourth, a cross-jurisdictional regulatory alignment structure mapping enterprise AI identity governance obligations under EU, US, and Chinese frameworks simultaneously, identifying irreconcilable conflicts and providing a governance mechanism for managing them. A four-phase implementation roadmap translates the MIGT into actionable enterprise programs.