评分理由: 论文核心研究LLM的置信度校准问题，属于大模型技术原理创新。高度相关关键词：1) “Large Language Models” (核心研究对象，10分)；2) “Mechanistic Interpretability” (使用线性探针和CAA进行机制解释，10分)。中等相关：1) “Chain of Thought” (论文研究推理过程对置信度的影响，8分)；2) “System 2 Thinking” (涉及深度推理过程，8分)；3) “Hallucination Mitigation” (置信度校准与事实性相关，8分)。其他关键词未在论文中涉及，均为0分。

大型语言模型（LLM）倾向于表达与其实际准确率显著脱节的置信度分数，然而支配这一行为的几何关系仍鲜为人知。在本研究中，我们对语言化置信度进行了机制可解释性分析，通过线性探针和对比激活添加（CAA）导向技术表明：校准信号与语言化置信度信号虽以线性方式编码，但彼此正交——这一发现在三个开源权重模型和四个数据集中均保持一致。有趣的是，当模型被要求同时进行问题推理并表达置信度分数时，推理过程会干扰语言化置信度的方向，加剧校准失准。我们将此现象称为“推理污染效应”。基于这一发现，我们提出了一种两阶段自适应导向流程：该流程读取模型的内部准确率估计值，并引导语言化输出与之匹配，从而在所有评估模型中显著提升了校准对齐度。

Large language models (LLMs) tend to verbalize confidence scores that are largely detached from their actual accuracy, yet the geometric relationship governing this behavior remain poorly understood. In this work, we present a mechanistic interpretability analysis of verbalized confidence, using linear probes and contrastive activation addition (CAA) steering to show that calibration and verbalized confidence signals are encoded linearly but are orthogonal to one another – a finding consistent across three open-weight models and four datasets. Interestingly, when models are prompted to simultaneously reason through a problem and verbalize a confidence score, the reasoning process disrupts the verbalized confidence direction, exacerbating miscalibration. We term this the “Reasoning Contamination Effect.” Leveraging this insight, we introduce a two-stage adaptive steering pipeline that reads the model’s internal accuracy estimate and steers verbalized output to match it, substantially improving calibration alignment across all evaluated models.

!!! info

本文主要采用机制可解释性分析方法。首先，使用岭回归线性探针在残差流中检测准确率信息的线性可访问性。其次，利用对比激活添加（CAA）技术，通过对比高置信度和低置信度提示下的激活差异构建引导向量。研究设计了纯正确性、纯置信度和联合三种提示类型来解构模型表示，并在MATH、MMLU等数据集上对Llama、Qwen等模型进行了实验验证。

• 深入的机制可解释性分析，从几何角度揭示了校准问题的根源
• 提出的方法无需重新训练模型，推理时干预即可生效，实用性强
• 实验覆盖了多个主流开源模型和不同类型的数据集，结论具有普适性

• 主要关注线性方向，可能忽略了更复杂的非线性关系
• 引导向量的构建依赖于特定的提示框架，可能对提示词的变化敏感
• 虽然改善了校准，但可能对模型的生成质量或流畅性有潜在影响

评分理由: 论文AD-CARE的核心是开发一个基于大语言模型（LLM）的智能体（Agent），用于阿尔茨海默病的临床诊断支持。因此，与"Large Language Models"和"LLM Agents"高度相关（10分），因为论文明确提到使用LLMs并构建了一个LLM驱动的智能体。与"Tool Use"高度相关（10分），因为智能体动态编排专门的诊断工具。与"AI for Science"高度相关（10分），因为这是大模型在生物医学（阿尔茨海默病诊断）领域的应用。论文未涉及其他关键词的具体技术细节（如MoE、量化、推理加速、对齐方法等），因此这些关键词评分为0分。

阿尔茨海默病（Alzheimer’s disease, AD）随着人口老龄化已成为日益严峻的全球健康挑战，及时、准确的诊断对于减轻个体和社会负担至关重要。然而，现实世界中的AD评估受到不完整、异质的多模态数据以及不同中心与患者人口统计学差异的阻碍。尽管大语言模型（large language models, LLMs）在生物医学领域展现出潜力，但其在AD中的应用大多局限于回答狭窄的疾病特定问题，而非生成支持临床决策的综合性诊断报告。本研究通过引入AD-CARE扩展了LLMs在临床决策支持方面的能力：这是一种模态无关的智能体，能够基于不完整且异质的输入数据，在不补全缺失模态的情况下，执行基于临床指南的诊断评估。通过动态协调专用诊断工具并将临床指南嵌入LLM驱动的推理过程，AD-CARE生成透明、报告式的输出，其形式与现实临床工作流程相符。在包含10,303个病例的六个队列中，AD-CARE实现了84.9%的诊断准确率，相对于基线方法获得了4.2%-13.7%的相对提升。尽管队列间存在差异，其数据集特异性准确率保持稳健（80.4%-98.8%），且该智能体在所有队列中均优于所有基线方法。AD-CARE减少了不同种族和年龄亚组间的性能差异，将四项指标的平均离散度分别降低了21%-68%和28%-51%。在一项受控阅片者研究中，该智能体将神经科医生和放射科医生的诊断准确率提高了6%-11%，并将决策时间缩短了一半以上。该框架在八种骨干LLMs上实现了2.29%-10.66%的绝对性能提升，并使它们的表现趋于一致。这些结果表明，AD-CARE是一个可扩展、具备实际部署能力的框架，可整合到常规临床工作流程中，为AD提供多模态决策支持。

Alzheimer’s disease (AD) is a growing global health challenge as populations age, and timely, accurate diagnosis is essential to reduce individual and societal burden. However, real-world AD assessment is hampered by incomplete, heterogeneous multimodal data and variability across sites and patient demographics. Although large language models (LLMs) have shown promise in biomedicine, their use in AD has largely been confined to answering narrow, disease-specific questions rather than generating comprehensive diagnostic reports that support clinical decision-making. Here we expand LLM capabilities for clinical decision support by introducing AD-CARE, a modality-agnostic agent that performs guideline-grounded diagnostic assessment from incomplete, heterogeneous inputs without imputing missing modalities. By dynamically orchestrating specialized diagnostic tools and embedding clinical guidelines into LLM-driven reasoning, AD-CARE generates transparent, report-style outputs aligned with real-world clinical workflows. Across six cohorts comprising 10,303 cases, AD-CARE achieved 84.9% diagnostic accuracy, delivering 4.2%-13.7% relative improvements over baseline methods. Despite cohort-level differences, dataset-specific accuracies remain robust (80.4%-98.8%), and the agent consistently outperforms all baselines. AD-CARE reduced performance disparities across racial and age subgroups, decreasing the average dispersion of four metrics by 21%-68% and 28%-51%, respectively. In a controlled reader study, the agent improved neurologist and radiologist accuracy by 6%-11% and more than halved decision time. The framework yielded 2.29%-10.66% absolute gains over eight backbone LLMs and converges their performance. These results show that AD-CARE is a scalable, practically deployable framework that can be integrated into routine clinical workflows for multimodal decision support in AD.

!!! info

论文采用基于LLM的智能体框架，包含三个核心组件：1) **规划器**：负责理解诊断请求，分解任务并识别可用的数据模态；2) **工具库**：集成针对特定模态的专用分析工具（如海马体萎缩量化、脑体积测量、多基因风险评分计算等）；3) **协调器**：依据临床指南和范例病例，整合各工具的输出，生成结构化的诊断报告。研究通过多队列评估（6个队列，10,303例）测试泛化能力，利用亚组分析评估公平性，并通过受控读者研究验证临床效用。

• 直接解决临床痛点：针对现实世界中数据不完整和异构的常态设计，避免了插补带来的偏差，实用性强。
• 可解释性高：生成基于指南的结构化诊断报告，推理过程透明，易于被临床医生理解和信任。
• 验证严谨：涵盖了大规模多队列评估、公平性分析和读者研究，证据链完整，科学性强。
• 部署灵活：骨干模型无关的特性使得该框架可以根据计算资源灵活选择底层LLM，适应性强。

• 系统性能依赖于工具库中专用分析工具（如影像分割、基因计算）的准确性，若底层工具存在偏差可能影响结果。
• 尽管兼容低成本模型，但作为LLM驱动的智能体，运行整套系统仍需一定的计算资源，可能在资源极度匮乏地区受限。
• 基于现有临床指南构建，若未来诊断标准发生重大变更，可能需要重新调整系统逻辑。
• LLM固有的幻觉风险虽受工具和指南约束，但在处理极罕见病例时仍需警惕。

评分理由: 论文核心是评估LLM代理在金融领域通过工具调用解决实际问题的能力，因此与"LLM Agents"和"Tool Use"高度相关（10分）。论文明确涉及LLM，故"Large Language Models"得10分。论文评估推理能力，与"Chain of Thought"和"System 2 Thinking"有一定关联（5分）。其他关键词如MoE、SFT、RAG等未在摘要中提及，与论文主题无关，得0分。

本文介绍了\textbf{FinMCP-Bench}，这是一个通过金融模型上下文协议工具调用来评估大语言模型解决现实世界金融问题能力的新型基准。FinMCP-Bench包含613个样本，涵盖10个主要场景和33个子场景，融合了真实与合成的用户查询，以确保多样性和真实性。它整合了65个真实的金融MCP以及三种样本类型——单工具、多工具和多轮对话，从而能够评估模型在不同任务复杂度下的表现。利用此基准，我们系统评估了一系列主流大语言模型，并提出了明确衡量工具调用准确性和推理能力的指标。FinMCP-Bench为推进金融大语言模型智能体的研究提供了一个标准化、实用且具有挑战性的测试平台。

This paper introduces \textbf{FinMCP-Bench}, a novel benchmark for evaluating large language models (LLMs) in solving real-world financial problems through tool invocation of financial model context protocols. FinMCP-Bench contains 613 samples spanning 10 main scenarios and 33 sub-scenarios, featuring both real and synthetic user queries to ensure diversity and authenticity. It incorporates 65 real financial MCPs and three types of samples, single tool, multi-tool, and multi-turn, allowing evaluation of models across different levels of task complexity. Using this benchmark, we systematically assess a range of mainstream LLMs and propose metrics that explicitly measure tool invocation accuracy and reasoning capabilities. FinMCP-Bench provides a standardized, practical, and challenging testbed for advancing research on financial LLM agents.

!!! info

研究首先从“小顾”AI助手的生产环境日志中收集真实交互数据。随后采用两种合成策略增强数据复杂度：一是基于链的方法，构建工具依赖图并采样路径生成多工具轨迹；二是基于角色扮演的方法，设定用户画像和目标，利用LLM模拟对话生成多轮样本。最后，通过自动验证和6位金融专家的独立审查（5点李克特量表）进行质量控制。

• 数据真实性强，基于生产环境日志和真实金融工具。
• 场景覆盖全面，包含多种金融任务和不同复杂度的交互模式。
• 数据构建方法科学严谨，结合了真实数据提取与LLM辅助合成，并经过专家严格审核。
• 基于MCP标准化协议，具有良好的通用性和扩展性。

• 数据集规模（613个样本）相对有限，可能无法覆盖所有长尾金融场景。
• 合成数据虽然经过验证，但与完全真实的用户行为可能仍存在偏差。
• 主要关注工具调用流程的准确性，对最终金融建议的专业合规性评估细节提及较少。

评分理由: 论文SEVerA专注于为自演化LLM代理提供形式化验证框架，确保其安全性和正确性。核心内容直接涉及LLM代理（“LLM Agents”）、自演化/自改进（“Self-Correction”）以及工具使用（“Tool Use”），这些是论文的核心创新点，因此给予10分。论文明确提到LLM作为规划器和生成模型，因此"Large Language Models"高度相关，得10分。其他关键词如MoE、量化、推理加速、幻觉缓解等，论文未涉及，得0分。

近期研究表明，自进化大语言模型智能体在程序修复和科学发现等任务中展现出显著成效。该范式通过规划大语言模型合成调用参数化模型（包括大语言模型）的智能体程序，并针对具体任务进行调优以提升性能。然而，现有自进化智能体框架缺乏对安全性或正确性的形式化保证。由于此类程序常需在未见输入上自主执行，这种保证缺失引发了可靠性与安全性的担忧。本文将智能体代码生成建模为约束学习问题，将硬性形式化规约与捕捉任务效用的软性目标相结合。我们提出形式化守护生成模型，该模型允许规划大语言模型使用一阶逻辑为每个生成模型调用指定形式化输出契约。每个形式化守护生成模型调用将底层模型封装于具备可验证回退机制的拒绝采样器中，确保在任何输入和参数设置下返回的输出均满足契约要求。基于形式化守护生成模型，我们构建了自进化验证智能体框架，其包含三个阶段：搜索阶段合成包含形式化守护生成模型调用的候选参数化程序；验证阶段针对所有参数值证明程序满足硬性约束的正确性，将问题简化为无约束学习；学习阶段采用可扩展的基于梯度的优化方法（包括类GRPO微调）来提升软性目标，同时保持正确性。我们在Dafny程序验证、符号数学合成及策略合规智能体工具使用三个基准任务上评估自进化验证智能体框架。实验表明，该框架在所有任务中均实现零约束违反，并在性能上超越无约束方法与当前最优基线，证明形式化行为约束不仅能保证正确性，还能引导合成过程产生更高质量的智能体。

Recent advances have shown the effectiveness of self-evolving LLM agents on tasks such as program repair and scientific discovery. In this paradigm, a planner LLM synthesizes an agent program that invokes parametric models, including LLMs, which are then tuned per task to improve performance. However, existing self-evolving agent frameworks provide no formal guarantees of safety or correctness. Because such programs are often executed autonomously on unseen inputs, this lack of guarantees raises reliability and security concerns. We formulate agentic code generation as a constrained learning problem, combining hard formal specifications with soft objectives capturing task utility. We introduce Formally Guarded Generative Models (FGGM), which allow the planner LLM to specify a formal output contract for each generative model call using first-order logic. Each FGGM call wraps the underlying model in a rejection sampler with a verified fallback, ensuring every returned output satisfies the contract for any input and parameter setting. Building on FGGM, we present SEVerA (Self-Evolving Verified Agents), a three-stage framework: Search synthesizes candidate parametric programs containing FGGM calls; Verification proves correctness with respect to hard constraints for all parameter values, reducing the problem to unconstrained learning; and Learning applies scalable gradient-based optimization, including GRPO-style fine-tuning, to improve the soft objective while preserving correctness. We evaluate SEVerA on Dafny program verification, symbolic math synthesis, and policy-compliant agentic tool use ($τ^2$-bench). Across tasks, SEVerA achieves zero constraint violations while improving performance over unconstrained and SOTA baselines, showing that formal behavioral constraints not only guarantee correctness but also steer synthesis toward higher-quality agents.

!!! info

论文将智能体代码生成建模为约束学习问题。首先，引入FGGM包装生成模型，使用一阶逻辑定义输入输出契约，并利用拒绝采样和验证回退机制确保输出合规。其次，实施三阶段流程：1) 搜索阶段，规划器LLM合成包含FGGM调用的候选参数化程序（使用Dafny语言）；2) 验证阶段，利用Dafny内置验证器证明程序在所有参数值下满足硬约束；3) 学习阶段，将验证后的程序转化为无约束优化问题，应用基于梯度的优化（如GRPO风格微调）来最大化软目标性能。

• 提供了严格的形式化安全性和正确性保证，解决了自进化智能体的可靠性隐患。
• 方法通用性强，不依赖于特定的模型架构，可应用于开源和闭源模型。
• 在保证安全的同时提升了任务性能，证明了约束有助于引导搜索。
• 理论基础扎实，提供了完备的定理证明。

• 依赖于一阶逻辑来表达约束，对于极其复杂或难以形式化的自然语言约束可能存在表达瓶颈。
• 验证阶段可能需要大量的计算资源，特别是对于复杂的程序逻辑。
• 拒绝采样机制可能会增加推理延迟，因为不满足约束的输出会被拒绝并重试。

评分理由: 论文核心研究LLMs在多步工具编排（multi-step tool orchestration）中的训练问题，与"Large Language Models"、“Tool Use"和"LLM Agents"高度相关（10分），因为论文直接研究LLMs如何调用多个API并管理依赖关系。与"Chain of Thought"有一定关联（8分），因为多步编排涉及顺序推理，但论文未明确使用CoT术语。其他关键词如MoE、SFT、RAG等未在论文中提及或相关，得0分。

多步骤工具编排任务要求大语言模型按正确顺序调用多个相互依赖的API并传递中间输出，目前仍具挑战性。现有先进模型在执行完整序列时频繁出错，其中参数值错误占失败案例的显著比例。训练模型处理此类工作流面临两大障碍：现有环境主要关注基于模拟数据的单轮次简单函数调用，且二元奖励机制无法为部分正确的执行提供有效信号。

我们提出了一个同时应对这两项挑战的框架。首先，我们构建了一个由大规模真实API响应缓存支持的强化学习环境，该环境支持数据合成流程，能够以可控复杂度采样有效的多步骤编排轨迹，其生成效率显著高于无约束方法。其次，我们提出了一种渐进式奖励设计，将正确性分解为原子有效性（在递增的粒度层级上评估单个函数调用的正确性）和编排能力（遵循依赖关系的正确工具排序）。在ComplexFuncBench基准测试中，我们的方法在轮次准确率上展现出显著提升。消融实验证实两项奖励组件均不可或缺：单独使用任一组件都会导致性能大幅下降。

Multi-step tool orchestration, where LLMs must invoke multiple dependent APIs in the correct order while propagating intermediate outputs, remains challenging. State-of-the-art models frequently fail on full sequence execution, with parameter value errors accounting for a significant portion of failures. Training models to handle such workflows faces two obstacles: existing environments focus on simple per-turn function calls with simulated data, and binary rewards provide no signal for partial correctness. We present a framework addressing both challenges. First, we construct a reinforcement learning environment backed by a large-scale cache of real API responses, enabling a data synthesis pipeline that samples valid multi-step orchestration traces with controllable complexity and significantly higher generation efficiency than unconstrained methods. Second, we propose a graduated reward design that decomposes correctness into atomic validity (individual function call correctness at increasing granularity) and orchestration (correct tool sequencing with dependency respect). On ComplexFuncBench, our approach demonstrates substantial improvements in turn accuracy. Ablation studies confirm both reward components are essential: using either alone significantly degrades performance.

!!! info

论文采用强化学习方法。首先，通过定义工作流模板和收集Booking.com真实API响应构建缓存环境。其次，利用反向索引进行约束感知的缓存采样，结合LLM生成对应的自然语言查询，合成训练数据。最后，在训练过程中，采用GRPO（Group Relative Policy Optimization）算法，利用设计的分级奖励（R_atomic和R_orch）对模型进行更新，使其学习正确的函数调用顺序和参数传递。

• 解决了多步工具编排中真实数据依赖缺失的问题，使用了真实API缓存。
• 有效缓解了长序列任务中的稀疏奖励问题，通过分级奖励提供细粒度反馈。
• 数据合成效率高，通过约束采样避免了无效轨迹的生成。

• 数据合成依赖于预定义的工作流模板，可能无法覆盖所有潜在的复杂编排模式。
• 缓存环境虽然基于真实数据，但毕竟是静态的，可能无法完全反映实时API的变化。
• 论文主要在特定领域（如酒店预订、租车）进行了验证，泛化到其他领域的程度尚需进一步研究。

评分理由: 论文核心研究虚假新闻检测，直接涉及LLMs（作为虚假新闻的生成和检测工具），因此"Large Language Models"得10分。“Hallucination Mitigation"得10分，因为虚假新闻检测本质上就是识别和缓解模型生成或传播的虚假/不实信息。“Pre-training"和"Post-training"各得5分，因为论文提到了微调模型和预训练暴露问题。“In-context Learning"得5分，因为论文提到LLMs通过零样本和少样本学习进行检测。其他关键词（如MoE、量化、RAG等）论文未涉及，得0分。

近年来，虚假新闻检测在公共讨论与科学研究中日益受到关注。尽管检测技术不断进步，但在大语言模型（LLMs）的驱动和社交媒体的放大效应下，虚假信息的产生与传播也变得更加复杂。本文对12种具有代表性的虚假新闻检测方法进行了批判性评估，涵盖传统机器学习、深度学习、Transformer模型以及专门的跨领域架构。我们在10个公开可用的数据集上评估了这些方法，这些数据集在体裁、来源、主题和标注逻辑上各不相同。我们将纯文本英文虚假新闻检测视为二分类任务，通过统一标注为“真实”与“虚假”来确保一致的评估流程。我们承认不同数据集的标签语义存在差异，统一标注不可避免地消除了此类语义上的细微差别。每个数据集均被视为一个独立领域。我们进行了领域内、多领域和跨领域实验，以模拟涉及领域偏移和分布外数据的真实场景。微调模型在领域内表现良好，但泛化能力不足。跨领域架构可以缩小这一差距，但需要大量数据；而大语言模型通过零样本和少样本学习提供了有前景的替代方案。鉴于数据集固有的混杂因素以及可能的预训练数据暴露，实验结果应视为在此纯文本英文评估框架内的鲁棒性评估。

In recent years, fake news detection has received increasing attention in public debate and scientific research. Despite advances in detection techniques, the production and spread of false information have become more sophisticated, driven by Large Language Models (LLMs) and the amplification power of social media. We present a critical assessment of 12 representative fake news detection approaches, spanning traditional machine learning, deep learning, transformers, and specialized cross-domain architectures. We evaluate these methods on 10 publicly available datasets differing in genre, source, topic, and labeling rationale. We address text-only English fake news detection as a binary classification task by harmonizing labels into “Real” and “Fake” to ensure a consistent evaluation protocol. We acknowledge that label semantics vary across datasets and that harmonization inevitably removes such semantic nuances. Each dataset is treated as a distinct domain. We conduct in-domain, multi-domain and cross-domain experiments to simulate real-world scenarios involving domain shift and out-of-distribution data. Fine-tuned models perform well in-domain but struggle to generalize. Cross-domain architectures can reduce this gap but are data-hungry, while LLMs offer a promising alternative through zero- and few-shot learning. Given inherent dataset confounds and possible pre-training exposure, results should be interpreted as robustness evaluations within this English, text-only protocol.

!!! info

论文采用了实证对比研究方法。首先，选取10个公开的英文纯文本假新闻数据集，并将标签统一为“真实”和“虚假”。其次，选择了12种代表性模型，包括传统机器学习（如SVM）、深度学习（如BiLSTM）、Transformer（如BERT）、专用跨域架构（如MDFEND, MERMAID）以及大语言模型（如GPT-3.5）。最后，设计了四组实验：数据集特定测试（基准）、跨数据集测试（暴露域偏移）、混合训练测试（多域模拟）和留一数据集测试（跨域泛化评估），使用准确率等指标进行评估。

• 评估全面：涵盖了从传统ML到最新LLM的广泛技术谱系，并在多个异构数据集上进行测试。
• 关注泛化：突破了仅关注域内性能的局限，重点解决了实际部署中至关重要的跨域泛化问题。
• 实验设计严谨：通过四种递进的实验设置，逐步施压测试模型的鲁棒性，结论更具说服力。
• 现实意义强：明确指出了现有模型在真实场景下的局限性，并验证了LLM在减少标注数据依赖方面的潜力。

• 模态单一：仅关注英文纯文本，忽略了图像、视频及社交传播上下文（如用户画像、转发结构）等多模态信息。
• 数据混淆：无法完全解耦主题、时间、来源和标注语义等混淆因素对模型性能的具体影响。
• LLM预训练污染：未控制LLM在预训练阶段可能接触过测试数据的情况，可能影响对LLM真实泛化能力的评估。
• 未评估生成式假新闻：实验数据主要基于人类撰写的假新闻，未专门针对LLM生成的假新闻进行测试。

评分理由: 论文核心研究大语言模型（LLMs）在数学推理中的应用，特别是通过强化学习框架TAPO解决多语言场景下的性能差距。因此，与"Large Language Models"高度相关（10分）。论文基于GRPO构建强化学习框架，与"RLHF"等相关（8分）。研究涉及理解-推理范式，与"Chain of Thought"和"System 2 Thinking"相关（各8分）。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、RAG、Quantization等未在摘要中提及，评为0分。

大型语言模型（LLMs）在英语数学推理方面已展现出卓越能力，但在多语言场景中仍存在显著的性能差距，这主要归因于语言理解能力的不足。为弥合这一差距，我们提出了翻译增强策略优化（Translation-Augmented Policy Optimization, TAPO），这是一个基于GRPO构建的新型强化学习框架。TAPO采用显式的对齐策略，使模型以英语为枢轴语言，并遵循“先理解后推理”的范式。关键之处在于，我们引入了步骤级相对优势机制，将理解与推理过程解耦，从而能够在避免优化冲突的前提下整合翻译质量奖励。大量实验表明，TAPO能有效协同语言理解与推理能力，并兼容多种模型。该方法在多语言数学推理和翻译任务中均优于基线方法，同时对新语言和领域外任务展现出良好的泛化能力。

Large Language Models (LLMs) have demonstrated remarkable proficiency in English mathematical reasoning, yet a significant performance disparity persists in multilingual contexts, largely attributed to deficiencies in language understanding. To bridge this gap, we introduce Translation-Augmented Policy Optimization (TAPO), a novel reinforcement learning framework built upon GRPO. TAPO enforces an explicit alignment strategy where the model leverages English as a pivot and follows an understand-then-reason paradigm. Crucially, we employ a step-level relative advantage mechanism that decouples understanding from reasoning, allowing the integration of translation quality rewards without introducing optimization conflicts. Extensive experiments reveal that TAPO effectively synergizes language understanding with reasoning capabilities and is compatible with various models. It outperforms baseline methods in both multilingual mathematical reasoning and translation tasks, while generalizing well to unseen languages and out-of-domain tasks.

!!! info

论文主要采用强化学习方法，基于GRPO（Group Relative Policy Optimization）框架构建TAPO。首先，设计包含格式奖励、翻译奖励（使用ChrF++、XCOMET等指标）和推理奖励（使用Math-Verify）的混合奖励模型。其次，通过特定的Prompt引导模型先生成英语翻译，再生成英语推理过程。核心在于引入步级相对优势机制，分别对翻译片段和推理片段的奖励进行归一化处理，计算独立的优势值，并通过插值系数融合翻译优势，从而避免不同奖励信号之间的相互干扰。

• 针对性强：准确识别了多语言推理中的“理解瓶颈”，并提出了针对性的解决方案。
• 机制创新：步级相对优势机制巧妙地解决了多目标强化学习中的奖励冲突问题，保证了训练的稳定性。
• 可解释性：通过显式的翻译步骤，使得模型的“理解”过程变得可观察和可量化。
• 泛化能力：不仅适用于训练语言，还能泛化到未见语言和其他数学任务。

• 依赖英语枢纽：方法严重依赖英语作为枢纽语言，对于非英语到非英语的推理可能不是最优解。
• 翻译指标局限：现有的翻译指标（如XCOMET）在低资源语言上可能表现不佳或容易受到奖励攻击。
• 推理开销：虽然论文提到未显著增加成本，但显式生成翻译步骤在理论上仍会增加生成长度，可能影响推理延迟。
• 数据依赖：需要高质量的平行语料或参考翻译来计算翻译奖励，这在某些低资源语言中可能难以获取。

评分理由: 论文核心研究LLM的置信度校准问题，属于大模型技术原理创新。高度相关关键词：1) “Large Language Models” (核心研究对象，10分)；2) “Mechanistic Interpretability” (使用线性探针和CAA进行机制解释，10分)。中等相关：1) “Chain of Thought” (论文研究推理过程对置信度的影响，8分)；2) “System 2 Thinking” (涉及深度推理过程，8分)；3) “Hallucination Mitigation” (置信度校准与事实性相关，8分)。其他关键词未在论文中涉及，均为0分。

大型语言模型（LLM）倾向于表达与其实际准确率显著脱节的置信度分数，然而支配这一行为的几何关系仍鲜为人知。在本研究中，我们对语言化置信度进行了机制可解释性分析，通过线性探针和对比激活添加（CAA）导向技术表明：校准信号与语言化置信度信号虽以线性方式编码，但彼此正交——这一发现在三个开源权重模型和四个数据集中均保持一致。有趣的是，当模型被要求同时进行问题推理并表达置信度分数时，推理过程会干扰语言化置信度的方向，加剧校准失准。我们将此现象称为“推理污染效应”。基于这一发现，我们提出了一种两阶段自适应导向流程：该流程读取模型的内部准确率估计值，并引导语言化输出与之匹配，从而在所有评估模型中显著提升了校准对齐度。

Large language models (LLMs) tend to verbalize confidence scores that are largely detached from their actual accuracy, yet the geometric relationship governing this behavior remain poorly understood. In this work, we present a mechanistic interpretability analysis of verbalized confidence, using linear probes and contrastive activation addition (CAA) steering to show that calibration and verbalized confidence signals are encoded linearly but are orthogonal to one another – a finding consistent across three open-weight models and four datasets. Interestingly, when models are prompted to simultaneously reason through a problem and verbalize a confidence score, the reasoning process disrupts the verbalized confidence direction, exacerbating miscalibration. We term this the “Reasoning Contamination Effect.” Leveraging this insight, we introduce a two-stage adaptive steering pipeline that reads the model’s internal accuracy estimate and steers verbalized output to match it, substantially improving calibration alignment across all evaluated models.

评分理由: 论文AD-CARE的核心是开发一个基于大语言模型（LLM）的智能体（Agent），用于阿尔茨海默病的临床诊断支持。因此，与"Large Language Models"和"LLM Agents"高度相关（10分），因为论文明确提到使用LLMs并构建了一个LLM驱动的智能体。与"Tool Use"高度相关（10分），因为智能体动态编排专门的诊断工具。与"AI for Science"高度相关（10分），因为这是大模型在生物医学（阿尔茨海默病诊断）领域的应用。论文未涉及其他关键词的具体技术细节（如MoE、量化、推理加速、对齐方法等），因此这些关键词评分为0分。

阿尔茨海默病（Alzheimer’s disease, AD）随着人口老龄化已成为日益严峻的全球健康挑战，及时、准确的诊断对于减轻个体和社会负担至关重要。然而，现实世界中的AD评估受到不完整、异质的多模态数据以及不同中心与患者人口统计学差异的阻碍。尽管大语言模型（large language models, LLMs）在生物医学领域展现出潜力，但其在AD中的应用大多局限于回答狭窄的疾病特定问题，而非生成支持临床决策的综合性诊断报告。本研究通过引入AD-CARE扩展了LLMs在临床决策支持方面的能力：这是一种模态无关的智能体，能够基于不完整且异质的输入数据，在不补全缺失模态的情况下，执行基于临床指南的诊断评估。通过动态协调专用诊断工具并将临床指南嵌入LLM驱动的推理过程，AD-CARE生成透明、报告式的输出，其形式与现实临床工作流程相符。在包含10,303个病例的六个队列中，AD-CARE实现了84.9%的诊断准确率，相对于基线方法获得了4.2%-13.7%的相对提升。尽管队列间存在差异，其数据集特异性准确率保持稳健（80.4%-98.8%），且该智能体在所有队列中均优于所有基线方法。AD-CARE减少了不同种族和年龄亚组间的性能差异，将四项指标的平均离散度分别降低了21%-68%和28%-51%。在一项受控阅片者研究中，该智能体将神经科医生和放射科医生的诊断准确率提高了6%-11%，并将决策时间缩短了一半以上。该框架在八种骨干LLMs上实现了2.29%-10.66%的绝对性能提升，并使它们的表现趋于一致。这些结果表明，AD-CARE是一个可扩展、具备实际部署能力的框架，可整合到常规临床工作流程中，为AD提供多模态决策支持。

Alzheimer’s disease (AD) is a growing global health challenge as populations age, and timely, accurate diagnosis is essential to reduce individual and societal burden. However, real-world AD assessment is hampered by incomplete, heterogeneous multimodal data and variability across sites and patient demographics. Although large language models (LLMs) have shown promise in biomedicine, their use in AD has largely been confined to answering narrow, disease-specific questions rather than generating comprehensive diagnostic reports that support clinical decision-making. Here we expand LLM capabilities for clinical decision support by introducing AD-CARE, a modality-agnostic agent that performs guideline-grounded diagnostic assessment from incomplete, heterogeneous inputs without imputing missing modalities. By dynamically orchestrating specialized diagnostic tools and embedding clinical guidelines into LLM-driven reasoning, AD-CARE generates transparent, report-style outputs aligned with real-world clinical workflows. Across six cohorts comprising 10,303 cases, AD-CARE achieved 84.9% diagnostic accuracy, delivering 4.2%-13.7% relative improvements over baseline methods. Despite cohort-level differences, dataset-specific accuracies remain robust (80.4%-98.8%), and the agent consistently outperforms all baselines. AD-CARE reduced performance disparities across racial and age subgroups, decreasing the average dispersion of four metrics by 21%-68% and 28%-51%, respectively. In a controlled reader study, the agent improved neurologist and radiologist accuracy by 6%-11% and more than halved decision time. The framework yielded 2.29%-10.66% absolute gains over eight backbone LLMs and converges their performance. These results show that AD-CARE is a scalable, practically deployable framework that can be integrated into routine clinical workflows for multimodal decision support in AD.

评分理由: 论文核心是评估LLM代理在金融领域通过工具调用解决实际问题的能力，因此与"LLM Agents"和"Tool Use"高度相关（10分）。论文明确涉及LLM，故"Large Language Models"得10分。论文评估推理能力，与"Chain of Thought"和"System 2 Thinking"有一定关联（5分）。其他关键词如MoE、SFT、RAG等未在摘要中提及，与论文主题无关，得0分。

本文介绍了\textbf{FinMCP-Bench}，这是一个通过金融模型上下文协议工具调用来评估大语言模型解决现实世界金融问题能力的新型基准。FinMCP-Bench包含613个样本，涵盖10个主要场景和33个子场景，融合了真实与合成的用户查询，以确保多样性和真实性。它整合了65个真实的金融MCP以及三种样本类型——单工具、多工具和多轮对话，从而能够评估模型在不同任务复杂度下的表现。利用此基准，我们系统评估了一系列主流大语言模型，并提出了明确衡量工具调用准确性和推理能力的指标。FinMCP-Bench为推进金融大语言模型智能体的研究提供了一个标准化、实用且具有挑战性的测试平台。

This paper introduces \textbf{FinMCP-Bench}, a novel benchmark for evaluating large language models (LLMs) in solving real-world financial problems through tool invocation of financial model context protocols. FinMCP-Bench contains 613 samples spanning 10 main scenarios and 33 sub-scenarios, featuring both real and synthetic user queries to ensure diversity and authenticity. It incorporates 65 real financial MCPs and three types of samples, single tool, multi-tool, and multi-turn, allowing evaluation of models across different levels of task complexity. Using this benchmark, we systematically assess a range of mainstream LLMs and propose metrics that explicitly measure tool invocation accuracy and reasoning capabilities. FinMCP-Bench provides a standardized, practical, and challenging testbed for advancing research on financial LLM agents.

评分理由: 论文SEVerA专注于为自演化LLM代理提供形式化验证框架，确保其安全性和正确性。核心内容直接涉及LLM代理（“LLM Agents”）、自演化/自改进（“Self-Correction”）以及工具使用（“Tool Use”），这些是论文的核心创新点，因此给予10分。论文明确提到LLM作为规划器和生成模型，因此"Large Language Models"高度相关，得10分。其他关键词如MoE、量化、推理加速、幻觉缓解等，论文未涉及，得0分。

近期研究表明，自进化大语言模型智能体在程序修复和科学发现等任务中展现出显著成效。该范式通过规划大语言模型合成调用参数化模型（包括大语言模型）的智能体程序，并针对具体任务进行调优以提升性能。然而，现有自进化智能体框架缺乏对安全性或正确性的形式化保证。由于此类程序常需在未见输入上自主执行，这种保证缺失引发了可靠性与安全性的担忧。本文将智能体代码生成建模为约束学习问题，将硬性形式化规约与捕捉任务效用的软性目标相结合。我们提出形式化守护生成模型，该模型允许规划大语言模型使用一阶逻辑为每个生成模型调用指定形式化输出契约。每个形式化守护生成模型调用将底层模型封装于具备可验证回退机制的拒绝采样器中，确保在任何输入和参数设置下返回的输出均满足契约要求。基于形式化守护生成模型，我们构建了自进化验证智能体框架，其包含三个阶段：搜索阶段合成包含形式化守护生成模型调用的候选参数化程序；验证阶段针对所有参数值证明程序满足硬性约束的正确性，将问题简化为无约束学习；学习阶段采用可扩展的基于梯度的优化方法（包括类GRPO微调）来提升软性目标，同时保持正确性。我们在Dafny程序验证、符号数学合成及策略合规智能体工具使用三个基准任务上评估自进化验证智能体框架。实验表明，该框架在所有任务中均实现零约束违反，并在性能上超越无约束方法与当前最优基线，证明形式化行为约束不仅能保证正确性，还能引导合成过程产生更高质量的智能体。

Recent advances have shown the effectiveness of self-evolving LLM agents on tasks such as program repair and scientific discovery. In this paradigm, a planner LLM synthesizes an agent program that invokes parametric models, including LLMs, which are then tuned per task to improve performance. However, existing self-evolving agent frameworks provide no formal guarantees of safety or correctness. Because such programs are often executed autonomously on unseen inputs, this lack of guarantees raises reliability and security concerns. We formulate agentic code generation as a constrained learning problem, combining hard formal specifications with soft objectives capturing task utility. We introduce Formally Guarded Generative Models (FGGM), which allow the planner LLM to specify a formal output contract for each generative model call using first-order logic. Each FGGM call wraps the underlying model in a rejection sampler with a verified fallback, ensuring every returned output satisfies the contract for any input and parameter setting. Building on FGGM, we present SEVerA (Self-Evolving Verified Agents), a three-stage framework: Search synthesizes candidate parametric programs containing FGGM calls; Verification proves correctness with respect to hard constraints for all parameter values, reducing the problem to unconstrained learning; and Learning applies scalable gradient-based optimization, including GRPO-style fine-tuning, to improve the soft objective while preserving correctness. We evaluate SEVerA on Dafny program verification, symbolic math synthesis, and policy-compliant agentic tool use ($τ^2$-bench). Across tasks, SEVerA achieves zero constraint violations while improving performance over unconstrained and SOTA baselines, showing that formal behavioral constraints not only guarantee correctness but also steer synthesis toward higher-quality agents.

评分理由: 论文核心研究LLMs在多步工具编排（multi-step tool orchestration）中的训练问题，与"Large Language Models”、“Tool Use"和"LLM Agents"高度相关（10分），因为论文直接研究LLMs如何调用多个API并管理依赖关系。与"Chain of Thought"有一定关联（8分），因为多步编排涉及顺序推理，但论文未明确使用CoT术语。其他关键词如MoE、SFT、RAG等未在论文中提及或相关，得0分。

多步骤工具编排任务要求大语言模型按正确顺序调用多个相互依赖的API并传递中间输出，目前仍具挑战性。现有先进模型在执行完整序列时频繁出错，其中参数值错误占失败案例的显著比例。训练模型处理此类工作流面临两大障碍：现有环境主要关注基于模拟数据的单轮次简单函数调用，且二元奖励机制无法为部分正确的执行提供有效信号。

我们提出了一个同时应对这两项挑战的框架。首先，我们构建了一个由大规模真实API响应缓存支持的强化学习环境，该环境支持数据合成流程，能够以可控复杂度采样有效的多步骤编排轨迹，其生成效率显著高于无约束方法。其次，我们提出了一种渐进式奖励设计，将正确性分解为原子有效性（在递增的粒度层级上评估单个函数调用的正确性）和编排能力（遵循依赖关系的正确工具排序）。在ComplexFuncBench基准测试中，我们的方法在轮次准确率上展现出显著提升。消融实验证实两项奖励组件均不可或缺：单独使用任一组件都会导致性能大幅下降。

Multi-step tool orchestration, where LLMs must invoke multiple dependent APIs in the correct order while propagating intermediate outputs, remains challenging. State-of-the-art models frequently fail on full sequence execution, with parameter value errors accounting for a significant portion of failures. Training models to handle such workflows faces two obstacles: existing environments focus on simple per-turn function calls with simulated data, and binary rewards provide no signal for partial correctness. We present a framework addressing both challenges. First, we construct a reinforcement learning environment backed by a large-scale cache of real API responses, enabling a data synthesis pipeline that samples valid multi-step orchestration traces with controllable complexity and significantly higher generation efficiency than unconstrained methods. Second, we propose a graduated reward design that decomposes correctness into atomic validity (individual function call correctness at increasing granularity) and orchestration (correct tool sequencing with dependency respect). On ComplexFuncBench, our approach demonstrates substantial improvements in turn accuracy. Ablation studies confirm both reward components are essential: using either alone significantly degrades performance.

评分理由: 论文核心研究虚假新闻检测，直接涉及LLMs（作为虚假新闻的生成和检测工具），因此"Large Language Models"得10分。“Hallucination Mitigation"得10分，因为虚假新闻检测本质上就是识别和缓解模型生成或传播的虚假/不实信息。“Pre-training"和"Post-training"各得5分，因为论文提到了微调模型和预训练暴露问题。“In-context Learning"得5分，因为论文提到LLMs通过零样本和少样本学习进行检测。其他关键词（如MoE、量化、RAG等）论文未涉及，得0分。

近年来，虚假新闻检测在公共讨论与科学研究中日益受到关注。尽管检测技术不断进步，但在大语言模型（LLMs）的驱动和社交媒体的放大效应下，虚假信息的产生与传播也变得更加复杂。本文对12种具有代表性的虚假新闻检测方法进行了批判性评估，涵盖传统机器学习、深度学习、Transformer模型以及专门的跨领域架构。我们在10个公开可用的数据集上评估了这些方法，这些数据集在体裁、来源、主题和标注逻辑上各不相同。我们将纯文本英文虚假新闻检测视为二分类任务，通过统一标注为“真实”与“虚假”来确保一致的评估流程。我们承认不同数据集的标签语义存在差异，统一标注不可避免地消除了此类语义上的细微差别。每个数据集均被视为一个独立领域。我们进行了领域内、多领域和跨领域实验，以模拟涉及领域偏移和分布外数据的真实场景。微调模型在领域内表现良好，但泛化能力不足。跨领域架构可以缩小这一差距，但需要大量数据；而大语言模型通过零样本和少样本学习提供了有前景的替代方案。鉴于数据集固有的混杂因素以及可能的预训练数据暴露，实验结果应视为在此纯文本英文评估框架内的鲁棒性评估。

In recent years, fake news detection has received increasing attention in public debate and scientific research. Despite advances in detection techniques, the production and spread of false information have become more sophisticated, driven by Large Language Models (LLMs) and the amplification power of social media. We present a critical assessment of 12 representative fake news detection approaches, spanning traditional machine learning, deep learning, transformers, and specialized cross-domain architectures. We evaluate these methods on 10 publicly available datasets differing in genre, source, topic, and labeling rationale. We address text-only English fake news detection as a binary classification task by harmonizing labels into “Real” and “Fake” to ensure a consistent evaluation protocol. We acknowledge that label semantics vary across datasets and that harmonization inevitably removes such semantic nuances. Each dataset is treated as a distinct domain. We conduct in-domain, multi-domain and cross-domain experiments to simulate real-world scenarios involving domain shift and out-of-distribution data. Fine-tuned models perform well in-domain but struggle to generalize. Cross-domain architectures can reduce this gap but are data-hungry, while LLMs offer a promising alternative through zero- and few-shot learning. Given inherent dataset confounds and possible pre-training exposure, results should be interpreted as robustness evaluations within this English, text-only protocol.

评分理由: 论文核心研究大语言模型（LLMs）在数学推理中的应用，特别是通过强化学习框架TAPO解决多语言场景下的性能差距。因此，与"Large Language Models"高度相关（10分）。论文基于GRPO构建强化学习框架，与"RLHF"等相关（8分）。研究涉及理解-推理范式，与"Chain of Thought"和"System 2 Thinking"相关（各8分）。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、RAG、Quantization等未在摘要中提及，评为0分。

大型语言模型（LLMs）在英语数学推理方面已展现出卓越能力，但在多语言场景中仍存在显著的性能差距，这主要归因于语言理解能力的不足。为弥合这一差距，我们提出了翻译增强策略优化（Translation-Augmented Policy Optimization, TAPO），这是一个基于GRPO构建的新型强化学习框架。TAPO采用显式的对齐策略，使模型以英语为枢轴语言，并遵循“先理解后推理”的范式。关键之处在于，我们引入了步骤级相对优势机制，将理解与推理过程解耦，从而能够在避免优化冲突的前提下整合翻译质量奖励。大量实验表明，TAPO能有效协同语言理解与推理能力，并兼容多种模型。该方法在多语言数学推理和翻译任务中均优于基线方法，同时对新语言和领域外任务展现出良好的泛化能力。

Large Language Models (LLMs) have demonstrated remarkable proficiency in English mathematical reasoning, yet a significant performance disparity persists in multilingual contexts, largely attributed to deficiencies in language understanding. To bridge this gap, we introduce Translation-Augmented Policy Optimization (TAPO), a novel reinforcement learning framework built upon GRPO. TAPO enforces an explicit alignment strategy where the model leverages English as a pivot and follows an understand-then-reason paradigm. Crucially, we employ a step-level relative advantage mechanism that decouples understanding from reasoning, allowing the integration of translation quality rewards without introducing optimization conflicts. Extensive experiments reveal that TAPO effectively synergizes language understanding with reasoning capabilities and is compatible with various models. It outperforms baseline methods in both multilingual mathematical reasoning and translation tasks, while generalizing well to unseen languages and out-of-domain tasks.

评分理由: 论文核心研究大语言模型（LLMs）在数学教育中的应用，特别是作为问题解决者和评估者的双重角色，因此与"Large Language Models"高度相关（10分）。研究涉及数学推理中的多步推理和错误定位，与"Chain of Thought"相关（8分）。论文评估LLM-based math tutor agents，属于"LLM Agents"范畴（8分）。其他关键词如MoE、SLMs、训练方法、优化技术、推理加速、科学AI应用等均未在摘要中提及，评为0分。

大型语言模型（LLM）在数学教育中的应用日益广泛，不仅作为问题求解工具，也作为学习者推理过程的评估者。然而，更强的数学问题求解能力是否与更强的步骤级评估性能相关联，目前尚不明确。本研究利用PROCESSBENCH（一个用于识别数学推理中最早错误步骤的人工标注基准）中的GSM8K和MATH子集，探讨了这一关系。我们评估了两种基于LLM的数学辅导智能体设置（分别以GPT-4和GPT-5实例化），在相同数学问题上的两项独立任务：求解原始问题，以及通过预测最早错误步骤来评估基准提供的解答。结果显示出一致的模型内规律：同一模型在自身能正确求解的数学问题条目上，其评估准确率显著高于在自身求解错误的条目上，这一关联在两种模型和数据集上均具有统计显著性。同时，评估任务仍比直接问题求解更为困难，尤其是在存在错误的解答上。这些发现表明，数学问题求解的专业能力有助于提升评估表现，但可靠的步骤级诊断还需要额外的能力，如步骤追踪、过程监控和精确错误定位。研究结果对数学教育中用于形成性评估的人工智能支持自适应教学系统（AIS）的设计与评估具有启示意义。

Large Language Models (LLMs) are increasingly used in math education not only as problem solvers but also as assessors of learners’ reasoning. However, it remains unclear whether stronger math problem-solving ability is associated with stronger step-level assessment performance. This study examines that relationship using the GSM8K and MATH subsets of PROCESSBENCH, a human-annotated benchmark for identifying the earliest erroneous step in mathematical reasoning. We evaluate two LLM-based math tutor agent settings, instantiated with GPT-4 and GPT-5, in two independent tasks on the same math problems: solving the original problem and assessing a benchmark-provided solution by predicting the earliest erroneous step. Results show a consistent within-model pattern: assessment accuracy is substantially higher on math problem items the same model solved correctly than on items it solved incorrectly, with statistically significant associations across both models and datasets. At the same time, assessment remains more difficult than direct problem solving, especially on error-present solutions. These findings suggest that math problem-solving expertise supports stronger assessment performance, but reliable step-level diagnosis also requires additional capabilities such as step tracking, monitoring, and precise error localization. The results have implications for the design and evaluation of AI-supported Adaptive Instructional Systems (AISs) for formative assessment in math education.

评分理由: 论文核心研究大语言模型（LLMs）在联邦学习（FL）环境下的多语言指令微调（instruction-tuning），因此与"Large Language Models"高度相关（10分）。研究明确涉及"Post-training/Supervised Fine-tuning"和"Instruction Tuning”，因为其实验基于多语言指令微调，属于这些范畴，但非唯一核心，故给8分。其他关键词如MoE、SLMs、Scaling Laws、RLHF、PEFT、RAG等，论文未直接涉及或提及，均为0分。

在多语言环境下进行大语言模型的联邦学习面临着显著挑战，这些挑战主要源于客户端间异构的语言分布以及语言资源可用性的差异。为解决这些问题，我们扩展了联邦学习框架FederatedScope-LLM，以支持大语言模型的多语言指令微调实验。同时，我们提出了一种新颖的客户端特定早停机制——本地动态早停（Local Dynamic Early Stopping, LDES-FL），该机制允许客户端根据本地验证性能暂停和恢复本地训练，从而提升训练效率和可持续性。通过一系列实验，我们研究了客户端的语言构成——从完全单语到逐渐多语化的客户端——如何影响多语言质量、公平性和训练成本。对于单一语言的专业化任务，本地单语微调仍然最为有效，而联邦训练则更适合学习单一平衡的多语言模型。在联邦学习中，增加客户端内部的多语言性能够产生更强且更公平的全局模型，缩小与集中式多语言微调的差距，并为资源较少的语言带来最大的收益，尽管这会以更多的优化步骤为代价。总体而言，我们的研究结果表明，客户端的语言构成是多语言联邦学习中的一个关键设计变量，它影响着性能、公平性和效率。

Federated Learning (FL) of Large Language Models (LLMs) in multilingual environments presents significant challenges stemming from heterogeneous language distributions across clients and disparities in language resource availability. To address these challenges, we extended the FederatedScope-LLM framework to support multilingual instruction-tuning experiments with LLMs. We also introduced a novel client-specific early stopping mechanism, Local Dynamic Early Stopping (LDES-FL), which allows clients to pause and resume local training based on client-side validation performance, enhancing training efficiency and sustainability. Through a series of experiments, we studied how client language composition - from fully monolingual to increasingly multilingual clients - affects multilingual quality, fairness and training cost. Monolingual local fine-tuning remains the most effective for single-language specialization, whereas federated training is better suited to learning a single balanced multilingual model. In FL, increasing within-client multilinguality leads to stronger and fairer global models, narrows the gap to centralized multilingual fine-tuning, and yields the largest gains for lower-resource languages, albeit at the cost of more optimization steps. Overall, our results identify client language composition as a key design variable in multilingual FL, shaping performance, fairness and efficiency.

评分理由: 该论文主要研究使用自主智能体（Plan、Judge、Execute）将自然语言描述自动转换为经过验证的计算成像系统设计。论文的核心是智能体系统在科学应用（成像系统设计）中的创新应用。因此，与"LLM Agents” OR “Autonomous Agents” OR “Agentic Workflow"高度相关（10分），因为论文明确提出了三个自主智能体。与"Multi-agent Systems” OR “Agent Coordination"相关（8分），因为涉及多个智能体的协调工作。与"AI for Science” OR “Bioinformatics” OR “Cheminformatics"相关（8分），因为论文将AI应用于科学领域的计算成像系统设计。其他关键词主要涉及大模型技术原理（如LLM训练、优化、推理等），论文未直接涉及这些技术，因此评分为0分。

设计一套计算成像系统——包括选择算子、设定参数、验证一致性——针对每种成像模态通常需要耗费专家数周时间，这种专业门槛限制了更广泛的科学界对成像仪器进行原型设计的能力。我们提出了spec.md这一结构化规范格式，以及三个自主智能体——规划（Plan）、评估（Judge）与执行（Execute）——它们能够将一句自然语言描述转化为一个经过验证、且重建误差有界的正向模型。一项从设计到实物的误差定理将总重建误差分解为五个可独立限定的项，每一项均对应一种纠正措施。在涵盖全部五种载体家族的6种真实数据模态上，该自动化流程达到了专家库的质量水平（98.1 +/- 4.2%）。十项新颖的设计——将基础模块组合成从3D到5D的链式结构——展示了其组合能力已超越任何单一模态工具。

Designing a computational imaging system – selecting operators, setting parameters, validating consistency – requires weeks of specialist effort per modality, creating an expertise bottleneck that excludes the broader scientific community from prototyping imaging instruments. We introduce spec.md, a structured specification format, and three autonomous agents – Plan, Judge, and Execute – that translate a one-sentence natural-language description into a validated forward model with bounded reconstruction error. A design-to-real error theorem decomposes total reconstruction error into five independently bounded terms, each linked to a corrective action. On 6 real-data modalities spanning all 5 carrier families, the automated pipeline matches expert-library quality (98.1 +/- 4.2%). Ten novel designs – composing primitives into chains from 3D to 5D – demonstrate compositional reach beyond any single-modality tool.

评分理由: 论文专注于化学语言模型（CLMs），这是大模型在科学领域（特别是化学信息学）的应用，因此与"AI for Science"高度相关（10分）。论文提出了一种名为SIGMA的预训练对齐方法，涉及对比学习，这属于"Pre-training"范畴（8分）。虽然论文未明确使用"Large Language Models"术语，但化学语言模型本质上是特定领域的大语言模型，因此给予8分。其他关键词如MoE、SFT、RLHF等与论文的分子生成和结构对齐核心内容无关，均得0分。

线性化字符串表示是可扩展自回归分子生成的基础；然而，其引入了根本性的模态不匹配问题：单个分子图可映射至多个不同的序列。这种模糊性导致了轨迹发散现象，即结构等效的部分子图因其线性化历史不同，其潜在表征在隐空间中逐渐漂移分离。为在不放弃高效字符串框架的前提下解决此问题，我们提出了结构不变生成分子对齐方法（SIGMA）。SIGMA不改变线性表示本身，而是通过词元级对比学习目标，使模型能够严格识别几何对称性，显式地对齐具有相同后缀的前缀序列的潜在状态。此外，我们引入同构束搜索（IsoBeam），通过在推理过程中动态剪枝等价路径来消除同构冗余。在标准基准上的实证评估表明，SIGMA弥合了序列可扩展性与图保真度之间的差距，相较于强基线模型，在多参数优化任务中实现了更优的采样效率和结构多样性。

Linearized string representations serve as the foundation of scalable autoregressive molecular generation; however, they introduce a fundamental modality mismatch where a single molecular graph maps to multiple distinct sequences. This ambiguity leads to \textit{trajectory divergence}, where the latent representations of structurally equivalent partial graphs drift apart due to differences in linearization history. To resolve this without abandoning the efficient string formulation, we propose Structure-Invariant Generative Molecular Alignment (SIGMA). Rather than altering the linear representation, SIGMA enables the model to strictly recognize geometric symmetries via a token-level contrastive objective, which explicitly aligns the latent states of prefixes that share identical suffixes. Furthermore, we introduce Isomorphic Beam Search (IsoBeam) to eliminate isomorphic redundancy during inference by dynamically pruning equivalent paths. Empirical evaluations on standard benchmarks demonstrate that SIGMA bridges the gap between sequence scalability and graph fidelity, yielding superior sample efficiency and structural diversity in multi-parameter optimization compared to strong baselines.

评分理由: 论文提出Drive My Way (DMW)，一个个性化的视觉-语言-动作（VLA）驾驶框架，其核心是使自动驾驶系统与用户的长期驾驶习惯和实时指令对齐。因此，与"Alignment"高度相关（10分）。论文涉及学习用户嵌入和条件化策略，这可以视为一种领域适应和微调过程，因此与"Pre-training/Domain Adaptation"和"Post-training/SFT"有一定关联（各5分）。论文是一个VLA模型，虽然主要不是纯LLM，但属于大模型在特定领域（自动驾驶）的应用，因此与"Large Language Models/Foundation Models"有一定关联（5分）。其他关键词如MoE、SLMs、Scaling Laws、RLHF、RAG、推理加速、量化等，论文未明确涉及或不是核心内容，因此评分为0分。

人类驾驶行为具有固有的个性化特征，其由长期习惯塑造并受短期意图影响。不同个体在加速、制动、并线、让行与超车等多样化场景中均表现出差异性。然而，现有的端到端自动驾驶系统或针对通用目标进行优化，或依赖固定的驾驶模式，缺乏适应个体偏好或解析自然语言意图的能力。为弥补这一不足，我们提出了“Drive My Way”（DMW），一种个性化的视觉-语言-行动（Vision-Language-Action, VLA）驾驶框架，该框架能与用户的长期驾驶习惯保持一致，并适应其实时指令。DMW从我们收集的多位真实驾驶员、多场景下的个性化驾驶数据集中学习用户嵌入向量，并在规划过程中以此嵌入向量为策略提供条件，而自然语言指令则提供额外的短期引导。在Bench2Drive基准测试上的闭环评估表明，DMW提升了风格指令适应能力；用户研究显示，其生成的行为可被识别为对应驾驶员自身的风格，这凸显了个性化作为以人为本的自动驾驶的一项关键能力。我们的数据与代码公开于 https://dmw-cvpr.github.io/。

Human driving behavior is inherently personal, which is shaped by long-term habits and influenced by short-term intentions. Individuals differ in how they accelerate, brake, merge, yield, and overtake across diverse situations. However, existing end-to-end autonomous driving systems either optimize for generic objectives or rely on fixed driving modes, lacking the ability to adapt to individual preferences or interpret natural language intent. To address this gap, we propose Drive My Way (DMW), a personalized Vision-Language-Action (VLA) driving framework that aligns with users’ long-term driving habits and adapts to real-time user instructions. DMW learns a user embedding from our personalized driving dataset collected across multiple real drivers and conditions the policy on this embedding during planning, while natural language instructions provide additional short-term guidance. Closed-loop evaluation on the Bench2Drive benchmark demonstrates that DMW improves style instruction adaptation, and user studies show that its generated behaviors are recognizable as each driver’s own style, highlighting personalization as a key capability for human-centered autonomous driving. Our data and code are available at https://dmw-cvpr.github.io/.

评分理由: 论文核心研究大语言模型（LLMs）的训练与评估，直接涉及"Large Language Models"关键词（10分）。研究比较自然数据与合成数据对LLMs的影响，间接关联数据质量（“Scaling Laws” AND “Data Quality”：5分）以及训练方法（“Pre-training”、“Post-training"等：5分）。其他关键词如MoE、SLMs、对齐、推理加速等均未在摘要中提及，评为0分。

本研究以法语和意大利语中的被动动词交替现象为例，比较了自然数据与合成数据对大型语言模型（Large Language Models, LLMs）训练与评估的影响。我们采用黑鸟语言矩阵（Blackbird Language Matrices, BLMs）——一种旨在通过系列句子探究底层语言知识模式的结构化数据集。我们将从通用依存语料库（Universal Dependencies）中提取的自然句子所实例化的结构化模板，与合成句子的结构化模板进行对比。实验表明，尽管模型在合成数据集上进行训练和测试时能达到上限性能，但它们无法可靠地推广到自然句子。相反，使用自然数据训练的模型在自然与合成测试集中均表现出稳健的性能，这证明其在捕捉抽象语言模式方面具有更优的能力。这些结果印证了自然数据以及结构化评估设置在探究LLMs句法与语义知识方面的价值。

This study compares the impact of natural and synthetic data on training and evaluating large language models (LLMs), using the case of passive verb alternation in French and Italian. We use Blackbird Language Matrices (BLMs), structured datasets designed to probe linguistic knowledge of underlying patterns across sentence sets. We compare structured templates instantiated with natural sentences extracted from Universal Dependencies to structured templates of synthetic sentences. Experiments show that while models achieve ceiling performance when trained and tested on synthetic datasets, they do not reliably generalize to natural sentences. In contrast, models trained on natural data exhibit robust performance across both natural and synthetic test suites, demonstrating their superior ability to capture abstract linguistic patterns. These results corroborate the value of natural data and of structured set ups in linguistic evaluation for probing LLMs’ syntactic and semantic knowledge.

评分理由: 该论文的核心贡献是提出了一种用于RAG系统的自适应分块框架，因此与"Retrieval-Augmented Generation"高度相关（10分）。论文提到了LLM-regex splitter，表明使用了LLM技术，因此与"Large Language Models"有一定关联（5分）。论文未涉及其他关键词的具体技术内容，如MoE、SLMs、Scaling Laws、各种训练方法、推理优化、代理系统等，因此这些关键词评分为0分。

检索增强生成（RAG）的有效性高度依赖于文档分块（chunking）的方式，即如何将文档分割为更小的单元以进行索引与检索。然而，常用的“一刀切”方法往往难以捕捉多样化文本的细微结构及语义。尽管分块处于核心地位，但目前缺乏专门的评估框架，导致难以独立于下游任务性能来评估和比较不同分块策略。我们通过提出自适应分块（Adaptive Chunking）框架来挑战这一范式，该框架基于五个新颖的、面向文档的内在指标——引用完整性（RC）、块内内聚性（ICC）、文档上下文连贯性（DCC）、块完整性（BI）与尺寸合规性（SC）——为每份文档选择最合适的分块策略，这些指标可直接从关键维度评估分块质量。为支持此框架，我们还引入了两种新的分块器：一种基于大语言模型与正则表达式的分割器（LLM-regex splitter），以及一种先分割后合并的递归分割器（split-then-merge recursive splitter），并辅以针对性的后处理技术。在涵盖法律、技术及社会科学领域的多样化语料上，我们基于指标引导的自适应方法显著提升了下游RAG性能。在不改变模型或提示的情况下，该框架改善了RAG结果，将答案正确率提升至72%（原为62-64%），并使成功回答的问题数量增加超过30%（65 vs. 49）。这些结果表明，通过一套互补的内在指标引导、具备文档感知的自适应分块，为构建更稳健的RAG系统提供了一条切实有效的路径。代码发布于 https://github.com/ekimetrics/adaptive-chunking。

The effectiveness of Retrieval-Augmented Generation (RAG) is highly dependent on how documents are chunked, that is, segmented into smaller units for indexing and retrieval. Yet, commonly used “one-size-fits-all” approaches often fail to capture the nuanced structure and semantics of diverse texts. Despite its central role, chunking lacks a dedicated evaluation framework, making it difficult to assess and compare strategies independently of downstream performance. We challenge this paradigm by introducing Adaptive Chunking, a framework that selects the most suitable chunking strategy for each document based on a set of five novel intrinsic, document-based metrics: References Completeness (RC), Intrachunk Cohesion (ICC), Document Contextual Coherence (DCC), Block Integrity (BI), and Size Compliance (SC), which directly assess chunking quality across key dimensions. To support this framework, we also introduce two new chunkers, an LLM-regex splitter and a split-then-merge recursive splitter, alongside targeted post-processing techniques. On a diverse corpus spanning legal, technical, and social science domains, our metric-guided adaptive method significantly improves downstream RAG performance. Without changing models or prompts, our framework increases RAG outcomes, raising answers correctness to 72% (from 62-64%) and increasing the number of successfully answered questions by over 30% (65 vs. 49). These results demonstrate that adaptive, document-aware chunking, guided by a complementary suite of intrinsic metrics, offers a practical and effective path to more robust RAG systems. Code available at https://github.com/ekimetrics/adaptive-chunking.

评分理由: 论文主要研究遥感领域的大规模多模态模型（LMMs），属于AI for Science（地球科学/遥感）的应用范畴，因此与"AI for Science"高度相关（10分）。论文提及LMMs，与"Large Language Models"有一定关联（5分），但核心是视觉-语言多模态模型而非纯语言模型。其他关键词主要涉及大模型技术原理（如MoE、训练方法、推理优化等）或特定应用领域（如生物信息学），论文未涉及，故评0分。

当前地球观测领域的大型多模态模型通常忽视了关键的“垂直”维度，这限制了其在复杂遥感几何结构与灾害场景中的推理能力——在这些场景中，物理空间结构的重要性往往超越平面视觉纹理。为弥补这一空白，我们引入了一个专用于高度感知遥感理解的综合评估框架。首先，为克服标注数据严重匮乏的问题，我们开发了一套可扩展的、基于视觉语言模型的自动化数据生成流程，该流程利用系统性提示工程与元数据提取技术，构建了两个互补的基准数据集：用于相对高度分析的GeoHeight-Bench，以及更具挑战性的、面向整体地形感知推理的GeoHeight-Bench+。此外，为验证高度感知的必要性，我们提出了首个高度感知遥感大型多模态模型基线——GeoHeightChat。作为一项有力的概念验证，该基线模型表明：将视觉语义与隐式注入的高度几何特征相融合，能有效缓解现有模型的“垂直盲区”，成功在现有光学模型中开创了交互式高度推理的新范式。

Current Large Multimodal Models (LMMs) in Earth Observation typically neglect the critical “vertical” dimension, limiting their reasoning capabilities in complex remote sensing geometries and disaster scenarios where physical spatial structures often outweigh planar visual textures. To bridge this gap, we introduce a comprehensive evaluation framework dedicated to height-aware remote sensing understanding. First, to overcome the severe scarcity of annotated data, we develop a scalable, VLM-driven data generation pipeline utilizing systematic prompt engineering and metadata extraction. This pipeline constructs two complementary benchmarks: GeoHeight-Bench for relative height analysis, and a more challenging GeoHeight-Bench+ for holistic, terrain-aware reasoning. Furthermore, to validate the necessity of height perception, we propose GeoHeightChat, the first height-aware remote sensing LMM baseline. Serving as a strong proof of concept, our baseline demonstrates that synergizing visual semantics with implicitly injected height geometric features effectively mitigates the “vertical blind spot”, successfully unlocking a new paradigm of interactive height reasoning in existing optical models.

评分理由: 论文《CIV-DG: Conditional Instrumental Variables for Domain Generalization in Medical Imaging》专注于医学影像领域的领域泛化问题，提出了一种基于条件工具变量的因果框架来解决选择偏差和结构混杂问题。论文的核心是深度学习在医学影像分析中的应用，属于"AI for Science”（特别是生物信息学/医学影像分析）范畴，因此该关键词得8分。论文提到了"Domain Adaptation”（领域适应）作为相关背景，但主要研究的是领域泛化（Domain Generalization），两者有联系但侧重点不同，因此给5分。论文未涉及大语言模型（LLMs）、模型架构（如MoE）、训练技术（如RLHF、PEFT）、推理优化、智能体或其他大模型相关技术，因此其他关键词均为0分。

医学人工智能的跨站点泛化能力从根本上受到选择偏倚的制约——这是一种结构性机制，即患者人口统计学特征（如年龄、疾病严重程度）非随机地决定其医院分配。传统的领域泛化范式主要针对图像层面的分布偏移，未能解决站点特异性变异与诊断标签之间由此产生的伪相关性。为克服这一可识别性障碍，我们提出CIV-DG因果框架，该框架利用条件工具变量将病理语义与扫描仪伪影进行解耦。通过放宽标准工具变量方法对随机分配的严格假设，CIV-DG能够适应医院选择由患者人口统计学特征内生驱动的复杂临床场景。我们通过深度广义矩估计架构实例化该理论，采用条件评判器来最小化矩违背，并在人口统计学分层内强制实现工具变量与误差的正交性。在Camelyon17基准和大规模胸部X射线数据集上的大量实验表明，CIV-DG显著优于主流基线方法，验证了条件因果机制在解决结构混杂问题、构建鲁棒医学人工智能方面的有效性。

Cross-site generalizability in medical AI is fundamentally compromised by selection bias, a structural mechanism where patient demographics (e.g., age, severity) non-randomly dictate hospital assignment. Conventional Domain Generalization (DG) paradigms, which predominantly target image-level distribution shifts, fail to address the resulting spurious correlations between site-specific variations and diagnostic labels. To surmount this identifiability barrier, we propose CIV-DG, a causal framework that leverages Conditional Instrumental Variables to disentangle pathological semantics from scanner-induced artifacts. By relaxing the strict random assignment assumption of standard IV methods, CIV-DG accommodates complex clinical scenarios where hospital selection is endogenously driven by patient demographics. We instantiate this theory via a Deep Generalized Method of Moments (DeepGMM) architecture, employing a conditional critic to minimize moment violations and enforce instrument-error orthogonality within demographic strata. Extensive experiments on the Camelyon17 benchmark and large-scale Chest X-Ray datasets demonstrate that CIV-DG significantly outperforms leading baselines, validating the efficacy of conditional causal mechanisms in resolving structural confounding for robust medical AI.

评分理由: 该论文明确将LLMs作为AI辅助代码生成工具的核心技术进行讨论，因此与"Large Language Models"高度相关（10分）。论文研究AI生成代码的质量影响因素，属于大模型在软件工程领域的应用研究，符合研究背景中"大模型在不同领域的研究应用"的要求。但论文未深入探讨LLMs的具体技术原理（如MoE、Scaling Laws、训练方法等），也未涉及其他特定技术关键词（如推理加速、幻觉缓解等），因此其他关键词均评为0分。

研究背景：以大型语言模型为代表的人工智能辅助代码生成工具的快速普及，正在深刻改变软件开发实践。尽管这类工具有望显著提升开发效率，但学术界与工业界日益关注其生成代码在质量、可靠性和安全性方面的问题。研究目的：本研究旨在系统梳理现有关于人工智能生成源代码质量影响因素的实证证据，并分析这些因素在不同评估情境下如何影响软件质量结果。研究方法：我们遵循既定规范开展了系统性文献综述，并在人工监督下采用人工智能辅助工作流程予以支持。通过跨主要数字图书馆的结构化检索与筛选，最终纳入24项核心研究。采用基于模式的定性证据综合方法进行数据提取与分析。研究结果：研究发现，人工智能辅助开发中的代码质量受到人为因素、人工智能系统特性以及人机交互动态的共同影响。关键影响因素包括提示词设计、任务规范性和开发者专业水平。结果同时表明，不同研究在代码正确性、安全性、可维护性和复杂性等质量维度上存在显著差异，既观察到质量提升也识别出潜在风险。研究结论：人工智能辅助代码生成标志着软件工程领域的社会技术范式转变，实现高质量产出既依赖于技术因素也取决于人为因素。尽管前景广阔，人工智能生成的代码仍需经过审慎验证并妥善集成至开发工作流程中。

Context: The rapid adoption of AI-assisted code generation tools, such as large language models (LLMs), is transforming software development practices. While these tools promise significant productivity gains, concerns regarding the quality, reliability, and security of AI-generated code are increasingly reported in both academia and industry. –Objective: This study aims to systematically synthesize existing empirical evidence on the factors influencing the quality of AI-generated source code and to analyze how these factors impact software quality outcomes across different evaluation contexts. –Method: We conducted a systematic literature review (SLR) following established guidelines, supported by an AI-assisted workflow with human oversight. A total of 24 primary studies were selected through a structured search and screening process across major digital libraries. Data were extracted and analyzed using qualitative, pattern-based evidence synthesis. –Results: The findings reveal that code quality in AI-assisted development is influenced by a combination of human factors, AI system characteristics, and human AI interaction dynamics. Key influencing factors include prompt design, task specification, and developer expertise. The results also show variability in quality outcomes such as correctness, security, maintainability, and complexity across studies, with both improvements and risks reported. –Conclusion: AI-assisted code generation represents a socio-technical shift in software engineering, where achieving high-quality outcomes depends on both technological and human factors. While promising, AI-generated code requires careful validation and integration into development workflows.

评分理由: 论文专注于计算机视觉领域的分布外泛化问题，提出了一种基于通道级稀疏化的方法（Hierarchical Causal Dropout），与大多数关键词（特别是大语言模型相关技术）无直接关联。仅与两个关键词有中等关联：1）“Mixture of Experts” OR “MoE” OR “Sparse Models”：论文使用通道级因果掩码实现特征稀疏化，与稀疏模型概念相关，但非核心MoE架构，给5分。2）“Pre-training” OR “Continual Pre-training” OR “Domain Adaptation”：论文解决领域泛化问题，与领域适应有一定概念重叠，但未涉及预训练技术，给5分。其他关键词均未涉及，给0分。

分布外泛化已成为评估图像分析系统的一项核心指标。由于深度学习模型倾向于捕捉领域特定的上下文，它们常对这些非因果特征形成捷径依赖，导致在不同数据源上的性能表现不一致。现有技术如不变性学习试图缓解这一问题，但难以在深层隐空间内有效分离高度混杂的特征，这一局限使其无法完全解决捷径学习问题。本文提出分层因果丢弃法，该方法通过通道级因果掩码强制实现特征稀疏性，使模型能够将因果特征与伪相关特征分离，从而在表征层面有效执行因果干预。训练过程以矩阵化互信息为目标函数进行引导，旨在最小化隐特征与领域标签间的互信息，同时最大化其与类别标签的共享信息。为确保稳定性，我们引入基于风格混合的VICReg模块，防止掩码意外过滤关键因果数据。在分布外泛化基准测试上的实验结果表明，本方法优于现有顶尖技术。

Out-of-Distribution (OOD) generalization has become a primary metric for evaluating image analysis systems. Since deep learning models tend to capture domain-specific context, they often develop shortcut dependencies on these non-causal features, leading to inconsistent performance across different data sources. Current techniques, such as invariance learning, attempt to mitigate this. However, they struggle to isolate highly mixed features within deep latent spaces. This limitation prevents them from fully resolving the shortcut learning problem.In this paper, we propose Hierarchical Causal Dropout (HCD), a method that uses channel-level causal masks to enforce feature sparsity. This approach allows the model to separate causal features from spurious ones, effectively performing a causal intervention at the representation level. The training is guided by a Matrix-based Mutual Information (MMI) objective to minimize the mutual information between latent features and domain labels, while simultaneously maximizing the information shared with class labels.To ensure stability, we incorporate a StyleMix-driven VICReg module, which prevents the masks from accidentally filtering out essential causal data. Experimental results on OOD benchmarks show that HCD performs better than existing top-tier methods.

评分理由: 论文核心研究LLM的提示工程优化方法（手动专家提示与自动优化DSPy/GEPA的比较），直接涉及LLM技术应用，因此"Large Language Models"相关关键词得10分。其他关键词如MoE、SLMs、训练方法、推理加速、对齐、RAG、代理等均未在摘要中提及或相关，故得0分。

大语言模型（LLM）的性能对提示设计高度敏感，然而在语言学任务中，自动提示优化能否取代专家提示工程仍未被探索。我们首次系统比较了手工设计的零样本专家提示、基础DSPy签名以及GEPA优化的DSPy签名在翻译、术语插入和语言质量评估（LQA）任务中的表现，评估了五种模型配置。结果具有任务依赖性。在术语插入任务中，优化提示与人工提示产生的质量在统计上大多无法区分。在翻译任务中，不同方法在不同模型上各有优势。在语言质量评估中，专家提示实现了更强的错误检测能力，而优化则提升了错误特征描述性能。在所有任务中，GEPA显著提升了基础DSPy签名的表现，且多数专家提示与优化提示的比较未显示出统计学上的显著差异。需要指出的是，这种比较存在不对称性：GEPA优化通过程序化搜索基于黄金标准数据分割进行，而专家提示原则上无需标注数据，其依赖的是领域专业知识与迭代优化过程。

LLM performance is highly sensitive to prompt design, yet whether automatic prompt optimization can replace expert prompt engineering in linguistic tasks remains unexplored. We present the first systematic comparison of hand-crafted zero-shot expert prompts, base DSPy signatures, and GEPA-optimized DSPy signatures across translation, terminology insertion, and language quality assessment, evaluating five model configurations. Results are task-dependent. In terminology insertion, optimized and manual prompts produce mostly statistically indistinguishable quality. In translation, each approach wins on different models. In LQA, expert prompts achieve stronger error detection while optimization improves characterization. Across all tasks, GEPA elevates minimal DSPy signatures, and the majority of expert-optimized comparisons show no statistically significant difference. We note that the comparison is asymmetric: GEPA optimization searches programmatically over gold-standard splits, whereas expert prompts require in principle no labeled data, relying instead on domain expertise and iterative refinement.

评分理由: 该论文专注于量子化学计算领域，提出了一种结合可迁移深度学习变分蒙特卡洛（VMC）与高斯过程回归的方法，用于高精度探索分子势能面。论文的核心是深度学习在科学计算（具体为量子化学）中的应用，属于"AI for Science"范畴。然而，论文并未涉及任何大语言模型（LLM）、模型架构（如MoE）、训练技术（如预训练、微调、对齐）、推理优化、智能体系统或其他列出的通用大模型技术关键词。因此，除"AI for Science"关键词外，其余所有关键词均得0分。

对化学过程的精确描述需要探索分子势能面的广阔区域，这对于强关联体系仍具挑战性。可迁移的深度学习变分蒙特卡洛方法通过高效联合求解不同分子构型下的电子薛定谔方程，提供了在持续高精度下实现这一目标的有效途径，但其随机性使得直接探索分子构型空间变得困难。本文提出了一种高精度从头算探索势能面的框架，该框架将可迁移的深度学习变分蒙特卡洛方法与低成本估算能量、力和 Hessian 矩阵相结合。通过在电子波函数的变分蒙特卡洛优化过程中持续采样核构型，我们获得了可迁移的描述，能够在化学相关的分子几何分布范围内实现零样本化学精度。在后续的分子构型空间表征中，势能面的评估仅需稀疏进行：通过在采样构型处估算变分蒙特卡洛能量和力，并利用高斯过程回归聚合由此产生的含噪声数据，构建局部近似。我们的方法能够对复杂的势能面景观进行精确高效的探索，包括基态和激发态的结构弛豫、过渡态搜索以及最小能量路径。这为研究具有显著多参考态特性的体系中的键断裂、形成及大规模结构重排打开了大门。

A faithful description of chemical processes requires exploring extended regions of the molecular potential energy surface (PES), which remains challenging for strongly correlated systems. Transferable deep-learning variational Monte Carlo (VMC) offers a promising route by efficiently solving the electronic Schrödinger equation jointly across molecular geometries at consistently high accuracy, yet its stochastic nature renders direct exploration of molecular configuration space nontrivial. Here, we present a framework for highly accurate ab initio exploration of PESs that combines transferable deep-learning VMC with a cost-effective estimation of energies, forces, and Hessians. By continuously sampling nuclear configurations during VMC optimization of electronic wave functions, we obtain transferable descriptions that achieve zero-shot chemical accuracy within chemically relevant distributions of molecular geometries. Throughout the subsequent characterization of molecular configuration space, the PES is evaluated only sparsely, with local approximations constructed by estimating VMC energies and forces at sampled geometries and aggregating the resulting noisy data using Gaussian process regression. Our method enables accurate and efficient exploration of complex PES landscapes, including structure relaxation, transition-state searches, and minimum-energy pathways, for both ground and excited states. This opens the door to studying bond breaking, formation, and large structural rearrangements in systems with pronounced multi-reference character.

评分理由: 论文专注于自动语音识别（ASR）系统的评估和基准测试，特别是针对语音代理在真实世界条件下的鲁棒性。它不涉及大语言模型（LLMs）、深度学习技术原理的创新，或大模型在不同领域的应用。唯一相关的关键词是"Hallucination Mitigation”，因为论文提到了ASR模型在部分或退化输入下会产生幻觉（hallucinate plausible but unspoken content），这构成了安全风险，因此给予5分（有一定关联）。其他所有关键词均与论文内容无关，得0分。

自动语音识别（ASR）系统在精选测试集上已达到接近人类的准确率，但在现实语音助手中，面对当前评估未能系统覆盖的场景时仍频繁失效。由于缺乏能够分离具体故障因素的诊断工具，开发者难以预判何种条件、在何种语言中会导致何种程度的性能下降。本文提出WildASR——一个完全源自真实人类语音的多语言（四种语言）诊断基准，该基准从三个维度分解ASR鲁棒性：环境干扰、人群差异与语言多样性。通过对七种广泛使用的ASR系统进行评估，我们发现其性能存在严重且不均衡的退化，且模型的鲁棒性无法跨语言或跨条件迁移。关键问题在于，面对部分或受损的输入时，模型常产生看似合理但实际未说出的幻觉内容，这给下游智能体行为带来了具体的安全风险。我们的研究结果表明，针对性的、因素隔离的评估对于理解和提升生产系统中ASR的可靠性至关重要。除基准本身外，我们还提供了三种分析工具，可供开发者用于指导部署决策。

Automatic speech recognition (ASR) systems have achieved near-human accuracy on curated benchmarks, yet still fail in real-world voice agents under conditions that current evaluations do not systematically cover. Without diagnostic tools that isolate specific failure factors, practitioners cannot anticipate which conditions, in which languages, will cause what degree of degradation. We introduce WildASR, a multilingual (four-language) diagnostic benchmark sourced entirely from real human speech that factorizes ASR robustness along three axes: environmental degradation, demographic shift, and linguistic diversity. Evaluating seven widely used ASR systems, we find severe and uneven performance degradation, and model robustness does not transfer across languages or conditions. Critically, models often hallucinate plausible but unspoken content under partial or degraded inputs, creating concrete safety risks for downstream agent behavior. Our results demonstrate that targeted, factor-isolated evaluation is essential for understanding and improving ASR reliability in production systems. Besides the benchmark itself, we also present three analytical tools that practitioners can use to guide deployment decisions.

评分理由: 论文研究的是使用ResNet-50神经网络通过背部标记识别猪只个体，属于计算机视觉在动物监测领域的应用。所有关键词均与大语言模型（LLM）、深度学习技术原理创新、模型训练优化方法（如MoE、Scaling Laws、PEFT、RLHF等）、推理技术（如CoT、MCTS）、代理系统或特定AI科学领域（如生物信息学）直接相关。论文仅涉及基础的卷积神经网络（ResNet-50）用于图像分类，未涉及任何大模型、深度学习技术原理创新或上述关键词中的具体方法。唯一略有相关的是"AI for Science”，因为该研究属于AI在动物科学/农业领域的应用，但并非核心匹配生物信息学或化学信息学，因此给予5分（有一定关联）。其他关键词均完全无关，得0分。

迄今为止，关于如何设计背部标记以最佳支持对猪等外观相似物种的个体水平监测的研究仍十分有限。随着近期基于机器学习的监测解决方案的涌现，尤其需要关于如何设计能被此类算法有效识别的标记的指导原则。本研究基于一个经过训练、旨在通过背部标记区分猪只的机器学习模型的分析，为有效的背部标记设计提供了有价值的见解。具体而言，我们训练了一个ResNet-50类型的神经网络，以对十头具有独特背部标记的猪进行分类。对该模型预测结果的分析突显了某些设计选择的重要性，即使在受控环境中也是如此。最重要的是，必须设计一套背部标记，使得每个标记在由动物行为引起的运动模糊、多样视角和遮挡条件下仍保持明确无误。此外，背部标记的设计必须考虑模型训练中常用的数据增强策略，如颜色、翻转和裁剪增强。这些研究见解可通过优化背部标记设计，为未来研究和实际应用中的个体水平监测提供支持。

To date, there is little research on how to design back marks to best support individual-level monitoring of uniform looking species like pigs. With the recent surge of machine learning-based monitoring solutions, there is a particular need for guidelines on the design of marks that can be effectively recognised by such algorithms. This study provides valuable insights on effective back mark design, based on the analysis of a machine learning model, trained to distinguish pigs via their back marks. Specifically, a neural network of type ResNet-50 was trained to classify ten pigs with unique back marks. The analysis of the model’s predictions highlights the significance of certain design choices, even in controlled settings. Most importantly, the set of back marks must be designed such that each mark remains unambiguous under conditions of motion blur, diverse view angles and occlusions, caused by animal behaviour. Further, the back mark design must consider data augmentation strategies commonly employed during model training, like colour, flip and crop augmentations. The generated insights can support individual-level monitoring in future studies and real-world applications by optimizing back mark design.

评分理由: 该论文专注于计算机视觉和医学图像处理领域，提出了一种无需训练的手术器械检测和6D姿态估计方法。论文的核心技术涉及多视图几何、特征提取、模板匹配和轮廓配准，属于传统的计算机视觉和深度学习应用，而非大语言模型（LLM）或大模型技术原理的创新。所有关键词（如LLMs、MoE、Scaling Laws、RLHF、RAG、CoT、Agents等）均与论文内容无关，因此除最后一个关键词外均得0分。最后一个关键词"AI for Science” OR “Bioinformatics” OR “Cheminformatics"得5分，因为论文涉及AI在医学（手术）领域的应用，属于"AI for Science"的范畴，但并非核心焦点（论文更侧重计算机视觉方法而非生物信息学或化学信息学）。

目的：手术器械的精确检测与六维姿态估计对众多计算机辅助介入治疗至关重要。然而，监督学习方法对新器械或未见过的器械缺乏灵活性，且需要大量标注数据。本研究提出一种免训练流程，用于对未见手术器械进行精确的多视角六维姿态估计，该流程仅需纹理化CAD模型作为先验知识。方法：我们的流程包含两个主要阶段。首先，在检测阶段，我们在每个视角生成物体掩膜候选区域，并使用预训练特征提取器评估其与渲染模板的相似度得分。检测结果在跨视角间进行匹配，通过三角测量生成三维实例候选，并利用多视角几何一致性进行筛选。其次，在姿态估计阶段，通过结合跨视角注意力机制的特征度量评分，对一组姿态假设进行迭代优化与评分。最优假设将采用一种新颖的多视角、遮挡感知轮廓配准方法进行最终优化，该方法最小化未遮挡轮廓点的重投影误差。结果：所提方法在MVPSP数据集中的真实手术数据上进行了严格评估。该方法在受控条件下实现了毫米级精度的姿态估计，其性能与监督学习方法相当，同时保持对未见器械的完全泛化能力。这些结果证明了在手术场景中实现免训练、无标记检测与跟踪的可行性，并凸显了手术环境中的独特挑战。结论：我们提出了一种新颖且灵活的流程，该流程有效结合了前沿的基础模型、多视角几何以及基于轮廓的优化方法，无需任务特定训练即可实现手术器械的高精度六维姿态估计。该方法为动态临床环境中实现稳健的器械跟踪与场景理解提供了可能。

Purpose: Accurate detection and 6D pose estimation of surgical instruments are crucial for many computer-assisted interventions. However, supervised methods lack flexibility for new or unseen tools and require extensive annotated data. This work introduces a training-free pipeline for accurate multi-view 6D pose estimation of unseen surgical instruments, which only requires a textured CAD model as prior knowledge. Methods: Our pipeline consists of two main stages. First, for detection, we generate object mask proposals in each view and score their similarity to rendered templates using a pre-trained feature extractor. Detections are matched across views, triangulated into 3D instance candidates, and filtered using multi-view geometric consistency. Second, for pose estimation, a set of pose hypotheses is iteratively refined and scored using feature-metric scores with cross-view attention. The best hypothesis undergoes a final refinement using a novel multi-view, occlusion-aware contour registration, which minimizes reprojection errors of unoccluded contour points. Results: The proposed method was rigorously evaluated on real-world surgical data from the MVPSP dataset. The method achieves millimeter-accurate pose estimates that are on par with supervised methods under controlled conditions, while maintaining full generalization to unseen instruments. These results demonstrate the feasibility of training-free, marker-less detection and tracking in surgical scenes, and highlight the unique challenges in surgical environments. Conclusion: We present a novel and flexible pipeline that effectively combines state-of-the-art foundational models, multi-view geometry, and contour-based refinement for high-accuracy 6D pose estimation of surgical instruments without task-specific training. This approach enables robust instrument tracking and scene understanding in dynamic clinical environments.

评分理由: 论文提出了一种用于动力系统的分布到分布（D2D）神经概率预测框架，核心是使用核均值嵌入和混合密度网络直接操作和演化预测分布，而非轨迹。所有关键词（共27个）中，仅"AI for Science” OR “Bioinformatics” OR “Cheminformatics"有微弱关联（评5分），因为该框架应用于科学领域（混沌动力系统Lorenz63），属于AI for Science的广义范畴，但论文未涉及大模型、深度学习技术原理创新或生物/化学信息学。其他26个关键词均专注于大模型技术（如LLM、MoE、对齐、推理、代理等）或其特定应用，与本文的通用神经概率预测框架无直接关系，故评0分。加权总分仅5.0分，远低于动态及格分26.6分，表明论文与评审关注的大模型/深度学习主题高度不相关。

概率预测通过将预测表示为概率分布而非确定性轨迹，为动力系统中的不确定性量化提供了原则性框架。然而，现有的预测方法——无论是基于物理模型还是基于神经网络——本质上仍以轨迹为导向：预测分布通常通过集合或采样获得，而非作为动力学对象直接演化。本文开发了一种分布到分布（D2D）神经概率预测框架，可直接对预测分布进行操作。该框架围绕可替换的神经预测模块构建了分布编码与解码结构：利用核均值嵌入表示输入分布，并采用混合密度网络参数化输出预测分布。这种设计使得预测不确定性能够在统一的端到端神经架构内递归传播，模型的训练与评估均直接基于概率预测技能进行。该框架在Lorenz63混沌动力系统中得到验证。结果表明：D2D模型能够捕捉非线性动力学下的非平凡分布演化，无需显式集合模拟即可生成具有良好技能的概率预测，其性能与简化完美模型基准相当，部分情况下甚至更优。这些发现指向了概率预测的新范式——预测分布可直接被学习与演化，而非通过基于集合的不确定性传播间接重构。

Probabilistic forecasting provides a principled framework for uncertainty quantification in dynamical systems by representing predictions as probability distributions rather than deterministic trajectories. However, existing forecasting approaches, whether physics-based or neural-network-based, remain fundamentally trajectory-oriented: predictive distributions are usually accessed through ensembles or sampling, rather than evolved directly as dynamical objects. A distribution-to-distribution (D2D) neural probabilistic forecasting framework is developed to operate directly on predictive distributions. The framework introduces a distributional encoding and decoding structure around a replaceable neural forecasting module, using kernel mean embeddings to represent input distributions and mixture density networks to parameterise output predictive distributions. This design enables recursive propagation of predictive uncertainty within a unified end-to-end neural architecture, with model training and evaluation carried out directly in terms of probabilistic forecast skill. The framework is demonstrated on the Lorenz63 chaotic dynamical system. Results show that the D2D model captures nontrivial distributional evolution under nonlinear dynamics, produces skillful probabilistic forecasts without explicit ensemble simulation, and remains competitive with, and in some cases outperforms, a simplified perfect model benchmark. These findings point to a new paradigm for probabilistic forecasting, in which predictive distributions are learned and evolved directly rather than reconstructed indirectly through ensemble-based uncertainty propagation.

评分理由: 论文核心研究RAG系统的知识库优化，与’Retrieval-Augmented Generation OR RAG OR Retrieval-Generation’高度相关（10分），因为直接提出WriteBack-RAG框架改进RAG。论文使用LLM作为RAG的骨干模型，与’Large Language Models OR LLMs OR Foundation Models’有一定关联（8分），但未深入LLM技术本身。其他关键词如MoE、SFT、RLHF等均未涉及，得0分。

检索增强生成（RAG）系统中的知识库通常一经构建便不再更新，然而查询所需的事实往往分散在不同文档中，并埋没于无关内容之内。我们认为知识库应被视为可训练的组件，并提出了WriteBack-RAG框架。该框架利用标注示例识别检索成功案例，从中剥离相关文档，并将其提炼为紧凑的知识单元，与原始语料库共同建立索引。由于该方法仅修改语料库，可作为离线预处理步骤一次性应用，并能与任何RAG流程结合。在四种RAG方法、六个基准测试和两种大语言模型（LLM）基座的实验中，WriteBack-RAG在所有评估场景中均取得提升，平均增益达+2.14%。跨方法迁移实验进一步表明，经提炼的知识单元对非原始生成流程的其他RAG系统同样有效，这证实了改进效果根植于语料库本身。

The knowledge base in a retrieval-augmented generation (RAG) system is typically assembled once and never revised, even though the facts a query requires are often fragmented across documents and buried in irrelevant content. We argue that the knowledge base should be treated as a trainable component and propose WriteBack-RAG, a framework that uses labeled examples to identify where retrieval succeeds, isolate the relevant documents, and distill them into compact knowledge units that are indexed alongside the original corpus. Because the method modifies only the corpus, it can be applied once as an offline preprocessing step and combined with any RAG pipeline. Across four RAG methods, six benchmarks, and two LLM backbones, WriteBack-RAG improves every evaluated setting, with gains averaging +2.14%. Cross-method transfer experiments further show that the distilled knowledge benefits RAG pipelines other than the one used to produce it, confirming that the improvement resides in the corpus itself.

评分理由: 论文提出Vega模型，这是一个用于自动驾驶的视觉-语言-世界-动作模型，核心是处理自然语言指令并生成轨迹。与关键词的相关性分析：1）与’Large Language Models’（5分）相关，因为模型处理语言指令，但未明确使用LLM；2）与’Pre-training’和’Post-training/SFT’（各5分）相关，涉及模型训练；3）与’Instruction Tuning’（8分）高度相关，因为模型专门设计用于遵循驾驶指令；4）与’Chain of Thought’（5分）有一定关联，涉及推理过程；5）与’LLM Agents’（8分）高度相关，因为模型作为自主驾驶代理；6）与’World Models’（8分）高度相关，因为模型包含世界建模组件用于未来预测。其他关键词如MoE、SLMs、RAG、量化等与论文内容无关，得0分。

视觉-语言-行动模型重塑了自动驾驶领域，将语言模态纳入决策过程。然而，现有的大多数流程仅将语言模态用于场景描述或推理，缺乏遵循多样化用户指令以实现个性化驾驶的灵活性。为解决这一问题，我们首先构建了一个大规模驾驶数据集（InstructScene），包含约10万个场景，每个场景均标注了多样化的驾驶指令及对应的轨迹。随后，我们提出了一种统一的视觉-语言-世界-行动模型（Vision-Language-World-Action model）——Vega，用于基于指令的生成与规划。我们采用自回归范式处理视觉输入（视觉）和语言指令（语言），并采用扩散范式生成未来预测（世界建模）和轨迹（行动）。通过联合注意力机制实现多模态间的交互，并为不同模态使用独立的投影层以增强模型能力。大量实验表明，我们的方法不仅实现了卓越的规划性能，还展现出强大的指令遵循能力，为更智能、个性化的驾驶系统开辟了道路。

Vision-language-action models have reshaped autonomous driving to incorporate languages into the decision-making process. However, most existing pipelines only utilize the language modality for scene descriptions or reasoning and lack the flexibility to follow diverse user instructions for personalized driving. To address this, we first construct a large-scale driving dataset (InstructScene) containing around 100,000 scenes annotated with diverse driving instructions with the corresponding trajectories. We then propose a unified Vision-Language-World-Action model, Vega, for instruction-based generation and planning. We employ the autoregressive paradigm to process visual inputs (vision) and language instructions (language) and the diffusion paradigm to generate future predictions (world modeling) and trajectories (action). We perform joint attention to enable interactions between the modalities and use individual projection layers for different modalities for more capabilities. Extensive experiments demonstrate that our method not only achieves superior planning performance but also exhibits strong instruction-following abilities, paving the way for more intelligent and personalized driving systems.

评分理由: 论文专注于计算机视觉领域的细粒度面部表情编辑，提出PixelSmile扩散框架和FFE数据集，研究内容涉及图像生成、语义解耦和对比学习，但完全不涉及大语言模型、深度学习技术原理创新或科学领域应用。所有关键词均与大模型、深度学习技术原理或AI for Science相关，而本文是纯粹的计算机视觉/图像处理研究，因此所有关键词相关度均为0。

细粒度面部表情编辑长期以来受限于内在的语义重叠问题。为解决此问题，我们构建了带有连续情感标注的Flex面部表情数据集，并建立了FFE-Bench评估体系，用于衡量结构混淆度、编辑准确性、线性可控性以及表情编辑与身份保持之间的平衡。我们提出PixelSmile——一种通过完全对称联合训练实现表情语义解耦的扩散框架。该框架结合强度监督与对比学习，以生成更强烈且更具区分度的表情，并通过文本潜在空间插值实现精确稳定的线性表情控制。大量实验表明，PixelSmile实现了卓越的解耦效果与鲁棒的身份保持能力，证实了其在连续、可控、细粒度表情编辑方面的有效性，同时天然支持平滑的表情融合。

Fine-grained facial expression editing has long been limited by intrinsic semantic overlap. To address this, we construct the Flex Facial Expression (FFE) dataset with continuous affective annotations and establish FFE-Bench to evaluate structural confusion, editing accuracy, linear controllability, and the trade-off between expression editing and identity preservation. We propose PixelSmile, a diffusion framework that disentangles expression semantics via fully symmetric joint training. PixelSmile combines intensity supervision with contrastive learning to produce stronger and more distinguishable expressions, achieving precise and stable linear expression control through textual latent interpolation. Extensive experiments demonstrate that PixelSmile achieves superior disentanglement and robust identity preservation, confirming its effectiveness for continuous, controllable, and fine-grained expression editing, while naturally supporting smooth expression blending.

评分理由: 论文专注于视频扩散模型，特别是解决长视频生成中的KV-cache增长问题。与关键词列表高度相关的只有"KV Cache Compression OR Linear Attention OR FlashAttention”（得10分），因为论文的核心创新是提出了一种三部分KV-cache策略来压缩历史上下文，直接涉及KV缓存压缩技术。其他关键词均与论文内容无关，论文未涉及大语言模型、对齐、推理、代理、科学AI等主题。

自回归视频扩散模型已取得显著进展，但在生成长视频时仍受限于难以处理的线性KV缓存增长、时间重复性以及误差累积问题。为应对这些挑战，我们提出了PackForcing——一个通过新颖的三分区KV缓存策略高效管理生成历史的统一框架。具体而言，我们将历史上下文划分为三种不同类型：(1) 锚定令牌(Sink tokens)，以完整分辨率保留早期锚定帧以维持全局语义；(2) 中间令牌(Mid tokens)，通过融合渐进式3D卷积与低分辨率VAE重编码的双分支网络，实现大规模时空压缩（令牌量减少32倍）；(3) 近期令牌(Recent tokens)，保持完整分辨率以确保局部时间连贯性。为在保证质量的同时严格限制内存占用，我们为中间令牌引入了动态top-$k$上下文选择机制，并结合连续时间旋转位置编码调整(Temporal RoPE Adjustment)，以可忽略的开销无缝重新对齐因令牌丢弃产生的位置间隙。凭借这种层次化上下文压缩机制，PackForcing可在单张H200 GPU上生成连贯的2分钟、832x480分辨率、16帧/秒的视频。其KV缓存严格限制在4GB，并实现惊人的24倍时间外推能力（从5秒到120秒），无论是零样本运行还是仅用5秒片段训练均能有效工作。在VBench上的大量实验结果表明，该方法在时间一致性（26.07）和动态程度（56.25）指标上达到最先进水平，证明短视频监督足以实现高质量的长视频合成。https://github.com/ShandaAI/PackForcing

Autoregressive video diffusion models have demonstrated remarkable progress, yet they remain bottlenecked by intractable linear KV-cache growth, temporal repetition, and compounding errors during long-video generation. To address these challenges, we present PackForcing, a unified framework that efficiently manages the generation history through a novel three-partition KV-cache strategy. Specifically, we categorize the historical context into three distinct types: (1) Sink tokens, which preserve early anchor frames at full resolution to maintain global semantics; (2) Mid tokens, which achieve a massive spatiotemporal compression (32x token reduction) via a dual-branch network fusing progressive 3D convolutions with low-resolution VAE re-encoding; and (3) Recent tokens, kept at full resolution to ensure local temporal coherence. To strictly bound the memory footprint without sacrificing quality, we introduce a dynamic top-$k$ context selection mechanism for the mid tokens, coupled with a continuous Temporal RoPE Adjustment that seamlessly re-aligns position gaps caused by dropped tokens with negligible overhead. Empowered by this principled hierarchical context compression, PackForcing can generate coherent 2-minute, 832x480 videos at 16 FPS on a single H200 GPU. It achieves a bounded KV cache of just 4 GB and enables a remarkable 24x temporal extrapolation (5s to 120s), operating effectively either zero-shot or trained on merely 5-second clips. Extensive results on VBench demonstrate state-of-the-art temporal consistency (26.07) and dynamic degree (56.25), proving that short-video supervision is sufficient for high-quality, long-video synthesis. https://github.com/ShandaAI/PackForcing

评分理由: 论文聚焦于智能体（agent）的harness工程，提出自然语言agent harnesses（NLAHs）和智能harness运行时（IHR），核心涉及LLM agents、工具使用和agent协调。与LLM agents高度相关（10分），因为研究agent harness设计；与tool use相关（8分），涉及agent控制逻辑和API使用；与multi-agent systems有一定关联（5分），涉及agent协调和模块化设计。其他关键词如LLMs（8分）作为基础技术相关，但论文不涉及具体LLM技术细节。大部分关键词（如MoE、量化、推理加速等）与论文内容无关，得0分。

智能体性能日益依赖于线束工程，然而线束设计通常深嵌于控制器代码和运行时特定规范中，使其难以作为科学对象进行迁移、比较和研究。我们探讨是否可以将智能体线束的高层控制逻辑外部化为一种可移植的可执行构件。我们提出自然语言智能体线束（Natural-Language Agent Harnesses，NLAHs），该框架以可编辑的自然语言表达线束行为；同时引入智能线束运行时（Intelligent Harness Runtime，IHR），这是一个通过显式契约、持久化构件和轻量适配器来执行这些线束的共享运行时环境。在编程与计算机使用基准测试中，我们对操作可行性、模块消融以及代码到文本的线束迁移进行了对照评估。

Agent performance increasingly depends on \emph{harness engineering}, yet harness design is usually buried in controller code and runtime-specific conventions, making it hard to transfer, compare, and study as a scientific object. We ask whether the high-level control logic of an agent harness can instead be externalized as a portable executable artifact. We introduce \textbf{Natural-Language Agent Harnesses} (NLAHs), which express harness behavior in editable natural language, and \textbf{Intelligent Harness Runtime} (IHR), a shared runtime that executes these harnesses through explicit contracts, durable artifacts, and lightweight adapters. Across coding and computer-use benchmarks, we conduct controlled evaluations of operational viability, module ablation, and code-to-text harness migration.

评分理由: 论文提出了一种强化学习框架RC2，通过跨模态循环一致性来改善多模态推理，核心关注推理过程（Chain of Thought/System 2 Thinking）和自我改进（Self-Correction），但与大多数关键词（如LLM技术、训练方法、优化技术等）无直接关联。

稳健的感知与推理需要跨感官模态的一致性。然而当前的多模态模型常违背这一原则，对同一概念的视觉与文本表征产生矛盾预测。不同于采用可能放大系统性偏差的标准投票机制掩盖这些缺陷，我们证明跨模态不一致性为学习提供了丰富而自然的信号。我们提出RC2——一种通过强制跨模态循环一致性来解决内部冲突的强化学习框架。通过要求模型执行反向推理、切换模态并可靠地通过前向推理重构答案，我们获得了密集且无需标注的奖励。这种循环约束促使模型自主对齐其内部表征。针对该结构的优化减轻了特定模态的误差，并将推理准确率最高提升7.6个百分点。我们的研究结果表明，高级推理能力的涌现不仅源于数据规模的扩展，更得益于对世界构建结构一致的理解。

Robust perception and reasoning require consistency across sensory modalities. Yet current multimodal models often violate this principle, yielding contradictory predictions for visual and textual representations of the same concept. Rather than masking these failures with standard voting mechanisms, which can amplify systematic biases, we show that cross-modal inconsistency provides a rich and natural signal for learning. We introduce RC2, a reinforcement learning framework that resolves internal conflicts by enforcing cross-modal cycle consistency. By requiring a model to perform backward inference, switch modalities, and reliably reconstruct the answer through forward inference, we obtain a dense, label-free reward. This cyclic constraint encourages the model to align its internal representations autonomously. Optimizing for this structure mitigates modality-specific errors and improves reasoning accuracy by up to 7.6 points. Our results suggest that advanced reasoning emerges not only from scaling data, but also from enforcing a structurally consistent understanding of the world.

评分理由: 论文研究通用编码代理在硬件优化中的应用，核心是构建和协调多个自主优化代理的工厂式流水线。这与’LLM Agents OR Autonomous Agents OR Agentic Workflow’和’Multi-agent Systems OR Agent Coordination’高度相关，因为论文明确涉及自主代理、代理协调和代理工作流。其他关键词主要涉及大模型技术原理、训练方法、推理优化、对齐、压缩等，论文未涉及这些具体技术，仅使用Claude Code作为工具，未讨论其内部机制或相关技术，因此评分为0。

本文通过实证研究探讨了未经硬件特定训练的通用编码代理能在多大程度上基于高层算法描述优化硬件设计。我们提出了一种代理工厂——一个两阶段流水线，用于构建并协调多个自主优化代理。
在第一阶段，流水线将设计分解为子内核，通过编译制导指令（pragma）和代码级转换独立优化每个子内核，并构建整数线性规划（ILP）模型，在面积约束下整合具有全局潜力的配置方案。
在第二阶段，流水线针对ILP筛选出的最优解启动N个专家代理，每个代理探索跨函数优化策略，例如编译制导指令重组、循环融合和内存重构等子内核分解未能涵盖的优化维度。
我们在HLS-Eval和Rodinia-HLS的12个内核上使用Claude Code（Opus 4.5/4.6）与AMD Vitis HLS工具链进行评估。将代理数量从1个增至10个时，平均可获得基线设计8.27倍的加速效果，且在复杂基准测试中提升更为显著：streamcluster超过20倍，kmeans达到约10倍。
所有基准测试中，代理在未经领域特定训练的情况下均能复现已知的硬件优化模式，且最优设计往往并非来自ILP排名最高的候选方案，这表明全局优化能发掘子内核搜索遗漏的改进空间。这些结果证实了代理规模扩展可作为高层次综合（HLS）优化中实用且有效的技术路径。

We present an empirical study of how far general-purpose coding agents – without hardware-specific training – can optimize hardware designs from high-level algorithmic specifications. We introduce an agent factory, a two-stage pipeline that constructs and coordinates multiple autonomous optimization agents. In Stage1, the pipeline decomposes a design into sub-kernels, independently optimizes each using pragma and code-level transformations, and formulates an Integer Linear Program (ILP) to assemble globally promising configurations under an area constraint. In Stage2, it launches $N$ expert agents over the top ILP solutions, each exploring cross-function optimizations such as pragma recombination, loop fusion, and memory restructuring that are not captured by sub-kernel decomposition. We evaluate the approach on 12 kernels from HLS-Eval and Rodinia-HLS using Claude Code (Opus~4.5/4.6) with AMD Vitis HLS. Scaling from 1 to 10 agents yields a mean $8.27\times$ speedup over baseline, with larger gains on harder benchmarks: streamcluster exceeds $20\times$ and kmeans reaches approximately $10\times$. Across benchmarks, agents consistently rediscover known hardware optimization patterns without domain-specific training, and the best designs often do not originate from top-ranked ILP candidates, indicating that global optimization exposes improvements missed by sub-kernel search. These results establish agent scaling as a practical and effective axis for HLS optimization.

评分理由: 论文研究的是传统机器学习管道（随机森林）到神经网络的转换，属于深度学习中的知识蒸馏和迁移学习范畴，但所有关键词都聚焦于大语言模型（LLMs）及其相关技术（如MoE、RLHF、RAG、量化等），而本文完全不涉及LLMs、大模型或任何语言模型技术，也未涉及AI for Science的具体应用，因此所有关键词相关度均为0。

迁移学习与知识蒸馏近来在深度学习领域备受关注。其中一种迁移方法——师生学习——已被证明能成功创建“小型”学生神经网络，以模仿规模更大、结构更复杂的“教师”网络的性能。本文研究了该方法的扩展应用：将基于非神经网络的机器学习流程作为教师模型，向神经网络学生模型进行知识迁移，从而实现对流程中各组件的联合优化，并为多种机器学习任务提供统一的推理引擎。具体而言，我们探索通过迁移学习将随机森林分类器替换为学生神经网络。我们在100个OpenML任务上测试了多种神经网络拓扑结构，这些任务中随机森林原本是最优解决方案之一。实验结果表明，在大多数任务中，若能选择恰当的神经网络超参数，学生神经网络确实能够有效模仿教师模型。我们还研究了利用随机森林辅助选择神经网络超参数的方法。

Transfer learning and knowledge distillation has recently gained a lot of attention in the deep learning community. One transfer approach, the student-teacher learning, has been shown to successfully create small'' student neural networks that mimic the performance of a much bigger and more complex teacher’’ networks. In this paper, we investigate an extension to this approach and transfer from a non-neural-based machine learning pipeline as teacher to a neural network (NN) student, which would allow for joint optimization of the various pipeline components and a single unified inference engine for multiple ML tasks. In particular, we explore replacing the random forest classifier by transfer learning to a student NN. We experimented with various NN topologies on 100 OpenML tasks in which random forest has been one of the best solutions. Our results show that for the majority of the tasks, the student NN can indeed mimic the teacher if one can select the right NN hyper-parameters. We also investigated the use of random forest for selecting the right NN hyper-parameters.

评分理由: 论文专注于视频世界模型（Video World Models）的特定内存机制问题，提出Hybrid Memory范式和HyDRA架构来解决动态主体在视野外时的连续性问题。虽然论文涉及世界模型（World Models），但仅限于视频领域的具体应用，并未涉及大语言模型（LLMs）、深度学习技术原理创新、或AI for Science等关键词。唯一高度相关的关键词是’World Models AND General World Models’，因为论文明确研究视频世界模型，但并非通用世界模型。其他所有关键词均与论文内容无关，论文未涉及语言模型、训练技术、推理方法、代理系统、模型优化等主题。

视频世界模型在模拟物理世界方面展现出巨大潜力，但现有记忆机制主要将环境视为静态画布。当动态目标暂时移出视野并随后重新出现时，当前方法往往难以应对，导致目标出现冻结、扭曲或消失等问题。为此，我们提出混合记忆（Hybrid Memory）这一新范式，要求模型同时充当静态背景的精确记录者与动态目标的敏锐追踪者，确保目标在离开视野期间的运动连续性。为推进该方向研究，我们构建了首个专注于混合记忆的大规模视频数据集HM-World，包含5.9万条高保真视频片段，其相机轨迹与目标运动轨迹完全解耦，涵盖17类多样场景、49种不同目标，并通过精心设计的进出视野事件以严格评估混合连贯性。此外，我们提出专用记忆架构HyDRA，该架构将记忆压缩为令牌，并采用时空相关性驱动的检索机制。通过选择性关注相关运动线索，HyDRA能有效保持隐藏目标的身份特征与运动状态。在HM-World上的大量实验表明，我们的方法在动态目标一致性与整体生成质量方面均显著优于现有先进方法。

Video world models have shown immense potential in simulating the physical world, yet existing memory mechanisms primarily treat environments as static canvases. When dynamic subjects hide out of sight and later re-emerge, current methods often struggle, leading to frozen, distorted, or vanishing subjects. To address this, we introduce Hybrid Memory, a novel paradigm requiring models to simultaneously act as precise archivists for static backgrounds and vigilant trackers for dynamic subjects, ensuring motion continuity during out-of-view intervals. To facilitate research in this direction, we construct HM-World, the first large-scale video dataset dedicated to hybrid memory. It features 59K high-fidelity clips with decoupled camera and subject trajectories, encompassing 17 diverse scenes, 49 distinct subjects, and meticulously designed exit-entry events to rigorously evaluate hybrid coherence. Furthermore, we propose HyDRA, a specialized memory architecture that compresses memory into tokens and utilizes a spatiotemporal relevance-driven retrieval mechanism. By selectively attending to relevant motion cues, HyDRA effectively preserves the identity and motion of hidden subjects. Extensive experiments on HM-World demonstrate that our method significantly outperforms state-of-the-art approaches in both dynamic subject consistency and overall generation quality.

评分理由: 论文提出Kitchen Loop框架，核心是利用LLM代理（LLM agent）作为合成用户进行软件测试和验证，实现自主、自演化的软件开发。这与’LLM Agents’高度相关（10分），因为LLM代理是系统的核心组件；与’Large Language Models’相关（8分），因为系统依赖LLM；与’Tool Use’相关（8分），因为LLM代理执行测试任务；与’Self-Correction’高度相关（10分），因为系统展示了多迭代自我纠正链和自主修复。其他关键词如MoE、SLMs、训练方法、推理优化、科学AI等均未涉及，得0分。

代码生产如今已成为一种商品；当前的瓶颈在于明确构建目标并验证其有效性。本文提出Kitchen Loop框架——一种基于统一信任模型的自主自演进软件架构，该模型包含四个核心组件：(1) 规格说明层：明确枚举产品声明支持的功能范围；(2) “千倍用户模拟”：通过LLM智能体以千倍于人类操作频度模拟超级用户对功能层进行验证；(3) 不可篡改测试：采用开发者无法伪造的基准真实验证机制；(4) 漂移控制：配备自动暂停阀门的持续质量监测体系。我们在两个生产系统中进行了285+次迭代验证，累计生成1,094+个合并请求，回归测试预言机（方法论见第6.1节）未检测到任何回归缺陷。我们观察到大规模运行中涌现的特性：多迭代自我修正链、自主基础设施修复能力以及单调改进的质量阀门。这些基础组件并非创新，我们的贡献在于将其整合为经过生产验证的系统，并通过严格的运维规范确保长期自主演进的安全性。

Code production is now a commodity; the bottleneck is knowing what to build and proving it works. We present the Kitchen Loop, a framework for autonomous, self-evolving software built on a unified trust model: (1) a specification surface enumerating what the product claims to support; (2) ‘As a User x 1000’, where an LLM agent exercises that surface as a synthetic power user at 1,000x human cadence; (3) Unbeatable Tests, ground-truth verification the code author cannot fake; and (4) Drift Control, continuous quality measurement with automated pause gates. We validate across two production systems over 285+ iterations, producing 1,094+ merged pull requests with zero regressions detected by the regression oracle (methodology in Section 6.1). We observe emergent properties at scale: multi-iteration self-correction chains, autonomous infrastructure healing, and monotonically improving quality gates. The primitives are not new; our contribution is their composition into a production-tested system with the operational discipline that makes long-running autonomous evolution safe.

评分理由: 论文专注于可信AI的硬件架构和内存系统优化，特别是针对概率计算的内存访问效率问题。虽然涉及AI系统，但所有关键词均与大模型、深度学习技术原理、AI应用或科学AI无关。论文未提及任何语言模型、训练方法、推理技术、代理系统或特定领域应用，因此所有关键词得分为0。

可信人工智能日益依赖概率计算以实现鲁棒性、可解释性、安全性与隐私保护。在实际系统中，此类工作负载将确定性数据访问与跨模型、数据路径及系统功能的重复随机采样交织在一起，使性能瓶颈从算术单元转移至必须同时提供数据与随机性的存储系统。本文提出一种统一的数据访问视角，将确定性访问视为随机采样的极限情况，使两种模式能在共同框架内被分析。这一视角揭示：随机性需求的增长会降低有效数据访问效率，并可能驱动系统进入熵受限运行状态。基于此洞见，我们定义了存储器层级的评估标准，包括统一操作、分布可编程性、效率、对硬件非理想性的鲁棒性以及并行兼容性。运用这些标准，我们分析了传统架构的局限性，并考察了将采样与内存访问相结合的新兴概率存内计算方法，从而为可信人工智能的可扩展硬件发展指明了路径。

Trustworthy artificial intelligence increasingly relies on probabilistic computation to achieve robustness, interpretability, security and privacy. In practical systems, such workloads interleave deterministic data access with repeated stochastic sampling across models, data paths and system functions, shifting performance bottlenecks from arithmetic units to memory systems that must deliver both data and randomness. Here we present a unified data-access perspective in which deterministic access is treated as a limiting case of stochastic sampling, enabling both modes to be analyzed within a common framework. This view reveals that increasing stochastic demand reduces effective data-access efficiency and can drive systems into entropy-limited operation. Based on this insight, we define memory-level evaluation criteria, including unified operation, distribution programmability, efficiency, robustness to hardware non-idealities and parallel compatibility. Using these criteria, we analyze limitations of conventional architectures and examine emerging probabilistic compute-in-memory approaches that integrate sampling with memory access, outlining pathways toward scalable hardware for trustworthy AI.

评分理由: 该论文研究跨视角地理定位（CVGL），通过自回归缩放方法在城市尺度卫星地图上进行定位，属于计算机视觉和地理信息系统领域。论文未涉及任何大语言模型、深度学习技术原理、AI for Science或相关关键词中的技术，所有关键词均与大模型、深度学习、AI科学应用无关，因此所有关键词相关度均为0分。

跨视角地理定位（CVGL）通过将街景图像与地理参照的俯视图像进行匹配来估计相机位置，实现在无GPS信号环境下的定位与导航。现有方法几乎普遍将CVGL构建为对比训练嵌入空间中的图像检索问题。这使得模型性能依赖于大批次训练和困难负样本挖掘，同时忽略了地图的几何结构以及街景与俯视图像之间的覆盖范围不匹配问题。具体而言，从街景视角可见的显著地标可能落在固定的卫星图像裁剪区域之外，导致检索目标模糊并限制了在地图上进行显式空间推理的能力。我们提出“精准缩放”方法，这是一种通过在城市尺度俯视地图上进行自回归缩放来实现CVGL的新范式。该方法从粗粒度卫星视图开始，模型通过一系列简短的缩放决策序列，在目标分辨率下选择终端卫星图像单元，无需依赖对比损失或困难负样本挖掘。我们进一步引入一个包含众包街景数据和高分辨率卫星影像的现实基准数据集，该数据集反映了真实的采集条件。在此基准测试中，“精准缩放”方法取得了最先进的性能，相较于最强的对比检索基线模型，在50米范围内的Recall@1指标提升了5.5%，在100米范围内的Recall@1指标提升了9.6%。这些结果证明了从粗到细的序列化空间推理在跨视角地理定位任务中的有效性。

Cross-view geo-localization (CVGL) estimates a camera’s location by matching a street-view image to geo-referenced overhead imagery, enabling GPS-denied localization and navigation. Existing methods almost universally formulate CVGL as an image-retrieval problem in a contrastively trained embedding space. This ties performance to large batches and hard negative mining, and it ignores both the geometric structure of maps and the coverage mismatch between street-view and overhead imagery. In particular, salient landmarks visible from the street view can fall outside a fixed satellite crop, making retrieval targets ambiguous and limiting explicit spatial inference over the map. We propose Just Zoom In, an alternative formulation that performs CVGL via autoregressive zooming over a city-scale overhead map. Starting from a coarse satellite view, the model takes a short sequence of zoom-in decisions to select a terminal satellite cell at a target resolution, without contrastive losses or hard negative mining. We further introduce a realistic benchmark with crowd-sourced street views and high-resolution satellite imagery that reflects real capture conditions. On this benchmark, Just Zoom In achieves state-of-the-art performance, improving Recall@1 within 50 m by 5.5% and Recall@1 within 100 m by 9.6% over the strongest contrastive-retrieval baseline. These results demonstrate the effectiveness of sequential coarse-to-fine spatial reasoning for cross-view geo-localization.