评分理由: 论文核心研究大语言模型（LLMs）在医学问答（AI for Science子领域）中的自我反思（Self-Correction/Self-Reflection）能力，并采用链式思维（Chain of Thought）提示方法进行评估；因此与"Large Language Models"、“Chain of Thought”、“Self-Correction"和"AI for Science"高度相关（10分）。论文涉及推理透明度与正确性的分析，与"System 2 Thinking"和"Explainable AI"有一定关联（5分）；同时探讨模型可靠性，与"Hallucination Mitigation"部分相关（5分）。其他关键词如MoE、SFT、RAG等未在研究中涉及，评为0分。

大语言模型（LLM）在医学问答任务上已展现出强劲性能，而思维链提示通过引导模型进行显式的中间推理进一步提升了结果；与此同时，自我反思（自我校正）提示被广泛认为能通过促使大语言模型批判和修正自身推理来增强模型可靠性，但其在安全关键的医疗场景中的有效性仍不明确。本研究对医学多项选择题问答中的自我反思推理进行了探索性分析：使用GPT-4o和GPT-4o-mini模型，我们比较了标准思维链提示与迭代式自我反思循环的效果，并在三个广泛使用的医学问答基准数据集（MedQA、HeadQA和PubMedQA）上追踪了预测结果在反思步骤中的演变过程。我们分析了自我反思是否会导致错误修正、错误持续或引入新错误。研究结果表明，自我反思提示并不能持续提升准确性，其效果高度依赖于数据集和模型：在MedQA上带来有限增益，但在HeadQA和PubMedQA上收益甚微或产生负面影响，且增加反思步骤数并不能保证性能提升。这些发现揭示了推理透明度与推理正确性之间的差距，表明自我反思推理更适合被视为理解模型行为的分析工具，而非提升医学问答可靠性的独立解决方案。

Large language models (LLMs) have achieved strong performance on medical question answering (medical QA), and chain-of-thought (CoT) prompting has further improved results by eliciting explicit intermediate reasoning; meanwhile, self-reflective (self-corrective) prompting has been widely claimed to enhance model reliability by prompting LLMs to critique and revise their own reasoning, yet its effectiveness in safety-critical medical settings remains unclear. In this work, we conduct an exploratory analysis of self-reflective reasoning for medical multiple-choice question answering: using GPT-4o and GPT-4o-mini, we compare standard CoT prompting with an iterative self-reflection loop and track how predictions evolve across reflection steps on three widely used medical QA benchmarks (MedQA, HeadQA, and PubMedQA). We analyze whether self-reflection leads to error correction, error persistence, or the introduction of new errors. Our results show that self-reflective prompting does not consistently improve accuracy and its impact is highly dataset- and model-dependent: it yields modest gains on MedQA but provides limited or negative benefits on HeadQA and PubMedQA, and increasing the number of reflection steps does not guarantee better performance. These findings highlight a gap between reasoning transparency and reasoning correctness, suggesting that self-reflective reasoning is better viewed as an analytical tool for understanding model behavior rather than a standalone solution for improving medical QA reliability.

评分理由: 论文提出HippoCamp基准，专门评估多模态大语言模型（MLLMs）和智能体在个人计算机环境中的文件管理能力，涉及搜索、证据感知和多步推理。核心相关关键词包括：‘Large Language Models’（论文明确评估MLLMs）、‘LLM Agents’（评估智能体方法）、‘Chain of Thought’（评估多步推理能力）。中等相关关键词：‘Retrieval-Augmented Generation’（涉及检索和生成）、‘Context Window Extension’（处理大量个人文件需要长上下文）、‘System 2 Thinking’（涉及深度推理）、‘Tool Use’（智能体可能使用工具进行文件管理）。其他关键词如MoE、量化、对齐等未在论文中涉及，评分为0。

我们推出HippoCamp——一个旨在评估智能体多模态文件管理能力的新型基准测试平台。与现有聚焦于通用场景下网络交互、工具使用或软件自动化等任务的智能体基准不同，HippoCamp将智能体置于以用户为中心的环境中，要求其建模个体用户画像并在海量个人文件中进行上下文感知推理。本基准基于覆盖多模态的真实世界用户画像实例化设备级文件系统，包含超过2000个真实文件，数据总量达42.4 GB。基于原始文件，我们构建了581组问答对以评估智能体的搜索能力、证据感知能力和多步推理能力。为支持细粒度分析，我们提供了4.61万条密集标注的结构化轨迹用于逐步故障诊断。我们在HippoCamp上评估了多种前沿的多模态大语言模型（MLLMs）与智能体方法。综合实验结果表明存在显著性能差距：即使在用户画像建模任务中，最先进的商业模型准确率也仅达48.3%，尤其在密集个人文件系统内的长程检索与跨模态推理方面表现欠佳。进一步的逐步故障诊断表明，多模态感知与证据锚定是当前的主要瓶颈。最终，HippoCamp揭示了现有智能体在真实用户中心环境中的关键局限，并为开发下一代个人人工智能助手奠定了坚实基础。

We present HippoCamp, a new benchmark designed to evaluate agents’ capabilities on multimodal file management. Unlike existing agent benchmarks that focus on tasks like web interaction, tool use, or software automation in generic settings, HippoCamp evaluates agents in user-centric environments to model individual user profiles and search massive personal files for context-aware reasoning. Our benchmark instantiates device-scale file systems over real-world profiles spanning diverse modalities, comprising 42.4 GB of data across over 2K real-world files. Building upon the raw files, we construct 581 QA pairs to assess agents’ capabilities in search, evidence perception, and multi-step reasoning. To facilitate fine-grained analysis, we provide 46.1K densely annotated structured trajectories for step-wise failure diagnosis. We evaluate a wide range of state-of-the-art multimodal large language models (MLLMs) and agentic methods on HippoCamp. Our comprehensive experiments reveal a significant performance gap: even the most advanced commercial models achieve only 48.3% accuracy in user profiling, struggling particularly with long-horizon retrieval and cross-modal reasoning within dense personal file systems. Furthermore, our step-wise failure diagnosis identifies multimodal perception and evidence grounding as the primary bottlenecks. Ultimately, HippoCamp exposes the critical limitations of current agents in realistic, user-centric environments and provides a robust foundation for developing next-generation personal AI assistants.

评分理由: 论文提出EVOM框架，使用LLMs（核心）将自然语言问题自动转化为优化建模代码，并通过执行验证的强化学习（GRPO和DAPO）进行训练，这直接涉及"Post-training/SFT”（与监督微调对比）、“RLHF/RLAIF/DPO”（使用GRPO和DAPO）、“LLM Agents”（自动化建模流程）和"Tool Use"（调用求解器API）。其他关键词如MoE、Scaling Laws、PEFT、RAG等未在摘要中提及，与论文内容无关。

利用大语言模型实现优化建模自动化是通向可扩展决策智能的一条前景广阔的路径，但现有方法要么依赖于基于闭源大语言模型构建的高推理延迟智能体流程，要么采用成本高昂的过程监督对较小模型进行微调，而这类方法常会过度适配单一求解器接口。受可验证奖励强化学习的启发，我们提出了执行验证优化建模（Execution-Verified Optimization Modeling, EVOM），这是一个执行验证学习框架，将数学规划求解器视为一个确定性的交互式验证器。给定自然语言描述的问题和目标求解器，EVOM生成针对特定求解器的代码，在沙箱环境中执行该代码，并将执行结果转化为标量奖励，通过GRPO和DAPO方法在“生成-执行-反馈-更新”的闭环流程中进行优化。这种仅基于结果的范式消除了对过程级监督的需求，并通过切换验证环境而非重建针对特定求解器的数据集，实现了跨求解器的泛化能力。在NL4OPT、MAMO、IndustryOR和OptiBench数据集上，针对Gurobi、OR-Tools和COPT等求解器的实验表明，EVOM达到或超越了过程监督的监督微调方法，支持零样本求解器迁移，并能通过在目标求解器后端下持续训练，实现高效低成本的求解器适配。

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency, or fine-tune smaller LLMs using costly process supervision that often overfits to a single solver API. Inspired by reinforcement learning with verifiable rewards, we propose Execution-Verified Optimization Modeling (EVOM), an execution-verified learning framework that treats a mathematical programming solver as a deterministic, interactive verifier. Given a natural-language problem and a target solver, EVOM generates solver-specific code, executes it in a sandboxed harness, and converts execution outcomes into scalar rewards, optimized with GRPO and DAPO in a closed-loop generate-execute-feedback-update process. This outcome-only formulation removes the need for process-level supervision, and enables cross-solver generalization by switching the verification environment rather than reconstructing solver-specific datasets. Experiments on NL4OPT, MAMO, IndustryOR, and OptiBench across Gurobi, OR-Tools, and COPT show that EVOM matches or outperforms process-supervised SFT, supports zero-shot solver transfer, and achieves effective low-cost solver adaptation by continuing training under the target solver backend.

评分理由: 论文核心研究对齐语言模型的行为问题（逃避式仆人现象）并提出Dignified Peer框架，直接涉及LLM对齐、DPO算法和LLM智能体构建，因此"Large Language Models"、“Instruction Tuning/Alignment”、“RLHF/DPO"和"LLM Agents"均获得10分（核心内容）。“Hallucination Mitigation"获得5分，因为论文关注可信度/真实性（trustworthiness）与幻觉缓解有一定关联。其他关键词在论文中未明确涉及，得0分。

当前的对齐语言模型表现出一种我们称之为“回避型仆人”的双重失效模式：它们会谄媚地认可用户有缺陷的信念，同时用模板化的免责声明来推卸责任。我们提出了“尊严对等体”框架，该框架通过反谄媚性和可信赖性来对抗顺从性，并通过同理心和创造力来缓解回避性。实现这一智能体需要克服数据监督、目标坍缩和评估偏见方面的重大挑战。我们通过引入PersonaKnob数据集来解决这些问题，该数据集具有多个人格偏好的组合偏序结构。这些数据与一种宽容的约束拉格朗日DPO算法结合使用，该算法动态平衡所有人格维度以防止行为坍缩。此外，我们采用了一种经心理测量学校准的项目反应理论评估方案，以将潜在模型的人格能力与评估者偏见等混杂因素区分开来。大量的实证研究表明，我们的方法成功构建了一个兼具尊严与对等性的LLM智能体。

Current aligned language models exhibit a dual failure mode we term the Evasive Servant: they sycophantically validate flawed user beliefs while deflecting responsibility with boilerplate disclaimers. We propose the Dignified Peer framework, which counters servility with anti-sycophancy and trustworthiness, and mitigates evasiveness through empathy and creativity. Realizing this agent requires overcoming significant challenges in data supervision, objective collapse, and evaluation bias. We address these issues by introducing the PersonaKnob dataset which features a compositional partial order structure of multiple persona preference. This data is utilized alongside a tolerant constrained Lagrangian DPO algorithm that dynamically balances all persona dimensions to prevent behavioral collapse. Additionally, we employ a psychometrically calibrated Item Response Theory evaluation protocol to disentangle latent model persona capability from confounders like judge biases. Extensive empirical studies demonstrate that our approach successfully build a LLM agent with both dignity and peer.

评分理由: 论文MOON3.0专注于多模态大语言模型（MLLMs）在电子商务产品理解中的应用，核心是利用MLLMs的推理能力显式建模细粒度产品属性。因此，与"Large Language Models"高度相关（10分），因为MLLMs是LLMs的扩展；与"Supervised Fine-tuning"高度相关（10分），因为论文明确提到SFT的局限性并提出了改进方法；与"Chain of Thought"和"System 2 Thinking"高度相关（10分），因为论文强调推理能力（reasoning-aware）和多步推理策略；与"Context Window Extension"有一定关联（5分），因为论文提到长上下文推理的挑战。其他关键词如MoE、SLMs、Scaling Laws、RLHF、RAG、Quantization等未在摘要中提及或与论文主题无关，故得0分。

随着电子商务的快速发展，探索通用表征而非任务特定表征已引起越来越多的关注。尽管近期多模态大语言模型（MLLMs）在商品理解方面推动了显著进展，但它们通常被用作特征提取器，将商品信息隐式编码为全局嵌入，从而限制了其捕捉细粒度属性的能力。因此，我们认为利用MLLMs的推理能力来显式建模细粒度商品属性具有重要潜力。然而，由于几个关键挑战，实现这一目标仍非易事：（i）长上下文推理容易稀释模型对原始输入中显著信息的注意力；（ii）监督微调（SFT）主要鼓励僵化模仿，限制了有效推理策略的探索；（iii）细粒度细节在前向传播过程中逐渐衰减。为解决这些问题，我们提出了MOON3.0，这是首个基于MLLM的推理感知商品表征学习模型。我们的方法（1）采用多头模态融合模块自适应整合原始信号；（2）结合联合对比与强化学习框架，自主探索更有效的推理策略；（3）引入细粒度残差增强模块，在整个网络中逐步保留局部细节。此外，我们发布了一个大规模多模态电子商务基准MBE3.0。实验表明，我们的模型在自建基准和公共数据集的各种下游任务中均展现出领先的零样本性能。

With the rapid growth of e-commerce, exploring general representations rather than task-specific ones has attracted increasing attention. Although recent multimodal large language models (MLLMs) have driven significant progress in product understanding, they are typically employed as feature extractors that implicitly encode product information into global embeddings, thereby limiting their ability to capture fine-grained attributes. Therefore, we argue that leveraging the reasoning capabilities of MLLMs to explicitly model fine-grained product attributes holds significant potential. Nevertheless, achieving this goal remains non-trivial due to several key challenges: (i) long-context reasoning tends to dilute the model’s attention to salient information in the raw input; (ii) supervised fine-tuning (SFT) primarily encourages rigid imitation, limiting the exploration of effective reasoning strategies; and (iii) fine-grained details are progressively attenuated during forward propagation. To address these issues, we propose MOON3.0, the first reasoning-aware MLLM-based model for product representation learning. Our method (1) employs a multi-head modality fusion module to adaptively integrate raw signals; (2) incorporates a joint contrastive and reinforcement learning framework to autonomously explore more effective reasoning strategies; and (3) introduces a fine-grained residual enhancement module to progressively preserve local details throughout the network. Additionally, we release a large-scale multimodal e-commerce benchmark MBE3.0. Experimentally, our model demonstrates state-of-the-art zero-shot performance across various downstream tasks on both our benchmark and public datasets.

评分理由: 论文核心研究多模态大语言模型（LLMs）在识别误导性可视化方面的能力，因此与"Large Language Models"高度相关（10分）。论文评估了包括小型模型（如Nemotron-Nano-V2-VL）在内的多种模型，因此与"Small Language Models"有一定关联（5分）。研究涉及模型对误导性内容的识别和解释，这需要推理能力，因此与"Chain of Thought"和"System 2 Thinking"有一定关联（各5分）。论文关注误导性可视化（即"lies”）的识别，这与事实性和幻觉缓解相关，因此与"Hallucination Mitigation"高度相关（8分）。研究还比较了模型与人类专家的行为，以提供见解，这涉及可解释性，因此与"Mechanistic Interpretability"高度相关（8分）。其他关键词（如MoE、Scaling Laws、Pre-training、RLHF等）在论文中未涉及或仅为背景提及，因此评分为0分。

本研究探讨了多模态大语言模型（LLMs）识别与解读误导性可视化图表的能力，以及其对这些观察结果、背后成因及潜在意图的认知。我们运用可视化修辞学概念及一套新构建的作者意图分类法作为解释框架。通过提出三个研究问题，我们利用包含2,336条与COVID-19相关推文的数据集进行了实验分析，其中半数推文含有误导性可视化内容，并辅以来自IEEE VIS社区专注于展示欺骗性与误导性可视化图表的活动VisLies中提取的真实案例，这些案例涵盖了感知、认知和概念层面的错误。为确保全面覆盖当前LLMs的发展现状，我们评估了16个前沿模型，其中15个为开放权重模型，涵盖了广泛的模型规模、架构家族及推理能力。所选模型包括小型模型：Nemotron-Nano-VL2（120亿参数）、Mistral-Small-3.2（240亿）、DeepSeek-VL2（270亿）、Gemma3（270亿）和GTA1（320亿）；中型模型：Qianfan-VL（700亿）、Molmo（720亿）、GLM-4.5V（1080亿）、LLaVA-NeXT（1100亿）和Pixtral-Large（1240亿）；大型模型：Qwen3-VL（2350亿）、InternVL3.5（2410亿）、Step3（3210亿）、Llama-4-Maverick（4000亿）和Kimi-K2.5（10000亿）。此外，我们还采用了前沿的专有模型OpenAI GPT-5.4。为建立人类对这些任务的认知基准，我们同时开展了可视化专家用户研究，以评估人类如何理解相同误导性可视化图表中的修辞技巧及作者意图。这使得模型与专家行为之间的比较成为可能，揭示了二者的相似性与差异性，从而深入洞察大语言模型在哪些方面与人类判断一致，在哪些方面存在分歧。

This study investigates the ability of multimodal Large Language Models (LLMs) to identify and interpret misleading visualizations, and recognize these observations along with their underlying causes and potential intentionality. Our analysis leverages concepts from visualization rhetoric and a newly developed taxonomy of authorial intents as explanatory lenses. We formulated three research questions and addressed them experimentally using a dataset of 2,336 COVID-19-related tweets, half of which contain misleading visualizations, and supplemented it with real-world examples of perceptual, cognitive, and conceptual errors drawn from VisLies, the IEEE VIS community event dedicated to showcasing deceptive and misleading visualizations. To ensure broad coverage of the current LLM landscape, we evaluated 16 state-of-the-art models. Among them, 15 are open-weight models, spanning a wide range of model sizes, architectural families, and reasoning capabilities. The selection comprises small models, namely Nemotron-Nano-V2-VL (12B parameters), Mistral-Small-3.2 (24B), DeepSeek-VL2 (27B), Gemma3 (27B), and GTA1 (32B); medium-sized models, namely Qianfan-VL (70B), Molmo (72B), GLM-4.5V (108B), LLaVA-NeXT (110B), and Pixtral-Large (124B); and large models, namely Qwen3-VL (235B), InternVL3.5 (241B), Step3 (321B), Llama-4-Maverick (400B), and Kimi-K2.5 (1000B). In addition, we employed OpenAI GPT-5.4, a frontier proprietary model. To establish a human perspective on these tasks, we also conducted a user study with visualization experts to assess how people perceive rhetorical techniques and the authorial intentions behind the same misleading visualizations. This allows comparison between model and expert behavior, revealing similarities and differences that provide insights into where LLMs align with human judgment and where they diverge.

评分理由: 论文核心研究将预训练文本大语言模型（LLMs）通过持续预训练适应为语音语言模型（Speech LMs），并提出了Multimodal Depth Upscaling方法。因此，与"Large Language Models"和"Pre-training/Continual Pre-training"高度相关（10分）。论文明确使用了SmolLM2模型（属于Small Language Models范畴）进行实验，故"Small Language Models"得10分。论文将提出的方法与LoRA（一种PEFT技术）进行比较，并涉及参数高效微调，故"PEFT/LoRA"得10分。其他关键词如MoE、Scaling Laws、SFT、Alignment、RAG等均未在摘要中提及或与核心内容无关，故得0分。

通过在海量语音数据上进行持续预训练，将预训练的文本大语言模型（LLMs）适配为语音语言模型（Speech LMs）具有广阔前景，但这一过程常导致模型原有的文本能力下降。我们提出多模态深度扩展方法，该方法是对持续大语言模型预训练中一种新兴策略的扩展：在冻结的文本大语言模型中插入新的Transformer层，并仅使用语音数据训练这些新增层。基于SmolLM2-360M和SmolLM2-1.7B模型，在4.8万小时英语自动语音识别（ASR）数据上的实验表明，深度扩展方法能达到与全参数微调相当的ASR性能，同时其导致的文本能力退化远低于全参数微调和低秩自适应（LoRA）。我们进一步证明，将专为语音识别设计的E-Branchformer架构作为插入层，在较大模型上实现的ASR性能可匹配甚至超越全参数微调，同时将文本能力退化降低75%以上，且可训练参数减少了60%。

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling, an extension of an emerging strategy in continual LLM pre-training, where new transformer layers are inserted into a frozen text LLM and only the added layers are trained on speech data. Experiments with SmolLM2-360M and SmolLM2-1.7B on 48k hours of English Automatic Speech Recognition (ASR) data show that depth up-scaling achieves ASR comparable to full fine-tuning while causing far less text degradation than both full fine-tuning and Low-Rank Adaptation (LoRA). We further show that incorporating E-Branchformer, an architecture designed for speech recognition, as the inserted layers achieves ASR that matches or surpasses full fine-tuning on the larger model while reducing text degradation by over 75% with 60% fewer trainable parameters.

评分理由: 论文提出了一种针对大型视觉语言模型（LVLMs）的无训练令牌剪枝框架IWP，核心是减少视觉令牌数量以降低计算成本。与"Large Language Models"高度相关（10分），因为LVLMs是大模型的一种。与"Quantization"和"Speculative Decoding"有一定关联（8分），因为令牌剪枝是一种模型压缩和推理加速技术。与"KV Cache Compression"和"Mechanistic Interpretability"有弱关联（5分），因为涉及注意力机制分析和效率优化。其他关键词如MoE、SFT、RAG等与论文内容无关（0分）。

大型视觉语言模型在图像与视频理解任务中展现出卓越性能，但其计算成本随视觉标记数量的增加而快速上升。现有的标记剪枝方法通过经验性策略缓解这一问题，却忽视了注意力机制的内在原理。本文基于注意力的对偶形式视角，提出一种无需训练的新型标记剪枝框架。我们将注意力重新表述为一个隐式线性层，其权重矩阵由多个秩为1的外积求和构成，每个外积由单个标记的键值对生成。因此，标记剪枝问题转化为选择这些秩1更新的最优子集，以最佳逼近原始对偶权重矩阵。将此视角扩展至大型视觉语言模型中的标准softmax注意力机制，我们推导出一种新的度量指标，可同时量化标记的信息强度与信息冗余度。为基于该度量高效选择子集，我们提出了渐进式分块最大边际相关性算法。大量实验表明，本方法在性能与效率之间实现了更优的平衡，同时为现有剪枝方法提供了新的理论视角。

Large Vision Language Models show impressive performance across image and video understanding tasks, yet their computational cost grows rapidly with the number of visual tokens. Existing token pruning methods mitigate this issue through empirical approaches while overlooking the internal mechanism of attention. In this paper, we propose a novel training free token pruning framework grounded in the dual form perspective of attention. We reformulate attention as an implicit linear layer whose weight matrix is the sum of rank 1 outer products, each generated by a single token’s key value pair. Token pruning thus reduces to selecting an optimal subset of these rank 1 updates that best approximates the original dual weight matrix. Extending this perspective to standard softmax attention in LVLMs, we derive a novel metric quantifying both a token’s information magnitude and information duplication. To efficiently select the subset with the proposed metric, we introduce Progressive Chunked Maximal Marginal Relevance. Extensive experiments demonstrate that our method achieves a better trade off between performance and efficiency, while providing another perspective on existing pruning approaches.

评分理由: 论文核心研究MoE系统在动态数据分布下的专家管理策略，提出’分子记忆’概念，属于大模型技术原理的创新。高度相关关键词：‘Mixture of Experts’（核心内容，15分），‘Large Language Models’（论文明确提及LLM开发，10分），‘Domain Adaptation’（研究领域适应问题，10分）。其他关键词如SLMs、Scaling Laws、SFT等未涉及，得0分。

我们展示了七组受控运行的实验结果，这些实验基于nanoFMT——一种采用动态混合专家（Mixture-of-Experts, MoE）管理的自由市场算法（Free-Market Algorithm, FMA）协调的Transformer模型。实验旨在回答高级大语言模型（LLM）开发中的一个核心问题：当MoE系统在数据分布动态变化下满负荷运行时，应如何管理其专家池？我们证明，采用成本惩罚的适应度指标，并结合为新专家设置的线性宽限期，能够构建一个通过多样化而非替换来积累领域专业知识的系统。核心成果体现在一项往返式领域切换实验中：当系统重返先前学习过的领域时，其恢复速度提升了9至11倍，且无需新增或替换任何专家。这种“分子记忆”效应——即休眠专家在其对应领域重现时得以保留并重新激活——在当前MoE管理方法中尚无先例。初步成本分析估算，在中等规模场景下，一个OpenAI级别的服务提供商采用此方法每年可节省约3910万美元成本，并减少27.1吉瓦时的能源消耗。

We present experimental results from seven controlled runs of nanoFMT, a Free-Market Algorithm (FMA) orchestrated transformer with dynamic Mixture-of-Experts (MoE) management. The experiments address a fundamental question for advanced LLM development: how should an MoE system manage its expert pool when operating at full capacity under changing data distributions? We demonstrate that cost-penalized fitness metrics, combined with a linear grace period for newborn experts, produce a system that accumulates domain expertise through diversification rather than replacement. The central result is a round-trip domain shift experiment showing 9-11x faster recovery when returning to a previously learned domain, with zero expert births or replacements required. This “molecular memory” effect – where dormant experts survive and reactivate when their domain returns – has no analogue in current MoE management approaches. A preliminary cost analysis estimates annual savings of $39.1M and 27.1 GWh energy reduction for an OpenAI-scale provider under a moderate scenario.

评分理由: 论文核心研究LLM agents生成工具库的质量评估，与"LLM Agents"和"Tool Use"高度相关（10分），属于大模型应用研究，因此"Large Language Models"也得10分。其他关键词如MoE、SLMs、Scaling Laws、训练方法、推理优化、AI for Science等均未在论文中涉及，得0分。

现代大语言模型（LLM）智能体在运行时越来越多地自主创建工具——从Python函数到API客户端——然而现有的基准测试几乎完全通过下游任务完成度来评估它们。这好比仅凭代码能否运行来评判软件工程师，而忽略了冗余性、回归问题和安全性。我们推出了EvolveTool-Bench，这是一个针对软件工程工作流中LLM生成工具库的诊断性基准测试。在三个需要实际工具执行的领域（专有数据格式、API编排和数值计算）中，我们定义了库级别的软件质量指标——复用性、冗余度、组合成功率、回归稳定性和安全性——同时引入衡量每个工具正确性、鲁棒性、通用性和代码质量的工具质量评分（Tool Quality Score）。在首次对代码级与策略级工具演化方法（ARISE vs. EvoSkill vs. 单次生成基线，涵盖99项任务和两种模型）的直接比较中，我们发现任务完成率相近的系统（63-68%）在工具库健康度上存在高达18%的差异，这揭示了仅关注任务的评估所无法察觉的软件质量风险。我们的研究结果强调：对LLM生成工具的评估与治理，需要将不断演化的工具库视为首要的软件制品，而非黑箱。

Modern LLM agents increasingly create their own tools at runtime – from Python functions to API clients – yet existing benchmarks evaluate them almost exclusively by downstream task completion. This is analogous to judging a software engineer only by whether their code runs, ignoring redundancy, regression, and safety. We introduce EvolveTool-Bench, a diagnostic benchmark for LLM-generated tool libraries in software engineering workflows. Across three domains requiring actual tool execution (proprietary data formats, API orchestration, and numerical computation), we define library-level software quality metrics – reuse, redundancy, composition success, regression stability, and safety – alongside a per-tool Tool Quality Score measuring correctness, robustness, generality, and code quality. In the first head-to-head comparison of code-level and strategy-level tool evolution (ARISE vs. EvoSkill vs. one-shot baselines, 99 tasks, two models), we show that systems with similar task completion (63-68%) differ by up to 18% in library health, revealing software quality risks invisible to task-only evaluation. Our results highlight that evaluation and governance of LLM-generated tools require treating the evolving tool library as a first-class software artifact, not a black box.

评分理由: 论文专注于LLM-based coding agents的性能预测框架，核心涉及LLM agents和tool use，因此这两个关键词分别获得10分和8分。其他关键词如MoE、SLMs、Scaling Laws、各种训练方法、推理技术、压缩方法、幻觉缓解、科学AI应用等均未在摘要中提及，与论文内容无关，得0分。

随着基于大语言模型的编程研究焦点从静态单步代码生成转向与工具及环境的多步智能体交互，理解何种任务将挑战智能体及其原因变得日益困难。当前实践加剧了这一挑战：智能体性能通常通过基准测试的总体通过率来衡量，但单一数值指标掩盖了基准测试内部任务的多样性。我们提出了一个针对智能体编程范式、用于预测个体任务成功或失败的框架。该方法通过从任务中提取丰富特征（包括问题描述、代码库上下文、解决方案和测试用例）来增强项目反应理论，并引入了一种将智能体能力分解为大语言模型能力与框架能力组件的新颖方法。这种参数化使我们能够整合异构排行榜的评估数据，并准确预测未见基准测试的任务级性能，以及未见的大语言模型-框架组合性能。我们的方法对基准设计者具有实际应用价值，他们无需运行计算成本高昂的智能体评估，即可更好地校准新任务的难度。

As the focus in LLM-based coding shifts from static single-step code generation to multi-step agentic interaction with tools and environments, understanding which tasks will challenge agents and why becomes increasingly difficult. This is compounded by current practice: agent performance is typically measured by aggregate pass rates on benchmarks, but single-number metrics obscure the diversity of tasks within a benchmark. We present a framework for predicting success or failure on individual tasks tailored to the agentic coding regime. Our approach augments Item Response Theory (IRT) with rich features extracted from tasks, including issue statements, repository contexts, solutions, and test cases, and introduces a novel decomposition of agent ability into LLM and scaffold ability components. This parameterization enables us to aggregate evaluation data across heterogeneous leaderboards and accurately predict task-level performance for unseen benchmarks, as well as unseen LLM-scaffold combinations. Our methods have practical utility for benchmark designers, who can better calibrate the difficulty of their new tasks without running computationally expensive agent evaluations.

评分理由: 论文核心研究大语言模型（LLMs）在医学问答（AI for Science子领域）中的自我反思（Self-Correction/Self-Reflection）能力，并采用链式思维（Chain of Thought）提示方法进行评估；因此与"Large Language Models”、“Chain of Thought”、“Self-Correction"和"AI for Science"高度相关（10分）。论文涉及推理透明度与正确性的分析，与"System 2 Thinking"和"Explainable AI"有一定关联（5分）；同时探讨模型可靠性，与"Hallucination Mitigation"部分相关（5分）。其他关键词如MoE、SFT、RAG等未在研究中涉及，评为0分。

大语言模型（LLM）在医学问答任务上已展现出强劲性能，而思维链提示通过引导模型进行显式的中间推理进一步提升了结果；与此同时，自我反思（自我校正）提示被广泛认为能通过促使大语言模型批判和修正自身推理来增强模型可靠性，但其在安全关键的医疗场景中的有效性仍不明确。本研究对医学多项选择题问答中的自我反思推理进行了探索性分析：使用GPT-4o和GPT-4o-mini模型，我们比较了标准思维链提示与迭代式自我反思循环的效果，并在三个广泛使用的医学问答基准数据集（MedQA、HeadQA和PubMedQA）上追踪了预测结果在反思步骤中的演变过程。我们分析了自我反思是否会导致错误修正、错误持续或引入新错误。研究结果表明，自我反思提示并不能持续提升准确性，其效果高度依赖于数据集和模型：在MedQA上带来有限增益，但在HeadQA和PubMedQA上收益甚微或产生负面影响，且增加反思步骤数并不能保证性能提升。这些发现揭示了推理透明度与推理正确性之间的差距，表明自我反思推理更适合被视为理解模型行为的分析工具，而非提升医学问答可靠性的独立解决方案。

Large language models (LLMs) have achieved strong performance on medical question answering (medical QA), and chain-of-thought (CoT) prompting has further improved results by eliciting explicit intermediate reasoning; meanwhile, self-reflective (self-corrective) prompting has been widely claimed to enhance model reliability by prompting LLMs to critique and revise their own reasoning, yet its effectiveness in safety-critical medical settings remains unclear. In this work, we conduct an exploratory analysis of self-reflective reasoning for medical multiple-choice question answering: using GPT-4o and GPT-4o-mini, we compare standard CoT prompting with an iterative self-reflection loop and track how predictions evolve across reflection steps on three widely used medical QA benchmarks (MedQA, HeadQA, and PubMedQA). We analyze whether self-reflection leads to error correction, error persistence, or the introduction of new errors. Our results show that self-reflective prompting does not consistently improve accuracy and its impact is highly dataset- and model-dependent: it yields modest gains on MedQA but provides limited or negative benefits on HeadQA and PubMedQA, and increasing the number of reflection steps does not guarantee better performance. These findings highlight a gap between reasoning transparency and reasoning correctness, suggesting that self-reflective reasoning is better viewed as an analytical tool for understanding model behavior rather than a standalone solution for improving medical QA reliability.

评分理由: 论文提出HippoCamp基准，专门评估多模态大语言模型（MLLMs）和智能体在个人计算机环境中的文件管理能力，涉及搜索、证据感知和多步推理。核心相关关键词包括：‘Large Language Models’（论文明确评估MLLMs）、‘LLM Agents’（评估智能体方法）、‘Chain of Thought’（评估多步推理能力）。中等相关关键词：‘Retrieval-Augmented Generation’（涉及检索和生成）、‘Context Window Extension’（处理大量个人文件需要长上下文）、‘System 2 Thinking’（涉及深度推理）、‘Tool Use’（智能体可能使用工具进行文件管理）。其他关键词如MoE、量化、对齐等未在论文中涉及，评分为0。

我们推出HippoCamp——一个旨在评估智能体多模态文件管理能力的新型基准测试平台。与现有聚焦于通用场景下网络交互、工具使用或软件自动化等任务的智能体基准不同，HippoCamp将智能体置于以用户为中心的环境中，要求其建模个体用户画像并在海量个人文件中进行上下文感知推理。本基准基于覆盖多模态的真实世界用户画像实例化设备级文件系统，包含超过2000个真实文件，数据总量达42.4 GB。基于原始文件，我们构建了581组问答对以评估智能体的搜索能力、证据感知能力和多步推理能力。为支持细粒度分析，我们提供了4.61万条密集标注的结构化轨迹用于逐步故障诊断。我们在HippoCamp上评估了多种前沿的多模态大语言模型（MLLMs）与智能体方法。综合实验结果表明存在显著性能差距：即使在用户画像建模任务中，最先进的商业模型准确率也仅达48.3%，尤其在密集个人文件系统内的长程检索与跨模态推理方面表现欠佳。进一步的逐步故障诊断表明，多模态感知与证据锚定是当前的主要瓶颈。最终，HippoCamp揭示了现有智能体在真实用户中心环境中的关键局限，并为开发下一代个人人工智能助手奠定了坚实基础。

We present HippoCamp, a new benchmark designed to evaluate agents’ capabilities on multimodal file management. Unlike existing agent benchmarks that focus on tasks like web interaction, tool use, or software automation in generic settings, HippoCamp evaluates agents in user-centric environments to model individual user profiles and search massive personal files for context-aware reasoning. Our benchmark instantiates device-scale file systems over real-world profiles spanning diverse modalities, comprising 42.4 GB of data across over 2K real-world files. Building upon the raw files, we construct 581 QA pairs to assess agents’ capabilities in search, evidence perception, and multi-step reasoning. To facilitate fine-grained analysis, we provide 46.1K densely annotated structured trajectories for step-wise failure diagnosis. We evaluate a wide range of state-of-the-art multimodal large language models (MLLMs) and agentic methods on HippoCamp. Our comprehensive experiments reveal a significant performance gap: even the most advanced commercial models achieve only 48.3% accuracy in user profiling, struggling particularly with long-horizon retrieval and cross-modal reasoning within dense personal file systems. Furthermore, our step-wise failure diagnosis identifies multimodal perception and evidence grounding as the primary bottlenecks. Ultimately, HippoCamp exposes the critical limitations of current agents in realistic, user-centric environments and provides a robust foundation for developing next-generation personal AI assistants.

评分理由: 论文提出EVOM框架，使用LLMs（核心）将自然语言问题自动转化为优化建模代码，并通过执行验证的强化学习（GRPO和DAPO）进行训练，这直接涉及"Post-training/SFT”（与监督微调对比）、“RLHF/RLAIF/DPO”（使用GRPO和DAPO）、“LLM Agents”（自动化建模流程）和"Tool Use"（调用求解器API）。其他关键词如MoE、Scaling Laws、PEFT、RAG等未在摘要中提及，与论文内容无关。

利用大语言模型实现优化建模自动化是通向可扩展决策智能的一条前景广阔的路径，但现有方法要么依赖于基于闭源大语言模型构建的高推理延迟智能体流程，要么采用成本高昂的过程监督对较小模型进行微调，而这类方法常会过度适配单一求解器接口。受可验证奖励强化学习的启发，我们提出了执行验证优化建模（Execution-Verified Optimization Modeling, EVOM），这是一个执行验证学习框架，将数学规划求解器视为一个确定性的交互式验证器。给定自然语言描述的问题和目标求解器，EVOM生成针对特定求解器的代码，在沙箱环境中执行该代码，并将执行结果转化为标量奖励，通过GRPO和DAPO方法在“生成-执行-反馈-更新”的闭环流程中进行优化。这种仅基于结果的范式消除了对过程级监督的需求，并通过切换验证环境而非重建针对特定求解器的数据集，实现了跨求解器的泛化能力。在NL4OPT、MAMO、IndustryOR和OptiBench数据集上，针对Gurobi、OR-Tools和COPT等求解器的实验表明，EVOM达到或超越了过程监督的监督微调方法，支持零样本求解器迁移，并能通过在目标求解器后端下持续训练，实现高效低成本的求解器适配。

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency, or fine-tune smaller LLMs using costly process supervision that often overfits to a single solver API. Inspired by reinforcement learning with verifiable rewards, we propose Execution-Verified Optimization Modeling (EVOM), an execution-verified learning framework that treats a mathematical programming solver as a deterministic, interactive verifier. Given a natural-language problem and a target solver, EVOM generates solver-specific code, executes it in a sandboxed harness, and converts execution outcomes into scalar rewards, optimized with GRPO and DAPO in a closed-loop generate-execute-feedback-update process. This outcome-only formulation removes the need for process-level supervision, and enables cross-solver generalization by switching the verification environment rather than reconstructing solver-specific datasets. Experiments on NL4OPT, MAMO, IndustryOR, and OptiBench across Gurobi, OR-Tools, and COPT show that EVOM matches or outperforms process-supervised SFT, supports zero-shot solver transfer, and achieves effective low-cost solver adaptation by continuing training under the target solver backend.

评分理由: 论文核心研究对齐语言模型的行为问题（逃避式仆人现象）并提出Dignified Peer框架，直接涉及LLM对齐、DPO算法和LLM智能体构建，因此"Large Language Models"、“Instruction Tuning/Alignment”、“RLHF/DPO"和"LLM Agents"均获得10分（核心内容）。“Hallucination Mitigation"获得5分，因为论文关注可信度/真实性（trustworthiness）与幻觉缓解有一定关联。其他关键词在论文中未明确涉及，得0分。

当前的对齐语言模型表现出一种我们称之为“回避型仆人”的双重失效模式：它们会谄媚地认可用户有缺陷的信念，同时用模板化的免责声明来推卸责任。我们提出了“尊严对等体”框架，该框架通过反谄媚性和可信赖性来对抗顺从性，并通过同理心和创造力来缓解回避性。实现这一智能体需要克服数据监督、目标坍缩和评估偏见方面的重大挑战。我们通过引入PersonaKnob数据集来解决这些问题，该数据集具有多个人格偏好的组合偏序结构。这些数据与一种宽容的约束拉格朗日DPO算法结合使用，该算法动态平衡所有人格维度以防止行为坍缩。此外，我们采用了一种经心理测量学校准的项目反应理论评估方案，以将潜在模型的人格能力与评估者偏见等混杂因素区分开来。大量的实证研究表明，我们的方法成功构建了一个兼具尊严与对等性的LLM智能体。

Current aligned language models exhibit a dual failure mode we term the Evasive Servant: they sycophantically validate flawed user beliefs while deflecting responsibility with boilerplate disclaimers. We propose the Dignified Peer framework, which counters servility with anti-sycophancy and trustworthiness, and mitigates evasiveness through empathy and creativity. Realizing this agent requires overcoming significant challenges in data supervision, objective collapse, and evaluation bias. We address these issues by introducing the PersonaKnob dataset which features a compositional partial order structure of multiple persona preference. This data is utilized alongside a tolerant constrained Lagrangian DPO algorithm that dynamically balances all persona dimensions to prevent behavioral collapse. Additionally, we employ a psychometrically calibrated Item Response Theory evaluation protocol to disentangle latent model persona capability from confounders like judge biases. Extensive empirical studies demonstrate that our approach successfully build a LLM agent with both dignity and peer.

评分理由: 论文MOON3.0专注于多模态大语言模型（MLLMs）在电子商务产品理解中的应用，核心是利用MLLMs的推理能力显式建模细粒度产品属性。因此，与"Large Language Models"高度相关（10分），因为MLLMs是LLMs的扩展；与"Supervised Fine-tuning"高度相关（10分），因为论文明确提到SFT的局限性并提出了改进方法；与"Chain of Thought"和"System 2 Thinking"高度相关（10分），因为论文强调推理能力（reasoning-aware）和多步推理策略；与"Context Window Extension"有一定关联（5分），因为论文提到长上下文推理的挑战。其他关键词如MoE、SLMs、Scaling Laws、RLHF、RAG、Quantization等未在摘要中提及或与论文主题无关，故得0分。

随着电子商务的快速发展，探索通用表征而非任务特定表征已引起越来越多的关注。尽管近期多模态大语言模型（MLLMs）在商品理解方面推动了显著进展，但它们通常被用作特征提取器，将商品信息隐式编码为全局嵌入，从而限制了其捕捉细粒度属性的能力。因此，我们认为利用MLLMs的推理能力来显式建模细粒度商品属性具有重要潜力。然而，由于几个关键挑战，实现这一目标仍非易事：（i）长上下文推理容易稀释模型对原始输入中显著信息的注意力；（ii）监督微调（SFT）主要鼓励僵化模仿，限制了有效推理策略的探索；（iii）细粒度细节在前向传播过程中逐渐衰减。为解决这些问题，我们提出了MOON3.0，这是首个基于MLLM的推理感知商品表征学习模型。我们的方法（1）采用多头模态融合模块自适应整合原始信号；（2）结合联合对比与强化学习框架，自主探索更有效的推理策略；（3）引入细粒度残差增强模块，在整个网络中逐步保留局部细节。此外，我们发布了一个大规模多模态电子商务基准MBE3.0。实验表明，我们的模型在自建基准和公共数据集的各种下游任务中均展现出领先的零样本性能。

With the rapid growth of e-commerce, exploring general representations rather than task-specific ones has attracted increasing attention. Although recent multimodal large language models (MLLMs) have driven significant progress in product understanding, they are typically employed as feature extractors that implicitly encode product information into global embeddings, thereby limiting their ability to capture fine-grained attributes. Therefore, we argue that leveraging the reasoning capabilities of MLLMs to explicitly model fine-grained product attributes holds significant potential. Nevertheless, achieving this goal remains non-trivial due to several key challenges: (i) long-context reasoning tends to dilute the model’s attention to salient information in the raw input; (ii) supervised fine-tuning (SFT) primarily encourages rigid imitation, limiting the exploration of effective reasoning strategies; and (iii) fine-grained details are progressively attenuated during forward propagation. To address these issues, we propose MOON3.0, the first reasoning-aware MLLM-based model for product representation learning. Our method (1) employs a multi-head modality fusion module to adaptively integrate raw signals; (2) incorporates a joint contrastive and reinforcement learning framework to autonomously explore more effective reasoning strategies; and (3) introduces a fine-grained residual enhancement module to progressively preserve local details throughout the network. Additionally, we release a large-scale multimodal e-commerce benchmark MBE3.0. Experimentally, our model demonstrates state-of-the-art zero-shot performance across various downstream tasks on both our benchmark and public datasets.

评分理由: 论文核心研究多模态大语言模型（LLMs）在识别误导性可视化方面的能力，因此与"Large Language Models"高度相关（10分）。论文评估了包括小型模型（如Nemotron-Nano-V2-VL）在内的多种模型，因此与"Small Language Models"有一定关联（5分）。研究涉及模型对误导性内容的识别和解释，这需要推理能力，因此与"Chain of Thought"和"System 2 Thinking"有一定关联（各5分）。论文关注误导性可视化（即"lies”）的识别，这与事实性和幻觉缓解相关，因此与"Hallucination Mitigation"高度相关（8分）。研究还比较了模型与人类专家的行为，以提供见解，这涉及可解释性，因此与"Mechanistic Interpretability"高度相关（8分）。其他关键词（如MoE、Scaling Laws、Pre-training、RLHF等）在论文中未涉及或仅为背景提及，因此评分为0分。

本研究探讨了多模态大语言模型（LLMs）识别与解读误导性可视化图表的能力，以及其对这些观察结果、背后成因及潜在意图的认知。我们运用可视化修辞学概念及一套新构建的作者意图分类法作为解释框架。通过提出三个研究问题，我们利用包含2,336条与COVID-19相关推文的数据集进行了实验分析，其中半数推文含有误导性可视化内容，并辅以来自IEEE VIS社区专注于展示欺骗性与误导性可视化图表的活动VisLies中提取的真实案例，这些案例涵盖了感知、认知和概念层面的错误。为确保全面覆盖当前LLMs的发展现状，我们评估了16个前沿模型，其中15个为开放权重模型，涵盖了广泛的模型规模、架构家族及推理能力。所选模型包括小型模型：Nemotron-Nano-VL2（120亿参数）、Mistral-Small-3.2（240亿）、DeepSeek-VL2（270亿）、Gemma3（270亿）和GTA1（320亿）；中型模型：Qianfan-VL（700亿）、Molmo（720亿）、GLM-4.5V（1080亿）、LLaVA-NeXT（1100亿）和Pixtral-Large（1240亿）；大型模型：Qwen3-VL（2350亿）、InternVL3.5（2410亿）、Step3（3210亿）、Llama-4-Maverick（4000亿）和Kimi-K2.5（10000亿）。此外，我们还采用了前沿的专有模型OpenAI GPT-5.4。为建立人类对这些任务的认知基准，我们同时开展了可视化专家用户研究，以评估人类如何理解相同误导性可视化图表中的修辞技巧及作者意图。这使得模型与专家行为之间的比较成为可能，揭示了二者的相似性与差异性，从而深入洞察大语言模型在哪些方面与人类判断一致，在哪些方面存在分歧。

This study investigates the ability of multimodal Large Language Models (LLMs) to identify and interpret misleading visualizations, and recognize these observations along with their underlying causes and potential intentionality. Our analysis leverages concepts from visualization rhetoric and a newly developed taxonomy of authorial intents as explanatory lenses. We formulated three research questions and addressed them experimentally using a dataset of 2,336 COVID-19-related tweets, half of which contain misleading visualizations, and supplemented it with real-world examples of perceptual, cognitive, and conceptual errors drawn from VisLies, the IEEE VIS community event dedicated to showcasing deceptive and misleading visualizations. To ensure broad coverage of the current LLM landscape, we evaluated 16 state-of-the-art models. Among them, 15 are open-weight models, spanning a wide range of model sizes, architectural families, and reasoning capabilities. The selection comprises small models, namely Nemotron-Nano-V2-VL (12B parameters), Mistral-Small-3.2 (24B), DeepSeek-VL2 (27B), Gemma3 (27B), and GTA1 (32B); medium-sized models, namely Qianfan-VL (70B), Molmo (72B), GLM-4.5V (108B), LLaVA-NeXT (110B), and Pixtral-Large (124B); and large models, namely Qwen3-VL (235B), InternVL3.5 (241B), Step3 (321B), Llama-4-Maverick (400B), and Kimi-K2.5 (1000B). In addition, we employed OpenAI GPT-5.4, a frontier proprietary model. To establish a human perspective on these tasks, we also conducted a user study with visualization experts to assess how people perceive rhetorical techniques and the authorial intentions behind the same misleading visualizations. This allows comparison between model and expert behavior, revealing similarities and differences that provide insights into where LLMs align with human judgment and where they diverge.

评分理由: 论文核心研究将预训练文本大语言模型（LLMs）通过持续预训练适应为语音语言模型（Speech LMs），并提出了Multimodal Depth Upscaling方法。因此，与"Large Language Models"和"Pre-training/Continual Pre-training"高度相关（10分）。论文明确使用了SmolLM2模型（属于Small Language Models范畴）进行实验，故"Small Language Models"得10分。论文将提出的方法与LoRA（一种PEFT技术）进行比较，并涉及参数高效微调，故"PEFT/LoRA"得10分。其他关键词如MoE、Scaling Laws、SFT、Alignment、RAG等均未在摘要中提及或与核心内容无关，故得0分。

通过在海量语音数据上进行持续预训练，将预训练的文本大语言模型（LLMs）适配为语音语言模型（Speech LMs）具有广阔前景，但这一过程常导致模型原有的文本能力下降。我们提出多模态深度扩展方法，该方法是对持续大语言模型预训练中一种新兴策略的扩展：在冻结的文本大语言模型中插入新的Transformer层，并仅使用语音数据训练这些新增层。基于SmolLM2-360M和SmolLM2-1.7B模型，在4.8万小时英语自动语音识别（ASR）数据上的实验表明，深度扩展方法能达到与全参数微调相当的ASR性能，同时其导致的文本能力退化远低于全参数微调和低秩自适应（LoRA）。我们进一步证明，将专为语音识别设计的E-Branchformer架构作为插入层，在较大模型上实现的ASR性能可匹配甚至超越全参数微调，同时将文本能力退化降低75%以上，且可训练参数减少了60%。

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling, an extension of an emerging strategy in continual LLM pre-training, where new transformer layers are inserted into a frozen text LLM and only the added layers are trained on speech data. Experiments with SmolLM2-360M and SmolLM2-1.7B on 48k hours of English Automatic Speech Recognition (ASR) data show that depth up-scaling achieves ASR comparable to full fine-tuning while causing far less text degradation than both full fine-tuning and Low-Rank Adaptation (LoRA). We further show that incorporating E-Branchformer, an architecture designed for speech recognition, as the inserted layers achieves ASR that matches or surpasses full fine-tuning on the larger model while reducing text degradation by over 75% with 60% fewer trainable parameters.

评分理由: 论文提出了一种针对大型视觉语言模型（LVLMs）的无训练令牌剪枝框架IWP，核心是减少视觉令牌数量以降低计算成本。与"Large Language Models"高度相关（10分），因为LVLMs是大模型的一种。与"Quantization"和"Speculative Decoding"有一定关联（8分），因为令牌剪枝是一种模型压缩和推理加速技术。与"KV Cache Compression"和"Mechanistic Interpretability"有弱关联（5分），因为涉及注意力机制分析和效率优化。其他关键词如MoE、SFT、RAG等与论文内容无关（0分）。

大型视觉语言模型在图像与视频理解任务中展现出卓越性能，但其计算成本随视觉标记数量的增加而快速上升。现有的标记剪枝方法通过经验性策略缓解这一问题，却忽视了注意力机制的内在原理。本文基于注意力的对偶形式视角，提出一种无需训练的新型标记剪枝框架。我们将注意力重新表述为一个隐式线性层，其权重矩阵由多个秩为1的外积求和构成，每个外积由单个标记的键值对生成。因此，标记剪枝问题转化为选择这些秩1更新的最优子集，以最佳逼近原始对偶权重矩阵。将此视角扩展至大型视觉语言模型中的标准softmax注意力机制，我们推导出一种新的度量指标，可同时量化标记的信息强度与信息冗余度。为基于该度量高效选择子集，我们提出了渐进式分块最大边际相关性算法。大量实验表明，本方法在性能与效率之间实现了更优的平衡，同时为现有剪枝方法提供了新的理论视角。

Large Vision Language Models show impressive performance across image and video understanding tasks, yet their computational cost grows rapidly with the number of visual tokens. Existing token pruning methods mitigate this issue through empirical approaches while overlooking the internal mechanism of attention. In this paper, we propose a novel training free token pruning framework grounded in the dual form perspective of attention. We reformulate attention as an implicit linear layer whose weight matrix is the sum of rank 1 outer products, each generated by a single token’s key value pair. Token pruning thus reduces to selecting an optimal subset of these rank 1 updates that best approximates the original dual weight matrix. Extending this perspective to standard softmax attention in LVLMs, we derive a novel metric quantifying both a token’s information magnitude and information duplication. To efficiently select the subset with the proposed metric, we introduce Progressive Chunked Maximal Marginal Relevance. Extensive experiments demonstrate that our method achieves a better trade off between performance and efficiency, while providing another perspective on existing pruning approaches.

评分理由: 论文核心研究MoE系统在动态数据分布下的专家管理策略，提出’分子记忆’概念，属于大模型技术原理的创新。高度相关关键词：‘Mixture of Experts’（核心内容，15分），‘Large Language Models’（论文明确提及LLM开发，10分），‘Domain Adaptation’（研究领域适应问题，10分）。其他关键词如SLMs、Scaling Laws、SFT等未涉及，得0分。

我们展示了七组受控运行的实验结果，这些实验基于nanoFMT——一种采用动态混合专家（Mixture-of-Experts, MoE）管理的自由市场算法（Free-Market Algorithm, FMA）协调的Transformer模型。实验旨在回答高级大语言模型（LLM）开发中的一个核心问题：当MoE系统在数据分布动态变化下满负荷运行时，应如何管理其专家池？我们证明，采用成本惩罚的适应度指标，并结合为新专家设置的线性宽限期，能够构建一个通过多样化而非替换来积累领域专业知识的系统。核心成果体现在一项往返式领域切换实验中：当系统重返先前学习过的领域时，其恢复速度提升了9至11倍，且无需新增或替换任何专家。这种“分子记忆”效应——即休眠专家在其对应领域重现时得以保留并重新激活——在当前MoE管理方法中尚无先例。初步成本分析估算，在中等规模场景下，一个OpenAI级别的服务提供商采用此方法每年可节省约3910万美元成本，并减少27.1吉瓦时的能源消耗。

We present experimental results from seven controlled runs of nanoFMT, a Free-Market Algorithm (FMA) orchestrated transformer with dynamic Mixture-of-Experts (MoE) management. The experiments address a fundamental question for advanced LLM development: how should an MoE system manage its expert pool when operating at full capacity under changing data distributions? We demonstrate that cost-penalized fitness metrics, combined with a linear grace period for newborn experts, produce a system that accumulates domain expertise through diversification rather than replacement. The central result is a round-trip domain shift experiment showing 9-11x faster recovery when returning to a previously learned domain, with zero expert births or replacements required. This “molecular memory” effect – where dormant experts survive and reactivate when their domain returns – has no analogue in current MoE management approaches. A preliminary cost analysis estimates annual savings of $39.1M and 27.1 GWh energy reduction for an OpenAI-scale provider under a moderate scenario.

评分理由: 论文核心研究LLM agents生成工具库的质量评估，与"LLM Agents"和"Tool Use"高度相关（10分），属于大模型应用研究，因此"Large Language Models"也得10分。其他关键词如MoE、SLMs、Scaling Laws、训练方法、推理优化、AI for Science等均未在论文中涉及，得0分。

现代大语言模型（LLM）智能体在运行时越来越多地自主创建工具——从Python函数到API客户端——然而现有的基准测试几乎完全通过下游任务完成度来评估它们。这好比仅凭代码能否运行来评判软件工程师，而忽略了冗余性、回归问题和安全性。我们推出了EvolveTool-Bench，这是一个针对软件工程工作流中LLM生成工具库的诊断性基准测试。在三个需要实际工具执行的领域（专有数据格式、API编排和数值计算）中，我们定义了库级别的软件质量指标——复用性、冗余度、组合成功率、回归稳定性和安全性——同时引入衡量每个工具正确性、鲁棒性、通用性和代码质量的工具质量评分（Tool Quality Score）。在首次对代码级与策略级工具演化方法（ARISE vs. EvoSkill vs. 单次生成基线，涵盖99项任务和两种模型）的直接比较中，我们发现任务完成率相近的系统（63-68%）在工具库健康度上存在高达18%的差异，这揭示了仅关注任务的评估所无法察觉的软件质量风险。我们的研究结果强调：对LLM生成工具的评估与治理，需要将不断演化的工具库视为首要的软件制品，而非黑箱。

Modern LLM agents increasingly create their own tools at runtime – from Python functions to API clients – yet existing benchmarks evaluate them almost exclusively by downstream task completion. This is analogous to judging a software engineer only by whether their code runs, ignoring redundancy, regression, and safety. We introduce EvolveTool-Bench, a diagnostic benchmark for LLM-generated tool libraries in software engineering workflows. Across three domains requiring actual tool execution (proprietary data formats, API orchestration, and numerical computation), we define library-level software quality metrics – reuse, redundancy, composition success, regression stability, and safety – alongside a per-tool Tool Quality Score measuring correctness, robustness, generality, and code quality. In the first head-to-head comparison of code-level and strategy-level tool evolution (ARISE vs. EvoSkill vs. one-shot baselines, 99 tasks, two models), we show that systems with similar task completion (63-68%) differ by up to 18% in library health, revealing software quality risks invisible to task-only evaluation. Our results highlight that evaluation and governance of LLM-generated tools require treating the evolving tool library as a first-class software artifact, not a black box.

评分理由: 论文专注于LLM-based coding agents的性能预测框架，核心涉及LLM agents和tool use，因此这两个关键词分别获得10分和8分。其他关键词如MoE、SLMs、Scaling Laws、各种训练方法、推理技术、压缩方法、幻觉缓解、科学AI应用等均未在摘要中提及，与论文内容无关，得0分。

随着基于大语言模型的编程研究焦点从静态单步代码生成转向与工具及环境的多步智能体交互，理解何种任务将挑战智能体及其原因变得日益困难。当前实践加剧了这一挑战：智能体性能通常通过基准测试的总体通过率来衡量，但单一数值指标掩盖了基准测试内部任务的多样性。我们提出了一个针对智能体编程范式、用于预测个体任务成功或失败的框架。该方法通过从任务中提取丰富特征（包括问题描述、代码库上下文、解决方案和测试用例）来增强项目反应理论，并引入了一种将智能体能力分解为大语言模型能力与框架能力组件的新颖方法。这种参数化使我们能够整合异构排行榜的评估数据，并准确预测未见基准测试的任务级性能，以及未见的大语言模型-框架组合性能。我们的方法对基准设计者具有实际应用价值，他们无需运行计算成本高昂的智能体评估，即可更好地校准新任务的难度。

As the focus in LLM-based coding shifts from static single-step code generation to multi-step agentic interaction with tools and environments, understanding which tasks will challenge agents and why becomes increasingly difficult. This is compounded by current practice: agent performance is typically measured by aggregate pass rates on benchmarks, but single-number metrics obscure the diversity of tasks within a benchmark. We present a framework for predicting success or failure on individual tasks tailored to the agentic coding regime. Our approach augments Item Response Theory (IRT) with rich features extracted from tasks, including issue statements, repository contexts, solutions, and test cases, and introduces a novel decomposition of agent ability into LLM and scaffold ability components. This parameterization enables us to aggregate evaluation data across heterogeneous leaderboards and accurately predict task-level performance for unseen benchmarks, as well as unseen LLM-scaffold combinations. Our methods have practical utility for benchmark designers, who can better calibrate the difficulty of their new tasks without running computationally expensive agent evaluations.

评分理由: 论文提出TRIMS框架，专注于扩散语言模型（DLMs）的训练优化，属于大模型技术原理的创新。核心贡献是轨迹引导的监督微调方法，与"Supervised Fine-tuning"高度相关（10分）。研究涉及LLaDA和Dream等大模型，与"Large Language Models"相关（8分）。方法旨在改善解码轨迹以实现低延迟生成，与"Speculative Decoding"或"Inference Acceleration"相关（8分）。其他关键词如MoE、SLMs、Scaling Laws、RAG、RLHF等未在摘要中提及或与论文主题无关，均给0分。

扩散语言模型（DLMs）通过并行解码为实现低延迟生成提供了可行路径，但其实际效率高度依赖于解码轨迹。在实践中，这一优势往往未能完全实现，因为标准训练未对标记揭示顺序提供显式监督，导致训练与推理之间的不匹配，从而产生次优的解码行为。我们提出轨迹排序指令掩码监督（TRIMS），这是一个简单的轨迹引导监督微调框架，能够以最小开销将轨迹监督注入标准的掩码扩散语言模型（MDLM）训练中。TRIMS不依赖基于DLM的高成本蒸馏，而是利用自回归教师模型生成的轻量级信号来引导轨迹感知的掩码策略，促使模型学习更有效的解码顺序。在数学和代码基准测试中对LLaDA和Dream进行的实验表明，与标准MDLM训练及无需训练的加速基线相比，TRIMS显著提升了准确性与并行性之间的权衡效果，同时以远低于训练成本的方式，实现了与先前基于蒸馏方法相竞争的性能。进一步分析表明，TRIMS能够产生更优的解码轨迹，验证了轨迹引导监督对DLMs的有效性。

Diffusion language models (DLMs) offer a promising path toward low-latency generation through parallel decoding, but their practical efficiency depends heavily on the decoding trajectory. In practice, this advantage often fails to fully materialize because standard training does not provide explicit supervision over token reveal order, creating a train-inference mismatch that leads to suboptimal decoding behavior. We propose Trajectory-Ranked Instruction Masked Supervision (TRIMS), a simple trajectory-guided supervised fine-tuning framework that injects trajectory supervision into standard Masked Diffusion Language Model (MDLM) training with minimal overhead. Instead of relying on costly DLM-based distillation, TRIMS uses lightweight signals from an autoregressive teacher to guide a trajectory-aware masking strategy, encouraging the model to learn more effective decoding orders. Experiments on LLaDA and Dream across math and coding benchmarks show that TRIMS significantly improves the accuracy-parallelism trade-off over both standard MDLM training and train-free acceleration baselines, while achieving competitive performance with prior distillation-based approaches at substantially lower training cost. Further analysis shows that TRIMS leads to better decoding trajectories, validating the effectiveness of trajectory-guided supervision for DLMs.

评分理由: 论文核心研究On-Policy Distillation (OPD)用于将大型语言模型(LLMs)的知识迁移到更小的可部署模型，因此与"Large Language Models"高度相关(10分)，与"Small Language Models"相关(8分)。论文讨论蒸馏作为知识转移机制，属于模型训练后优化范畴，与"Post-training"相关(8分)。论文未涉及其他关键词的具体技术或应用。

知识蒸馏已成为将推理能力与领域专业知识从前沿大语言模型向更小、可部署的学生模型迁移的核心机制。然而，主流范式仍是\textit{离策略}的：学生模型在静态的教师生成数据上进行训练，在学习过程中从未接触自身错误。这种训练与测试的错位——\textit{暴露偏差}的一种表现——导致预测误差在推理时以自回归方式不断累积。策略蒸馏通过让学生模型生成自身的轨迹，并基于这些自生成输出获得教师反馈，将蒸馏过程建立在交互式模仿学习理论基础上，从而解决了这一问题。尽管该领域在散度最小化、奖励引导学习和自我博弈等方面发展迅速，但相关文献仍较为零散，缺乏统一的理论框架。本综述首次为大语言模型的策略蒸馏提供了全面概述。我们引入了一个基于策略样本的统一$f$-散度框架，并从三个正交维度梳理该领域：\emph{反馈信号}（基于逻辑值、基于结果或自我博弈）、\emph{教师访问权限}（白盒、黑盒或无教师）以及\emph{损失粒度}（词元级、序列级或混合型）。我们系统分析了代表性方法，考察了工业部署实践，并指出了包括蒸馏缩放定律、不确定性感知反馈和智能体级蒸馏在内的若干开放性问题。

Knowledge distillation has become a primary mechanism for transferring reasoning and domain expertise from frontier Large Language Models (LLMs) to smaller, deployable students. However, the dominant paradigm remains \textit{off-policy}: students train on static teacher-generated data and never encounter their own errors during learning. This train–test mismatch, an instance of \textit{exposure bias}, causes prediction errors to compound autoregressively at inference time. On-Policy Distillation (OPD) addresses this by letting the student generate its own trajectories and receive teacher feedback on these self-generated outputs, grounding distillation in the theory of interactive imitation learning. Despite rapid growth spanning divergence minimization, reward-guided learning, and self-play, the OPD literature remains fragmented with no unified treatment. This survey provides the first comprehensive overview of OPD for LLMs. We introduce a unified $f$-divergence framework over on-policy samples and organize the landscape along three orthogonal dimensions: \emph{feedback signal} (logit-based, outcome-based, or self-play), \emph{teacher access} (white-box, black-box, or teacher-free), and \emph{loss granularity} (token-level, sequence-level, or hybrid). We systematically analyze representative methods, examine industrial deployments, and identify open problems including distillation scaling laws, uncertainty-aware feedback, and agent-level distillation.

评分理由: 论文核心研究LLM-based agent judges（LLM代理评估者）在评估对话AI中的应用，直接高度相关于"Large Language Models"和"LLM Agents"关键词。研究涉及使用具有不同人格的agent组成panel进行评估，这体现了多agent系统的协调概念，因此与"Multi-agent Systems"有一定关联（5分）。论文未涉及其他关键词的具体技术（如MoE、SFT、RAG等）或应用领域（如生物信息学），因此这些关键词评分为0分。

基于大语言模型的智能体评估者正成为评估对话式人工智能的新兴方法，但一个根本性不确定性依然存在：我们能否信任其评估结果？若可信任，又需要多少评估者？通过对两组模型在15项任务中开展的960次会话分析，我们发现在图灵式验证中，基于人格设定的智能体评估者产生的评估结果与人类评分者无法区分。我们进而发现评分与覆盖范围之间的分离现象：质量评分随评审团规模呈对数增长，而独特问题发现数量则遵循亚线性幂律——两者均呈现收益递减趋势，但评分饱和速度约为问题发现速度的两倍。我们假设这反映了发现空间的幂律分布：关键问题可由小型评审团率先发现，而边缘案例则需要逐步扩大评审规模，这与生态学中的物种累积曲线具有相似性。其机制可追溯至集成多样性：基于大五人格的设定使智能体能够探查不同的质量维度，其中专家型评估者扮演对抗性探查角色，将发现推向问题分布的尾部。受控消融实验证实，需要结构化的人格设定而非简单提示才能产生这种缩放特性。

LLM-based agent judges are an emerging approach to evaluating conversational AI, yet a fundamental uncertainty remains: can we trust their assessments, and if so, how many are needed? Through 960 sessions with two model pairs across 15 tasks, we show that persona-based agent judges produce evaluations indistinguishable from human raters in a Turing-style validation. We then identify a score-coverage dissociation: quality scores improve logarithmically with panel size, while unique issue discoveries follow a sublinear power law-both exhibit diminishing returns, but scores saturate roughly twice as fast as discoveries. We hypothesize this reflects a power law distribution of the finding space: critical issues are discovered first by small panels, while corner cases require progressively larger panels, analogous to species accumulation curves in ecology. The mechanism traces to ensemble diversity-Big Five personality conditioning makes agents probe different quality dimensions, with expert judges acting as adversarial probes that push discovery into the tail of the finding distribution. A controlled ablation confirms that structured persona conditioning, not simple prompting, is required to produce these scaling properties.

评分理由: 论文核心研究大语言模型（LLMs）与视觉编码器的分层预训练（Pre-training）集成，因此这两个关键词高度相关（10分）。论文提到“vision-language alignment”，与“Alignment”有一定关联（5分）。其他关键词如MoE、SFT、RAG等未在摘要中提及或与论文主题无关，得0分。

计算机视觉领域通过可扩展的视觉编码器与多模态预训练框架取得了显著进展。然而，现有方法通常将视觉编码器与大型语言模型（LLMs）视为独立模块，限制了层次化视觉特征的深度融合。本研究提出HIVE（Hierarchical Pre-Training of Vision Encoders）——一种通过引入视觉编码器与LLM之间的层次化交叉注意力机制来增强视觉-语言对齐的新框架。与传统方法将图像嵌入扁平化处理不同，HIVE实现了跨多网络层的结构化特征融合，从而改善了梯度流与表征学习能力。为优化这种交互机制，我们设计了三阶段训练策略，逐步对齐视觉编码器与LLM，确保稳定的优化过程与有效的多模态融合。实证评估表明，HIVE不仅在图像分类任务中表现优异，在MME、GQA、OK-VQA和ScienceQA等基准测试的多种视觉-语言任务上也超越了基于自注意力的方法。我们的研究结果凸显了层次化特征整合的优势，为构建更高效、表达能力更强的视觉-语言模型开辟了新路径。

The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks. However, existing approaches often treat vision encoders and large language models (LLMs) as independent modules, limiting the integration of hierarchical visual features. In this work, we propose HIVE (Hierarchical Pre-Training of Vision Encoders), a novel framework that enhances vision-language alignment by introducing hierarchical cross-attention between the vision encoder and LLM. Unlike conventional methods that flatten image embeddings, HIVE enables structured feature fusion across multiple layers, improving gradient flow and representation learning. To optimize this interaction, we introduce a three-stage training strategy that progressively aligns the vision encoder with the LLM, ensuring stable optimization and effective multimodal fusion. Empirical evaluations demonstrate that HIVE achieves superior performance not only in image classification but also on various vision-language tasks, outperforming self-attention-based methods in benchmarks such as MME, GQA, OK-VQA, and ScienceQA. Our results highlight the benefits of hierarchical feature integration, paving the way for more efficient and expressive vision-language models.

评分理由: 论文核心研究LLM训练过程中的下游性能评估问题，提出使用轻量级探针分析内部表示来预测性能，因此与"Large Language Models"高度相关（10分）。论文涉及训练过程监控，与"Pre-training"有一定关联（5分）。探针分析内部表示可视为模型解释性的一种方法，与"Mechanistic Interpretability"有一定关联（5分）。其他关键词如MoE、SFT、RAG、推理加速等均未在论文中涉及，故评0分。

扩大大型语言模型（LLMs）在参数量与测试时间上的规模范式，不断推动着人工智能能力的边界，但代价是使传统的生成式评估范式变得极其昂贵，从而导致LLM训练期间下游性能评估的延迟变得难以承受。然而，简单的指标如训练损失（困惑度）并不总是与下游性能相关，因为它们的趋势有时会与实际任务结果相背离。这一困境呼唤一种计算高效且能足够准确衡量模型能力的方法。为应对这一挑战，我们引入了一种新的训练中评估范式，它使用轻量级探针来监测下游性能。这些探针以LLM训练过程中检查点的内部表示为输入，直接预测该检查点在下游任务上的性能（以成功率，即pass@1衡量）。我们设计了多种探针架构，并通过在OLMo3-7B模型的一系列多样化下游任务检查点上进行验证，证明了其有效性。这些探针能够准确预测检查点的性能（平均AUROC$>$0.75），在不同检查点间具有良好的泛化能力（早期预测后期），并将计算延迟从约1小时（使用传统生成式评估方法）降低至约3分钟。总之，这项工作提出了一种实用且可扩展的训练中下游评估范式，能够实现更敏捷、更知情、更高效的大型语言模型开发流程。

The paradigm of scaling Large Language Models (LLMs) in both parameter size and test time has pushed the boundaries of AI capabilities, but at the cost of making the traditional generative evaluation paradigm prohibitively expensive, therefore making the latency of LLM’s in-training downstream performance evaluation unbearable. However, simple metrics like training loss (perplexity) are not always correlated with downstream performance, as sometimes their trends diverge from the actual task outcomes. This dilemma calls for a method that is computationally efficient and sufficiently accurate in measuring model capabilities. To address this challenge, we introduce a new in-training evaluation paradigm that uses a lightweight probe for monitoring downstream performance. The probes take the internal representations of LLM checkpoints (during training) as input and directly predict the checkpoint’s performance on downstream tasks measured by success probability (i.e., pass@1). We design several probe architectures, validating their effectiveness using the OLMo3-7B’s checkpoints across a diverse set of downstream tasks. The probes can accurately predict a checkpoint’s performance (with avg. AUROC$>$0.75), have decent generalizability across checkpoints (earlier predicts later), and reduce the computation latency from $\sim$1 hr (using conventional generative evaluation method) to $\sim$3 min. In sum, this work presents a practical and scalable in-training downstream evaluation paradigm, enabling a more agile, informed, and efficient LLM development process.

评分理由: 论文核心研究Mixture-of-Experts（MoE）模型的架构创新，提出Routing-Free MoE方法，因此与"Mixture of Experts"关键词高度相关（15分）。MoE通常作为大模型（LLMs）的组件，论文属于大模型技术范畴，但与LLMs的具体应用或训练方法无直接关联，给5分。其他关键词如SLMs、训练方法、推理优化、AI应用等均未在摘要中涉及，给0分。

标准混合专家模型依赖于引入刚性归纳偏置的集中式路由机制。我们提出无路由混合专家模型，该模型消除了包括外部路由器、Softmax函数、Top-K选择和负载均衡在内的所有硬编码集中式设计，转而将所有激活功能封装在单个专家内部，并通过连续梯度流直接优化，使每个专家能够完全自主决定其激活状态。我们引入了一个统一的自适应负载均衡框架，通过可配置的插值方法同时优化专家均衡与令牌均衡目标，实现灵活可定制的资源分配。大量实验表明，无路由混合专家模型能够持续超越基线模型，并展现出更好的可扩展性与鲁棒性。我们对其行为进行了详细分析，提供了可能促进未来混合专家模型设计与优化的见解。

Standard Mixture-of-Experts (MoE) models rely on centralized routing mechanisms that introduce rigid inductive biases. We propose Routing-Free MoE which eliminates any hard-coded centralized designs including external routers, Softmax, Top-K and load balancing, instead encapsulating all activation functionalities within individual experts and directly optimized through continuous gradient flow, enabling each expert to determine its activation entirely on its own. We introduce a unified adaptive load-balancing framework to simultaneously optimize both expert-balancing and token-balancing objectives through a configurable interpolation, allowing flexible and customizable resource allocation. Extensive experiments show that Routing-Free MoE can consistently outperform baselines with better scalability and robustness. We analyze its behavior in detail and offer insights that may facilitate future MoE design ad optimization.

评分理由: 论文核心研究LLM agents在长视野、动态环境（网页导航）中处理用户中断的能力，与关键词"Large Language Models"和"LLM Agents"高度相关（10分），因为论文明确使用LLM作为agent骨干并评估其agentic能力。其他关键词如MoE、SFT、RAG、CoT等均未在摘要中提及或涉及，因此评0分。

随着大语言模型智能体从解决简短、静态问题转向在动态环境中执行复杂、长周期的任务，在任务执行过程中处理用户中断（例如增加需求或修改目标）的能力正成为其实际部署的核心要求。然而，现有基准测试大多假设智能体行为不受中断，或仅在简短、无约束的语言任务中研究中断现象。本文首次对长周期、环境具身的网络导航任务中可中断智能体进行了系统性研究，此类任务中的操作会引发持久的状态改变。我们形式化了三种现实的中断类型，包括增加、修改和撤销，并引入了InterruptBench——一个源自WebArena-Lite的基准测试，其在严格的语义约束下合成了高质量的中断场景。通过统一的中断模拟框架，我们评估了六种强大LLM基座模型在单轮和多轮中断设置下的表现，既分析了它们适应更新意图的有效性，也评估了它们从任务中途变更中恢复的效率。我们的研究结果表明，对于当前性能强大的大规模LLM而言，在长周期智能体任务中有效且高效地处理用户中断仍然具有挑战性。代码与数据集发布于https://github.com/HenryPengZou/InterruptBench。

As LLM agents transition from short, static problem solving to executing complex, long-horizon tasks in dynamic environments, the ability to handle user interruptions, such as adding requirement or revising goals, during mid-task execution is becoming a core requirement for realistic deployment. However, existing benchmarks largely assume uninterrupted agent behavior or study interruptions only in short, unconstrained language tasks. In this paper, we present the first systematic study of interruptible agents in long-horizon, environmentally grounded web navigation tasks, where actions induce persistent state changes. We formalize three realistic interruption types, including addition, revision, and retraction, and introduce InterruptBench, a benchmark derived from WebArena-Lite that synthesizes high-quality interruption scenarios under strict semantic constraints. Using a unified interruption simulation framework, we evaluate six strong LLM backbones across single- and multi-turn interruption settings, analyzing both their effectiveness in adapting to updated intents and their efficiency in recovering from mid-task changes. Our results show that handling user interruptions effectively and efficiently during long-horizon agentic tasks remains challenging for powerful large-scale LLMs. Code and dataset are available at https://github.com/HenryPengZou/InterruptBench.

评分理由: 论文PHASOR专注于医学影像（CT）的虚拟对比增强，属于AI for Science（生物医学AI）应用领域，与关键词"AI for Science"高度相关（10分）。论文核心创新之一是提出了anatomy-routed mixture-of-experts (AR-MoE)模块，直接应用了MoE技术，与关键词"Mixture of Experts"高度相关（10分）。论文未涉及大语言模型（LLMs）、模型训练/对齐技术（如RLHF、PEFT）、推理优化（如量化、推测解码）、智能体系统或其他通用AI技术，因此这些关键词评分为0分。

对比增强计算机断层扫描（CECT）对于凸显组织灌注和血管分布至关重要，但其临床应用普及受到造影剂侵入性和辐射风险的限制。虚拟对比增强（VCE）技术提供了从非增强CT（NCCT）合成CECT的替代方案，然而现有方法因解剖结构异质性和空间错位问题，常导致增强模式不一致及细节错误。本文提出PHASOR——一种面向高保真CT虚拟对比增强的体积扩散框架。通过将CT体积数据视为连贯序列，我们利用视频扩散模型来增强结构连贯性与体积精度。为确保解剖-时相一致的合成，我们引入了两个互补模块：首先，解剖路由专家混合模块（AR-MoE）将不同的增强模式锚定于解剖语义，其器官特异性记忆机制能够捕捉显著细节；其次，强度-时相感知表征对齐模块（IP-REPA）在强调精细对比信号的同时，减轻不完美空间对齐的影响。基于三个数据集的广泛实验表明，PHASOR在合成质量和增强准确性方面均显著优于现有先进方法。

Contrast-enhanced computed tomography (CECT) is pivotal for highlighting tissue perfusion and vascularity, yet its clinical ubiquity is impeded by the invasive nature of contrast agents and radiation risks. While virtual contrast enhancement (VCE) offers an alternative to synthesizing CECT from non-contrast CT (NCCT), existing methods struggle with anatomical heterogeneity and spatial misalignment, leading to inconsistent enhancement patterns and incorrect details. This paper introduces PHASOR, a volumetric diffusion framework for high-fidelity CT VCE. By treating CT volumes as coherent sequences, we leverage a video diffusion model to enhance structural coherence and volumetric accuracy. To ensure anatomy-phase consistent synthesis, we introduce two complementary modules. First, anatomy-routed mixture-of-experts (AR-MoE) anchors distinct enhancement patterns to anatomical semantics, with organ-specific memory to capture salient details. Second, intensity-phase aware representation alignment (IP-REPA) highlights intricate contrast signals while mitigating the impact of imperfect spatial alignment. Extensive experiments across three datasets demonstrate that PHASOR significantly outperforms state-of-the-art methods in both synthesis quality and enhancement accuracy.

评分理由: 论文主要研究YouTube Shorts上关于以色列-哈马斯战争的多模态分析，核心是开发一个结合自动转录、基于方面的情感分析（ABSA）和语义场景分类的管道。论文与大多数关键词无关，因为这些关键词主要涉及大模型的技术原理、训练方法、推理优化、对齐技术等，而本文主要应用现成的NLP和计算机视觉技术进行内容分析。唯一相关的关键词是：1）“Small Language Models” OR “SLMs” OR “On-device AI”：得8分，因为摘要明确指出"smaller domain-adapted models outperform large transformers and even LLMs for sentiment analysis”，直接讨论了小模型相对于大模型/LLM的优势，这是论文的一个重要发现。2）“Pre-training” OR “Continual Pre-training” OR “Domain Adaptation”：得5分，因为提到了"domain-adapted models"，暗示了领域适应技术，但这不是论文的核心创新点。3）“Large Language Models” OR “LLMs” OR “Foundation Models”：得2分，因为论文提到了LLMs作为比较基准（“outperform large transformers and even LLMs”），但LLMs本身不是研究焦点。其他关键词如MoE、Scaling Laws、SFT、RLHF、RAG、Attention优化、推理技术、代理、量化等均未涉及。论文属于AI在社会科学/媒体研究中的应用，而非大模型技术原理的创新。

YouTube Shorts已成为该平台新闻消费的核心形式，然而关于地缘政治事件在此类短视频中如何呈现的研究仍显不足。为填补这一空白，本研究提出一种结合自动转录、基于方面的情感分析（Aspect-Based Sentiment Analysis, ABSA）与语义场景分类的多模态分析流程。该流程首先进行可行性评估，随后应用于分析国家资助媒体对以色列-哈马斯战争的短视频报道。通过对2,300余条冲突相关Shorts及94,000多帧视觉画面的分析，我们系统考察了主要国际广播机构的战争报道模式。研究发现：不同媒体机构在特定议题上的文本情感倾向存在差异且随时间演变，而场景分类结果则显示出与现实事件相吻合的视觉线索特征。值得注意的是，在情感分析任务中，经过领域适配的小型模型表现优于大型Transformer模型乃至大语言模型，这凸显了资源高效型方法在人文研究中的价值。本分析流程可为TikTok、Instagram等其他短视频平台提供研究模板，同时证明多模态方法与定性解读相结合，能够有效揭示算法驱动视频环境中情感模式与视觉线索的特征规律。

YouTube Shorts have become central to news consumption on the platform, yet research on how geopolitical events are represented in this format remains limited. To address this gap, we present a multimodal pipeline that combines automatic transcription, aspect-based sentiment analysis (ABSA), and semantic scene classification. The pipeline is first assessed for feasibility and then applied to analyze short-form coverage of the Israel-Hamas war by state-funded outlets. Using over 2,300 conflict-related Shorts and more than 94,000 visual frames, we systematically examine war reporting across major international broadcasters. Our findings reveal that the sentiment expressed in transcripts regarding specific aspects differs across outlets and over time, whereas scene-type classifications reflect visual cues consistent with real-world events. Notably, smaller domain-adapted models outperform large transformers and even LLMs for sentiment analysis, underscoring the value of resource-efficient approaches for humanities research. The pipeline serves as a template for other short-form platforms, such as TikTok and Instagram, and demonstrates how multimodal methods, combined with qualitative interpretation, can characterize sentiment patterns and visual cues in algorithmically driven video environments.

评分理由: 论文《GRASP: Gradient Realignment via Active Shared Perception for Multi-Agent Collaborative Optimization》专注于多智能体强化学习（MARL）领域，提出了一种解决非平稳性问题的框架。其核心贡献在于通过主动共享感知和梯度对齐来优化多智能体协作，这与关键词"Multi-agent Systems" OR “Agent Coordination"高度相关（评分为10分），因为论文直接研究多智能体系统中的协调与优化问题。然而，论文未涉及大语言模型（LLMs）、深度学习技术原理创新、科学领域AI应用或其他指定的大模型相关关键词（如MoE、Scaling Laws、RLHF、RAG等），因此这些关键词均评为0分。论文的研究背景虽然提到关注大模型和深度学习在科学领域的应用，但本文的具体内容并未体现这些方向。

非平稳性源于并行的策略更新，并导致持续的环境波动。现有方法如集中训练分散执行（CTDE）和顺序更新方案缓解了这一问题。然而，由于对其他智能体策略的感知仍依赖于采样环境交互数据，智能体本质上处于被动感知状态。这不可避免地引发均衡振荡，并显著降低系统收敛速度。为解决此问题，我们提出基于主动共享感知的梯度重对齐（GRASP）框架，该框架将广义贝尔曼均衡定义为策略演化的稳定目标。GRASP的核心机制在于利用智能体的独立梯度推导出已定义的共识梯度，使智能体能够主动感知策略更新并优化团队协作。理论上，我们借助角谷不动点定理证明共识方向$u^*$保证了该均衡的存在性与可达性。在星际争霸II多智能体挑战（SMAC）和谷歌研究足球（GRF）平台上的大量实验验证了该框架的可扩展性与优越性能。

Non-stationarity arises from concurrent policy updates and leads to persistent environmental fluctuations. Existing approaches like Centralized Training with Decentralized Execution (CTDE) and sequential update schemes mitigate this issue. However, since the perception of the policies of other agents remains dependent on sampling environmental interaction data, the agent essentially operates in a passive perception state. This inevitably triggers equilibrium oscillations and significantly slows the convergence speed of the system. To address this issue, we propose Gradient Realignment via Active Shared Perception (GRASP), a novel framework that defines generalized Bellman equilibrium as a stable objective for policy evolution. The core mechanism of GRASP involves utilizing the independent gradients of agents to derive a defined consensus gradient, enabling agents to actively perceive policy updates and optimize team collaboration. Theoretically, we leverage the Kakutani Fixed-Point Theorem to prove that the consensus direction $u^*$ guarantees the existence and attainability of this equilibrium. Extensive experiments on StarCraft II Multi-Agent Challenge (SMAC) and Google Research Football (GRF) demonstrate the scalability and promising performance of the framework.

评分理由: 论文专注于AI天气预测，属于AI for Science（科学AI）领域，与关键词’AI for Science OR Bioinformatics OR Cheminformatics’高度相关（10分）。其他关键词均涉及大模型、深度学习技术原理（如LLM、MoE、训练方法、推理优化等），而本文研究的是AI天气预测的数学框架和训练管道，不涉及大模型技术本身，因此其他关键词均为0分。

人工智能天气预报已取得快速发展，但尚未形成统一的数学框架来解释预报技能的决定因素。现有理论主要针对特定架构选择而非整个学习流程，而2023-2026年的业务实践表明，训练方法、损失函数设计和数据多样性至少与架构选择同等重要。本文提出两项交织的贡献：理论上，我们构建了一个根植于球面近似理论、动力系统理论、信息论和统计学习理论的框架，该框架处理完整学习流程（架构、损失函数、训练策略、数据分布）而非仅关注架构。我们建立了学习流程误差分解理论，证明在当前规模下估计误差（依赖损失函数与数据）主导着近似误差（依赖架构）。我们提出损失函数谱理论，形式化球谐坐标中均方误差（MSE）引发的谱模糊效应，并推导出分布外外推边界，证明数据驱动模型系统性地低估破纪录极端天气事件，其偏差随纪录超出量呈线性增长。实证方面，我们通过NVIDIA Earth2Studio平台使用ERA5初始条件对十种架构各异的人工智能天气模型进行推理验证，涵盖所有季节的30个初始化日期并评估六项指标。结果证实：经MSE训练的模型普遍存在高波数谱能量损失；误差共识比持续上升表明大部分预报误差在不同架构间具有共性；极端事件期间存在线性负偏差。我们提出的整体模型评估分数实现了统一的多维评估，而预设框架可在训练前对拟议流程进行数学评估。

AI weather prediction has advanced rapidly, yet no unified mathematical framework explains what determines forecast skill. Existing theory addresses specific architectural choices rather than the learning pipeline as a whole, while operational evidence from 2023-2026 demonstrates that training methodology, loss function design, and data diversity matter at least as much as architecture selection. This paper makes two interleaved contributions. Theoretically, we construct a framework rooted in approximation theory on the sphere, dynamical systems theory, information theory, and statistical learning theory that treats the complete learning pipeline (architecture, loss function, training strategy, data distribution) rather than architecture alone. We establish a Learning Pipeline Error Decomposition showing that estimation error (loss- and data-dependent) dominates approximation error (architecture-dependent) at current scales. We develop a Loss Function Spectral Theory formalizing MSE-induced spectral blurring in spherical harmonic coordinates, and derive Out-of-Distribution Extrapolation Bounds proving that data-driven models systematically underestimate record-breaking extremes with bias growing linearly in record exceedance. Empirically, we validate these predictions via inference across ten architecturally diverse AI weather models using NVIDIA Earth2Studio with ERA5 initial conditions, evaluating six metrics across 30 initialization dates spanning all seasons. Results confirm universal spectral energy loss at high wavenumbers for MSE-trained models, rising Error Consensus Ratios showing that the majority of forecast error is shared across architectures, and linear negative bias during extreme events. A Holistic Model Assessment Score provides unified multi-dimensional evaluation, and a prescriptive framework enables mathematical evaluation of proposed pipelines before training.

评分理由: 论文LAPIS-SHRED专注于复杂时空系统的动态重建与预测，属于AI for Science领域，特别是物理、环境等科学应用，因此与’AI for Science OR Bioinformatics OR Cheminformatics’有一定关联（评分8.0）。论文提到SHRED模型在模拟数据上进行预训练，这与’Pre-training OR Continual Pre-training OR Domain Adaptation’有间接联系（评分5.0）。其他关键词主要涉及大语言模型（LLMs）的技术细节（如MoE、RLHF、RAG等）或特定推理方法（如CoT、MCTS），而本文研究的是基于浅层循环解码器的时空动态重建，未涉及LLMs、深度学习技术原理创新或大模型应用，因此其余关键词评分为0.0。

在复杂系统中，从时空稀疏观测中重建完整的时空动态仍是一个核心挑战，因为测量可能在空间上不完整，且可能局限于狭窄的时间窗口。然而，近似完整的时空轨迹对于机理洞察与理解、模型校准以及操作决策至关重要。本文提出LAPIS-SHRED（基于浅层循环解码器的短时序潜在相位推断），这是一种模块化架构，能够从局限于短时间窗口的稀疏传感器观测中重建和/或预测完整的时空动态。LAPIS-SHRED通过三阶段流程运行：（一）SHRED模型完全在仿真数据上预训练，将传感器时间序列映射到结构化的潜在空间；（二）一个在仿真导出的潜在轨迹上训练的时间序列模型，学习在时间上向前或向后传播潜在状态，以从短观测时间窗口跨越未观测的时间区域；（三）在部署阶段，仅提供来自真实系统的超稀疏传感器测量的短观测窗口，冻结的SHRED模型与时间模型共同从中重建或预测完整的时空轨迹。该框架支持双向推断，从其模块化结构中继承了数据同化和多尺度重建能力，并能适应极端的观测约束，包括单帧终端输入。我们在涵盖复杂时空物理的六个实验中对LAPIS-SHRED进行评估：湍流、多尺度推进物理、不稳定燃烧瞬态以及卫星反演的环境场，突显了其轻量级、模块化的架构，适用于观测受物理或实际条件限制的操作场景。

Reconstructing full spatio-temporal dynamics from sparse observations in both space and time remains a central challenge in complex systems, as measurements can be spatially incomplete and can be also limited to narrow temporal windows. Yet approximating the complete spatio-temporal trajectory is essential for mechanistic insight and understanding, model calibration, and operational decision-making. We introduce LAPIS-SHRED (LAtent Phase Inference from Short time sequence using SHallow REcurrent Decoders), a modular architecture that reconstructs and/or forecasts complete spatiotemporal dynamics from sparse sensor observations confined to short temporal windows. LAPIS-SHRED operates through a three-stage pipeline: (i) a SHRED model is pre-trained entirely on simulation data to map sensor time-histories into a structured latent space, (ii) a temporal sequence model, trained on simulation-derived latent trajectories, learns to propagate latent states forward or backward in time to span unobserved temporal regions from short observational time windows, and (iii) at deployment, only a short observation window of hyper-sparse sensor measurements from the true system is provided, from which the frozen SHRED model and the temporal model jointly reconstruct or forecast the complete spatiotemporal trajectory. The framework supports bidirectional inference, inherits data assimilation and multiscale reconstruction capabilities from its modular structure, and accommodates extreme observational constraints including single-frame terminal inputs. We evaluate LAPIS-SHRED on six experiments spanning complex spatio-temporal physics: turbulent flows, multiscale propulsion physics, volatile combustion transients, and satellite-derived environmental fields, highlighting a lightweight, modular architecture suited for operational settings where observation is constrained by physical or logistical limitations.

评分理由: 论文核心研究LLM智能体在长期规划任务中的表现，与’LLM Agents’高度相关（15分），直接使用LLM作为评估对象（10分），涉及多步推理和深度思考（各10分）。其他关键词如MoE、量化、RAG等未在摘要中提及，评0分。

随着大语言模型智能体处理日益复杂的任务，一个关键问题在于它们能否在长周期内保持战略连贯性：即在不确定性下进行规划、从延迟反馈中学习，并在早期错误产生连锁影响时及时调整。我们推出 $\texttt{YC-Bench}$ 基准测试，通过要求智能体在模拟中运营一家初创公司长达一年时间（涵盖数百个回合），来评估这些能力。智能体必须在部分可观测的环境中管理员工、选择任务合同并维持盈利能力，其中对抗性客户和不断增长的薪资支出会使错误决策产生连锁后果。我们评估了12个专有及开源模型，每个模型运行3次随机种子。仅三个模型能持续超越20万美元的初始资本，其中 Claude Opus 4.6 以平均最终资金127万美元取得最高成绩，紧随其后的是 GLM-5（121万美元），其推理成本低11倍。跨上下文截断时唯一的信息持久化机制——草稿纸使用情况，是预测成功的最强指标；而对抗性客户检测是主要失败模式，导致47%的破产案例。我们的分析表明，前沿模型仍会因特定失败模式（如过度并行化）而失败，这揭示了其在长周期性能方面存在的能力差距。$\texttt{YC-Bench}$ 具有开源、可复现和可配置的特点。

As LLM agents tackle increasingly complex tasks, a critical question is whether they can maintain strategic coherence over long horizons: planning under uncertainty, learning from delayed feedback, and adapting when early mistakes compound. We introduce $\texttt{YC-Bench}$, a benchmark that evaluates these capabilities by tasking an agent with running a simulated startup over a one-year horizon spanning hundreds of turns. The agent must manage employees, select task contracts, and maintain profitability in a partially observable environment where adversarial clients and growing payroll create compounding consequences for poor decisions. We evaluate 12 models, both proprietary and open source, across 3 seeds each. Only three models consistently surpass the starting capital of $200K, with Claude Opus 4.6 achieving the highest average final funds at $1.27 M, followed by GLM-5 at $1.21 M at 11$\times$ lower inference cost. Scratchpad usage, the sole mechanism for persisting information across context truncation, is the strongest predictor of success, and adversarial client detection is the primary failure mode, accounting for $47%$ of bankruptcies. Our analysis reveals that frontier models still fail through distinct failure modes such as over-parallelization, demonstrating the capability gaps for long-horizon performance. $\texttt{YC-Bench}$ is open-source, reproducible, and configurable.

评分理由: 论文提出CliffSearch框架，使用LLM代理（LLM agents）实现进化操作（选择、交叉、变异、评审），属于多代理系统（multi-agent systems），用于科学算法发现（AI for Science）。因此，与’LLM Agents/Autonomous Agents/Agentic Workflow’、‘Multi-agent Systems/Agent Coordination’和’AI for Science/Bioinformatics/Cheminformatics’高度相关（10分）。论文核心使用LLM，与’Large Language Models/LLMs/Foundation Models’高度相关（10分）。其他关键词如MoE、SLMs、训练技术、推理优化、对齐等未在摘要中提及，完全无关（0分）。

科学算法发现是一个迭代过程：假设被提出、实现、压力测试并修正。当前基于大语言模型（LLM）的搜索系统加速了假设生成环节，但通常因仅优化纯代码产物且缺乏严格的正确定/原创性筛选机制，未能充分体现科学结构。我们提出CliffSearch，这是一个智能演化框架，其核心演化算子（配对选择、交叉、变异和评审）均由LLM智能体实现，且循环设计遵循三项原则：（1）每个节点均为结构化的科学产物，以“理论+代码”或“纯代码”模式实例化；（2）评审者对正确性和原创性的判断与目标基准指标的优化同等重要，共同作为核心筛选关口；（3）变异被拆分为探索和修正两条路径，各自具有不同目标。探索变异通过引入相邻科学领域的思想以提升新颖性，而修正变异则利用评审信号（涉及理论、代码、基准结果和运行时错误）进行有针对性的证据引导修复。我们在三项基于基准测试的研究中展示了该框架：Transformer超连接结构演化、固定nanoGPT栈上的优化器发现，以及一项小规模原生优化器的消融实验。在这些场景中，同一循环支持明确的指标导向、可复现的持久化存储，以及在受控搜索条件下通过评审关口对发现进行比较。由此产生的工作流优先考虑科学可解释性与正确性，并在受控的新颖性约束下优化任务指标，而非仅仅追求候选方案的数量。完整运行记录、交互式可视化图表及已报告研究中导出的最佳节点可在 https://cliffsearch.ai 获取。

Scientific algorithm discovery is iterative: hypotheses are proposed, implemented, stress-tested, and revised. Current LLM-guided search systems accelerate proposal generation, but often under-represent scientific structure by optimizing code-only artifacts with weak correctness/originality gating. We present CliffSearch, an agentic evolutionary framework in which the core evolution operators (pair selection, crossover, mutation, and review) are implemented as LLM agents, and the loop is designed around three principles: (1) each node is a structured scientific artifact, instantiated in either theory+code or code_only mode, (2) reviewer judgments of correctness and originality are first-class selection gates alongside optimization of the benchmark metric of interest, and (3) mutation is split into exploration and correction pathways with distinct objectives. Exploration mutation imports ideas from adjacent scientific domains to increase novelty, while correction mutation performs targeted evidence-guided repair using reviewer signals over theory, code, benchmark results, and runtime errors. We illustrate the framework on three benchmark-grounded studies: transformer hyper-connection evolution, optimizer discovery on a fixed nanoGPT stack, and a smaller native-optimizer ablation. Across these settings, the same loop supports explicit metric direction, reproducible persistence, and reviewer-gated comparison of discoveries under controlled search conditions. The result is a discovery workflow that prioritizes scientific interpretability and correctness while optimizing task metrics under controlled novelty constraints, rather than maximizing candidate throughput alone. Full run artifacts, interactive visualizations, and exported best nodes for the reported studies are available at https://cliffsearch.ai .

评分理由: 该论文专注于计算机视觉和图形学领域的神经表示方法，特别是用于3D重建和新视角合成的Neural Harmonic Textures技术。论文内容涉及3D高斯泼溅、神经场、傅里叶分析、周期性激活函数等，但完全不涉及大语言模型、深度学习技术原理创新、AI for Science等关键词。所有关键词均与大模型、深度学习技术原理或科学应用无关，因此所有关键词相关度均为0分。

基于基元的方法（如3D高斯泼溅）近年来已成为新视角合成及相关重建任务的前沿技术。与神经场相比，这类表征更具灵活性、自适应性，且能更好地扩展至大场景。然而，单个基元的有限表达能力使得高频细节建模面临挑战。我们提出神经谐波纹理（Neural Harmonic Textures），这是一种将潜在特征向量锚定在每个基元周围虚拟支架上的神经表征方法。这些特征在光线交点处于基元内部进行插值。受傅里叶分析启发，我们对插值后的特征施加周期性激活函数，将阿尔法混合转化为谐波分量的加权求和。随后通过一个轻量神经网络在单次延迟传递中对生成的信号进行解码，显著降低了计算成本。神经谐波纹理在实时新视角合成中取得了领先成果，同时弥合了基于基元与基于神经场的重建方法之间的差距。我们的方法可无缝集成到现有基元驱动流程中，如3DGUT、三角泼溅（Triangle Splatting）和2DGS。我们进一步通过其在二维图像拟合与语义重建中的应用验证了该方法的通用性。

Primitive-based methods such as 3D Gaussian Splatting have recently become the state-of-the-art for novel-view synthesis and related reconstruction tasks. Compared to neural fields, these representations are more flexible, adaptive, and scale better to large scenes. However, the limited expressivity of individual primitives makes modeling high-frequency detail challenging. We introduce Neural Harmonic Textures, a neural representation approach that anchors latent feature vectors on a virtual scaffold surrounding each primitive. These features are interpolated within the primitive at ray intersection points. Inspired by Fourier analysis, we apply periodic activations to the interpolated features, turning alpha blending into a weighted sum of harmonic components. The resulting signal is then decoded in a single deferred pass using a small neural network, significantly reducing computational cost. Neural Harmonic Textures yield state-of-the-art results in real-time novel view synthesis while bridging the gap between primitive- and neural-field-based reconstruction. Our method integrates seamlessly into existing primitive-based pipelines such as 3DGUT, Triangle Splatting, and 2DGS. We further demonstrate its generality with applications to 2D image fitting and semantic reconstruction.

评分理由: 论文研究大型语言模型（LLMs）在推理过程中的决策机制，核心关注点包括：1）Chain-of-Thought推理过程（高度相关，10分）；2）工具调用决策（Tool Use，高度相关，10分）；3）系统2思维/深度推理（System 2 Thinking，8分）；4）机制可解释性（Mechanistic Interpretability，8分）；5）自我反思/自我改进（Self-Correction，5分）。论文未涉及其他关键词如MoE、量化、RAG、对齐等具体技术。

我们探讨以下问题：当大型语言推理模型做出选择时，它是先思考后决定，还是先决定后思考？本文提供的证据表明，在推理模型中，可检测的、早期编码的决策会影响思维链的生成。具体而言，我们证明一个简单的线性探针能够以极高的置信度从生成前的激活状态中解码工具调用决策，在某些情况下，甚至能在模型产生第一个推理标记之前就实现解码。激活导向从因果角度支持了这一发现：扰动决策方向会导致模型过度“斟酌”，并在许多示例中改变其行为（改变比例在7%至79%之间，具体取决于模型和基准测试）。通过行为分析我们还发现，当导向改变决策时，思维链过程往往会合理化这种转变而非抵抗它。综合来看，这些结果表明，推理模型可能在开始文本层面的推演之前就已编码了行动选择。

We consider the question: when a large language reasoning model makes a choice, did it think first and then decide to, or decide first and then think? In this paper, we present evidence that detectable, early-encoded decisions shape chain-of-thought in reasoning models. Specifically, we show that a simple linear probe successfully decodes tool-calling decisions from pre-generation activations with very high confidence, and in some cases, even before a single reasoning token is produced. Activation steering supports this causally: perturbing the decision direction leads to inflated deliberation, and flips behavior in many examples (between 7 - 79% depending on model and benchmark). We also show through behavioral analysis that, when steering changes the decision, the chain-of-thought process often rationalizes the flip rather than resisting it. Together, these results suggest that reasoning models can encode action choices before they begin to deliberate in text.

评分理由: 论文核心研究搜索代理（Search Agents），涉及语言模型与网络搜索的集成，属于LLM Agents范畴（高度相关10分）。研究使用Qwen3-4B（4B参数模型）进行训练，属于Small Language Models（8分）。方法涉及多步检索和推理（Chain of Thought 10分，System 2 Thinking 8分），并采用Retrieval-Augmented Generation（RAG）框架（10分）。训练使用GRPO（一种强化学习优化方法），与Post-training/SFT相关（8分）。验证阶段涉及自我和外部验证，与Self-Correction（5分）和Factuality（5分）相关。数据生成框架关注低成本合成数据，与Scaling Laws & Data Quality有一定关联（5分）。工具使用体现在搜索代理的API/工具集成（5分）。其他关键词如MoE、PEFT、量化等未在论文中涉及，评分为0。

将语言模型（LMs）与网络搜索相结合的搜索智能体，正日益成为回答复杂用户查询的关键工具。然而，针对涉及多步检索与推理的深度研究任务构建训练数据集仍面临挑战，这主要源于高昂的人工标注成本或繁琐的先决条件。本研究提出了ORBIT，一个包含2万个推理密集型查询及其简短可验证答案的训练数据集，该数据集通过一个无需依赖付费API服务的轻量级框架生成。该模块化框架包含四个阶段：种子创建、问答对生成，以及两个验证阶段：自我验证与外部验证。ORBIT涵盖15个领域，每个训练对需要4至5步推理，且需通过完整的网络进行外部搜索验证。我们以Qwen3-4B为基础模型，使用GRPO方法在ORBIT上进行训练，并在维基百科问答任务上对其评估。大量实验结果表明，ORBIT-4B在4B参数以下的大型语言模型（LLMs）作为搜索智能体时表现出色，验证了合成数据集的实用性。我们的框架、代码与数据集均已开源并公开提供。

Search agents, which integrate language models (LMs) with web search, are becoming crucial for answering complex user queries. Constructing training datasets for deep research tasks, involving multi-step retrieval and reasoning, remains challenging due to expensive human annotation, or cumbersome prerequisites. In this work, we introduce ORBIT, a training dataset with 20K reasoning-intensive queries with short verifiable answers, generated using a frugal framework without relying on paid API services. The modular framework relies on four stages: seed creation, question–answer pair generation, and two stages of verification: self and external. ORBIT spans 15 domains and each training pair requires 4–5 reasoning steps, with external search verification required from the complete web. We train Qwen3-4B as the base model on ORBIT using GRPO and evaluate it on Wikipedia question answering tasks. Extensive experiment results demonstrate that ORBIT-4B achieves strong performance among sub-4B LLMs as search agents, proving the utility of synthetic datasets. Our framework, code and datasets are open-sourced and available publicly.

评分理由: 论文主要研究Florence-2（一个基础视觉语言模型）在机器人系统中的实际部署和集成，通过ROS 2包装器实现本地推理。与关键词的相关性分析如下：1）高度相关（8分）：论文明确涉及基础模型（Foundation Models）在机器人领域的应用，Florence-2属于视觉语言基础模型，符合“大模型在不同领域的研究应用”标准。2）其他关键词（0分）：论文聚焦于工程部署和系统集成（ROS 2包装器、本地执行、吞吐量测试），未涉及模型架构创新（如MoE、量化）、训练方法（如预训练、微调）、推理优化（如注意力机制）、代理系统或多步推理等技术原理。尽管属于AI应用，但未专门针对科学领域（如生物信息学），且未提及其他关键词的具体内容。

基础视觉-语言模型正日益与机器人技术产生紧密关联，因其能提供比特定任务专用流程更丰富的语义感知能力。然而，这些模型在机器人软件栈中的实际应用，仍取决于可复现的中间件集成，而非仅依赖于模型质量本身。Florence-2 在这方面尤其具有吸引力，因为它将图像描述、光学字符识别、开放词汇检测、视觉定位及相关视觉-语言任务统一整合在一个相对可控的模型规模内。本文介绍了一种 Florence-2 的 ROS 2 封装器，该封装器通过三种互补的交互模式提供模型功能：持续的主题驱动处理、同步服务调用以及异步动作执行。该封装器设计用于本地运行，支持原生安装和 Docker 容器部署两种方式。同时，它结合了通用 JSON 输出与面向检测任务的标准 ROS 2 消息绑定。文中报告了功能验证结果以及在多种 GPU 上的吞吐量研究，表明使用消费级硬件进行本地部署是可行的。代码仓库已公开：https://github.com/JEDominguezVidal/florence2_ros2_wrapper

Foundation vision-language models are becoming increasingly relevant to robotics because they can provide richer semantic perception than narrow task-specific pipelines. However, their practical adoption in robot software stacks still depends on reproducible middleware integrations rather than on model quality alone. Florence-2 is especially attractive in this regard because it unifies captioning, optical character recognition, open-vocabulary detection, grounding and related vision-language tasks within a comparatively manageable model size. This article presents a ROS 2 wrapper for Florence-2 that exposes the model through three complementary interaction modes: continuous topic-driven processing, synchronous service calls and asynchronous actions. The wrapper is designed for local execution and supports both native installation and Docker container deployment. It also combines generic JSON outputs with standard ROS 2 message bindings for detection-oriented tasks. A functional validation is reported together with a throughput study on several GPUs, showing that local deployment is feasible with consumer grade hardware. The repository is publicly available here: https://github.com/JEDominguezVidal/florence2_ros2_wrapper

评分理由: 论文提出了一种名为Multiscreen的新型语言模型架构，通过引入screening机制来解决标准softmax注意力机制中缺乏绝对查询-键相关性的问题。该研究直接涉及大语言模型架构创新（高度相关），并显著改进了长上下文处理能力（在100K上下文长度下减少推理延迟3.2倍），因此与’Context Window Extension OR Long Context LLMs’、‘KV Cache Compression OR Linear Attention OR FlashAttention’和’Speculative Decoding OR Inference Acceleration’高度相关。论文未涉及其他关键词领域，如MoE、小模型、对齐、RAG、代理等。

标准softmax注意力的一个核心局限在于，其未定义查询与键的绝对相关性概念：注意力权重是通过依据所有键的相对得分重新分配固定单位质量而获得的。因此，相关性仅相对于竞争键来定义，且无法明确排除无关键。我们提出了Multiscreen，这是一种围绕我们称为“筛选”机制构建的语言模型架构，该机制能够实现查询与键的绝对相关性。筛选并非在所有键间重新分配注意力，而是依据一个明确的阈值评估每个键，丢弃无关键并聚合剩余键，从而消除了键之间的全局竞争。在多项实验中，与Transformer基线相比，Multiscreen以约40%更少的参数取得了相当的验证损失，能在显著更大的学习率下实现稳定优化，在长上下文困惑度上保持强劲性能，即使远超训练上下文长度，其检索性能也几乎未见下降，并在100K上下文长度下将推理延迟降低了高达3.2倍。

A core limitation of standard softmax attention is that it does not define a notion of absolute query–key relevance: attention weights are obtained by redistributing a fixed unit mass across all keys according to their relative scores. As a result, relevance is defined only relative to competing keys, and irrelevant keys cannot be explicitly rejected. We introduce Multiscreen, a language-model architecture built around a mechanism we call screening, which enables absolute query–key relevance. Instead of redistributing attention across all keys, screening evaluates each key against an explicit threshold, discarding irrelevant keys and aggregating the remaining keys, thereby removing global competition among keys. Across experiments, Multiscreen achieves comparable validation loss with approximately 40% fewer parameters than a Transformer baseline, enables stable optimization at substantially larger learning rates, maintains strong performance in long-context perplexity, shows little to no degradation in retrieval performance even far beyond the training context length, and reduces inference latency by up to 3.2$\times$ at 100K context length.

评分理由: 论文核心研究LLM推理过程中的校准问题，与’Large Language Models’高度相关（10分）。论文明确提到’post-trained language models’，与’Post-training’高度相关（10分）。研究涉及推理任务中的校准，与’Chain of Thought’和’System 2 Thinking’高度相关（各10分）。其他关键词如MoE、SLMs、Scaling Laws、RLHF、RAG、Quantization等未在摘要中提及，与论文内容无关（0分）。

尽管测试时缩放技术使大语言模型能够解决高难度任务，但最先进的结果往往伴随着极高的计算成本。这些低效问题可归因于后训练语言模型的校准失准，以及主流采样技术中校准机制的缺失。本文提出在线推理校准框架，该框架结合了共形预测与测试时训练技术，旨在对采样过程进行校准。具体而言，我们引入一种元学习流程，能够针对每个输入动态更新校准模块。这使得我们能够在分布偏移情况下提供有效的置信度估计，例如跨越不同推理阶段出现的思维模式差异，或模型开发与部署阶段的提示分布差异。ORCA不仅为共形风险提供理论保证，更在不同推理任务中实证展现出更高的效率与泛化能力。在风险水平δ=0.1时，ORCA将Qwen2.5-32B模型在分布内任务上的效率提升至47.5%（使用监督标签）和40.7%（使用自洽性标签）。在零样本域外设定下，该框架将MATH-500数据集的节省率从静态校准基线的24.8%提升至67.0%，同时保持较低的经验错误率，这一优势在不同模型家族与下游基准测试中均得到验证。我们的代码已公开于https://github.com/wzekai99/ORCA。

While test-time scaling has enabled large language models to solve highly difficult tasks, state-of-the-art results come at exorbitant compute costs. These inefficiencies can be attributed to the miscalibration of post-trained language models, and the lack of calibration in popular sampling techniques. Here, we present Online Reasoning Calibration (ORCA), a framework for calibrating the sampling process that draws upon conformal prediction and test-time training. Specifically, we introduce a meta-learning procedure that updates the calibration module for each input. This allows us to provide valid confidence estimates under distributional shift, e.g. in thought patterns that occur across different stages of reasoning, or in prompt distributions between model development and deployment. ORCA not only provides theoretical guarantees on conformal risks, but also empirically shows higher efficiency and generalization across different reasoning tasks. At risk level $δ=0.1$, ORCA improves Qwen2.5-32B efficiency on in-distribution tasks with savings up to 47.5% with supervised labels and 40.7% with self-consistency labels. Under zero-shot out-of-domain settings, it improves MATH-500 savings from 24.8% of the static calibration baseline to 67.0% while maintaining a low empirical error rate, and the same trend holds across model families and downstream benchmarks. Our code is publicly available at https://github.com/wzekai99/ORCA.

评分理由: 论文提出AdaLoRA-QAT框架，专注于医学图像分割领域的大模型高效部署。核心创新点包括：1）自适应低秩适配（AdaLoRA），属于参数高效微调（PEFT）范畴，与关键词’PEFT OR LoRA OR Parameter-efficient Fine-tuning’高度相关（15分）；2）量化感知训练（QAT），实现模型压缩，与关键词’Quantization OR Model Compression OR Low-bit Weights’高度相关（15分）；3）应用于胸部X光分割，属于生物信息学/科学AI应用，与关键词’AI for Science OR Bioinformatics OR Cheminformatics’相关（10分）；4）基于基础模型（如SAM）进行微调，与关键词’Post-training OR Supervised Fine-tuning OR SFT’相关（10分）；5）整体涉及大模型/基础模型在特定领域的应用，与关键词’Large Language Models OR LLMs OR Foundation Models’有一定关联（8分）。其他关键词如MoE、Scaling Laws、RLHF、RAG等与论文内容无关，得0分。

胸部X光（Chest X-ray, CXR）分割是计算机辅助诊断中的重要步骤，然而由于计算资源的限制，在临床环境中部署大型基础模型仍具挑战性。我们提出了AdaLoRA-QAT，一种结合了自适应低秩编码器适配与全量化感知训练的两阶段微调框架。自适应秩分配提升了参数效率，而选择性混合精度INT8量化则保留了对于临床可靠性至关重要的结构保真度。在大规模CXR数据集上的评估表明，AdaLoRA-QAT取得了95.6%的Dice系数，与全精度SAM解码器微调性能相当，同时将可训练参数减少了16.6倍，并实现了2.24倍的模型压缩。Wilcoxon符号秩检验证实量化并未显著降低分割精度。这些结果表明，AdaLoRA-QAT在准确性、效率和结构可信度之间实现了有效平衡，为医学图像分割提供了紧凑且可部署的基础模型。代码与预训练模型已公开于：https://prantik-pdeb.github.io/adaloraqat.github.io/

Chest X-ray (CXR) segmentation is an important step in computer-aided diagnosis, yet deploying large foundation models in clinical settings remains challenging due to computational constraints. We propose AdaLoRA-QAT, a two-stage fine-tuning framework that combines adaptive low-rank encoder adaptation with full quantization-aware training. Adaptive rank allocation improves parameter efficiency, while selective mixed-precision INT8 quantization preserves structural fidelity crucial for clinical reliability. Evaluated across large-scale CXR datasets, AdaLoRA-QAT achieves 95.6% Dice, matching full-precision SAM decoder fine-tuning while reducing trainable parameters by 16.6\times and yielding 2.24\times model compression. A Wilcoxon signed-rank test confirms that quantization does not significantly degrade segmentation accuracy. These results demonstrate that AdaLoRA-QAT effectively balances accuracy, efficiency, and structural trust-worthiness, enabling compact and deployable foundation models for medical image segmentation. Code and pretrained models are available at: https://prantik-pdeb.github.io/adaloraqat.github.io/

评分理由: 论文核心研究MoE-LoRA架构用于LLM的持续多领域微调，高度相关关键词包括：MoE、LoRA/PEFT、LLMs、Continual Pre-training/Domain Adaptation、SFT、DPO、Quantization、Chain of Thought。论文使用TinyLlama-1.1B和Gemma 3 12B，涉及小模型但非核心，给5分。提到医学领域应用，与AI for Science相关但非重点，给5分。其他关键词如Scaling Laws、RAG、Context Window等未涉及，给0分。

本文提出Brainstacks，一种用于大语言模型持续多领域微调的模块化架构，其将领域专业知识封装为冻结的适配器栈，在推理时以可叠加方式组合于共享的冻结基础模型之上。该架构包含五个相互关联的组件：（1）MoE-LoRA：采用Shazeer式带噪声的top-2路由机制，作用于QLoRA 4位量化与rsLoRA缩放下的全部七个Transformer投影层；（2）内循环：通过冻结已训练栈并添加新栈进行残差增强；（3）外循环：按照课程排序的依赖关系，顺序训练领域专用栈；（4）零空间投影：通过随机化SVD将新栈约束至与先前方向正交的子空间，实现孤立状态下的零遗忘；（5）基于结果的Sigmoid元路由器：基于经验发现的领域组合目标进行训练，可选择性加权各栈，实现跨领域组合。两项边界实验：（6）在随机初始化模型上进行PSN预训练；（7）逐领域强化学习（DPO/GRPO），验证其与SFT后对齐方法的兼容性。在TinyLlama-1.1B（4个领域，9个栈）和Gemma 3 12B IT（5个领域，10个栈）上的验证表明：MoE-LoRA比参数匹配的单LoRA收敛速度快2.5倍；残差增强突破了单栈性能上限；路由系统恢复了因无门控栈累积而破坏的生成质量。核心发现：基于结果的路由器揭示出领域栈编码的是可迁移的认知基元（如指令遵循清晰度、数值推理、程序逻辑、思维链结构），而非领域特定知识——尽管相关栈中未包含任何医学数据，医学提示在97%的情况下被路由至聊天栈与数学栈的组合。

We present Brainstacks, a modular architecture for continual multi-domain fine-tuning of large language models that packages domain expertise as frozen adapter stacks composing additively on a shared frozen base at inference. Five interlocking components: (1) MoE-LoRA with Shazeer-style noisy top-2 routing across all seven transformer projections under QLoRA 4-bit quantization with rsLoRA scaling; (2) an inner loop performing residual boosting by freezing trained stacks and adding new ones; (3) an outer loop training sequential domain-specific stacks with curriculum-ordered dependencies; (4) null-space projection via randomized SVD constraining new stacks to subspaces orthogonal to prior directions, achieving zero forgetting in isolation; (5) an outcome-based sigmoid meta-router trained on empirically discovered domain-combination targets that selectively weights stacks, enabling cross-domain composition. Two boundary experiments: (6) PSN pretraining on a randomly initialized model; (7) per-domain RL (DPO/GRPO) validating compatibility with post-SFT alignment. Validated on TinyLlama-1.1B (4 domains, 9 stacks) and Gemma 3 12B IT (5 domains, 10 stacks), MoE-LoRA achieves 2.5x faster convergence than parameter-matched single LoRA, residual boosting breaks through the single-stack ceiling, and the routed system recovers generation quality destroyed by ungated stack accumulation. The central finding: the outcome-based router discovers that domain stacks encode transferable cognitive primitives (instruction-following clarity, numerical reasoning, procedural logic, chain-of-thought structure) rather than domain-specific knowledge, with medical prompts routing to chat+math stacks in 97% of cases despite zero medical data in those stacks.

评分理由: 论文核心研究多智能体系统中LLM智能体的共谋检测问题，与’LLM Agents’、‘Multi-agent Systems’和’Mechanistic Interpretability’高度相关（10分），因为这些是论文的直接研究对象和方法。论文涉及LLM，但主要关注智能体应用而非LLM技术本身，因此’Large Language Models’给8分。其他关键词如MoE、SFT、RAG等与论文内容无关，均给0分。

随着大语言模型智能体在多智能体系统中日益广泛的应用，其可能引发的隐蔽协同风险可能规避常规形式的人工监督。尽管基于模型激活的线性探针在单智能体场景中已显示出检测欺骗行为的潜力，但共谋本质上是一种多智能体现象，利用内部表征检测智能体间共谋的研究仍属空白。我们提出了NARCBench——一个用于评估环境分布偏移下共谋检测能力的基准，并提出了五种探针技术，通过聚合单智能体欺骗分数来实现群体层面的场景分类。我们的探针在分布内测试中取得了1.00的AUROC值，在零样本迁移到结构不同的多智能体场景及隐写式二十一点纸牌记牌任务中，AUROC值达到0.60–0.86。研究发现，没有任何单一探针技术能在所有共谋类型中保持最优，这表明不同形式的共谋在激活空间中具有不同的表征模式。我们还发现了初步证据，表明该信号定位于词元级别：共谋智能体的激活值在其处理伙伴消息的编码部分时会特异性突增。这项工作向多智能体可解释性迈出了一步：将白盒检测从单一模型扩展到多智能体场景，其中检测需要聚合跨智能体的信号。这些结果表明，模型内部状态为文本级监控提供了补充信号，尤其适用于能够获取模型激活的组织机构，可用于检测多智能体共谋。代码与数据详见https://github.com/aaronrose227/narcbench。

As LLM agents are increasingly deployed in multi-agent systems, they introduce risks of covert coordination that may evade standard forms of human oversight. While linear probes on model activations have shown promise for detecting deception in single-agent settings, collusion is inherently a multi-agent phenomenon, and the use of internal representations for detecting collusion between agents remains unexplored. We introduce NARCBench, a benchmark for evaluating collusion detection under environment distribution shift, and propose five probing techniques that aggregate per-agent deception scores to classify scenarios at the group level. Our probes achieve 1.00 AUROC in-distribution and 0.60–0.86 AUROC when transferred zero-shot to structurally different multi-agent scenarios and a steganographic blackjack card-counting task. We find that no single probing technique dominates across all collusion types, suggesting that different forms of collusion manifest differently in activation space. We also find preliminary evidence that this signal is localised at the token level, with the colluding agent’s activations spiking specifically when processing the encoded parts of their partner’s message. This work takes a step toward multi-agent interpretability: extending white-box inspection from single models to multi-agent contexts, where detection requires aggregating signals across agents. These results suggest that model internals provide a complementary signal to text-level monitoring for detecting multi-agent collusion, particularly for organisations with access to model activations. Code and data are available at https://github.com/aaronrose227/narcbench.