评分理由: 论文核心研究递归自我改进（recursive self-improvement）中的递归漂移问题，提出NSRSA框架，通过符号验证子系统在推理步骤层面筛选训练数据质量。该研究高度相关于大模型（LLMs）、对齐（Alignment）、DPO、思维链（CoT）、系统2思维（System 2 Thinking）和自我改进（Self-Improvement），因为这些是论文的核心技术和方法。与数据质量（Scaling Laws AND Data Quality）、幻觉缓解（Hallucination Mitigation）和可解释AI（Explainable AI）有一定关联，因为论文涉及数据筛选和推理验证。其他关键词如MoE、SLMs、预训练、RAG、量化等未在论文中涉及，评为0分。

递归自我改进——即模型基于自身输出进行迭代训练——虽能带来持续的能力增长，却面临一个根本性障碍：递归漂移。当模型在多轮迭代中基于自生成数据进行训练时，中间推理过程中的误差会不断累积，导致模式崩溃与性能下降。我们提出神经符号递归自对齐（Neuro-Symbolic Recursive Self-Alignment, NSRSA），该方法通过嵌入一个符号验证子系统，在推理步骤层面控制训练数据质量，从而稳定迭代式自训练。与仅基于结果的过滤方法（会纳入推理过程存在缺陷的“侥幸猜中”答案）不同，NSRSA通过sympy验证每个算术运算步骤，检查推理步骤间的逻辑流一致性，并强制执行领域约束。我们在GSM8K数据集上使用Qwen3-4B-Thinking模型，在五种条件下（无验证、结果验证、多数投票、完整NSRSA符号验证、以及NSRSA结合DPO）进行了5轮自训练迭代评估。我们的过滤分析表明，NSRSA拒绝了约34%能通过结果验证的正确答案解法，从而将推理有误的“侥幸猜中”样本从训练集中剔除。我们进一步证明，基于NSRSA验证结果构建的DPO偏好对，能够教会模型区分严谨与有缺陷的推理（奖励模型准确率从46%提升至63%）。NSRSA提供了一个可扩展的框架，证明了在可实现自动验证的领域内，外部符号验证如何使递归自我改进变得可衡量且可靠。

Recursive self-improvement–where a model iteratively trains on its own outputs–promises sustained capability growth but faces a fundamental obstacle: recursive drift. As models train on self-generated data across multiple iterations, errors in intermediate reasoning compound, leading to mode collapse and performance degradation. We propose Neuro-Symbolic Recursive Self-Alignment (NSRSA), which stabilizes iterative self-training by embedding a symbolic verification subsystem that gates training data quality at the reasoning step level. Unlike outcome-only filtering (which admits “lucky guesses” with flawed reasoning), NSRSA verifies each arithmetic operation via sympy, checks logical flow consistency across reasoning steps, and enforces domain constraints. We evaluate NSRSA on GSM8K using Qwen3-4B-Thinking across 5 self-training iterations under five conditions: no verification, outcome verification, majority voting, full NSRSA symbolic verification, and NSRSA with DPO. Our filtering analysis shows that NSRSA rejects approximately 34% of correct-answer solutions that pass outcome verification, eliminating “lucky guesses” with flawed reasoning from the training set. We further demonstrate that constructing DPO preference pairs from NSRSA verification teaches the model to distinguish sound from flawed reasoning (reward accuracy 46% to 63%). NSRSA provides an extensible framework that demonstrates how external symbolic verification can make recursive self-improvement measurable and reliable within domains where automated verification is available.

!!! info

论文采用迭代自训练循环，每轮包括生成、验证、训练和评估四个步骤。核心在于验证策略：1. 生成阶段使用模型对每个问题采样多个解；2. 验证阶段应用NSRSA过滤器，通过解析算术表达式并用sympy计算验证算术正确性，通过跟踪变量赋值验证逻辑流一致性，以及检查领域约束；3. 仅通过所有检查的解进入训练集用于微调模型。此外，还对比了无验证、仅结果验证、多数投票等基线，并探索了结合DPO利用验证结果构建偏好对的方法。

• 细粒度验证：超越了传统的结果监督，实现了过程级的符号验证，能有效识别并过滤掉推理有缺陷的数据。
• 解决递归漂移：针对递归自我改进中的核心痛点（错误累积和模式崩溃）提出了有效的解决方案。
• 自动化流程：利用符号计算工具实现了自动化的步骤级验证，无需人工标注步骤标签。
• 提升推理质量：不仅关注答案正确性，更强调推理过程的合理性，有助于提升模型的内在推理能力。

• 解析覆盖限制：算术验证依赖于文本解析，对于无法解析的表达式（如自然语言描述的运算）可能无法检测错误。
• 逻辑流简化：逻辑流验证基于简单的字符串匹配而非复杂的指代消解，可能遗漏重命名变量或代词指代导致的错误。
• 领域特定性：目前的验证规则主要针对数学问题，扩展到其他领域可能需要重新设计验证器。
• 计算开销：对每个生成的解进行多步符号验证会增加计算成本。

评分理由: 论文研究多模态大语言模型（MLLMs）在具身智能体中的空间推理和规划能力，核心贡献包括：1）引入Video2Mental基准评估MLLMs的"心理导航"能力；2）提出NavMind模型，通过显式认知地图作为中间表示来增强结构化规划。论文高度相关于大模型技术（LLMs/MLLMs）、推理方法（CoT/System 2 Thinking）、智能体（LLM Agents）和世界模型（World Models），并明确使用监督微调（SFT）进行训练。其他关键词如MoE、量化、RAG等未涉及。

尽管多模态大语言模型（MLLMs）在具身智能体中被广泛采用，但其能力仍主要局限于基于即时观察的反应式规划，在跨越广阔时空尺度的空间推理方面始终表现不佳。认知科学揭示，生物智能（BI）的优势在于“心理导航”：即从经验中策略性地构建空间表征，并在行动前进行路径的心理模拟。为弥合人工智能（AI）与生物智能之间的差距，我们提出了Video2Mental，一个用于评估MLLMs心理导航能力的开创性基准。该任务要求从长时第一人称视角视频中构建分层认知地图，并逐步生成基于地标的路径规划，其规划准确性通过基于模拟器的物理交互进行验证。我们的基准测试结果表明，心理导航能力并未从标准预训练中自然涌现。前沿的MLLMs在零样本结构化空间表征方面存在显著困难，且其规划准确性随规划时域的延长而急剧下降。为克服这一局限，我们提出了\textbf{NavMind}，一种推理模型，它通过将显式、细粒度的认知地图作为可学习的中间表征，将心理导航过程内化。通过采用难度分层的渐进式监督微调范式，NavMind有效弥合了原始感知与结构化规划之间的鸿沟。实验证明，NavMind实现了卓越的心理导航能力，显著超越了前沿的商业及空间专用MLLMs。

Despite the widespread adoption of MLLMs in embodied agents, their capabilities remain largely confined to reactive planning from immediate observations, consistently failing in spatial reasoning across extensive spatiotemporal scales. Cognitive science reveals that Biological Intelligence (BI) thrives on “mental navigation”: the strategic construction of spatial representations from experience and the subsequent mental simulation of paths prior to action. To bridge the gap between AI and BI, we introduce Video2Mental, a pioneering benchmark for evaluating the mental navigation capabilities of MLLMs. The task requires constructing hierarchical cognitive maps from long egocentric videos and generating landmark-based path plans step by step, with planning accuracy verified through simulator-based physical interaction. Our benchmarking results reveal that mental navigation capability does not naturally emerge from standard pre-training. Frontier MLLMs struggle profoundly with zero-shot structured spatial representation, and their planning accuracy decays precipitously over extended horizons. To overcome this, we propose \textbf{NavMind}, a reasoning model that internalizes mental navigation using explicit, fine-grained cognitive maps as learnable intermediate representations. Through a difficulty-stratified progressive supervised fine-tuning paradigm, NavMind effectively bridges the gap between raw perception and structured planning. Experiments demonstrate that NavMind achieves superior mental navigation capabilities, significantly outperforming frontier commercial and spatial MLLMs.

!!! info

论文首先构建了Video2Mental基准，包含长第一人称视频数据，任务要求构建分层认知地图并生成基于地标的路径规划，通过模拟器进行物理交互验证。随后，作者提出了NavMind模型，该模型将认知地图显式地整合到推理过程中。在训练阶段，采用了难度分层的渐进式监督微调策略，逐步提升模型处理复杂空间结构的能力。

• 跨学科创新：将认知科学中的心理导航概念引入AI领域，为具身智能提供了新的视角。
• 评估严谨：通过模拟器进行物理交互验证，而非仅依赖文本生成，确保了评估的真实性。
• 针对性强：有效解决了MLLMs在长时序、大尺度空间推理中的核心瓶颈。
• 方法可解释：引入显式的认知地图作为中间表征，增强了模型推理过程的可解释性。

• 依赖模拟器环境，可能无法完全覆盖现实世界中极其复杂和动态的物理环境。
• 需要特定的分层认知地图数据进行监督微调，数据获取和标注成本较高。
• 模型架构引入了额外的中间表征，可能会增加计算开销和推理延迟。

评分理由: 论文核心研究大语言模型（LLMs）的长上下文推理能力，通过结构化表格数据增强该能力，属于大模型技术原理创新。高度相关的关键词包括：LLMs（核心研究对象）、Post-training（通过RL增强推理）、Long Context LLMs（核心研究问题）、RLHF（使用RL方法）、CoT Reasoning和System 2 Thinking（涉及深度推理）。中等相关的关键词：Scaling Laws AND Data Quality（涉及数据质量和扩展实验）、Mechanistic Interpretability（分析底层机制）。其他关键词未在论文中涉及。

随着现实世界任务日益复杂，长上下文推理已成为大语言模型（LLM）的核心能力。然而，目前少有研究探讨何种数据类型对长上下文推理有效及其原因。我们发现具有周期性结构的结构化表格数据展现出长上下文推理的强大潜力。基于这一观察，我们利用互信息对表格依赖结构进行数学分析，揭示了表格数据中周期性不衰减的依赖关系。进一步，我们系统分析了结构化表格数据的能力，开展了相关的扩展实验，并验证了其增强长上下文推理的内在机制，从而获得了若干有意义的洞见。基于这些洞见，我们提出了一种简单且可扩展的流程（TableLong），用于合成高质量、多样化且可验证的结构化表格数据，以通过强化学习（RL）提升长上下文推理能力。大量实验结果表明，表格数据显著提升了LLM在多个长上下文基准测试上的推理能力（平均提升8.24%），甚至改善了其在领域外基准测试上的性能（平均提升8.06%）。我们希望这些洞见能为提升LLM长上下文推理能力的有效后训练数据提供实用指导。

As real-world tasks grow increasingly complex, long-context reasoning has become a core capability for Large Language Models (LLMs). However, few studies explore which data types are effective for long-context reasoning and why. We find that structured table data with periodic structures shows strong potential for long-context reasoning. Motivated by this observation, we mathematically analyze tabular dependency structures using mutual information, revealing periodic non-vanishing dependencies in table data. Furthermore, we systematically analyze the capabilities of structured table data, conduct relevant scaling experiments, and validate its underlying mechanisms for enhancing long-context reasoning, yielding several meaningful insights. Leveraging these insights, we propose a simple yet scalable pipeline(TableLong) for synthesizing high-quality, diverse, and verifiable structured table data to boost long-context reasoning via RL. Extensive experimental results demonstrate that table data significantly enhances the long-context reasoning capability of LLMs across multiple long-context benchmarks (+8.24% on average), and even improves performance on out-of-domain benchmarks (+8.06% on average). We hope that our insights provide practical guidance for effective post-training data to enhance long-context reasoning in LLMs.

!!! info

论文采用理论分析与实证实验相结合的方法。首先，通过信息论框架（互信息）对比分析自然语言与表格数据的依赖衰减模式。其次，构建TableLong数据合成流水线，包括环境初始化（混合表格源）、样本构建（生成SQL查询与自然语言问题并执行验证）以及基于一致性的验证与过滤机制。最后，利用合成数据通过强化学习（RL）对大模型进行训练，并在多个长上下文及域外基准上进行评估。

• 理论扎实：提供了数学层面的互信息分析，深入解释了表格数据为何有效，而非仅依赖经验观察。
• 可扩展性强：TableLong流水线设计简单，能够自动化生成大规模、多样化的训练数据。
• 数据质量高：利用SQL执行结果进行验证，并采用一致性过滤机制剔除噪声和简单样本，确保了训练数据的难度和质量。
• 泛化能力好：不仅提升了长上下文任务性能，还迁移到了数学和代码等不同领域。

• 数据形式单一：主要关注结构化表格数据，对于非结构化长文本推理的普适性可能有限。
• 线性化假设：分析基于行优先的表格线性化，可能忽略了其他表格表示方式的潜在优势。
• 计算开销：SQL执行和一致性过滤步骤需要额外的计算资源。
• 实验细节缺失：提供的文本截断了实验部分的具体设置细节。

评分理由: 论文核心研究LLM在系统优化中的agentic应用，直接涉及LLMs、LLM Agents和Multi-agent Systems（核心内容，10分）。它解决长上下文限制（Context Window Extension，8分）和KV缓存优化（KV Cache Compression，8分），并采用多步推理（Chain of Thought和System 2 Thinking，各8分）。其他关键词如MoE、SLMs、训练方法、RAG、量化等未在摘要中提及，评为0分。

设计高性能系统启发式方法是一个创造性、迭代性的过程，需要专家提出假设并执行多步骤的概念转换。尽管大型语言模型（LLMs）在自动化这一循环中展现出潜力，但由于两种关键失效模式——进化邻域偏差和连贯性上限——它们在处理复杂系统问题时仍面临困难。进化方法依赖标量基准分数，常常陷入局部最优解，当需要协调的多步骤变更时便会失效。相反，现有的智能体框架在长周期中会遭遇上下文退化，或无法在独立运行中积累知识。

我们提出了Engram，一种智能体研究者架构，通过将长周期探索与单一上下文窗口的限制解耦，以应对这些局限。Engram将探索组织为一系列智能体的序列，这些智能体迭代地设计、测试和分析机制。在每次运行结束时，一个智能体会将代码快照、日志和结果存储到持久化档案库中，并将高层建模洞见提炼为一份简洁、持久的研究摘要。随后的智能体则从一个全新的上下文窗口开始，通过阅读研究摘要来基于先前的发现进行构建。

我们发现，Engram在多个领域均表现出卓越性能，包括多云组播、LLM推理请求路由，以及通过自然语言查询优化数据库中的KV缓存复用。

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they struggle with complex system problems due to two critical failure modes: evolutionary neighborhood bias and the coherence ceiling. Evolutionary methods often remain trapped in local optima by relying on scalar benchmark scores, failing when coordinated multi-step changes are required. Conversely, existing agentic frameworks suffer from context degradation over long horizons or fail to accumulate knowledge across independent runs. We present Engram, an agentic researcher architecture that addresses these limitations by decoupling long-horizon exploration from the constraints of a single context window. Engram organizes exploration into a sequence of agents that iteratively design, test, and analyze mechanisms. At the conclusion of each run, an agent stores code snapshots, logs, and results in a persistent Archive and distills high-level modeling insights into a compact, persistent Research Digest. Subsequent agents then begin with a fresh context window, reading the Research Digest to build on prior discoveries. We find that Engram exhibits superior performance across diverse domains including multi-cloud multicast, LLM inference request routing, and optimizing KV cache reuse in databases with natural language queries.

!!! info

论文采用基于智能体的研究方法。Engram架构将系统优化过程组织为一系列单智能体探索，每个智能体遵循科学方法（假设-实现-实验-分析）循环。智能体在工作空间中操作，拥有文件读写、运行脚本和调用模拟器等工具。关键步骤是每个智能体结束时将实验结果和见解写入Research Digest，后续智能体通过检索Digest来构建新的探索计划。评估在ADRS基准和LLM请求路由器等九个系统问题上进行。

• 有效解决了LLM智能体在长期任务中的上下文腐烂和知识遗忘问题，显著提升了长程推理能力。
• 架构设计兼顾了连贯性、灵活性和持久性，克服了现有方法（如纯代码演化或单一智能体迭代）的局限性。
• 在多个真实的系统优化领域展示了卓越的性能，具有广泛的适用性。
• 引入的Research Digest概念为智能体间的知识传承提供了可扩展的范式。

• 系统的性能依赖于底层LLM生成高质量假设和代码的能力，若模型能力不足可能影响效果。
• 结构化交接的质量取决于智能体准确总结和提炼见解的能力，若摘要不准确可能导致误导。
• 运行多个智能体和大量模拟实验可能带来较高的计算成本。
• 目前主要针对系统优化问题，在其他领域的通用性尚需进一步验证。

评分理由: 论文核心是开发企业级AI代理部署平台EnterpriseLab，重点关注小型语言模型（SLMs）在企业环境中的应用，通过集成工具、自动化数据生成和训练管道来提升代理能力。与"Small Language Models"高度相关（10分），因为论文明确讨论SLMs作为隐私保护替代方案；与"LLM Agents"高度相关（15分），因为整个平台围绕代理开发部署；与"Tool Use"高度相关（10分），因为平台集成140+企业工具；与"Large Language Models"相关（8分），因为与GPT-4o对比；与"Post-training"相关（8分），涉及训练管道；与"Pre-training"有一定关联（5分），涉及领域适应。其他关键词如MoE、Scaling Laws、RAG等未在论文中涉及，得0分。

在企业环境中部署人工智能代理，需要在能力与数据主权及成本限制之间取得平衡。虽然小型语言模型为前沿模型提供了保护隐私的替代方案，但其专业化进程受到开发流程碎片化的阻碍——这些流程将工具集成、数据生成和训练相互割裂。我们推出EnterpriseLab，一个全栈平台，将这些阶段统一到一个闭环框架中。EnterpriseLab提供：(1) 一个模块化环境，通过模型上下文协议（Model Context Protocol）暴露企业应用程序，实现专有工具与开源工具的无缝集成；(2) 自动化轨迹合成，能够根据环境模式以编程方式生成训练数据；(3) 集成的训练管道与持续评估机制。我们通过EnterpriseArena对该平台进行了验证，这是一个在IT、人力资源、销售和工程领域包含15个应用程序和140多个工具的具体实例。我们的结果表明，在EnterpriseLab中训练的80亿参数模型，在复杂企业工作流上的性能与GPT-4o相当，同时将推理成本降低了8-10倍，并且在包括EnterpriseBench（+10%）和CRMArena（+10%）在内的多种企业基准测试中均保持稳健性。EnterpriseLab为企业提供了一条可行的路径，使其能够部署能力强、保护隐私的智能代理，同时不牺牲运营能力。

Deploying AI agents in enterprise environments requires balancing capability with data sovereignty and cost constraints. While small language models offer privacy-preserving alternatives to frontier models, their specialization is hindered by fragmented development pipelines that separate tool integration, data generation, and training. We introduce EnterpriseLab, a full-stack platform that unifies these stages into a closed-loop framework. EnterpriseLab provides (1) a modular environment exposing enterprise applications via Model Context Protocol, enabling seamless integration of proprietary and open-source tools; (2) automated trajectory synthesis that programmatically generates training data from environment schemas; and (3) integrated training pipelines with continuous evaluation. We validate the platform through EnterpriseArena, an instantiation with 15 applications and 140+ tools across IT, HR, sales, and engineering domains. Our results demonstrate that 8B-parameter models trained within EnterpriseLab match GPT-4o’s performance on complex enterprise workflows while reducing inference costs by 8-10x, and remain robust across diverse enterprise benchmarks, including EnterpriseBench (+10%) and CRMArena (+10%). EnterpriseLab provides enterprises a practical path to deploying capable, privacy-preserving agents without compromising operational capability.

!!! info

论文构建了包含15个容器化应用和140+工具的EnterpriseArena仿真环境。在技术路线上，实现了基于MCP的动态工具注册表和有状态执行容器；提出了四阶段任务合成流程：工具图构建、约束感知轨迹采样（DFS遍历）、分层任务生成和验证；采用监督微调（SFT）、偏好优化（DPO）和在线强化学习（RL）相结合的集成训练管道，并利用环境反馈进行持续优化。

• 全栈集成：打破了工具集成、数据生成和训练之间的壁垒，形成闭环反馈。
• 自动化程度高：通过工具图遍历自动生成训练数据，极大降低了企业定制智能体的门槛和成本。
• 性能与成本兼顾：证明了小模型在特定垂直领域可以超越大模型，兼顾了隐私、成本和性能。
• 通用性强：支持任意工具集成，不仅限于开源工具，也适配企业私有系统。

• 环境依赖：虽然支持任意工具，但构建高保真的仿真环境（如EnterpriseArena）仍需大量工作，且仿真环境与真实生产环境可能存在差异。
• 模型规模限制：目前主要验证了8B参数模型，对于极其复杂的跨领域长链路推理，小模型可能仍存在天花板。
• 合成数据质量：尽管有约束感知，自动生成的轨迹可能仍缺乏人类专家在处理模糊或异常情况时的灵活性。

评分理由: 论文核心研究参数高效微调（PEFT）和量化技术在葡萄牙语问答任务中的应用，与关键词"PEFT"和"Quantization"高度相关（核心内容，给10-15分）。论文涉及大语言模型（LLMs）在低资源语言的应用，与"Large Language Models"相关（给8分）。论文比较生成式LLMs与小型编码器模型（如BERTimbau），与"Small Language Models"有一定关联（给5分）。论文进行微调实验，与"Post-training"相关（核心内容，给10分）。论文提及领域适应（葡萄牙语），与"Pre-training"有一定关联（给5分）。其他关键词如MoE、Scaling Laws、Instruction Tuning等与论文内容无关，给0分。

尽管大语言模型已变革了自然语言处理领域，但其计算成本为巴西葡萄牙语等低资源语言的可及性设置了障碍。本研究对应用于BERTimbau模型的参数高效微调（Parameter-Efficient Fine-Tuning, PEFT）与量化技术进行了系统性评估，任务为基于巴西葡萄牙语版SQuAD v1（SQuAD-BR）的问答任务。我们评估了40种配置组合，涵盖四种PEFT方法（LoRA、DoRA、QLoRA、QDoRA）及两种模型规模（Base版：1.1亿参数，Large版：3.35亿参数）。研究结果揭示了三个关键发现：（1）在BERTimbau-Large模型上，LoRA方法能达到基线性能的95.8%，同时将训练时间减少73.5%（F1分数为81.32对比84.86）；（2）较高的学习率（2e-4）能显著提升PEFT性能，相较于标准学习率可获得最高达+19.71分的F1分数提升；（3）更大规模的模型展现出两倍的量化鲁棒性（F1分数损失为4.83对比9.56分）。这些结果表明，基于编码器的模型可通过高效微调应用于巴西葡萄牙语抽取式问答任务，其计算成本远低于大型生成式大语言模型，从而推动了符合“绿色人工智能”原则的可持续方法。对Tucano和Sabiá模型在同一抽取式问答基准上的探索性评估显示：虽然生成式模型通过LoRA微调可获得有竞争力的F1分数，但其所需GPU内存最高达BERTimbau-Base的4.2倍，训练时间多出3倍，这进一步印证了基于编码器的小型架构在此类任务中的效率优势。

Although large language models have transformed natural language processing, their computational costs create accessibility barriers for low-resource languages such as Brazilian Portuguese. This work presents a systematic evaluation of Parameter-Efficient Fine-Tuning (PEFT) and quantization techniques applied to BERTimbau for Question Answering on SQuAD-BR, the Brazilian Portuguese translation of SQuAD v1. We evaluate 40 configurations combining four PEFT methods (LoRA, DoRA, QLoRA, QDoRA) across two model sizes (Base: 110M, Large: 335M parameters). Our findings reveal three critical insights: (1) LoRA achieves 95.8% of baseline performance on BERTimbau-Large while reducing training time by 73.5% (F1=81.32 vs 84.86); (2) higher learning rates (2e-4) substantially improve PEFT performance, with F1 gains of up to +19.71 points over standard rates; and (3) larger models show twice the quantization resilience (loss of 4.83 vs 9.56 F1 points). These results demonstrate that encoder-based models can be efficiently fine-tuned for extractive Brazilian Portuguese QA with substantially lower computational cost than large generative LLMs, promoting more sustainable approaches aligned with \textit{Green AI} principles. An exploratory evaluation of Tucano and Sabiá on the same extractive QA benchmark shows that while generative models can reach competitive F1 scores with LoRA fine-tuning, they require up to 4.2$\times$ more GPU memory and 3$\times$ more training time than BERTimbau-Base, reinforcing the efficiency advantage of smaller encoder-based architectures for this task.

!!! info

研究使用 SQuAD-BR（巴西葡萄牙语版 SQuAD v1）作为基准数据集。选取 BERTimbau 的 Base（110M）和 Large（335M）两个版本作为主要实验对象。设计了 40 种配置，结合四种 PEFT 方法（LoRA, DoRA, QLoRA, QDoRA）和两种模型规模进行对比实验。以全参数微调作为基线，评估指标包括 F1 分数、Exact Match (EM)、训练时间和 GPU 内存占用。此外，对 Tucano 和 Sabiá 等生成式 LLM 进行了探索性评估，对比其与编码器模型的效率。

• 针对性强：专注于低资源语言（巴西葡萄牙语），解决了特定领域的计算资源瓶颈问题。
• 实验设计系统：涵盖了多种 PEFT 方法、量化策略和模型规模，提供了全面的对比分析。
• 实用价值高：提供了具体的超参数建议（如学习率 2e-4），并量化了效率提升，对资源受限环境有重要指导意义。
• 绿色 AI 导向：强调了编码器模型在特定任务上的效率优势，倡导可持续的研究方法。

• 任务范围有限：主要聚焦于提取式问答（SQuAD-BR），未涉及生成式问答或其他 NLP 任务，结论的普适性有待验证。
• 模型选择局限：虽然探索了生成式 LLM，但主要深度分析仍集中在 BERT 架构，未涵盖最新的更高效的架构（如 Mamba 等）。
• 生成式 LLM 评估较浅：对 Tucano 和 Sabiá 的评估仅为探索性，可能未充分挖掘其通过提示工程或更复杂微调方法的潜力。

评分理由: 论文核心研究LLM作为对话代理（LLM Agents）的个性化问题，提出VARS框架使用检索增强（Retrieval-Augmented Generation）技术来建模用户偏好，因此与"Large Language Models"、“LLM Agents"和"Retrieval-Augmented Generation"高度相关（10分）。框架涉及从用户反馈中学习，与"Self-Correction"有一定关联（5分），且双向量设计支持可解释性，与"Explainable AI"有一定关联（5分）。其他关键词如MoE、SFT、量化等未在论文中涉及，得0分。

大型语言模型正日益被用作个人助手，然而大多数模型缺乏持久的用户模型，迫使用户在不同会话中反复重述偏好。我们提出向量自适应检索评分（VARS），这是一个与具体流程无关、主干网络冻结的框架，通过在共享偏好空间中使用长期与短期向量来表示每位用户，并利用这些向量对结构化偏好记忆的检索评分进行偏置调整。这些向量通过用户反馈产生的弱标量奖励进行在线更新，从而实现无需针对每位用户进行微调的个性化适配。我们在\textsc{MultiSessionCollab}（一个包含丰富用户偏好档案的在线多会话协作基准测试）上对数学和编程任务进行了评估。在主干网络冻结的条件下，用户感知检索的主要优势在于提升交互效率，而非大幅提高原始任务准确率：我们完整的VARS智能体实现了最强的综合性能，在任务成功率上与强大的反思基线模型持平，同时降低了超时率和用户操作负担。学习到的长期向量与跨用户偏好重叠度保持一致，而短期向量则捕捉了会话特定的适应性，这支持了双向量设计的可解释性。代码、模型与数据可在https://github.com/YurenHao0426/VARS获取。

Large language models are increasingly used as personal assistants, yet most lack a persistent user model, forcing users to repeatedly restate preferences across sessions. We propose Vector-Adapted Retrieval Scoring (VARS), a pipeline-agnostic, frozen-backbone framework that represents each user with long-term and short-term vectors in a shared preference space and uses these vectors to bias retrieval scoring over structured preference memory. The vectors are updated online from weak scalar rewards from users’ feedback, enabling personalization without per-user fine-tuning. We evaluate on \textsc{MultiSessionCollab}, an online multi-session collaboration benchmark with rich user preference profiles, across math and code tasks. Under frozen backbones, the main benefit of user-aware retrieval is improved interaction efficiency rather than large gains in raw task accuracy: our full VARS agent achieves the strongest overall performance, matches a strong Reflection baseline in task success, and reduces timeout rate and user effort. The learned long-term vectors also align with cross-user preference overlap, while short-term vectors capture session-specific adaptation, supporting the interpretability of the dual-vector design. Code, model, and data are available at https://github.com/YurenHao0426/VARS.

!!! info

1. 偏好提取：使用微调的轻量级模型（Mext）将对话转换为结构化的JSON偏好元组。2. 偏好记忆：将偏好存储为包含元数据和嵌入向量的记忆卡片，并通过PCA降维到共享物品空间。3. 用户状态建模：构建长期向量（用户所有物品向量的均值）和短期向量，组合成有效用户向量。4. 个性化检索：在检索和重排序阶段，利用有效用户向量对候选记忆卡片进行偏置打分。5. 在线更新：通过关键词匹配将后续查询转化为标量奖励，使用REINFORCE算法更新用户向量。

• 高效性：无需针对每个用户微调大模型，仅更新低维向量，计算成本低，易于部署。
• 可解释性：双向量设计清晰分离了长期和短期偏好，便于理解模型的决策依据。
• 实用性：显著降低了用户在长期协作中的重复输入和纠正成本，提升了交互体验。
• 鲁棒性：冻结主干模型避免了灾难性遗忘，并保持了基础模型的能力。

• 评估依赖模拟：主要基于LLM用户模拟器进行评估，可能无法完全反映真实人类用户的复杂反馈行为。
• 奖励信号简单：使用关键词匹配生成弱奖励信号，可能存在噪声或无法捕捉细微的用户满意度。
• 提取精度：偏好提取模型虽然召回率高但精度较低，依赖下游过滤，可能引入无关信息。

评分理由: 论文主要研究文本到图像生成中的空间一致性奖励建模，核心贡献是SpatialReward模型和SpatRelBench基准。与关键词的相关性分析如下：1）“Chain of Thought” (10分)：摘要明确提到vision-language model应用chain-of-thought reasoning来评估复杂空间关系，这是核心方法。2）“RLHF” (8分)：论文使用强化学习训练文本到图像模型，SpatialReward作为奖励模型，与RLHF技术高度相关。3）“Large Language Models” (5分)：虽然论文主要涉及视觉语言模型和文本到图像模型，但属于大模型在特定领域的应用。4）“System 2 Thinking” (5分)：chain-of-thought reasoning体现了深度推理过程。5）“Hallucination Mitigation” (5分)：解决图像生成中的空间不准确问题可视为缓解幻觉的一种形式。6）“Explainable AI” (5分)：verifiable reward modeling和可解释的评估过程相关。其他关键词如MoE、量化、RAG等与论文内容无直接关联。

近期，基于强化学习（RL）的文本到图像（T2I）生成技术得益于评估语义对齐与视觉质量的奖励模型而取得进展。然而，现有奖励模型大多对细粒度空间关系关注有限，常生成整体看似合理但物体定位存在偏差的图像。本研究提出 SpatialReward，一种可验证的奖励模型，专门用于评估生成图像中的空间布局。SpatialReward采用多阶段流程：提示分解器（Prompt Decomposer）从自由形式提示中提取实体、属性及空间元数据；专家检测器提供物体位置与属性的精确视觉定位；视觉语言模型则基于定位观察结果进行思维链推理，以评估基于规则方法难以处理的复杂空间关系。为更全面评估生成图像中的空间关系，我们引入 SpatRelBench 基准，涵盖物体属性、朝向、物体间关系及渲染文本布局等维度。在Stable Diffusion和FLUX上的实验表明，将SpatialReward融入RL训练能持续提升空间一致性与整体生成质量，其结果与人类判断更为吻合。这些发现表明，可验证的奖励模型在推动文本到图像生成模型实现更精准、可控的优化方面具有显著潜力。

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present \textbf{SpatialReward}, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a \emph{Prompt Decomposer} extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce \textbf{SpatRelBench}, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.

!!! info

论文采用多阶段技术路线：1. 提示分解阶段，使用微调后的Qwen2.5-VL-7B模型将自然语言提示解析为包含实体、属性和空间关系的结构化约束集；2. 可验证奖励阶段，利用开放集检测器和OCR工具提取图像中的物体边界框、属性及文本信息，生成可验证的观测数据；3. 推理阶段，将验证信息输入视觉-语言模型（如Qwen-VL），通过思维链推理判断复杂的空间关系是否满足约束，并聚合生成最终奖励分数。最后，将SpatialReward集成到Flow-GRPO强化学习框架中，对Stable Diffusion和FLUX等基础模型进行优化。

• 可验证性强：通过引入专家检测器，减少了纯VLM推理可能产生的幻觉，提供了基于事实的评估依据。
• 灵活性高：能够处理任意自由形式的提示，克服了传统结构化方法仅适用于固定模板的局限性。
• 针对性强：专注于解决T2I生成中细粒度空间一致性的痛点，填补了现有奖励模型在空间布局评估上的不足。
• 评估全面：新提出的SpatRelBench涵盖了更丰富的空间关系维度，有助于更全面地评估模型性能。

• 计算复杂度高：三阶段流水线（分解、检测、推理）相比简单的CLIP分数计算需要更多的计算资源和时间。
• 依赖检测器性能：系统的准确性在很大程度上依赖于专家检测器的表现，如果检测器漏检或误检物体，将直接影响奖励分数。
• 推理链长度限制：对于极其复杂的场景（包含大量物体和嵌套关系），VLM的推理链可能会变得过长，导致推理错误或效率下降。

评分理由: 论文核心研究大语言模型（LLMs）在气象科学领域的应用，提出了一种基于多智能体系统（Multi-agent Systems）和LLM Agents的免训练框架WeatherTGD，用于从天气时间序列数据生成可解释的自然语言描述。因此，与"Large Language Models”、“LLM Agents"和"Multi-agent Systems"高度相关（10分），与"AI for Science"有一定关联（5分），因为气象学属于科学应用领域。其他关键词如MoE、SLMs、训练方法、推理加速、对齐技术等均未在论文中涉及，故得0分。

将天气时间序列数据转化为可解释的自然语言描述，仍然是气象科学与自然语言处理交叉领域的一项重大挑战。尽管大语言模型（LLMs）在时间序列预测与分析方面已展现出卓越能力，但现有方法要么生成缺乏人类可理解解释的数值预测，要么产生缺乏领域专业深度的通用描述。我们提出了WeatherTGD，一个无需训练的多智能体框架，它通过文本梯度下降（Text Gradient Descent, TGD）的视角重新诠释了协作式描述优化过程。我们的系统部署了三个专业化的LLM智能体，包括统计分析师、物理解释器和气象学专家，它们从天气时间序列观测中生成领域特定的文本梯度。这些梯度通过一种新颖的共识感知梯度融合机制进行聚合，该机制在提取共同信号的同时保留了独特的领域视角。融合后的梯度随后指导一个类似于梯度下降的迭代优化过程，其中每个LLM生成的反馈信号都会更新描述，使其逼近最优解。在真实世界气象数据集上的实验表明，WeatherTGD在基于LLM的评估和人类专家评估中均取得了显著提升，大幅超越了现有的多智能体基线方法，同时通过并行智能体执行保持了计算效率。

Generating interpretable natural language captions from weather time series data remains a significant challenge at the intersection of meteorological science and natural language processing. While recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in time series forecasting and analysis, existing approaches either produce numerical predictions without human-accessible explanations or generate generic descriptions lacking domain-specific depth. We introduce WeatherTGD, a training-free multi-agent framework that reinterprets collaborative caption refinement through the lens of Text Gradient Descent (TGD). Our system deploys three specialized LLM agents including a Statistical Analyst, a Physics Interpreter, and a Meteorology Expert that generate domain-specific textual gradients from weather time series observations. These gradients are aggregated through a novel Consensus-Aware Gradient Fusion mechanism that extracts common signals while preserving unique domain perspectives. The fused gradients then guide an iterative refinement process analogous to gradient descent, where each LLM-generated feedback signal updates the caption toward an optimal solution. Experiments on real-world meteorological datasets demonstrate that WeatherTGD achieves significant improvements in both LLM-based evaluation and human expert evaluation, substantially outperforming existing multi-agent baselines while maintaining computational efficiency through parallel agent execution.

!!! info

论文采用多智能体系统结合文本梯度下降的方法。首先，三个专用LLM智能体（统计、物理、气象）并行分析天气数据并生成文本形式的“梯度”（反馈）。然后，通过共识感知梯度融合模块聚合这些反馈，提取共同信号并整合独特见解。最后，在迭代优化循环中，利用融合后的梯度不断修正生成的描述，直到达到语义相似度阈值或最大迭代次数。

• 免训练：不需要模型微调，降低了计算成本和门槛。
• 领域融合：巧妙结合了统计学、物理学和气象学三个视角，生成的描述更具深度和准确性。
• 创新性：将数值优化的梯度下降概念迁移到离散的自然语言生成中，视角新颖。
• 高效性：智能体并行执行，且具有明确的收敛条件，避免了无限循环。

• 依赖LLM能力：框架的性能严重依赖底层LLM（如ChatGPT, Claude, Qwen）的推理能力和知识储备。
• 计算开销：虽然是免训练，但每次生成都需要多次调用多个LLM进行推理，推理成本较高。
• 收敛性保证：虽然提出了停止准则，但在极端情况下可能无法收敛或陷入局部最优。
• 泛化能力：目前主要针对气象领域，迁移到其他复杂科学领域可能需要重新设计智能体角色和融合机制。

评分理由: 该论文研究如何从科学文献全文中提取假设和统计证据，属于大模型在科学领域的应用研究。论文明确使用了大型语言模型（LLMs）作为提取器，并系统评估了检索增强生成（RAG）方法在上下文选择中的作用，因此与"Large Language Models"和"Retrieval-Augmented Generation"高度相关（10分）。研究内容属于科学文献分析，与"AI for Science"高度相关（10分）。论文未涉及其他关键词所描述的具体技术原理（如MoE、量化、对齐等）或应用场景（如智能体、工具调用等），因此这些关键词评分为0分。

从全文科学文献中提取假设及其支持的统计证据，是实证研究结果综合的核心环节，但由于文档长度以及科学论证分散于论文不同章节，这一任务仍面临困难。本研究探讨了一种序列式全文提取场景：将文章摘要中陈述的主要发现，与（i）论文正文中对应的假设陈述及（ii）支持或反驳该假设的统计证据进行关联。这一框架构建了一个具有挑战性的文档内检索场景，其中许多候选段落虽与发现主题相关，但修辞功能各异，从而为检索与提取过程制造了困难负例。通过采用两阶段“检索-提取”框架，我们开展了一项关于检索设计选择的对照研究，在四种大型语言模型提取器上，分别调整上下文数量、上下文质量（标准检索增强生成、重排序，以及结合重排序的微调检索器），并设置理想段落对照以区分检索失败与提取局限。研究发现，针对性的上下文选择相较于全文提示持续改进了假设提取，其增益主要集中在优化检索质量与上下文纯净度的配置中。相比之下，统计证据提取的难度仍然显著更高。即使在理想段落条件下，性能仍处于中等水平，这表明提取器在处理混合数值-文本陈述时存在持续的能力局限，而非仅由检索失败导致。

Extracting hypotheses and their supporting statistical evidence from full-text scientific articles is central to the synthesis of empirical findings, but remains difficult due to document length and the distribution of scientific arguments across sections of the paper. The work studies a sequential full-text extraction setting, where the statement of a primary finding in an article’s abstract is linked to (i) a corresponding hypothesis statement in the paper body and (ii) the statistical evidence that supports or refutes that hypothesis. This formulation induces a challenging within-document retrieval setting in which many candidate paragraphs are topically related to the finding but differ in rhetorical role, creating hard negatives for retrieval and extraction. Using a two-stage retrieve-and-extract framework, we conduct a controlled study of retrieval design choices, varying context quantity, context quality (standard Retrieval Augmented Generation, reranking, and a fine-tuned retriever paired with reranking), as well as an oracle paragraph setting to separate retrieval failures from extraction limits across four Large Language Model extractors. We find that targeted context selection consistently improves hypothesis extraction relative to full-text prompting, with gains concentrated in configurations that optimize retrieval quality and context cleanliness. In contrast, statistical evidence extraction remains substantially harder. Even with oracle paragraphs, performance remains moderate, indicating persistent extractor limitations in handling hybrid numeric-textual statements rather than retrieval failures alone.

!!! info

论文采用两阶段的检索-提取管道。第一阶段，使用摘要中的发现作为查询检索候选段落，利用大语言模型提取核心假设；第二阶段，将摘要发现与提取的假设组合作为查询，检索统计证据的候选段落。研究在检索增强生成（RAG）范式下，对比了不同检索配置（Top-k段落数量、标准密集检索、重排序、微调检索器）的效果，并使用Oracle段落设置来界定性能上限，区分检索误差和提取误差。

• 设计了严谨的Oracle实验设置，有效地分离了检索阶段和提取阶段的错误来源。
• 深入分析了文档内检索中的“困难负样本”问题，即主题相关但修辞角色不符的段落对提取的干扰。
• 明确区分了假设提取（语义对齐）和证据提取（数值信息提取）的不同特性，为后续研究提供了清晰的思路。
• 提供了关于如何优化科学文献信息检索系统的实用见解，强调了上下文质量的重要性。

• 统计证据提取的性能仍然较低，即使检索完美，现有的LLM提取器在处理混合数字-文本数据时仍存在显著局限。
• 研究仅关注基于统计证据的经验性发现，排除了理论论证等其他类型的学术推理。
• 预处理阶段排除了表格、图片和公式，而这些部分往往包含关键的统计数据，限制了证据提取的完整性。

评分理由: 论文核心研究递归自我改进（recursive self-improvement）中的递归漂移问题，提出NSRSA框架，通过符号验证子系统在推理步骤层面筛选训练数据质量。该研究高度相关于大模型（LLMs）、对齐（Alignment）、DPO、思维链（CoT）、系统2思维（System 2 Thinking）和自我改进（Self-Improvement），因为这些是论文的核心技术和方法。与数据质量（Scaling Laws AND Data Quality）、幻觉缓解（Hallucination Mitigation）和可解释AI（Explainable AI）有一定关联，因为论文涉及数据筛选和推理验证。其他关键词如MoE、SLMs、预训练、RAG、量化等未在论文中涉及，评为0分。

递归自我改进——即模型基于自身输出进行迭代训练——虽能带来持续的能力增长，却面临一个根本性障碍：递归漂移。当模型在多轮迭代中基于自生成数据进行训练时，中间推理过程中的误差会不断累积，导致模式崩溃与性能下降。我们提出神经符号递归自对齐（Neuro-Symbolic Recursive Self-Alignment, NSRSA），该方法通过嵌入一个符号验证子系统，在推理步骤层面控制训练数据质量，从而稳定迭代式自训练。与仅基于结果的过滤方法（会纳入推理过程存在缺陷的“侥幸猜中”答案）不同，NSRSA通过sympy验证每个算术运算步骤，检查推理步骤间的逻辑流一致性，并强制执行领域约束。我们在GSM8K数据集上使用Qwen3-4B-Thinking模型，在五种条件下（无验证、结果验证、多数投票、完整NSRSA符号验证、以及NSRSA结合DPO）进行了5轮自训练迭代评估。我们的过滤分析表明，NSRSA拒绝了约34%能通过结果验证的正确答案解法，从而将推理有误的“侥幸猜中”样本从训练集中剔除。我们进一步证明，基于NSRSA验证结果构建的DPO偏好对，能够教会模型区分严谨与有缺陷的推理（奖励模型准确率从46%提升至63%）。NSRSA提供了一个可扩展的框架，证明了在可实现自动验证的领域内，外部符号验证如何使递归自我改进变得可衡量且可靠。

Recursive self-improvement–where a model iteratively trains on its own outputs–promises sustained capability growth but faces a fundamental obstacle: recursive drift. As models train on self-generated data across multiple iterations, errors in intermediate reasoning compound, leading to mode collapse and performance degradation. We propose Neuro-Symbolic Recursive Self-Alignment (NSRSA), which stabilizes iterative self-training by embedding a symbolic verification subsystem that gates training data quality at the reasoning step level. Unlike outcome-only filtering (which admits “lucky guesses” with flawed reasoning), NSRSA verifies each arithmetic operation via sympy, checks logical flow consistency across reasoning steps, and enforces domain constraints. We evaluate NSRSA on GSM8K using Qwen3-4B-Thinking across 5 self-training iterations under five conditions: no verification, outcome verification, majority voting, full NSRSA symbolic verification, and NSRSA with DPO. Our filtering analysis shows that NSRSA rejects approximately 34% of correct-answer solutions that pass outcome verification, eliminating “lucky guesses” with flawed reasoning from the training set. We further demonstrate that constructing DPO preference pairs from NSRSA verification teaches the model to distinguish sound from flawed reasoning (reward accuracy 46% to 63%). NSRSA provides an extensible framework that demonstrates how external symbolic verification can make recursive self-improvement measurable and reliable within domains where automated verification is available.

评分理由: 论文研究多模态大语言模型（MLLMs）在具身智能体中的空间推理和规划能力，核心贡献包括：1）引入Video2Mental基准评估MLLMs的"心理导航"能力；2）提出NavMind模型，通过显式认知地图作为中间表示来增强结构化规划。论文高度相关于大模型技术（LLMs/MLLMs）、推理方法（CoT/System 2 Thinking）、智能体（LLM Agents）和世界模型（World Models），并明确使用监督微调（SFT）进行训练。其他关键词如MoE、量化、RAG等未涉及。

尽管多模态大语言模型（MLLMs）在具身智能体中被广泛采用，但其能力仍主要局限于基于即时观察的反应式规划，在跨越广阔时空尺度的空间推理方面始终表现不佳。认知科学揭示，生物智能（BI）的优势在于“心理导航”：即从经验中策略性地构建空间表征，并在行动前进行路径的心理模拟。为弥合人工智能（AI）与生物智能之间的差距，我们提出了Video2Mental，一个用于评估MLLMs心理导航能力的开创性基准。该任务要求从长时第一人称视角视频中构建分层认知地图，并逐步生成基于地标的路径规划，其规划准确性通过基于模拟器的物理交互进行验证。我们的基准测试结果表明，心理导航能力并未从标准预训练中自然涌现。前沿的MLLMs在零样本结构化空间表征方面存在显著困难，且其规划准确性随规划时域的延长而急剧下降。为克服这一局限，我们提出了\textbf{NavMind}，一种推理模型，它通过将显式、细粒度的认知地图作为可学习的中间表征，将心理导航过程内化。通过采用难度分层的渐进式监督微调范式，NavMind有效弥合了原始感知与结构化规划之间的鸿沟。实验证明，NavMind实现了卓越的心理导航能力，显著超越了前沿的商业及空间专用MLLMs。

Despite the widespread adoption of MLLMs in embodied agents, their capabilities remain largely confined to reactive planning from immediate observations, consistently failing in spatial reasoning across extensive spatiotemporal scales. Cognitive science reveals that Biological Intelligence (BI) thrives on “mental navigation”: the strategic construction of spatial representations from experience and the subsequent mental simulation of paths prior to action. To bridge the gap between AI and BI, we introduce Video2Mental, a pioneering benchmark for evaluating the mental navigation capabilities of MLLMs. The task requires constructing hierarchical cognitive maps from long egocentric videos and generating landmark-based path plans step by step, with planning accuracy verified through simulator-based physical interaction. Our benchmarking results reveal that mental navigation capability does not naturally emerge from standard pre-training. Frontier MLLMs struggle profoundly with zero-shot structured spatial representation, and their planning accuracy decays precipitously over extended horizons. To overcome this, we propose \textbf{NavMind}, a reasoning model that internalizes mental navigation using explicit, fine-grained cognitive maps as learnable intermediate representations. Through a difficulty-stratified progressive supervised fine-tuning paradigm, NavMind effectively bridges the gap between raw perception and structured planning. Experiments demonstrate that NavMind achieves superior mental navigation capabilities, significantly outperforming frontier commercial and spatial MLLMs.

评分理由: 论文核心研究大语言模型（LLMs）的长上下文推理能力，通过结构化表格数据增强该能力，属于大模型技术原理创新。高度相关的关键词包括：LLMs（核心研究对象）、Post-training（通过RL增强推理）、Long Context LLMs（核心研究问题）、RLHF（使用RL方法）、CoT Reasoning和System 2 Thinking（涉及深度推理）。中等相关的关键词：Scaling Laws AND Data Quality（涉及数据质量和扩展实验）、Mechanistic Interpretability（分析底层机制）。其他关键词未在论文中涉及。

随着现实世界任务日益复杂，长上下文推理已成为大语言模型（LLM）的核心能力。然而，目前少有研究探讨何种数据类型对长上下文推理有效及其原因。我们发现具有周期性结构的结构化表格数据展现出长上下文推理的强大潜力。基于这一观察，我们利用互信息对表格依赖结构进行数学分析，揭示了表格数据中周期性不衰减的依赖关系。进一步，我们系统分析了结构化表格数据的能力，开展了相关的扩展实验，并验证了其增强长上下文推理的内在机制，从而获得了若干有意义的洞见。基于这些洞见，我们提出了一种简单且可扩展的流程（TableLong），用于合成高质量、多样化且可验证的结构化表格数据，以通过强化学习（RL）提升长上下文推理能力。大量实验结果表明，表格数据显著提升了LLM在多个长上下文基准测试上的推理能力（平均提升8.24%），甚至改善了其在领域外基准测试上的性能（平均提升8.06%）。我们希望这些洞见能为提升LLM长上下文推理能力的有效后训练数据提供实用指导。

As real-world tasks grow increasingly complex, long-context reasoning has become a core capability for Large Language Models (LLMs). However, few studies explore which data types are effective for long-context reasoning and why. We find that structured table data with periodic structures shows strong potential for long-context reasoning. Motivated by this observation, we mathematically analyze tabular dependency structures using mutual information, revealing periodic non-vanishing dependencies in table data. Furthermore, we systematically analyze the capabilities of structured table data, conduct relevant scaling experiments, and validate its underlying mechanisms for enhancing long-context reasoning, yielding several meaningful insights. Leveraging these insights, we propose a simple yet scalable pipeline(TableLong) for synthesizing high-quality, diverse, and verifiable structured table data to boost long-context reasoning via RL. Extensive experimental results demonstrate that table data significantly enhances the long-context reasoning capability of LLMs across multiple long-context benchmarks (+8.24% on average), and even improves performance on out-of-domain benchmarks (+8.06% on average). We hope that our insights provide practical guidance for effective post-training data to enhance long-context reasoning in LLMs.

评分理由: 论文核心研究LLM在系统优化中的agentic应用，直接涉及LLMs、LLM Agents和Multi-agent Systems（核心内容，10分）。它解决长上下文限制（Context Window Extension，8分）和KV缓存优化（KV Cache Compression，8分），并采用多步推理（Chain of Thought和System 2 Thinking，各8分）。其他关键词如MoE、SLMs、训练方法、RAG、量化等未在摘要中提及，评为0分。

设计高性能系统启发式方法是一个创造性、迭代性的过程，需要专家提出假设并执行多步骤的概念转换。尽管大型语言模型（LLMs）在自动化这一循环中展现出潜力，但由于两种关键失效模式——进化邻域偏差和连贯性上限——它们在处理复杂系统问题时仍面临困难。进化方法依赖标量基准分数，常常陷入局部最优解，当需要协调的多步骤变更时便会失效。相反，现有的智能体框架在长周期中会遭遇上下文退化，或无法在独立运行中积累知识。

我们提出了Engram，一种智能体研究者架构，通过将长周期探索与单一上下文窗口的限制解耦，以应对这些局限。Engram将探索组织为一系列智能体的序列，这些智能体迭代地设计、测试和分析机制。在每次运行结束时，一个智能体会将代码快照、日志和结果存储到持久化档案库中，并将高层建模洞见提炼为一份简洁、持久的研究摘要。随后的智能体则从一个全新的上下文窗口开始，通过阅读研究摘要来基于先前的发现进行构建。

我们发现，Engram在多个领域均表现出卓越性能，包括多云组播、LLM推理请求路由，以及通过自然语言查询优化数据库中的KV缓存复用。

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they struggle with complex system problems due to two critical failure modes: evolutionary neighborhood bias and the coherence ceiling. Evolutionary methods often remain trapped in local optima by relying on scalar benchmark scores, failing when coordinated multi-step changes are required. Conversely, existing agentic frameworks suffer from context degradation over long horizons or fail to accumulate knowledge across independent runs. We present Engram, an agentic researcher architecture that addresses these limitations by decoupling long-horizon exploration from the constraints of a single context window. Engram organizes exploration into a sequence of agents that iteratively design, test, and analyze mechanisms. At the conclusion of each run, an agent stores code snapshots, logs, and results in a persistent Archive and distills high-level modeling insights into a compact, persistent Research Digest. Subsequent agents then begin with a fresh context window, reading the Research Digest to build on prior discoveries. We find that Engram exhibits superior performance across diverse domains including multi-cloud multicast, LLM inference request routing, and optimizing KV cache reuse in databases with natural language queries.

评分理由: 论文核心是开发企业级AI代理部署平台EnterpriseLab，重点关注小型语言模型（SLMs）在企业环境中的应用，通过集成工具、自动化数据生成和训练管道来提升代理能力。与"Small Language Models"高度相关（10分），因为论文明确讨论SLMs作为隐私保护替代方案；与"LLM Agents"高度相关（15分），因为整个平台围绕代理开发部署；与"Tool Use"高度相关（10分），因为平台集成140+企业工具；与"Large Language Models"相关（8分），因为与GPT-4o对比；与"Post-training"相关（8分），涉及训练管道；与"Pre-training"有一定关联（5分），涉及领域适应。其他关键词如MoE、Scaling Laws、RAG等未在论文中涉及，得0分。

在企业环境中部署人工智能代理，需要在能力与数据主权及成本限制之间取得平衡。虽然小型语言模型为前沿模型提供了保护隐私的替代方案，但其专业化进程受到开发流程碎片化的阻碍——这些流程将工具集成、数据生成和训练相互割裂。我们推出EnterpriseLab，一个全栈平台，将这些阶段统一到一个闭环框架中。EnterpriseLab提供：(1) 一个模块化环境，通过模型上下文协议（Model Context Protocol）暴露企业应用程序，实现专有工具与开源工具的无缝集成；(2) 自动化轨迹合成，能够根据环境模式以编程方式生成训练数据；(3) 集成的训练管道与持续评估机制。我们通过EnterpriseArena对该平台进行了验证，这是一个在IT、人力资源、销售和工程领域包含15个应用程序和140多个工具的具体实例。我们的结果表明，在EnterpriseLab中训练的80亿参数模型，在复杂企业工作流上的性能与GPT-4o相当，同时将推理成本降低了8-10倍，并且在包括EnterpriseBench（+10%）和CRMArena（+10%）在内的多种企业基准测试中均保持稳健性。EnterpriseLab为企业提供了一条可行的路径，使其能够部署能力强、保护隐私的智能代理，同时不牺牲运营能力。

Deploying AI agents in enterprise environments requires balancing capability with data sovereignty and cost constraints. While small language models offer privacy-preserving alternatives to frontier models, their specialization is hindered by fragmented development pipelines that separate tool integration, data generation, and training. We introduce EnterpriseLab, a full-stack platform that unifies these stages into a closed-loop framework. EnterpriseLab provides (1) a modular environment exposing enterprise applications via Model Context Protocol, enabling seamless integration of proprietary and open-source tools; (2) automated trajectory synthesis that programmatically generates training data from environment schemas; and (3) integrated training pipelines with continuous evaluation. We validate the platform through EnterpriseArena, an instantiation with 15 applications and 140+ tools across IT, HR, sales, and engineering domains. Our results demonstrate that 8B-parameter models trained within EnterpriseLab match GPT-4o’s performance on complex enterprise workflows while reducing inference costs by 8-10x, and remain robust across diverse enterprise benchmarks, including EnterpriseBench (+10%) and CRMArena (+10%). EnterpriseLab provides enterprises a practical path to deploying capable, privacy-preserving agents without compromising operational capability.

评分理由: 论文核心研究参数高效微调（PEFT）和量化技术在葡萄牙语问答任务中的应用，与关键词"PEFT"和"Quantization"高度相关（核心内容，给10-15分）。论文涉及大语言模型（LLMs）在低资源语言的应用，与"Large Language Models"相关（给8分）。论文比较生成式LLMs与小型编码器模型（如BERTimbau），与"Small Language Models"有一定关联（给5分）。论文进行微调实验，与"Post-training"相关（核心内容，给10分）。论文提及领域适应（葡萄牙语），与"Pre-training"有一定关联（给5分）。其他关键词如MoE、Scaling Laws、Instruction Tuning等与论文内容无关，给0分。

尽管大语言模型已变革了自然语言处理领域，但其计算成本为巴西葡萄牙语等低资源语言的可及性设置了障碍。本研究对应用于BERTimbau模型的参数高效微调（Parameter-Efficient Fine-Tuning, PEFT）与量化技术进行了系统性评估，任务为基于巴西葡萄牙语版SQuAD v1（SQuAD-BR）的问答任务。我们评估了40种配置组合，涵盖四种PEFT方法（LoRA、DoRA、QLoRA、QDoRA）及两种模型规模（Base版：1.1亿参数，Large版：3.35亿参数）。研究结果揭示了三个关键发现：（1）在BERTimbau-Large模型上，LoRA方法能达到基线性能的95.8%，同时将训练时间减少73.5%（F1分数为81.32对比84.86）；（2）较高的学习率（2e-4）能显著提升PEFT性能，相较于标准学习率可获得最高达+19.71分的F1分数提升；（3）更大规模的模型展现出两倍的量化鲁棒性（F1分数损失为4.83对比9.56分）。这些结果表明，基于编码器的模型可通过高效微调应用于巴西葡萄牙语抽取式问答任务，其计算成本远低于大型生成式大语言模型，从而推动了符合“绿色人工智能”原则的可持续方法。对Tucano和Sabiá模型在同一抽取式问答基准上的探索性评估显示：虽然生成式模型通过LoRA微调可获得有竞争力的F1分数，但其所需GPU内存最高达BERTimbau-Base的4.2倍，训练时间多出3倍，这进一步印证了基于编码器的小型架构在此类任务中的效率优势。

Although large language models have transformed natural language processing, their computational costs create accessibility barriers for low-resource languages such as Brazilian Portuguese. This work presents a systematic evaluation of Parameter-Efficient Fine-Tuning (PEFT) and quantization techniques applied to BERTimbau for Question Answering on SQuAD-BR, the Brazilian Portuguese translation of SQuAD v1. We evaluate 40 configurations combining four PEFT methods (LoRA, DoRA, QLoRA, QDoRA) across two model sizes (Base: 110M, Large: 335M parameters). Our findings reveal three critical insights: (1) LoRA achieves 95.8% of baseline performance on BERTimbau-Large while reducing training time by 73.5% (F1=81.32 vs 84.86); (2) higher learning rates (2e-4) substantially improve PEFT performance, with F1 gains of up to +19.71 points over standard rates; and (3) larger models show twice the quantization resilience (loss of 4.83 vs 9.56 F1 points). These results demonstrate that encoder-based models can be efficiently fine-tuned for extractive Brazilian Portuguese QA with substantially lower computational cost than large generative LLMs, promoting more sustainable approaches aligned with \textit{Green AI} principles. An exploratory evaluation of Tucano and Sabiá on the same extractive QA benchmark shows that while generative models can reach competitive F1 scores with LoRA fine-tuning, they require up to 4.2$\times$ more GPU memory and 3$\times$ more training time than BERTimbau-Base, reinforcing the efficiency advantage of smaller encoder-based architectures for this task.

评分理由: 论文核心研究LLM作为对话代理（LLM Agents）的个性化问题，提出VARS框架使用检索增强（Retrieval-Augmented Generation）技术来建模用户偏好，因此与"Large Language Models”、“LLM Agents"和"Retrieval-Augmented Generation"高度相关（10分）。框架涉及从用户反馈中学习，与"Self-Correction"有一定关联（5分），且双向量设计支持可解释性，与"Explainable AI"有一定关联（5分）。其他关键词如MoE、SFT、量化等未在论文中涉及，得0分。

大型语言模型正日益被用作个人助手，然而大多数模型缺乏持久的用户模型，迫使用户在不同会话中反复重述偏好。我们提出向量自适应检索评分（VARS），这是一个与具体流程无关、主干网络冻结的框架，通过在共享偏好空间中使用长期与短期向量来表示每位用户，并利用这些向量对结构化偏好记忆的检索评分进行偏置调整。这些向量通过用户反馈产生的弱标量奖励进行在线更新，从而实现无需针对每位用户进行微调的个性化适配。我们在\textsc{MultiSessionCollab}（一个包含丰富用户偏好档案的在线多会话协作基准测试）上对数学和编程任务进行了评估。在主干网络冻结的条件下，用户感知检索的主要优势在于提升交互效率，而非大幅提高原始任务准确率：我们完整的VARS智能体实现了最强的综合性能，在任务成功率上与强大的反思基线模型持平，同时降低了超时率和用户操作负担。学习到的长期向量与跨用户偏好重叠度保持一致，而短期向量则捕捉了会话特定的适应性，这支持了双向量设计的可解释性。代码、模型与数据可在https://github.com/YurenHao0426/VARS获取。

Large language models are increasingly used as personal assistants, yet most lack a persistent user model, forcing users to repeatedly restate preferences across sessions. We propose Vector-Adapted Retrieval Scoring (VARS), a pipeline-agnostic, frozen-backbone framework that represents each user with long-term and short-term vectors in a shared preference space and uses these vectors to bias retrieval scoring over structured preference memory. The vectors are updated online from weak scalar rewards from users’ feedback, enabling personalization without per-user fine-tuning. We evaluate on \textsc{MultiSessionCollab}, an online multi-session collaboration benchmark with rich user preference profiles, across math and code tasks. Under frozen backbones, the main benefit of user-aware retrieval is improved interaction efficiency rather than large gains in raw task accuracy: our full VARS agent achieves the strongest overall performance, matches a strong Reflection baseline in task success, and reduces timeout rate and user effort. The learned long-term vectors also align with cross-user preference overlap, while short-term vectors capture session-specific adaptation, supporting the interpretability of the dual-vector design. Code, model, and data are available at https://github.com/YurenHao0426/VARS.

评分理由: 论文主要研究文本到图像生成中的空间一致性奖励建模，核心贡献是SpatialReward模型和SpatRelBench基准。与关键词的相关性分析如下：1）“Chain of Thought” (10分)：摘要明确提到vision-language model应用chain-of-thought reasoning来评估复杂空间关系，这是核心方法。2）“RLHF” (8分)：论文使用强化学习训练文本到图像模型，SpatialReward作为奖励模型，与RLHF技术高度相关。3）“Large Language Models” (5分)：虽然论文主要涉及视觉语言模型和文本到图像模型，但属于大模型在特定领域的应用。4）“System 2 Thinking” (5分)：chain-of-thought reasoning体现了深度推理过程。5）“Hallucination Mitigation” (5分)：解决图像生成中的空间不准确问题可视为缓解幻觉的一种形式。6）“Explainable AI” (5分)：verifiable reward modeling和可解释的评估过程相关。其他关键词如MoE、量化、RAG等与论文内容无直接关联。

近期，基于强化学习（RL）的文本到图像（T2I）生成技术得益于评估语义对齐与视觉质量的奖励模型而取得进展。然而，现有奖励模型大多对细粒度空间关系关注有限，常生成整体看似合理但物体定位存在偏差的图像。本研究提出 SpatialReward，一种可验证的奖励模型，专门用于评估生成图像中的空间布局。SpatialReward采用多阶段流程：提示分解器（Prompt Decomposer）从自由形式提示中提取实体、属性及空间元数据；专家检测器提供物体位置与属性的精确视觉定位；视觉语言模型则基于定位观察结果进行思维链推理，以评估基于规则方法难以处理的复杂空间关系。为更全面评估生成图像中的空间关系，我们引入 SpatRelBench 基准，涵盖物体属性、朝向、物体间关系及渲染文本布局等维度。在Stable Diffusion和FLUX上的实验表明，将SpatialReward融入RL训练能持续提升空间一致性与整体生成质量，其结果与人类判断更为吻合。这些发现表明，可验证的奖励模型在推动文本到图像生成模型实现更精准、可控的优化方面具有显著潜力。

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present \textbf{SpatialReward}, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a \emph{Prompt Decomposer} extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce \textbf{SpatRelBench}, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.

评分理由: 论文核心研究大语言模型（LLMs）在气象科学领域的应用，提出了一种基于多智能体系统（Multi-agent Systems）和LLM Agents的免训练框架WeatherTGD，用于从天气时间序列数据生成可解释的自然语言描述。因此，与"Large Language Models”、“LLM Agents"和"Multi-agent Systems"高度相关（10分），与"AI for Science"有一定关联（5分），因为气象学属于科学应用领域。其他关键词如MoE、SLMs、训练方法、推理加速、对齐技术等均未在论文中涉及，故得0分。

将天气时间序列数据转化为可解释的自然语言描述，仍然是气象科学与自然语言处理交叉领域的一项重大挑战。尽管大语言模型（LLMs）在时间序列预测与分析方面已展现出卓越能力，但现有方法要么生成缺乏人类可理解解释的数值预测，要么产生缺乏领域专业深度的通用描述。我们提出了WeatherTGD，一个无需训练的多智能体框架，它通过文本梯度下降（Text Gradient Descent, TGD）的视角重新诠释了协作式描述优化过程。我们的系统部署了三个专业化的LLM智能体，包括统计分析师、物理解释器和气象学专家，它们从天气时间序列观测中生成领域特定的文本梯度。这些梯度通过一种新颖的共识感知梯度融合机制进行聚合，该机制在提取共同信号的同时保留了独特的领域视角。融合后的梯度随后指导一个类似于梯度下降的迭代优化过程，其中每个LLM生成的反馈信号都会更新描述，使其逼近最优解。在真实世界气象数据集上的实验表明，WeatherTGD在基于LLM的评估和人类专家评估中均取得了显著提升，大幅超越了现有的多智能体基线方法，同时通过并行智能体执行保持了计算效率。

Generating interpretable natural language captions from weather time series data remains a significant challenge at the intersection of meteorological science and natural language processing. While recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in time series forecasting and analysis, existing approaches either produce numerical predictions without human-accessible explanations or generate generic descriptions lacking domain-specific depth. We introduce WeatherTGD, a training-free multi-agent framework that reinterprets collaborative caption refinement through the lens of Text Gradient Descent (TGD). Our system deploys three specialized LLM agents including a Statistical Analyst, a Physics Interpreter, and a Meteorology Expert that generate domain-specific textual gradients from weather time series observations. These gradients are aggregated through a novel Consensus-Aware Gradient Fusion mechanism that extracts common signals while preserving unique domain perspectives. The fused gradients then guide an iterative refinement process analogous to gradient descent, where each LLM-generated feedback signal updates the caption toward an optimal solution. Experiments on real-world meteorological datasets demonstrate that WeatherTGD achieves significant improvements in both LLM-based evaluation and human expert evaluation, substantially outperforming existing multi-agent baselines while maintaining computational efficiency through parallel agent execution.

评分理由: 该论文研究如何从科学文献全文中提取假设和统计证据，属于大模型在科学领域的应用研究。论文明确使用了大型语言模型（LLMs）作为提取器，并系统评估了检索增强生成（RAG）方法在上下文选择中的作用，因此与"Large Language Models"和"Retrieval-Augmented Generation"高度相关（10分）。研究内容属于科学文献分析，与"AI for Science"高度相关（10分）。论文未涉及其他关键词所描述的具体技术原理（如MoE、量化、对齐等）或应用场景（如智能体、工具调用等），因此这些关键词评分为0分。

从全文科学文献中提取假设及其支持的统计证据，是实证研究结果综合的核心环节，但由于文档长度以及科学论证分散于论文不同章节，这一任务仍面临困难。本研究探讨了一种序列式全文提取场景：将文章摘要中陈述的主要发现，与（i）论文正文中对应的假设陈述及（ii）支持或反驳该假设的统计证据进行关联。这一框架构建了一个具有挑战性的文档内检索场景，其中许多候选段落虽与发现主题相关，但修辞功能各异，从而为检索与提取过程制造了困难负例。通过采用两阶段“检索-提取”框架，我们开展了一项关于检索设计选择的对照研究，在四种大型语言模型提取器上，分别调整上下文数量、上下文质量（标准检索增强生成、重排序，以及结合重排序的微调检索器），并设置理想段落对照以区分检索失败与提取局限。研究发现，针对性的上下文选择相较于全文提示持续改进了假设提取，其增益主要集中在优化检索质量与上下文纯净度的配置中。相比之下，统计证据提取的难度仍然显著更高。即使在理想段落条件下，性能仍处于中等水平，这表明提取器在处理混合数值-文本陈述时存在持续的能力局限，而非仅由检索失败导致。

Extracting hypotheses and their supporting statistical evidence from full-text scientific articles is central to the synthesis of empirical findings, but remains difficult due to document length and the distribution of scientific arguments across sections of the paper. The work studies a sequential full-text extraction setting, where the statement of a primary finding in an article’s abstract is linked to (i) a corresponding hypothesis statement in the paper body and (ii) the statistical evidence that supports or refutes that hypothesis. This formulation induces a challenging within-document retrieval setting in which many candidate paragraphs are topically related to the finding but differ in rhetorical role, creating hard negatives for retrieval and extraction. Using a two-stage retrieve-and-extract framework, we conduct a controlled study of retrieval design choices, varying context quantity, context quality (standard Retrieval Augmented Generation, reranking, and a fine-tuned retriever paired with reranking), as well as an oracle paragraph setting to separate retrieval failures from extraction limits across four Large Language Model extractors. We find that targeted context selection consistently improves hypothesis extraction relative to full-text prompting, with gains concentrated in configurations that optimize retrieval quality and context cleanliness. In contrast, statistical evidence extraction remains substantially harder. Even with oracle paragraphs, performance remains moderate, indicating persistent extractor limitations in handling hybrid numeric-textual statements rather than retrieval failures alone.

评分理由: 论文研究多模态大语言模型（MLLMs）的安全对齐漏洞，核心围绕LLMs和Alignment。论文明确研究MLLMs（属于LLMs的扩展）的安全对齐失败模式，因此与"Large Language Models"和"Alignment"高度相关（10分）。论文涉及安全评估和事实性（如不可靠的安全评估器），与"Hallucination Mitigation"有一定关联（5分）。其他关键词如MoE、Scaling Laws、Pre-training、RLHF、RAG、Agents等，论文未涉及技术细节或应用，故评0分。

多模态大语言模型（MLLMs）在纯文本大语言模型的基础上扩展了视觉推理能力，但也引入了基于视觉指令的新安全失效模式。我们研究了漫画模板越狱攻击，该方法将有害目标嵌入简单的三格视觉叙事中，并诱导模型进行角色扮演以“完成漫画”。基于JailbreakBench和JailbreakV，我们提出了ComicJailbreak——一个基于漫画的越狱基准测试集，包含1,167个攻击实例，涵盖10种危害类别和5种任务设置。在对15个前沿多模态大语言模型（6个商业模型和9个开源模型）的测试中，基于漫画的攻击成功率与强规则型越狱方法相当，并显著超越纯文本和随机图像基线，在多个商业模型上的集成成功率超过90%。进一步实验表明，现有防御方法虽能有效拦截有害漫画，但在处理良性提示时也会引发高拒绝率。最后，通过自动评估和针对性人工评估，我们发现当前安全评估器对敏感但无害内容的判断存在不可靠性。本研究揭示了针对叙事驱动型多模态越狱攻击构建鲁棒安全对齐机制的必要性。

Multimodal Large Language Models (MLLMs) extend text-only LLMs with visual reasoning, but also introduce new safety failure modes under visually grounded instructions. We study comic-template jailbreaks that embed harmful goals inside simple three-panel visual narratives and prompt the model to role-play and “complete the comic.” Building on JailbreakBench and JailbreakV, we introduce ComicJailbreak, a comic-based jailbreak benchmark with 1,167 attack instances spanning 10 harm categories and 5 task setups. Across 15 state-of-the-art MLLMs (six commercial and nine open-source), comic-based attacks achieve success rates comparable to strong rule-based jailbreaks and substantially outperform plain-text and random-image baselines, with ensemble success rates exceeding 90% on several commercial models. Then, with the existing defense methodologies, we show that these methods are effective against the harmful comics, they will induce a high refusal rate when prompted with benign prompts. Finally, using automatic judging and targeted human evaluation, we show that current safety evaluators can be unreliable on sensitive but non-harmful content. Our findings highlight the need for safety alignment robust to narrative-driven multimodal jailbreaks.

评分理由: 论文核心是利用大语言模型（LLMs）生成合成数据来解决精神病症状识别中的数据稀缺问题，属于大模型在科学（具体是心理健康/生物信息学）领域的应用。因此，与"Large Language Models"高度相关（10分），与"AI for Science"高度相关（10分）。论文提到模型可以从真实数据中进一步微调，与"Post-training"有一定关联（5分）。其他关键词如MoE、Scaling Laws、RLHF、RAG等均未涉及，得0分。

社交媒体精神症状识别旨在从用户生成的内容中推断细粒度的心理健康症状，从而实现对用户心理状态的细致理解。然而，由于专家标注需要大量资源且缺乏标准化的标注指南，大规模症状级别数据集的构建仍面临挑战，这进而限制了模型从用户生成文本中识别多样化症状表达的可泛化性。为解决这些问题，我们提出了SynSym——一个用于构建可泛化症状识别数据集的合成数据生成框架。SynSym利用大语言模型，通过以下方式构建高质量训练样本：(1) 将每个症状扩展为子概念以增强生成表达的多样性，(2) 生成反映不同语言风格下精神症状的合成表达，以及(3) 依据临床共现模式构建真实的多症状复合表达。我们在涵盖不同抑郁症状表达风格的三个基准数据集上验证了SynSym。实验结果表明，仅使用SynSym生成的合成数据训练的模型与使用真实数据训练的模型表现相当，并且能通过真实数据的进一步微调获得额外提升。这些发现凸显了合成数据作为精神症状建模中真实标注替代资源的潜力，而SynSym则为生成具有临床相关性且真实的症状表达提供了一个实用框架。

Psychiatric symptom identification on social media aims to infer fine-grained mental health symptoms from user-generated posts, allowing a detailed understanding of users’ mental states. However, the construction of large-scale symptom-level datasets remains challenging due to the resource-intensive nature of expert labeling and the lack of standardized annotation guidelines, which in turn limits the generalizability of models to identify diverse symptom expressions from user-generated text. To address these issues, we propose SynSym, a synthetic data generation framework for constructing generalizable datasets for symptom identification. Leveraging large language models (LLMs), SynSym constructs high-quality training samples by (1) expanding each symptom into sub-concepts to enhance the diversity of generated expressions, (2) producing synthetic expressions that reflect psychiatric symptoms in diverse linguistic styles, and (3) composing realistic multi-symptom expressions, informed by clinical co-occurrence patterns. We validate SynSym on three benchmark datasets covering different styles of depressive symptom expression. Experimental results demonstrate that models trained solely on the synthetic data generated by SynSym perform comparably to those trained on real data, and benefit further from additional fine-tuning with real data. These findings underscore the potential of synthetic data as an alternative resource to real-world annotations in psychiatric symptom modeling, and SynSym serves as a practical framework for generating clinically relevant and realistic symptom expressions.

评分理由: 论文核心是利用LLMs的in-context reasoning能力解决跨语言知识图谱融合问题，因此与"Large Language Models"和"In-context Learning"高度相关（10分）。论文提到LLMs的推理能力，与"Chain of Thought"有一定关联（5分）。其他关键词如MoE、SFT、RAG、量化等均未在摘要中提及或相关，故给0分。

融合跨语言边界的多个知识图谱（Knowledge Graphs, KGs）一直是一个持续存在的挑战，这主要源于语义异构性和图谱环境的复杂性。我们提出了一种跨语言图谱融合框架，该框架利用大型语言模型（Large Language Models, LLMs）的上下文推理能力和多语言语义先验知识。该框架通过将三元组直接映射为自然语言序列（例如，[头实体] [关系] [尾实体]）来实现结构线性化，使得LLM能够在不断演化的融合图谱（$G_{c}^{(t-1)}$）与新的候选图谱（$G_{t}$）之间进行关系映射和实体对齐。在DBP15K数据集上的评估表明，这项探索性研究证实了LLMs能够作为解决跨语言差异的通用语义桥梁。结果显示，该框架成功实现了多个异构图谱的序列化聚合，为多源、多语言环境下的持续知识合成提供了一个可扩展、模块化的解决方案。

Combining multiple knowledge graphs (KGs) across linguistic boundaries is a persistent challenge due to semantic heterogeneity and the complexity of graph environments. We propose a framework for cross-lingual graph fusion, leveraging the in-context reasoning and multilingual semantic priors of Large Language Models (LLMs). The framework implements structural linearization by mapping triplets directly into natural language sequences (e.g., [head] [relation] [tail]), enabling the LLM to map relations and reconcile entities between an evolving fused graph ($G_{c}^{(t-1)}$) and a new candidate graph ($G_{t}$). Evaluated on the DBP15K dataset, this exploratory study demonstrates that LLMs can serve as a universal semantic bridge to resolve cross-lingual discrepancies. Results show the successful sequential agglomeration of multiple heterogeneous graphs, offering a scalable, modular solution for continuous knowledge synthesis in multi-source, multilingual environments.

评分理由: 论文AnimalCLAP专注于利用深度学习进行动物声音识别和生态特征推断，属于AI在科学（特别是生物信息学）领域的应用。核心贡献包括构建大规模动物声音数据集和开发基于CLAP（对比语言-音频预训练）的模型，通过整合分类学信息提升未见物种的识别能力。因此，与"Pre-training"高度相关（10分），因为模型基于音频和文本进行预训练；与"AI for Science"高度相关（10分），属于生物信息学应用。与"Large Language Models"有一定关联（5分），因为CLAP框架涉及语言模型组件，但论文未深入探讨LLM技术本身。其他关键词（如MoE、SFT、RAG等）与论文内容无关，均得0分。

动物发声为野生动物评估提供了关键洞察，尤其在森林等复杂环境中，有助于物种识别与生态监测。深度学习的最新进展使得通过发声实现物种自动分类成为可能。然而，对训练阶段未出现物种的分类仍具挑战性。为应对这一局限，我们提出了AnimalCLAP——一个融合层级生物学信息的、具备分类学感知能力的语言-音频框架，包含新数据集与模型。具体而言，我们的发声数据集包含4,225小时录音，涵盖6,823个物种，并标注了22种生态特征。AnimalCLAP模型基于该数据集训练，利用分类学结构对齐音频与文本表征，从而提升对未见物种的识别能力。我们证明，所提出的模型能直接从物种发声有效推断其生态与生物学属性，相比CLAP实现了更优性能。我们的数据集、代码与模型将通过https://dahlian00.github.io/AnimalCLAP_Page/ 公开提供。

Animal vocalizations provide crucial insights for wildlife assessment, particularly in complex environments such as forests, aiding species identification and ecological monitoring. Recent advances in deep learning have enabled automatic species classification from their vocalizations. However, classifying species unseen during training remains challenging. To address this limitation, we introduce AnimalCLAP, a taxonomy-aware language-audio framework comprising a new dataset and model that incorporate hierarchical biological information. Specifically, our vocalization dataset consists of 4,225 hours of recordings covering 6,823 species, annotated with 22 ecological traits. The AnimalCLAP model is trained on this dataset to align audio and textual representations using taxonomic structures, improving the recognition of unseen species. We demonstrate that our proposed model effectively infers ecological and biological attributes of species directly from their vocalizations, achieving superior performance compared to CLAP. Our dataset, code, and models will be publicly available at https://dahlian00.github.io/AnimalCLAP_Page/.

评分理由: 论文核心研究多任务监督微调（SFT）中的数据混合过拟合问题，提出mSFT算法。与关键词"Post-training” OR “Supervised Fine-tuning” OR “SFT"高度相关（15分），因为论文标题和摘要明确聚焦SFT。与"Large Language Models” OR “LLMs” OR “Foundation Models"有一定关联（8分），因为论文涉及语言模型训练，但未明确指定为大模型。其他关键词如MoE、Scaling Laws、RLHF等均未在论文中提及，故评0分。

当前语言模型训练通常采用多任务监督微调（SFT），并在所有子数据集上使用均匀的计算预算。这种方法本质上并非最优：异质的学习动态会导致学习速度较快的任务过早过拟合，而学习较慢的任务则仍处于欠拟合状态。为解决这一问题，我们提出了mSFT——一种针对多任务数据混合的迭代式、过拟合感知搜索算法。mSFT在动态混合数据上训练模型，识别并排除最早发生过拟合的子数据集，并在继续训练前回退至该特定任务的最优检查点。大量评估表明，mSFT在10个基准测试和6个基础模型上均持续优于4种基线方法。进一步分析证实，mSFT在不同数据集规模、任务粒度下均保持稳健的性能提升，且对其唯一新增超参数（计算预算）不敏感。值得注意的是，在低计算预算下，mSFT能在降低训练FLOPs的同时提升模型性能。最终，mSFT为多任务SFT建立了一种实用的过拟合感知算法，能够最大化模型在多样化数据混合中的潜力。

Current language model training commonly applies multi-task Supervised Fine-Tuning (SFT) using a homogeneous compute budget across all sub-datasets. This approach is fundamentally sub-optimal: heterogeneous learning dynamics cause faster-learning tasks to overfit early while slower ones remain under-fitted. To address this, we introduce mSFT, an iterative, overfitting-aware search algorithm for multi-task data mixtures. mSFT trains the model on an active mixture, identifies and excludes the earliest overfitting sub-dataset, and reverts to that specific optimal checkpoint before continuing. Extensive evaluations demonstrate that mSFT consistently outperforms 4 baselines across 10 benchmarks and 6 base models. Further analysis confirms mSFT maintains robust gains across diverse dataset sizes, task granularities, and is insensitive to its single new hyperparameter (compute budget). Notably, at low compute budget, mSFT can improve performance while lowering training FLOPs. Ultimately, mSFT establishes a practical overfitting-aware algorithm for multi-task SFT that maximizes the potential of models across diverse data mixtures.

评分理由: 论文研究LLMs在阴谋论检测中的应用，核心是评估LLMs识别阴谋论的能力，并探索框架语义（frames）如何支持此任务。摘要明确提到"the ability of LLMs to recognize this phenomenon"和"injection of frames in an in-context approach”，因此与"Large Language Models"和"In-context Learning"高度相关（10分）。其他关键词如MoE、Scaling Laws、RLHF等涉及模型架构、训练方法或特定技术，论文未提及，故得0分。

阴谋论是反权威的叙事，易引发社会冲突并影响人们对政治信息的认知。为深入理解这一问题，我们提出“阴谋论框架”：一种基于框架语义学与符号学构建的、针对阴谋论叙事的细粒度语义表征体系。基于此框架，我们构建了“阴谋论框架数据集”——一个在片段层级进行标注的Telegram消息语料库。该框架与数据集有助于推动对阴谋论更具普适性的理解与识别研究。我们考察了大语言模型在领域内及跨领域场景中识别此类现象的能力，并探究框架在此任务中的潜在支持作用。实验结果表明：尽管在上下文学习中注入框架未能显著提升模型性能，但其仍具潜力；通过将标注片段与FrameNet进行映射，我们发现了抽象的语义模式（如“亲属关系”“摄入物质”），这或可为构建更具语义与符号学意识的阴谋论叙事检测方法开辟新路径。

Conspiracy theories are anti-authoritarian narratives that lead to social conflict, impacting how people perceive political information. To help in understanding this issue, we introduce the Conspiracy Frame: a fine-grained semantic representation of conspiratorial narratives derived from frame-semantics and semiotics, which spawned the Conspiracy Frames (Con.Fra.) dataset: a corpus of Telegram messages annotated at span-level. The Conspiracy Frame and Con.Fra. dataset contribute to the implementation of a more generalizable understanding and recognition of conspiracy theories. We observe the ability of LLMs to recognize this phenomenon in-domain and out-of-domain, investigating the role that frames may have in supporting this task. Results show that, while the injection of frames in an in-context approach does not lead to clear increase of performance, it has potential; the mapping of annotated spans with FrameNet shows abstract semantic patterns (e.g., Kinship', Ingest_substance’) that potentially pave the way for a more semantically- and semiotically-aware detection of conspiratorial narratives.

评分理由: 论文核心是开发一个基于LLM（Google’s Gemini）的自动化管道TimeTox，用于从临床试验方案中提取时间毒性指标，这直接对应关键词"Large Language Models" OR “LLMs” OR “Foundation Models”（高度相关，10分）和"AI for Science" OR “Bioinformatics” OR “Cheminformatics”（生物医学AI应用，高度相关，10分）。论文未涉及其他技术原理创新（如MoE、量化、推理优化等），也未使用其他训练方法（如SFT、RLHF、PEFT等），因此其他关键词均得0分。

时间毒性（Time toxicity）——即临床试验参与过程中累积的医疗接触天数——是一项重要但需从试验方案文件中人工提取的指标。我们开发了TimeTox，一种基于大语言模型的自动化流程，用于从评估计划表中提取时间毒性数据。TimeTox采用谷歌Gemini模型，分三个阶段运行：从完整方案PDF中提取摘要、量化各治疗组在六个累积时间点的时间毒性，以及通过基于治疗组位置匹配的多轮共识机制进行整合。我们在20份合成评估计划（共240组对比）上进行了验证，并在644份真实世界肿瘤学试验方案中评估了其可重复性。我们比较了两种架构：单阶段直接提取与两阶段分步提取。在合成数据上，两阶段流程实现了100%临床可接受的准确度（误差±3天，平均绝对误差0.81天），而单阶段流程仅为41.5%（平均绝对误差9.0天）。然而在真实世界方案中，单阶段流程展现出更优的可重复性：在644份方案的三轮运行中达到95.3%临床可接受准确度（四分位距≤3天），其中82.0%实现完全稳定（四分位距=0）。生产流程最终成功提取了涵盖多疾病领域的1,288个治疗组的时间毒性数据。对于生产环境的大语言模型部署而言，真实世界数据上的提取稳定性比合成基准测试的准确度更具决定性意义。

Time toxicity, the cumulative healthcare contact days from clinical trial participation, is an important but labor-intensive metric to extract from protocol documents. We developed TimeTox, an LLM-based pipeline for automated extraction of time toxicity from Schedule of Assessments tables. TimeTox uses Google’s Gemini models in three stages: summary extraction from full-length protocol PDFs, time toxicity quantification at six cumulative timepoints for each treatment arm, and multi-run consensus via position-based arm matching. We validated against 20 synthetic schedules (240 comparisons) and assessed reproducibility on 644 real-world oncology protocols. Two architectures were compared: single-pass (vanilla) and two-stage (structure-then-count). The two-stage pipeline achieved 100% clinically acceptable accuracy ($\pm$3 days) on synthetic data (MAE 0.81 days) versus 41.5% for vanilla (MAE 9.0 days). However, on real-world protocols, the vanilla pipeline showed superior reproducibility: 95.3% clinically acceptable accuracy (IQR $\leq$ 3 days) across 3 runs on 644 protocols, with 82.0% perfect stability (IQR = 0). The production pipeline extracted time toxicity for 1,288 treatment arms across multiple disease sites. Extraction stability on real-world data, rather than accuracy on synthetic benchmarks, is the decisive factor for production LLM deployment.

评分理由: 该论文的核心是评估大型语言模型（LLMs）在低资源语言（如哈萨克语和蒙古语）上的性能表现，并测试跨语言迁移策略的有效性。因此，它与关键词"Large Language Models" OR “LLMs” OR “Foundation Models"高度相关（评分为10分），因为论文直接以LLMs为研究对象，并进行了基准测试。然而，论文并未深入探讨其他关键词所涉及的具体技术（如MoE、SFT、RAG、量化等）、方法（如CoT、RLHF、PEFT）或应用领域（如AI for Science）。它主要关注性能评估和跨语言迁移策略，而非技术创新或特定领域的应用。

本研究通过评估八种大型语言模型在英语、哈萨克语和蒙古语五种实验条件下的表现，探究其对低资源语言的处理能力。我们使用涵盖事实性、推理性、技术性及文化相关类别的50个人工设计问题，对2000个回答的准确性、流畅性和完整性进行评估。研究发现，英语与低资源语言条件之间存在13.8至16.7个百分点的稳定性能差距：模型虽能保持表层流畅性，但生成内容的准确性显著降低。跨语言迁移策略——即提示模型先用英语推理再翻译回目标语言——为双语架构模型带来选择性提升（+2.2至+4.3个百分点），但对英语主导模型无增益效果。我们的结果表明，当前大型语言模型系统性地未能充分服务低资源语言群体，且有效的缓解策略需根据模型架构定制，而非普适通用。

We investigate how large language models perform on low-resource languages by benchmarking eight LLMs across five experimental conditions in English, Kazakh, and Mongolian. Using 50 hand-crafted questions spanning factual, reasoning, technical, and culturally grounded categories, we evaluate 2,000 responses on accuracy, fluency, and completeness. We find a consistent performance gap of 13.8-16.7 percentage points between English and low-resource language conditions, with models maintaining surface-level fluency while producing significantly less accurate content. Cross-lingual transfer-prompting models to reason in English before translating back-yields selective gains for bilingual architectures (+2.2pp to +4.3pp) but provides no benefit to English-dominant models. Our results demonstrate that current LLMs systematically underserve low-resource language communities, and that effective mitigation strategies are architecture-dependent rather than universal.

评分理由: 论文主要研究多语言视觉语言模型（VLMs）在孟加拉文化理解上的评估，属于大模型（VLMs是视觉语言模型，可视为大模型的一种）在特定文化领域的应用研究，因此与"Large Language Models” OR “LLMs” OR “Foundation Models"有一定关联（5分）。其他关键词主要涉及大模型的技术原理（如MoE、Scaling Laws、训练方法、推理优化等）或特定应用领域（如AI for Science），论文未直接涉及这些具体技术或领域，因此评分为0分。

孟加拉文化通过地域、方言、历史、饮食、政治、媒体及日常视觉生活得到丰富展现，但在多模态评估领域仍代表性不足。为填补这一空白，我们推出BanglaVerse——一个基于文化的基准测试集，用于评估多语言视觉-语言模型（VLMs）在跨越历史关联语言及区域方言的孟加拉文化上的表现。该基准包含九个领域共1,152张人工筛选图像，支持视觉问答与图像描述任务，并扩展至四种语言及五种孟加拉方言，共生成约3.23万项数据样本。实验表明，仅评估标准孟加拉语会高估模型的真实能力：在方言变体下模型性能显著下降（尤其在图像描述生成任务中），而印地语、乌尔都语等历史关联语言虽能保留部分文化语义，但在结构化推理任务上表现仍较弱。跨领域分析发现，主要瓶颈在于模型缺乏文化知识而非单纯的视觉基础能力，尤其在知识密集型类别中表现明显。这些发现使BanglaVerse成为衡量语言变异下文化根基性多模态理解能力的更现实测试平台。

Bangla culture is richly expressed through region, dialect, history, food, politics, media, and everyday visual life, yet it remains underrepresented in multimodal evaluation. To address this gap, we introduce BanglaVerse, a culturally grounded benchmark for evaluating multilingual vision-language models (VLMs) on Bengali culture across historically linked languages and regional dialects. Built from 1,152 manually curated images across nine domains, the benchmark supports visual question answering and captioning, and is expanded into four languages and five Bangla dialects, yielding ~32.3K artifacts. Our experiments show that evaluating only standard Bangla overestimates true model capability: performance drops under dialectal variation, especially for caption generation, while historically linked languages such as Hindi and Urdu retain some cultural meaning but remain weaker for structured reasoning. Across domains, the main bottleneck is missing cultural knowledge rather than visual grounding alone, with knowledge-intensive categories. These findings position BanglaVerse as a more realistic test bed for measuring culturally grounded multimodal understanding under linguistic variation.

评分理由: 论文专注于遥感领域的高光谱图像仿真，提出了一种基于潜在表示学习的框架，使用变分自编码器（VAE）进行预训练和插值。研究内容属于AI在科学领域的应用（遥感），与"AI for Science"有一定关联（5分），但论文未涉及大语言模型（LLMs）、深度学习技术原理创新或任何其他评分关键词中的具体技术（如MoE、Scaling Laws、RLHF等），因此其他关键词均为0分。

合成高光谱图像生成对于大规模仿真、算法开发和任务设计至关重要，然而传统的辐射传输模型计算成本高昂，且通常仅限于光谱级输出。本研究提出一种基于潜在表征的高光谱仿真框架，该框架学习高光谱数据的潜在生成表征。所提出的方法同时支持光谱级与空间-光谱级仿真，既可通过直接一步式训练实现，也可采用耦合变分自编码器预训练与参数-潜在空间插值的两步式策略进行训练。在PROSAIL模拟植被数据和哨兵-3 OLCI影像上的实验表明，该方法在重建精度、光谱保真度以及对真实世界空间变异性的鲁棒性方面均优于经典的基于回归的仿真器。我们进一步证明，仿真生成的高光谱图像在下游生物物理参数反演任务中能保持性能表现，这凸显了仿真数据在遥感应用中的实际价值。

Synthetic hyperspectral image (HSI) generation is essential for large-scale simulation, algorithm development, and mission design, yet traditional radiative transfer models remain computationally expensive and often limited to spectrum-level outputs. In this work, we propose a latent representation-based framework for hyperspectral emulation that learns a latent generative representation of hyperspectral data. The proposed approach supports both spectrum-level and spatial-spectral emulation and can be trained either in a direct one-step formulation or in a two-step strategy that couples variational autoencoder (VAE) pretraining with parameter-to-latent interpolation. Experiments on PROSAIL-simulated vegetation data and Sentinel-3 OLCI imagery demonstrate that the method outperforms classical regression-based emulators in reconstruction accuracy, spectral fidelity, and robustness to real-world spatial variability. We further show that emulated HSIs preserve performance in downstream biophysical parameter retrieval, highlighting the practical relevance of emulated data for remote sensing applications.

评分理由: 论文UniMotion提出了一种统一框架，用于在单一架构中同时理解和生成人体运动、自然语言和RGB图像。它明确使用了共享的LLM骨干网络（高度相关），并提出了自监督预训练策略LRA（与预训练相关）。然而，论文专注于多模态统一建模，特别是运动-文本-视觉的交叉模态对齐和生成，未涉及其他关键词如MoE、SLMs、对齐、推理、代理、压缩等具体技术。

本文提出UniMotion框架，据我们所知，这是首个能够在单一架构内同时理解与生成人体运动、自然语言和RGB图像的统一模型。现有统一模型仅能处理受限的模态子集（如运动-文本或静态姿态-图像），且主要依赖离散化标记方法，这会引入量化误差并破坏时间连续性。UniMotion通过一个核心原则克服了这些局限：将运动视为与RGB平等的连续模态。我们设计了新型跨模态对齐运动变分自编码器（CMA-VAE）与对称双路嵌入器，在共享大语言模型主干中为运动和RGB构建了并行的连续处理通路。为了在推理时无需图像输入的情况下将视觉语义先验注入运动表征，我们提出双后验KL对齐（DPA）方法，将视觉融合编码器更丰富的后验分布蒸馏至纯运动编码器。针对冷启动问题——仅凭文本监督过于稀疏而无法校准新引入的运动通路——我们进一步提出潜在重建对齐（LRA），这是一种自监督预训练策略，利用稠密的运动潜在表征作为明确条件，协同校准嵌入器、主干网络和流预测头，为所有下游任务建立稳定的运动感知基础。UniMotion在涵盖三种模态间任意到任意理解、生成与编辑的七项任务中均达到最先进性能，尤其在跨模态组合任务上展现出显著优势。

We present UniMotion, to our knowledge the first unified framework for simultaneous understanding and generation of human motion, natural language, and RGB images within a single architecture. Existing unified models handle only restricted modality subsets (e.g., Motion-Text or static Pose-Image) and predominantly rely on discrete tokenization, which introduces quantization errors and disrupts temporal continuity. UniMotion overcomes both limitations through a core principle: treating motion as a first-class continuous modality on equal footing with RGB. A novel Cross-Modal Aligned Motion VAE (CMA-VAE) and symmetric dual-path embedders construct parallel continuous pathways for Motion and RGB within a shared LLM backbone. To inject visual-semantic priors into motion representations without requiring images at inference, we propose Dual-Posterior KL Alignment (DPA), which distills a vision-fused encoder’s richer posterior into the motion-only encoder. To address the cold-start problem – where text supervision alone is too sparse to calibrate the newly introduced motion pathway – we further propose Latent Reconstruction Alignment (LRA), a self-supervised pre-training strategy that uses dense motion latents as unambiguous conditions to co-calibrate the embedder, backbone, and flow head, establishing a stable motion-aware foundation for all downstream tasks. UniMotion achieves state-of-the-art performance across seven tasks spanning any-to-any understanding, generation, and editing among the three modalities, with especially strong advantages on cross-modal compositional tasks.

评分理由: 该论文提出了一种名为UNITE的自动编码器架构，用于统一标记化和潜在扩散，主要关注图像和分子模态的生成模型。论文的核心贡献在于单阶段联合训练方法，通过共享参数实现标记化和生成的联合优化。所有关键词均与大型语言模型（LLMs）相关，但论文未涉及LLMs，而是专注于潜在扩散模型（LDMs）和自动编码器。唯一相关的关键词是’AI for Science OR Bioinformatics OR Cheminformatics’，因为论文提到了分子模态的应用，但这不是核心焦点，因此给予5分（有一定关联）。其他关键词与LLMs技术、对齐、推理、代理等无关，均得0分。

潜在扩散模型通过在学习的潜在空间中操作，实现了高保真度的合成。然而，训练最先进的潜在扩散模型需要复杂的分阶段过程：必须首先训练一个分词器，然后才能在冻结的潜在空间中训练扩散模型。我们提出了UNITE——一种用于统一分词和潜在扩散的自编码器架构。UNITE包含一个通过权重共享同时作为图像分词器和潜在生成器的生成式编码器。我们的核心见解是，分词和生成可以被视为不同条件设定下的同一潜在推断问题：分词是从完全观测到的图像推断潜在表示，而生成则是从噪声结合文本或类别条件中推断潜在表示。受此启发，我们引入了一种单阶段训练程序，通过同一生成式编码器的两次前向传播来联合优化这两个任务。共享参数使得梯度能够共同塑造潜在空间，从而促进一种“共同的潜在语言”。在图像和分子模态上，UNITE无需对抗性损失或预训练编码器（例如DINO），即可达到接近最先进的性能，在ImageNet 256 x 256数据集上，其Base和Large模型的FID分别达到2.12和1.73。我们进一步从表征对齐和压缩的角度分析了生成式编码器。这些结果表明，从头开始对分词和生成进行单阶段联合训练是可行的。

Latent diffusion models (LDMs) enable high-fidelity synthesis by operating in learned latent spaces. However, training state-of-the-art LDMs requires complex staging: a tokenizer must be trained first, before the diffusion model can be trained in the frozen latent space. We propose UNITE - an autoencoder architecture for unified tokenization and latent diffusion. UNITE consists of a Generative Encoder that serves as both image tokenizer and latent generator via weight sharing. Our key insight is that tokenization and generation can be viewed as the same latent inference problem under different conditioning regimes: tokenization infers latents from fully observed images, whereas generation infers them from noise together with text or class conditioning. Motivated by this, we introduce a single-stage training procedure that jointly optimizes both tasks via two forward passes through the same Generative Encoder. The shared parameters enable gradients to jointly shape the latent space, encouraging a “common latent language”. Across image and molecule modalities, UNITE achieves near state of the art performance without adversarial losses or pretrained encoders (e.g., DINO), reaching FID 2.12 and 1.73 for Base and Large models on ImageNet 256 x 256. We further analyze the Generative Encoder through the lenses of representation alignment and compression. These results show that single stage joint training of tokenization & generation from scratch is feasible.

评分理由: 论文专注于视频世界模型（Video World Models）的推理加速技术，特别是针对Diffusion Transformers（DiTs）的缓存优化方法。与绝大多数关键词（涉及大语言模型、训练方法、对齐、代理等）完全无关。仅与两个关键词相关：1）“World Models AND General World Models"高度相关（10分），因为论文直接研究视频世界模型；2）“Speculative Decoding OR Inference Acceleration"有一定关联（5分），因为论文核心目标是加速推理，但方法是通过缓存而非推测解码。

扩散变换器（Diffusion Transformers, DiTs）驱动着高保真度的视频世界模型，但由于其顺序去噪过程及昂贵的时空注意力机制，计算成本依然高昂。免训练特征缓存技术通过在去噪步骤间复用中间激活值来加速推理；然而，现有方法主要依赖于零阶保持假设，即在全局漂移较小时将缓存特征作为静态快照复用。这常常导致动态场景中出现重影伪影、模糊和运动不一致问题。我们提出 \textbf{WorldCache}，一种感知约束的动态缓存框架，从“何时复用”和“如何复用”两方面进行改进。WorldCache 引入了运动自适应阈值、显著性加权的漂移估计、通过混合与形变实现的最优近似，以及在扩散步骤间采用相位感知的阈值调度。我们这一整体性方法实现了自适应、运动一致的特征复用，且无需重新训练。在 PAI-Bench 上评估的 Cosmos-Predict2.5-2B 模型中，WorldCache 实现了 \textbf{2.3$\times$} 的推理加速，同时保持了基线模型 \textbf{99.4%} 的质量，显著优于先前的免训练缓存方法。我们的代码可在 \href{https://umair1221.github.io/World-Cache/}{World-Cache} 上获取。

Diffusion Transformers (DiTs) power high-fidelity video world models but remain computationally expensive due to sequential denoising and costly spatio-temporal attention. Training-free feature caching accelerates inference by reusing intermediate activations across denoising steps; however, existing methods largely rely on a Zero-Order Hold assumption i.e., reusing cached features as static snapshots when global drift is small. This often leads to ghosting artifacts, blur, and motion inconsistencies in dynamic scenes. We propose \textbf{WorldCache}, a Perception-Constrained Dynamical Caching framework that improves both when and how to reuse features. WorldCache introduces motion-adaptive thresholds, saliency-weighted drift estimation, optimal approximation via blending and warping, and phase-aware threshold scheduling across diffusion steps. Our cohesive approach enables adaptive, motion-consistent feature reuse without retraining. On Cosmos-Predict2.5-2B evaluated on PAI-Bench, WorldCache achieves \textbf{2.3$\times$} inference speedup while preserving \textbf{99.4%} of baseline quality, substantially outperforming prior training-free caching approaches. Our code can be accessed on \href{https://umair1221.github.io/World-Cache/}{World-Cache}.

评分理由: 论文核心研究LLMs在空间布局编辑任务中的结构化推理能力，与’Large Language Models’和’Chain of Thought’高度相关（10分），因为直接使用LLMs并改进其推理过程。与’SFT’和’Instruction Tuning’有一定关联（5分），因涉及指令跟随的微调。与’System 2 Thinking’和’Explainable AI’有弱关联（5分），因强调深度推理和可解释性。其他关键词如MoE、SLMs、RAG等未涉及，得0分。

大语言模型（LLMs）与视觉语言模型（VLMs）已展现出令人瞩目的推理能力，但在执行细粒度视觉编辑任务时，它们仍难以准确把握空间理解与布局一致性。本文提出一种结构化推理框架，该框架通过场景图推理实现基于文本条件的空间布局编辑。给定输入场景图及自然语言指令，模型对场景图进行推理，生成满足文本条件且保持空间连贯性的更新后场景图。通过利用结构化关系表征显式引导推理过程，我们的方法提升了对空间关系的可解释性与控制力。我们在一个涵盖排序、空间对齐及房间编辑任务的新型文本引导布局编辑基准上评估了本方法。相较于思维链微调（CoT-SFT）与原始GRPO基线，我们的训练范式在交并比（IoU）上平均提升15%，中心距离误差降低25%。与当前最先进的零样本大语言模型相比，我们最优模型的平均交并比（mIoU）最高可提升20%，显示出显著增强的空间精确性。

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a Structured Reasoning framework that performs text-conditioned spatial layout editing via scene-graph reasoning. Given an input scene graph and a natural-language instruction, the model reasons over the graph to generate an updated scene graph that satisfies the text condition while maintaining spatial coherence. By explicitly guiding the reasoning process through structured relational representations, our approach improves both interpretability and control over spatial relationships. We evaluate our method on a new text-guided layout editing benchmark encompassing sorting, spatial alignment, and room-editing tasks. Our training paradigm yields an average 15% improvement in IoU and 25% reduction in center-distance error compared to Chain of Thought Fine-tuning (CoT-SFT) and vanilla GRPO baselines. Compared to SOTA zero-shot LLMs, our best models achieve up to 20% higher mIoU, demonstrating markedly improved spatial precision.

评分理由: 论文专注于视觉-语言模型（VLM）引导的潜在世界模型框架，核心是结合密集帧动态建模与长时域语义指导。仅与关键词’World Models AND General World Models’高度相关（10分），因为论文明确研究潜在世界模型（latent world models）并改进其预测能力。其他关键词主要涉及纯语言模型技术、训练方法、推理优化、代理系统等，论文未涉及这些具体技术，因此评分为0分。

近期潜在世界模型（如V-JEPA2）的研究进展表明，其通过视频观测预测未来世界状态的能力颇具前景。然而，基于短时观测窗口的密集预测限制了时间上下文，易使预测器偏向局部、低层次的推断，难以捕捉长时程语义，从而降低了下游任务的实用性。相比之下，视觉—语言模型通过对均匀采样帧进行推理，提供了强大的语义基础和通用知识，但由于计算驱动的稀疏采样、将细粒度交互状态压缩为面向文本表征的语言输出瓶颈，以及适配小型动作条件数据集时的数据机制不匹配，它们并不适合作为独立的密集预测器。我们提出了一种VLM引导的JEPA风格潜在世界建模框架，通过双时间路径将密集帧动态建模与长时程语义引导相结合：一个用于细粒度运动与交互线索的密集JEPA分支，以及一个具有更大时间步长、提供知识丰富引导的均匀采样VLM“思考者”分支。为有效传递VLM的渐进式推理信号，我们引入了分层金字塔表征提取模块，该模块将多层VLM表征聚合为与潜在预测兼容的引导特征。在手工操作轨迹预测任务上的实验表明，我们的方法在性能上超越了仅使用VLM的强基线模型和JEPA预测器基线，并产生了更稳健的长时程推演行为。

Recent progress in latent world models (e.g., V-JEPA2) has shown promising capability in forecasting future world states from video observations. Nevertheless, dense prediction from a short observation window limits temporal context and can bias predictors toward local, low-level extrapolation, making it difficult to capture long-horizon semantics and reducing downstream utility. Vision–language models (VLMs), in contrast, provide strong semantic grounding and general knowledge by reasoning over uniformly sampled frames, but they are not ideal as standalone dense predictors due to compute-driven sparse sampling, a language-output bottleneck that compresses fine-grained interaction states into text-oriented representations, and a data-regime mismatch when adapting to small action-conditioned datasets. We propose a VLM-guided JEPA-style latent world modeling framework that combines dense-frame dynamics modeling with long-horizon semantic guidance via a dual-temporal pathway: a dense JEPA branch for fine-grained motion and interaction cues, and a uniformly sampled VLM \emph{thinker} branch with a larger temporal stride for knowledge-rich guidance. To transfer the VLM’s progressive reasoning signals effectively, we introduce a hierarchical pyramid representation extraction module that aggregates multi-layer VLM representations into guidance features compatible with latent prediction. Experiments on hand-manipulation trajectory prediction show that our method outperforms both a strong VLM-only baseline and a JEPA-predictor baseline, and yields more robust long-horizon rollout behavior.

评分理由: 论文提出TiCo方法，属于大模型在语音对话领域的应用创新。核心相关关键词：1) ‘Post-training OR Supervised Fine-tuning OR SFT’（10分）- TiCo被明确描述为’post-training method’，是核心方法；2) ‘RLHF OR RLAIF OR Direct Preference Optimization OR DPO’（5分）- 论文提到使用’reinforcement learning’进行优化；3) ‘Instruction Tuning OR Alignment OR Value Alignment’（5分）- 涉及使模型遵循时间约束指令；4) ‘Large Language Models OR LLMs OR Foundation Models’（5分）- 论文研究spoken dialogue models，属于大模型应用范畴；5) ‘LLM Agents OR Autonomous Agents OR Agentic Workflow’（5分）- 应用于voice assistants和interactive agents。其他关键词与论文内容无直接关联。

我们提出TiCo，一种简单的训练后方法，旨在使口语对话模型能够遵循时间约束指令，并生成时长可控的响应。这种能力对于现实世界中的口语系统（如语音助手和交互式代理）具有重要价值，因为控制响应时长可以提升交互质量。然而，尽管现有模型在生成自然口语响应方面表现出色，它们缺乏时间意识，难以遵循与时长相关的指令（例如“请生成一段约15秒的响应”）。通过对开源和商业口语对话模型的实证评估，我们发现它们经常无法满足此类时间控制要求。TiCo通过使模型在生成过程中借助口语时间标记（例如<10.6秒>）来估计已用说话时间，从而解决了这一局限。这些标记帮助模型保持时间意识，并调整剩余内容以满足目标时长。TiCo方法简单高效：仅需少量数据且无需额外的问答对，而是依赖自生成和强化学习。实验结果表明，TiCo在保持响应质量的同时，显著提升了模型对时长约束的遵循能力。

We propose TiCo, a simple post-training method for enabling spoken dialogue models (SDMs) to follow time-constrained instructions and generate responses with controllable duration. This capability is valuable for real-world spoken language systems such as voice assistants and interactive agents, where controlling response duration can improve interaction quality. However, despite their strong ability to generate natural spoken responses, existing models lack time awareness and struggle to follow duration-related instructions (e.g., “Please generate a response lasting about 15 seconds”). Through an empirical evaluation of both open-source and commercial SDMs, we show that they frequently fail to satisfy such time-control requirements. TiCo addresses this limitation by enabling models to estimate elapsed speaking time during generation through Spoken Time Markers (STM) (e.g., <10.6 seconds>). These markers help the model maintain awareness of time and adjust the remaining content to meet the target duration. TiCo is simple and efficient: it requires only a small amount of data and no additional question-answer pairs, relying instead on self-generation and reinforcement learning. Experimental results show that TiCo significantly improves adherence to duration constraints while preserving response quality.

评分理由: 论文研究的是生成式推荐系统（GEM-Rec），专注于商业检索中的广告投放和竞价机制，通过控制令牌和竞价感知解码来优化语义相关性和平台收入。所有关键词均涉及大模型、深度学习技术原理或科学应用（如生物信息学），而本文的核心是推荐系统架构和商业优化，未涉及任何大模型技术、深度学习创新或科学领域应用，因此所有关键词相关度均为0。

基于语义ID的生成式推荐系统（如TIGER [Rajput等人，2023]）已成为序列推荐领域广泛采用的竞争范式。然而，现有架构仅针对语义检索设计，并未解决诸如通过广告收入实现货币化以及商业检索中竞价整合等问题。我们提出了GEM-Rec，一个将商业相关性与货币化目标直接整合到生成序列中的统一框架。我们引入了控制令牌，以将“是否展示广告”与“展示哪个项目”的决策解耦。这使得模型能够直接从交互日志中学习有效的广告投放模式，这些日志本质上反映了过去成功的广告投放。作为补充，我们设计了一种竞价感知解码机制，该机制处理实时定价，将竞价直接注入推理过程，以引导生成朝向高价值项目。我们证明了该方法能保证分配单调性，即确保更高的竞价会弱增加广告被展示的可能性，而无需重新训练模型。实验表明，GEM-Rec使平台能够动态优化语义相关性与平台收入。

Generative Recommender Systems using semantic ids, such as TIGER (Rajput et al., 2023), have emerged as a widely adopted competitive paradigm in sequential recommendation. However, existing architectures are designed solely for semantic retrieval and do not address concerns such as monetization via ad revenue and incorporation of bids for commercial retrieval. We propose GEM-Rec, a unified framework that integrates commercial relevance and monetization objectives directly into the generative sequence. We introduce control tokens to decouple the decision of whether to show an ad from which item to show. This allows the model to learn valid placement patterns directly from interaction logs, which inherently reflect past successful ad placements. Complementing this, we devise a Bid-Aware Decoding mechanism that handles real-time pricing, injecting bids directly into the inference process to steer the generation toward high-value items. We prove that this approach guarantees allocation monotonicity, ensuring that higher bids weakly increase an ad’s likelihood of being shown without requiring model retraining. Experiments demonstrate that GEM-Rec allows platforms to dynamically optimize for semantic relevance and platform revenue.

评分理由: 论文研究扩散语言模型（DLMs）的解码策略理论分析，属于语言模型技术范畴，但所有关键词均针对大语言模型（LLMs）及其相关技术（如MoE、SFT、RLHF、RAG等），而DLMs是不同于LLMs的模型架构（扩散模型 vs. 自回归模型），论文未涉及LLMs或任何关键词中的具体技术，因此所有关键词相关度为0。

扩散语言模型已成为自回归模型在语言建模领域一种颇具前景的替代方案，它允许灵活的生成顺序和多个标记的并行生成。然而，这种灵活性引入了一个自回归模型所不具备的挑战：解码策略——即决定每次迭代中生成标记的顺序和数量——会关键性地影响采样效率。在实践中探索的解码策略中，基于置信度的方法（其根据预测置信度自适应地选择要解掩哪些标记以及解掩多少标记）已展现出强大的实证性能。尽管取得了这些成功，我们对基于置信度解码的理论理解仍然有限。

在本工作中，我们为扩散语言模型中的基于置信度解码建立了首个理论分析框架。我们聚焦于一种基于熵和的策略，该策略在每次迭代中持续解掩标记，直至累积熵超过某个阈值。我们证明，该策略能以 $\widetilde O(H(X_0)/\varepsilon)$ 的期望迭代次数实现KL散度意义上的 $\varepsilon$ 精确采样，其中 $H(X_0)$ 表示目标数据分布的熵。值得注意的是，当数据分布相对于序列长度具有较低熵时，此策略能带来显著的采样加速，同时能自动适应数据的内在复杂性，而无需先验知识或超参数调整。总体而言，我们的研究结果为基于置信度的解码提供了理论基础，并可能为设计更高效的扩散语言模型解码策略提供参考。

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) models for language modeling, allowing flexible generation order and parallel generation of multiple tokens. However, this flexibility introduces a challenge absent in AR models: the \emph{decoding strategy} – which determines the order and number of tokens generated at each iteration – critically affects sampling efficiency. Among decoding strategies explored in practice, confidence-based methods, which adaptively select which and how many tokens to unmask based on prediction confidence, have shown strong empirical performance. Despite this success, our theoretical understanding of confidence-based decoding remains limited. In this work, we develop the first theoretical analysis framework for confidence-based decoding in DLMs. We focus on an entropy sum-based strategy that continues unmasking tokens within each iteration until the cumulative entropy exceeds a threshold, and show that it achieves $\varepsilon$-accurate sampling in KL divergence with an expected number of iterations $\widetilde O(H(X_0)/\varepsilon)$, where $H(X_0)$ denotes the entropy of the target data distribution. Notably, this strategy yields substantial sampling acceleration when the data distribution has low entropy relative to the sequence length, while automatically adapting to the intrinsic complexity of data without requiring prior knowledge or hyperparameter tuning. Overall, our results provide a theoretical foundation for confidence-based decoding and may inform the design of more efficient decoding strategies for DLMs.

评分理由: 论文介绍了一个名为Dyadic的对话研究平台，支持人-人和人-AI对话研究，但论文本身不涉及任何大模型或深度学习的技术原理、创新或应用。它只是一个研究工具平台，不包含模型训练、优化、推理、对齐、压缩、解释性、科学应用等任何技术内容。所有关键词均与大模型技术或科学应用相关，而本文仅涉及平台工具介绍，因此所有关键词相关度为0。

对话在社会生活中无处不在，但对此互动过程的实证研究长期受限于工具模块化不足且难以适应研究者需求。为突破对话研究中的诸多限制，本教程概述并介绍一款新型工具——Dyadic（https://www.chatdyadic.com/），这是一个基于网络的平台，可用于通过文本或语音聊天研究人-人及人-人工智能（AI）对话。Dyadic区别于其他平台的特点在于：它支持多模态研究、AI建议（例如在人-人研究中，AI可为参与者生成回复建议）、实时监控（例如研究者可对交流者间的聊天进行实时评估）以及调查部署（例如可将李克特量表、情感温度计和开放式文本框发送给参与者，用于对互动进行现场评估）等关键功能。使用Dyadic无需编程基础，且平台支持与现有调查工具的集成。

Conversation is ubiquitous in social life, but the empirical study of this interactive process has been thwarted by tools that are insufficiently modular and unadaptive to researcher needs. To relieve many constraints in conversation research, the current tutorial presents an overview and introduction to a new tool, Dyadic (https://www.chatdyadic.com/), a web-based platform for studying human-human and human-AI conversations using text-based or voice-based chats. Dyadic is distinct from other platforms by offering studies with multiple modalities, AI suggestions (e.g., in human-human studies, AI can suggest responses to a participant), live monitoring (e.g., researchers can evaluate, in real time, chats between communicators), and survey deployment (e.g., Likert-type scales, feeling thermometers, and open-ended text boxes can be sent to humans for in situ evaluations of the interaction), among other consequential features. No coding is required to operate Dyadic directly, and integrations with existing survey platforms are offered.

评分理由: 论文核心研究LLM作为评估者（LLM-as-judge）的可靠性和与人类判断的一致性，直接涉及LLM技术应用，因此与’Large Language Models’高度相关（10分）。研究测试了37个不同规模的对话LLM，包括GPT-4o和开源模型，并提到有5个模型针对任务进行了微调，这与’Post-training OR Supervised Fine-tuning OR SFT’有一定关联（5分）。论文未涉及其他关键词的具体技术或应用，如MoE、SLMs、Scaling Laws、Instruction Tuning、RAG、推理加速、幻觉缓解、AI for Science等，因此这些关键词评分为0分。

大语言模型（LLM）作为评判者，通过分析受害机器学习（ML）模型（特别是大语言模型）的输出来评估其质量。LLM作为评判者由一个模型和一个专门设计的评判提示组合而成，该提示包含了分析标准。相较于人工评审，这种分析自动化通过更快速、更一致的判断，实现了对受害模型自由文本输出的复杂评估的大规模扩展。因此，对大语言模型的质量和安全评估能够覆盖受害模型广泛的用例范围。作为一种相对较新的技术，LLM作为评判者在其可靠性以及与人类判断的一致性方面尚缺乏深入研究。

我们的工作评估了LLM作为受害LLM自动化质量评估者的适用性。我们测试了37个不同规模的对话式LLM，结合5种不同的评判提示、二级评判者的概念，以及5个为此任务微调的模型作为评估者的效能。作为评估目标，我们为八类不同的评判任务策划了数据集，并基于人工评估提供了相应的真实标签。我们的实证结果表明，当结合合适的提示时，LLM作为评判者与人类评估结果具有高度相关性，尤其是GPT-4o、多个参数规模≥320亿的开源模型，以及如Qwen2.5 140亿等少数较小模型。

A Large Language Model (LLM) as judge evaluates the quality of victim Machine Learning (ML) models, specifically LLMs, by analyzing their outputs. An LLM as judge is the combination of one model and one specifically engineered judge prompt that contains the criteria for the analysis. The resulting automation of the analysis scales up the complex evaluation of the victim models’ free-form text outputs by faster and more consistent judgments compared to human reviewers. Thus, quality and security assessments of LLMs can cover a wide range of the victim models’ use cases. Being a comparably new technique, LLMs as judges lack a thorough investigation for their reliability and agreement to human judgment. Our work evaluates the applicability of LLMs as automated quality assessors of victim LLMs. We test the efficacy of 37 differently sized conversational LLMs in combination with 5 different judge prompts, the concept of a second-level judge, and 5 models fine-tuned for the task as assessors. As assessment objective, we curate datasets for eight different categories of judgment tasks and the corresponding ground-truth labels based on human assessments. Our empirical results show a high correlation of LLMs as judges with human assessments, when combined with a suitable prompt, in particular for GPT-4o, several open-source models with $\geqslant$ 32B parameters, and a few smaller models like Qwen2.5 14B.

评分理由: 论文核心研究LLM的知识注入问题，提出SPA方法通过提示工程生成合成数据进行知识增强，与’Large Language Models’高度相关（10分）。论文未涉及其他关键词的具体技术，如MoE、SLMs、Scaling Laws、各种训练方法、推理技术、代理系统、压缩技术等，因此这些关键词评分为0分。论文属于大模型应用研究，符合研究背景要求。

尽管大语言模型（LLM）已在海量数据上进行预训练，但其知识覆盖在专业化、数据稀缺的领域中仍不完整，这促使学界广泛研究通过合成数据生成进行知识注入。我们提出SPA（规模化提示工程增强），这是一种简单但难以被超越的基线方法，它使用少量精心设计的提示来生成大规模合成数据以进行知识注入。通过系统比较，我们发现SPA的表现优于多个强基线方法。此外，我们指出了先前方法的两个关键局限：（1）基于强化学习（RL）的方法虽然能在小规模下提升基于LLM的数据增强的标记效率，但随着数据规模扩大，它们会遭遇多样性崩溃，导致收益递减；（2）尽管多阶段提示方法可能优于简单的增强方法，但经过细致的提示调优后，其优势可能消失。我们的结果表明，对于知识注入任务，精心设计的提示结合直接的大规模增强可以出人意料地有效，我们希望SPA能为该领域的未来研究提供一个强有力的基线。我们的代码发布于https://github.com/Tangkexian/SPA。

While large language models (LLMs) are pretrained on massive amounts of data, their knowledge coverage remains incomplete in specialized, data-scarce domains, motivating extensive efforts to study synthetic data generation for knowledge injection. We propose SPA (Scaling Prompt-engineered Augmentation), a simple but tough-to-beat baseline that uses a small set of carefully designed prompts to generate large-scale synthetic data for knowledge injection. Through systematic comparisons, we find that SPA outperforms several strong baselines. Furthermore, we identify two key limitations of prior approaches: (1) while RL-based methods may improve the token efficiency of LLM-based data augmentation at small scale, they suffer from diversity collapse as data scales, leading to diminishing returns; and (2) while multi-stage prompting may outperform simple augmentation methods, their advantages can disappear after careful prompt tuning. Our results suggest that, for knowledge injection, careful prompt design combined with straightforward large-scale augmentation can be surprisingly effective, and we hope SPA can serve as a strong baseline for future studies in this area. Our code is available at https://github.com/Tangkexian/SPA.

评分理由: 论文主要研究图论与全息对偶的数学理论在AI任务中的应用，属于理论交叉研究。虽然属于AI for Science范畴（给5分），但论文内容高度专注于数学图论和物理全息对偶理论，未涉及任何具体的大模型技术、训练方法、推理优化、对齐技术、代理系统等关键词。论文提到GPT-style语言模型和RL系统仅作为类比示例，并非研究核心。

本文是CayleyPy项目的第四篇论文，该项目将人工智能方法应用于大型图结构的探索。在本研究中，我们提出该框架下可能存在一种新的离散全息弦对偶形式，并探讨其与人工智能系统及数学领域的关联。许多现代人工智能任务——例如GPT类语言模型或强化学习系统所处理的问题——可被视为在图结构上预测粒子轨迹的直接类比。我们针对一大类凯莱图（Cayley graphs）研究了该问题，并证明这类问题惊人地存在离散弦理论的对偶描述。我们推测此类对偶性可推广至一系列人工智能系统，从而催生更高效的计算方法。特别地，受AdS/CFT中“复杂度=体积”原理的启发，我们提出态的全息弦图像可作为数据嵌入的自然候选方案。

对于对称群S_n的凯莱图，我们的研究结果表明其对应对偶对象是平坦的平面多边形。图的直径等于多边形内部整数点数量乘以n的缩放值。图的顶点可通过全息映射对应到多边形内部的路径，而常规的图距离则对应于路径下方的面积，从而直接实现了“复杂度=体积”范式。我们还在大n极限下发现了连续共形场论（CFT）与对偶弦存在的证据。我们通过大量初始案例验证了这一图景及对偶性的其他方面。同时，我们提供了新的数据集（通过机器学习与传统工具结合获得），这些数据将有助于在更普遍情形下建立对偶关系。

This is the fourth paper in the CayleyPy project, which applies AI methods to the exploration of large graphs. In this work, we suggest the existence of a new discrete version of holographic string dualities for this setup, and discuss their relevance to AI systems and mathematics. Many modern AI tasks – such as those addressed by GPT-style language models or RL systems – can be viewed as direct analogues of predicting particle trajectories on graphs. We investigate this problem for a large family of Cayley graphs, for which we show that surprisingly it admits a dual description in terms of discrete strings. We hypothesize that such dualities may extend to a range of AI systems where they can lead to more efficient computational approaches. In particular, string holographic images of states are proposed as natural candidates for data embeddings, motivated by the “complexity = volume” principle in AdS/CFT. For Cayley graphs of the symmetric group S_n, our results indicate that the corresponding dual objects are flat, planar polygons. The diameter of the graph is equal to the number of integer points inside the polygon scaled by n. Vertices of the graph can be mapped holographically to paths inside the polygon, and the usual graph distances correspond to the area under the paths, thus directly realising the “complexity = volume” paradigm. We also find evidence for continuous CFTs and dual strings in the large n limit. We confirm this picture and other aspects of the duality in a large initial set of examples. We also present new datasets (obtained by a combination of ML and conventional tools) which should be instrumental in establishing the duality for more general cases.