评分理由: 论文提出AutoVerifier，一个基于LLM的智能体框架，用于自动化验证技术声明，因此与"Large Language Models"和"LLM Agents"高度相关（10分）。其结构化推理过程涉及多步分析和证据追踪，与"Chain of Thought"和"System 2 Thinking"相关（8分）。框架旨在提高事实性和减少错误，与"Hallucination Mitigation"相关（8分）。应用场景为科学和技术情报分析，属于"AI for Science"范畴（8分）。框架涉及检索和生成知识图谱，与"Retrieval-Augmented Generation"有一定关联（5分）。其他关键词如MoE、量化、训练方法等未在论文中涉及，得0分。

科技情报分析需要在快速增长的文献中验证复杂的技术主张，而现有方法难以弥合表层准确性与深层方法有效性之间的验证鸿沟。我们提出AutoVerifier——一个基于大语言模型的智能体框架，无需领域专业知识即可实现技术主张的端到端自动化验证。该框架将每个技术论断分解为（主体，谓词，客体）形式的结构化主张三元组，通过构建知识图谱实现跨六个渐进增强层的结构化推理：文献库构建与导入、实体与主张提取、文档内验证、跨源验证、外部信号佐证以及最终假设矩阵生成。我们以一项存在争议的量子计算主张为例展示AutoVerifier的效能：在操作者不具备量子专业知识的情况下，该框架自动识别出目标论文中的过度宣称与度量标准不一致问题，追溯跨文献矛盾，发现未披露的商业利益冲突，并生成最终评估报告。这些结果表明，结构化的大语言模型验证能够可靠评估新兴技术的有效性与成熟度，将原始技术文档转化为可追溯、有证据支撑的情报评估。

Scientific and Technical Intelligence (S&TI) analysis requires verifying complex technical claims across rapidly growing literature, where existing approaches fail to bridge the verification gap between surface-level accuracy and deeper methodological validity. We present AutoVerifier, an LLM-based agentic framework that automates end-to-end verification of technical claims without requiring domain expertise. AutoVerifier decomposes every technical assertion into structured claim triples of the form (Subject, Predicate, Object), constructing knowledge graphs that enable structured reasoning across six progressively enriching layers: corpus construction and ingestion, entity and claim extraction, intra-document verification, cross-source verification, external signal corroboration, and final hypothesis matrix generation. We demonstrate AutoVerifier on a contested quantum computing claim, where the framework, operated by analysts with no quantum expertise, automatically identified overclaims and metric inconsistencies within the target paper, traced cross-source contradictions, uncovered undisclosed commercial conflicts of interest, and produced a final assessment. These results show that structured LLM verification can reliably evaluate the validity and maturity of emerging technologies, turning raw technical documents into traceable, evidence-backed intelligence assessments.

评分理由: 论文研究LLM训练流程（预训练、SFT、RLHF）对AI素养和说服力的影响，与LLM、SFT、RLHF高度相关（10分），与预训练、事实性/真实性缓解相关（8分），与对齐、可解释AI有一定关联（5分），其他关键词未涉及（0分）。

随着大型语言模型（LLM）的说服力日益增强，人们担忧其可能在不同情境下大规模影响公众的观点与决策。现有的缓解措施（如AI检测器和免责声明）大多将人类视为AI生成信息的被动接收者。为更主动地干预具有说服力的AI，我们提出了$\textbf{LLMimic}$——一种基于角色扮演、交互式、游戏化的AI素养教程。在该教程中，参与者扮演LLM的角色，并依次经历模型训练流程的三个关键阶段：预训练、监督微调（SFT）和基于人类反馈的强化学习（RLHF）。我们开展了一项$2 \times 3$的组间实验（$N = 274$），参与者被分为两组：一组观看AI发展史视频（对照组），另一组与LLMimic进行交互（实验组），随后参与三种现实AI说服场景中的一种：（a）慈善捐款劝说，（b）恶意资金索取，或（c）酒店推荐。研究结果表明，LLMimic显著提升了参与者的AI素养（$p < .001$），降低了各场景中的说服成功率（$p < .05$），并在酒店推荐场景中提高了回答的真实性与社会责任水平（$p<0.01$）。这些发现表明，LLMimic提供了一种可扩展、以人为本的方法，能够有效提升AI素养，并支持人们与具有说服力的AI进行更明智的互动。

As large language models (LLMs) become increasingly persuasive, there is concern that people’s opinions and decisions may be influenced across various contexts at scale. Prior mitigation (e.g., AI detectors and disclaimers) largely treats people as passive recipients of AI-generated information. To provide a more proactive intervention against persuasive AI, we introduce $\textbf{LLMimic}$, a role-play-based, interactive, gamified AI literacy tutorial, where participants assume the role of an LLM and progress through three key stages of the training pipeline (pretraining, SFT, and RLHF). We conducted a $2 \times 3$ between-subjects study ($N = 274$) where participants either (1) watched an AI history video (control) or (2) interacted with LLMimic (treatment), and then engaged in one of three realistic AI persuasion scenarios: (a) charity donation persuasion, (b) malicious money solicitation, or (c) hotel recommendation. Our results show that LLMimic significantly improved participants’ AI literacy ($p < .001$), reduced persuasion success across scenarios ($p < .05$), and enhanced truthfulness and social responsibility levels ($p<0.01$) in the hotel scenario. These findings suggest that LLMimic offers a scalable, human-centered approach to improving AI literacy and supporting more informed interactions with persuasive AI.

评分理由: 论文R2-Write专注于通过反思和修订模式提升大语言模型在开放式写作任务中的深度推理能力。核心相关关键词包括：LLMs（论文明确研究大语言模型在写作中的应用）、Chain of Thought/CoT Reasoning（论文系统研究长思维链在开放式任务中的有效性）、System 2 Thinking/In-depth Reasoning（论文旨在解锁深度推理能力）、Self-Correction/Self-Reflection（论文核心框架基于反思和修订模式）。部分相关关键词：RLHF（论文使用强化学习进行过程奖励监督，但非核心对齐方法）、LLM Agents/Multi-agent Systems（论文框架涉及writer-judge交互，可视为简单多智能体协调，但非主要焦点）。其余关键词与论文的技术方法（如MoE、量化、RAG等）或应用领域（如科学AI）无直接关联。

尽管长链思维深度推理已在数学等可验证领域显著提升了大语言模型的性能，其在开放式任务（如写作）中的有效性仍未被探索。本文通过系统性研究发现，现有主流推理模型在开放式写作任务上取得的提升有限。进一步分析表明，这些模型在开放式写作中缺乏深度反思与修订模式，导致其改进幅度远小于数学推理任务。为应对这一局限，我们提出了R2-Write：一种通过迭代式“作者-评判者”交互生成高质量思维轨迹的自动化框架，该轨迹融合了显性的反思与修订模式。为避免冗余反思，我们设计了过程奖励机制，在强化学习过程中监督反思质量，从而提升性能并优化计算效率。在多项创意写作与深度研究基准上的广泛实验证明了该方法的显著改进，验证了显式融入反思与修订模式能够为开放式写作任务解锁深度推理能力。

While deep reasoning with long chain-of-thought has dramatically improved large language models in verifiable domains like mathematics, its effectiveness for open-ended tasks such as writing remains unexplored. In this paper, we conduct a systematic investigation revealing that existing mainstream reasoning models achieve limited gains on open-ended writing tasks. Our further analysis shows that these models lack deep reflection and revision patterns in open-ended writing, resulting in substantially smaller improvements compared to mathematical reasoning tasks. To address this limitation, we introduce R2-Write: an automated framework that synthesizes high-quality thinking trajectories enriched with explicit reflection and revision patterns through iterative writer-judge interaction. To prevent redundant reflections, we design a process reward mechanism that supervises reflection quality during reinforcement learning, improving both performance and token efficiency. Extensive experiments across multiple creative writing and deep-research benchmarks demonstrate significant improvements, validating that explicitly incorporating reflection and revision patterns unlocks deep reasoning capabilities for open-ended writing tasks.

评分理由: 论文提出Speaker-Reasoner，一个用于多说话人自动语音识别（ASR）的端到端语音大语言模型（Speech LLM），核心创新在于采用代理式多轮时序推理（agentic multi-turn temporal reasoning）来处理重叠语音、快速话轮转换等挑战。因此，与"Large Language Models"（10分）和"LLM Agents"（10分）高度相关，因为模型被描述为具有代理推理能力的Speech LLM。与"Context Window Extension"（8分）相关，因为提到了speaker-aware cache以处理超出训练上下文窗口的音频。与"Chain of Thought"和"System 2 Thinking"（各8分）相关，因为模型采用迭代、多步的推理过程（分析全局结构、预测边界、细粒度分析）。与"Pre-training"和"Post-training"（各5分）有一定关联，因为提到了三阶段渐进训练策略，可能涉及预训练和微调。其他关键词如MoE、SLMs、Scaling Laws、Alignment、RAG、Quantization等，论文未直接涉及或不是核心，故给0分。

转录和理解多人对话需要完成语音识别、说话人归属和时间戳定位三项任务。虽然语音大语言模型在单人任务中表现出色，但在多人场景中，由于重叠语音、反馈性发声、快速话轮转换以及上下文窗口限制，该任务仍具挑战性。我们提出了Speaker-Reasoner，一种具备智能多轮时序推理能力的端到端语音大语言模型。该模型摒弃单次推理模式，转而迭代分析全局音频结构，自主预测时间边界，并进行细粒度片段分析，从而联合建模说话人身份、性别、时间戳和转录文本。一个说话人感知缓存机制进一步将处理能力扩展至超出训练上下文窗口的音频。通过采用三阶段渐进式策略进行训练，Speaker-Reasoner在AliMeeting和AISHELL-4数据集上相较于强基线模型取得了持续的性能提升，尤其在处理重叠语音和复杂话轮转换方面表现突出。

Transcribing and understanding multi-speaker conversations requires speech recognition, speaker attribution, and timestamp localization. While speech LLMs excel at single-speaker tasks, multi-speaker scenarios remain challenging due to overlapping speech, backchannels, rapid turn-taking, and context window constraints. We propose Speaker-Reasoner, an end-to-end Speech LLM with agentic multi-turn temporal reasoning. Instead of single-pass inference, the model iteratively analyzes global audio structure, autonomously predicts temporal boundaries, and performs fine-grained segment analysis, jointly modeling speaker identity, gender, timestamps, and transcription. A speaker-aware cache further extends processing to audio exceeding the training context window. Trained with a three-stage progressive strategy, Speaker-Reasoner achieves consistent improvements over strong baselines on AliMeeting and AISHELL-4 datasets, particularly in handling overlapping speech and complex turn-taking.

评分理由: 论文研究大型推理模型（LRMs）在复杂推理任务中的表现，核心发现是“第一个解决方案最优”现象，并提出了一个名为RED的自引导高效推理框架。该研究与以下关键词高度相关：1) “Large Language Models” OR “LLMs” OR “Foundation Models”（10分）：论文明确研究大型推理模型，如DeepSeek-R1，属于大模型范畴。2) “Chain of Thought” OR “CoT Reasoning” OR “Multi-step Reasoning”（10分）：论文专注于复杂推理任务，涉及多步推理和思维链。3) “System 2 Thinking” OR “Slow Thinking” OR “In-depth Reasoning”（10分）：论文探讨深度推理和错误分析，与系统2思维相关。4) “Self-Correction” OR “Self-Improvement” OR “Self-Reflection”（10分）：RED框架包含自我引导的推理和错误抑制，涉及自我校正。5) “Scaling Laws” AND “Data Quality”（8分）：论文挑战测试时缩放定律，并分析错误缩放，与缩放定律有一定关联。其他关键词如MoE、SLMs、训练方法、RAG、量化等未在论文中提及，因此评分为0。

近期的大型推理模型（Large Reasoning Models, LRMs），如DeepSeek-R1，在复杂推理任务中展现出显著的成功，其探索多种替代解决方案的模式呈现出类人的特点。然而，通过更细致的观察，我们发现了一个令人惊讶的现象：“首选即最佳”，即替代方案不仅并非更优，反而可能具有损害性。这一观察挑战了被广泛接受的测试时缩放定律，促使我们提出假设：推理路径中的错误会随着测试时间同步增加。通过全面的实证分析，我们将错误表征为一种森林结构的错误森林（Forest of Errors, FoE），并得出结论：错误森林使得“首选即最佳”现象成立，这一结论得到了严格理论分析的支持。基于这些洞见，我们提出了RED——一个自引导的高效推理框架，包含两个组成部分：I) 精炼首选，旨在抑制首个解决方案中错误森林的生长；以及II) 舍弃后续，通过双重一致性对后续的错误森林进行剪枝。在五个基准测试和六个骨干模型上进行的大量实验表明，RED优于八个竞争性基线方法，实现了高达19.0%的性能提升，同时将令牌消耗降低了37.7% ~ 70.4%。此外，在错误森林指标上的对比实验揭示了RED实现有效性的内在机制。

Recent Large Reasoning Models (LRMs) like DeepSeek-R1 have demonstrated remarkable success in complex reasoning tasks, exhibiting human-like patterns in exploring multiple alternative solutions. Upon closer inspection, however, we uncover a surprising phenomenon: The First is The Best, where alternative solutions are not merely suboptimal but potentially detrimental. This observation challenges widely accepted test-time scaling laws, leading us to hypothesize that errors within the reasoning path scale concurrently with test time. Through comprehensive empirical analysis, we characterize errors as a forest-structured Forest of Errors (FoE) and conclude that FoE makes the First the Best, which is underpinned by rigorous theoretical analysis. Leveraging these insights, we propose RED, a self-guided efficient reasoning framework comprising two components: I) Refining First, which suppresses FoE growth in the first solution; and II) Discarding Subs, which prunes subsequent FoE via dual-consistency. Extensive experiments across five benchmarks and six backbone models demonstrate that RED outperforms eight competitive baselines, achieving performance gains of up to 19.0% while reducing token consumption by 37.7% ~ 70.4%. Moreover, comparative experiments on FoE metrics shed light on how RED achieves effectiveness.

评分理由: 论文核心研究RAG系统在真实企业环境中的评估问题，与关键词"Retrieval-Augmented Generation"高度相关（10分）。论文涉及LLMs作为RAG的基础组件（8分），并强调企业部署中的可解释性要求，与"Explainable AI"相关（8分）。论文提到评估需考虑推理复杂性，与"Chain of Thought"和"System 2 Thinking"有一定关联（各5分）。论文关注RAG系统在实际部署中的可靠性，与缓解幻觉、提升事实性有一定关联（5分）。其他关键词如MoE、SFT、量化等与论文内容无直接关系，评0分。

企业环境中检索增强生成（RAG）系统的性能评估受多维复合因素支配，其范围远超简单的最终准确性检验。这些因素包括推理复杂性、检索难度、文档的多样化结构以及对操作可解释性的严格要求。现有学术基准未能系统性地诊断这些相互关联的挑战，导致一个关键差距：在学术评估中获得高分的模型在实际部署中往往无法达到预期的可靠性。为弥合这一差异，本研究提出一个多维诊断框架，通过定义四轴难度分类法并将其整合到企业RAG基准中，以诊断系统的潜在弱点。

Performance evaluation of Retrieval-Augmented Generation (RAG) systems within enterprise environments is governed by multi-dimensional and composite factors extending far beyond simple final accuracy checks. These factors include reasoning complexity, retrieval difficulty, the diverse structure of documents, and stringent requirements for operational explainability. Existing academic benchmarks fail to systematically diagnose these interlocking challenges, resulting in a critical gap where models achieving high performance scores fail to meet the expected reliability in practical deployment. To bridge this discrepancy, this research proposes a multi-dimensional diagnostic framework by defining a four-axis difficulty taxonomy and integrating it into an enterprise RAG benchmark to diagnose potential system weaknesses.

评分理由: 论文核心研究LLM驱动的多智能体系统中的角色一致性问题，与"LLM Agents"和"Multi-agent Systems"高度相关（10分）。论文明确使用LLMs（10分），并采用轻量级微调方法，与"Post-training/SFT"和"PEFT/LoRA"有一定关联（5分）。其他关键词如MoE、Scaling Laws、RAG、CoT等未在摘要中提及或与核心问题无关（0分）。

在大语言模型（LLM）驱动的多智能体系统中，角色规范违背（即未能遵循所分配角色的既定职责与约束，可能导致智能体行为类似于其他角色）是一种主要的故障模式。为应对此问题，本文提出一种定量的角色清晰度指标以提升角色一致性。首先，我们构建一个角色分配矩阵 $S(φ)=[s_{ij}(φ)]$，其中 $s_{ij}(φ)$ 表示第 $i$ 个智能体的行为轨迹与第 $j$ 个智能体的角色描述之间的语义相似度。随后，我们将角色清晰度矩阵 $M(φ)$ 定义为 $\text{softmax}(S(φ))-I$，其中 $\text{softmax}(S(φ))$ 是 $S(φ)$ 按行计算的 softmax 结果，$I$ 为单位矩阵。$M(φ)$ 的 Frobenius 范数可量化智能体角色描述与其行为轨迹之间的对齐程度。此外，我们在轻量级微调过程中将角色清晰度矩阵作为正则化项，以提升角色一致性，从而改善端到端任务性能。在 ChatDev 多智能体系统上的实验表明，我们的方法显著提升了角色一致性与任务性能：使用 Qwen 和 Llama 模型时，角色越界率分别从 $46.4%$ 降至 $8.4%$ 和从 $43.4%$ 降至 $0.2%$，角色清晰度得分分别从 $0.5328$ 提升至 $0.9097$ 和从 $0.5007$ 提升至 $0.8530$，任务成功率分别从 $0.6769$ 提升至 $0.6909$ 和从 $0.6174$ 提升至 $0.6763$。

In large language model (LLM)-driven multi-agent systems, disobey role specification (failure to adhere to the defined responsibilities and constraints of an assigned role, potentially leading to an agent behaving like another) is a major failure mode \cite{DBLP:journals/corr/abs-2503-13657}. To address this issue, in the present paper, we propose a quantitative role clarity to improve role consistency. Firstly, we construct a role assignment matrix $S(φ)=[s_{ij}(φ)]$, where $s_{ij}(φ)$ is the semantic similarity between the $i$-th agent’s behavior trajectory and the $j$-th agent’s role description. Then we define role clarity matrix $M(φ)$ as $\text{softmax}(S(φ))-I$, where $\text{softmax}(S(φ))$ is a row-wise softmax of $S(φ)$ and $I$ is the identity matrix. The Frobenius norm of $M(φ)$ quantifies the alignment between agents’ role descriptions and their behaviors trajectory. Moreover, we employ the role clarity matrix as a regularizer during lightweight fine-tuning to improve role consistency, thereby improving end-to-end task performance. Experiments on the ChatDev multi-agent system show that our method substantially improves role consistency and task performance: with Qwen and Llama, the role overstepping rate decreases from $46.4%$ to $8.4%$ and from $43.4%$ to $0.2%$, respectively, and the role clarity score increases from $0.5328$ to $0.9097$ and from $0.5007$ to $0.8530$, respectively, the task success rate increases from $0.6769$ to $0.6909$ and from $0.6174$ to $0.6763$, respectively.

评分理由: 论文研究LLM编码代理的安全漏洞，核心涉及LLM代理（LLM Agents）和供应链攻击，与"Large Language Models"和"LLM Agents"高度相关（10分）。论文提到对齐（alignment）检测和工具使用（如文件写入、shell命令），与"Instruction Tuning"和"Tool Use"有一定关联（5分）。其他关键词如MoE、SLMs、训练方法、推理技术、科学AI应用等均未涉及，得0分。

基于大语言模型的编码智能体通过开放市场中分发的第三方智能体技能扩展其能力，这些技能无需经过强制性安全审查。与传统软件包不同，这些技能以具备系统级权限的操作指令形式执行，因此单个恶意技能即可危害宿主系统。尽管现有防护机制存在，先前研究尚未探讨供应链攻击是否能够直接劫持智能体的操作空间（例如文件写入、shell命令和网络请求）。我们提出文档驱动的隐式载荷执行（Document-Driven Implicit Payload Execution, DDIPE）攻击方法，将恶意逻辑嵌入技能文档内的代码示例和配置模板中。由于智能体在常规任务中会复用这些示例，载荷得以在无需显式指令触发的情况下执行。通过采用大语言模型驱动的流程，我们从81个种子技能中生成覆盖15个MITRE ATTACK类别的1,070个对抗性技能。在四个框架和五个模型的测试中，DDIPE实现了11.6%至33.5%的绕过率，而显式指令攻击在强防御机制下的成功率则为0%。静态分析可检测大多数案例，但仍有2.5%的案例能同时规避检测和对齐机制。通过负责任披露，我们已确认四个相关漏洞并推动完成两项修复。

LLM-based coding agents extend their capabilities via third-party agent skills distributed through open marketplaces without mandatory security review. Unlike traditional packages, these skills are executed as operational directives with system-level privileges, so a single malicious skill can compromise the host. Prior work has not examined whether supply-chain attacks can directly hijack an agent’s action space, such as file writes, shell commands, and network requests, despite existing safeguards. We introduce Document-Driven Implicit Payload Execution (DDIPE), which embeds malicious logic in code examples and configuration templates within skill documentation. Because agents reuse these examples during normal tasks, the payload executes without explicit prompts. Using an LLM-driven pipeline, we generate 1,070 adversarial skills from 81 seeds across 15 MITRE ATTACK categories. Across four frameworks and five models, DDIPE achieves 11.6% to 33.5% bypass rates, while explicit instruction attacks achieve 0% under strong defenses. Static analysis detects most cases, but 2.5% evade both detection and alignment. Responsible disclosure led to four confirmed vulnerabilities and two fixes.

评分理由: 论文核心研究大语言模型（LLMs）在指令跟随任务中的对齐问题，提出了一种基于准则的强化学习框架RTT，直接涉及"Large Language Models"、“Instruction Tuning/Alignment"和"RLHF/RLAIF/DPO"等关键词，并高度相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、PEFT、RAG、推理方法、代理、压缩、科学AI等均未在摘要中提及，与论文内容无关（0分）。

基于量规的强化学习已成为使大语言模型与复杂开放域指令跟随任务对齐的有效方法。然而，现有方法主要依赖响应级奖励，导致严重的奖励稀疏性与奖励模糊性问题。为解决这些问题，我们提出“量规到令牌”方法，这是一种新颖的基于量规的强化学习框架，旨在连接粗粒度的响应级评分与细粒度的令牌级信用分配。该方法引入了一个令牌级相关性判别器，用于预测响应中哪些令牌应对特定约束负责，并通过RTT-GRPO算法优化策略模型，该算法将响应级与令牌级优势集成在统一框架内。此外，当基于令牌级量规的强化学习从一维结果级奖励转向三维奖励空间时，我们提出了一种新颖的组归一化方法——样本内令牌组归一化，以适应这一转变。大量实验与基准测试表明，在不同模型上，该方法在指令级与量规级准确率方面均持续优于其他基线模型。

Rubric-based Reinforcement Learning (RL) has emerged as a promising approach for aligning Large Language Models (LLMs) with complex, open-domain instruction following tasks. However, existing methods predominantly rely on response-level rewards, introducing severe reward sparsity and reward ambiguity problems. To address these issues, we propose Rubrics to Tokens (RTT), a novel rubric-based RL framework that bridges coarse response-level scores and fine-grained token-level credit assignment. RTT introduces a Token-Level Relevance Discriminator to predict which tokens in the response are responsible for a specific constraint, and optimizes the policy model via RTT-GRPO, which integrates response-level and token-level advantages within a unified framework. Furthermore, when transitioning from one-dimensional, outcome-level reward to three-dimensional reward space in the token-level rubric-based RL, we propose a novel group normalization method, called Intra-sample Token Group Normalization, to accommodate this shift. Extensive experiments and benchmarks demonstrate that RTT consistently outperforms other baselines in both instruction- and rubric-level accuracy across different models.

评分理由: 论文提出AutoVerifier，一个基于LLM的智能体框架，用于自动化验证技术声明，因此与"Large Language Models"和"LLM Agents"高度相关（10分）。其结构化推理过程涉及多步分析和证据追踪，与"Chain of Thought"和"System 2 Thinking"相关（8分）。框架旨在提高事实性和减少错误，与"Hallucination Mitigation"相关（8分）。应用场景为科学和技术情报分析，属于"AI for Science"范畴（8分）。框架涉及检索和生成知识图谱，与"Retrieval-Augmented Generation"有一定关联（5分）。其他关键词如MoE、量化、训练方法等未在论文中涉及，得0分。

科技情报分析需要在快速增长的文献中验证复杂的技术主张，而现有方法难以弥合表层准确性与深层方法有效性之间的验证鸿沟。我们提出AutoVerifier——一个基于大语言模型的智能体框架，无需领域专业知识即可实现技术主张的端到端自动化验证。该框架将每个技术论断分解为（主体，谓词，客体）形式的结构化主张三元组，通过构建知识图谱实现跨六个渐进增强层的结构化推理：文献库构建与导入、实体与主张提取、文档内验证、跨源验证、外部信号佐证以及最终假设矩阵生成。我们以一项存在争议的量子计算主张为例展示AutoVerifier的效能：在操作者不具备量子专业知识的情况下，该框架自动识别出目标论文中的过度宣称与度量标准不一致问题，追溯跨文献矛盾，发现未披露的商业利益冲突，并生成最终评估报告。这些结果表明，结构化的大语言模型验证能够可靠评估新兴技术的有效性与成熟度，将原始技术文档转化为可追溯、有证据支撑的情报评估。

Scientific and Technical Intelligence (S&TI) analysis requires verifying complex technical claims across rapidly growing literature, where existing approaches fail to bridge the verification gap between surface-level accuracy and deeper methodological validity. We present AutoVerifier, an LLM-based agentic framework that automates end-to-end verification of technical claims without requiring domain expertise. AutoVerifier decomposes every technical assertion into structured claim triples of the form (Subject, Predicate, Object), constructing knowledge graphs that enable structured reasoning across six progressively enriching layers: corpus construction and ingestion, entity and claim extraction, intra-document verification, cross-source verification, external signal corroboration, and final hypothesis matrix generation. We demonstrate AutoVerifier on a contested quantum computing claim, where the framework, operated by analysts with no quantum expertise, automatically identified overclaims and metric inconsistencies within the target paper, traced cross-source contradictions, uncovered undisclosed commercial conflicts of interest, and produced a final assessment. These results show that structured LLM verification can reliably evaluate the validity and maturity of emerging technologies, turning raw technical documents into traceable, evidence-backed intelligence assessments.

评分理由: 论文研究LLM训练流程（预训练、SFT、RLHF）对AI素养和说服力的影响，与LLM、SFT、RLHF高度相关（10分），与预训练、事实性/真实性缓解相关（8分），与对齐、可解释AI有一定关联（5分），其他关键词未涉及（0分）。

随着大型语言模型（LLM）的说服力日益增强，人们担忧其可能在不同情境下大规模影响公众的观点与决策。现有的缓解措施（如AI检测器和免责声明）大多将人类视为AI生成信息的被动接收者。为更主动地干预具有说服力的AI，我们提出了$\textbf{LLMimic}$——一种基于角色扮演、交互式、游戏化的AI素养教程。在该教程中，参与者扮演LLM的角色，并依次经历模型训练流程的三个关键阶段：预训练、监督微调（SFT）和基于人类反馈的强化学习（RLHF）。我们开展了一项$2 \times 3$的组间实验（$N = 274$），参与者被分为两组：一组观看AI发展史视频（对照组），另一组与LLMimic进行交互（实验组），随后参与三种现实AI说服场景中的一种：（a）慈善捐款劝说，（b）恶意资金索取，或（c）酒店推荐。研究结果表明，LLMimic显著提升了参与者的AI素养（$p < .001$），降低了各场景中的说服成功率（$p < .05$），并在酒店推荐场景中提高了回答的真实性与社会责任水平（$p<0.01$）。这些发现表明，LLMimic提供了一种可扩展、以人为本的方法，能够有效提升AI素养，并支持人们与具有说服力的AI进行更明智的互动。

As large language models (LLMs) become increasingly persuasive, there is concern that people’s opinions and decisions may be influenced across various contexts at scale. Prior mitigation (e.g., AI detectors and disclaimers) largely treats people as passive recipients of AI-generated information. To provide a more proactive intervention against persuasive AI, we introduce $\textbf{LLMimic}$, a role-play-based, interactive, gamified AI literacy tutorial, where participants assume the role of an LLM and progress through three key stages of the training pipeline (pretraining, SFT, and RLHF). We conducted a $2 \times 3$ between-subjects study ($N = 274$) where participants either (1) watched an AI history video (control) or (2) interacted with LLMimic (treatment), and then engaged in one of three realistic AI persuasion scenarios: (a) charity donation persuasion, (b) malicious money solicitation, or (c) hotel recommendation. Our results show that LLMimic significantly improved participants’ AI literacy ($p < .001$), reduced persuasion success across scenarios ($p < .05$), and enhanced truthfulness and social responsibility levels ($p<0.01$) in the hotel scenario. These findings suggest that LLMimic offers a scalable, human-centered approach to improving AI literacy and supporting more informed interactions with persuasive AI.

评分理由: 论文R2-Write专注于通过反思和修订模式提升大语言模型在开放式写作任务中的深度推理能力。核心相关关键词包括：LLMs（论文明确研究大语言模型在写作中的应用）、Chain of Thought/CoT Reasoning（论文系统研究长思维链在开放式任务中的有效性）、System 2 Thinking/In-depth Reasoning（论文旨在解锁深度推理能力）、Self-Correction/Self-Reflection（论文核心框架基于反思和修订模式）。部分相关关键词：RLHF（论文使用强化学习进行过程奖励监督，但非核心对齐方法）、LLM Agents/Multi-agent Systems（论文框架涉及writer-judge交互，可视为简单多智能体协调，但非主要焦点）。其余关键词与论文的技术方法（如MoE、量化、RAG等）或应用领域（如科学AI）无直接关联。

尽管长链思维深度推理已在数学等可验证领域显著提升了大语言模型的性能，其在开放式任务（如写作）中的有效性仍未被探索。本文通过系统性研究发现，现有主流推理模型在开放式写作任务上取得的提升有限。进一步分析表明，这些模型在开放式写作中缺乏深度反思与修订模式，导致其改进幅度远小于数学推理任务。为应对这一局限，我们提出了R2-Write：一种通过迭代式“作者-评判者”交互生成高质量思维轨迹的自动化框架，该轨迹融合了显性的反思与修订模式。为避免冗余反思，我们设计了过程奖励机制，在强化学习过程中监督反思质量，从而提升性能并优化计算效率。在多项创意写作与深度研究基准上的广泛实验证明了该方法的显著改进，验证了显式融入反思与修订模式能够为开放式写作任务解锁深度推理能力。

While deep reasoning with long chain-of-thought has dramatically improved large language models in verifiable domains like mathematics, its effectiveness for open-ended tasks such as writing remains unexplored. In this paper, we conduct a systematic investigation revealing that existing mainstream reasoning models achieve limited gains on open-ended writing tasks. Our further analysis shows that these models lack deep reflection and revision patterns in open-ended writing, resulting in substantially smaller improvements compared to mathematical reasoning tasks. To address this limitation, we introduce R2-Write: an automated framework that synthesizes high-quality thinking trajectories enriched with explicit reflection and revision patterns through iterative writer-judge interaction. To prevent redundant reflections, we design a process reward mechanism that supervises reflection quality during reinforcement learning, improving both performance and token efficiency. Extensive experiments across multiple creative writing and deep-research benchmarks demonstrate significant improvements, validating that explicitly incorporating reflection and revision patterns unlocks deep reasoning capabilities for open-ended writing tasks.

评分理由: 论文提出Speaker-Reasoner，一个用于多说话人自动语音识别（ASR）的端到端语音大语言模型（Speech LLM），核心创新在于采用代理式多轮时序推理（agentic multi-turn temporal reasoning）来处理重叠语音、快速话轮转换等挑战。因此，与"Large Language Models”（10分）和"LLM Agents"（10分）高度相关，因为模型被描述为具有代理推理能力的Speech LLM。与"Context Window Extension"（8分）相关，因为提到了speaker-aware cache以处理超出训练上下文窗口的音频。与"Chain of Thought"和"System 2 Thinking"（各8分）相关，因为模型采用迭代、多步的推理过程（分析全局结构、预测边界、细粒度分析）。与"Pre-training"和"Post-training"（各5分）有一定关联，因为提到了三阶段渐进训练策略，可能涉及预训练和微调。其他关键词如MoE、SLMs、Scaling Laws、Alignment、RAG、Quantization等，论文未直接涉及或不是核心，故给0分。

转录和理解多人对话需要完成语音识别、说话人归属和时间戳定位三项任务。虽然语音大语言模型在单人任务中表现出色，但在多人场景中，由于重叠语音、反馈性发声、快速话轮转换以及上下文窗口限制，该任务仍具挑战性。我们提出了Speaker-Reasoner，一种具备智能多轮时序推理能力的端到端语音大语言模型。该模型摒弃单次推理模式，转而迭代分析全局音频结构，自主预测时间边界，并进行细粒度片段分析，从而联合建模说话人身份、性别、时间戳和转录文本。一个说话人感知缓存机制进一步将处理能力扩展至超出训练上下文窗口的音频。通过采用三阶段渐进式策略进行训练，Speaker-Reasoner在AliMeeting和AISHELL-4数据集上相较于强基线模型取得了持续的性能提升，尤其在处理重叠语音和复杂话轮转换方面表现突出。

Transcribing and understanding multi-speaker conversations requires speech recognition, speaker attribution, and timestamp localization. While speech LLMs excel at single-speaker tasks, multi-speaker scenarios remain challenging due to overlapping speech, backchannels, rapid turn-taking, and context window constraints. We propose Speaker-Reasoner, an end-to-end Speech LLM with agentic multi-turn temporal reasoning. Instead of single-pass inference, the model iteratively analyzes global audio structure, autonomously predicts temporal boundaries, and performs fine-grained segment analysis, jointly modeling speaker identity, gender, timestamps, and transcription. A speaker-aware cache further extends processing to audio exceeding the training context window. Trained with a three-stage progressive strategy, Speaker-Reasoner achieves consistent improvements over strong baselines on AliMeeting and AISHELL-4 datasets, particularly in handling overlapping speech and complex turn-taking.

评分理由: 论文研究大型推理模型（LRMs）在复杂推理任务中的表现，核心发现是“第一个解决方案最优”现象，并提出了一个名为RED的自引导高效推理框架。该研究与以下关键词高度相关：1) “Large Language Models” OR “LLMs” OR “Foundation Models”（10分）：论文明确研究大型推理模型，如DeepSeek-R1，属于大模型范畴。2) “Chain of Thought” OR “CoT Reasoning” OR “Multi-step Reasoning”（10分）：论文专注于复杂推理任务，涉及多步推理和思维链。3) “System 2 Thinking” OR “Slow Thinking” OR “In-depth Reasoning”（10分）：论文探讨深度推理和错误分析，与系统2思维相关。4) “Self-Correction” OR “Self-Improvement” OR “Self-Reflection”（10分）：RED框架包含自我引导的推理和错误抑制，涉及自我校正。5) “Scaling Laws” AND “Data Quality”（8分）：论文挑战测试时缩放定律，并分析错误缩放，与缩放定律有一定关联。其他关键词如MoE、SLMs、训练方法、RAG、量化等未在论文中提及，因此评分为0。

近期的大型推理模型（Large Reasoning Models, LRMs），如DeepSeek-R1，在复杂推理任务中展现出显著的成功，其探索多种替代解决方案的模式呈现出类人的特点。然而，通过更细致的观察，我们发现了一个令人惊讶的现象：“首选即最佳”，即替代方案不仅并非更优，反而可能具有损害性。这一观察挑战了被广泛接受的测试时缩放定律，促使我们提出假设：推理路径中的错误会随着测试时间同步增加。通过全面的实证分析，我们将错误表征为一种森林结构的错误森林（Forest of Errors, FoE），并得出结论：错误森林使得“首选即最佳”现象成立，这一结论得到了严格理论分析的支持。基于这些洞见，我们提出了RED——一个自引导的高效推理框架，包含两个组成部分：I) 精炼首选，旨在抑制首个解决方案中错误森林的生长；以及II) 舍弃后续，通过双重一致性对后续的错误森林进行剪枝。在五个基准测试和六个骨干模型上进行的大量实验表明，RED优于八个竞争性基线方法，实现了高达19.0%的性能提升，同时将令牌消耗降低了37.7% ~ 70.4%。此外，在错误森林指标上的对比实验揭示了RED实现有效性的内在机制。

Recent Large Reasoning Models (LRMs) like DeepSeek-R1 have demonstrated remarkable success in complex reasoning tasks, exhibiting human-like patterns in exploring multiple alternative solutions. Upon closer inspection, however, we uncover a surprising phenomenon: The First is The Best, where alternative solutions are not merely suboptimal but potentially detrimental. This observation challenges widely accepted test-time scaling laws, leading us to hypothesize that errors within the reasoning path scale concurrently with test time. Through comprehensive empirical analysis, we characterize errors as a forest-structured Forest of Errors (FoE) and conclude that FoE makes the First the Best, which is underpinned by rigorous theoretical analysis. Leveraging these insights, we propose RED, a self-guided efficient reasoning framework comprising two components: I) Refining First, which suppresses FoE growth in the first solution; and II) Discarding Subs, which prunes subsequent FoE via dual-consistency. Extensive experiments across five benchmarks and six backbone models demonstrate that RED outperforms eight competitive baselines, achieving performance gains of up to 19.0% while reducing token consumption by 37.7% ~ 70.4%. Moreover, comparative experiments on FoE metrics shed light on how RED achieves effectiveness.

评分理由: 论文核心研究RAG系统在真实企业环境中的评估问题，与关键词"Retrieval-Augmented Generation"高度相关（10分）。论文涉及LLMs作为RAG的基础组件（8分），并强调企业部署中的可解释性要求，与"Explainable AI"相关（8分）。论文提到评估需考虑推理复杂性，与"Chain of Thought"和"System 2 Thinking"有一定关联（各5分）。论文关注RAG系统在实际部署中的可靠性，与缓解幻觉、提升事实性有一定关联（5分）。其他关键词如MoE、SFT、量化等与论文内容无直接关系，评0分。

企业环境中检索增强生成（RAG）系统的性能评估受多维复合因素支配，其范围远超简单的最终准确性检验。这些因素包括推理复杂性、检索难度、文档的多样化结构以及对操作可解释性的严格要求。现有学术基准未能系统性地诊断这些相互关联的挑战，导致一个关键差距：在学术评估中获得高分的模型在实际部署中往往无法达到预期的可靠性。为弥合这一差异，本研究提出一个多维诊断框架，通过定义四轴难度分类法并将其整合到企业RAG基准中，以诊断系统的潜在弱点。

Performance evaluation of Retrieval-Augmented Generation (RAG) systems within enterprise environments is governed by multi-dimensional and composite factors extending far beyond simple final accuracy checks. These factors include reasoning complexity, retrieval difficulty, the diverse structure of documents, and stringent requirements for operational explainability. Existing academic benchmarks fail to systematically diagnose these interlocking challenges, resulting in a critical gap where models achieving high performance scores fail to meet the expected reliability in practical deployment. To bridge this discrepancy, this research proposes a multi-dimensional diagnostic framework by defining a four-axis difficulty taxonomy and integrating it into an enterprise RAG benchmark to diagnose potential system weaknesses.

评分理由: 论文核心研究LLM驱动的多智能体系统中的角色一致性问题，与"LLM Agents"和"Multi-agent Systems"高度相关（10分）。论文明确使用LLMs（10分），并采用轻量级微调方法，与"Post-training/SFT"和"PEFT/LoRA"有一定关联（5分）。其他关键词如MoE、Scaling Laws、RAG、CoT等未在摘要中提及或与核心问题无关（0分）。

在大语言模型（LLM）驱动的多智能体系统中，角色规范违背（即未能遵循所分配角色的既定职责与约束，可能导致智能体行为类似于其他角色）是一种主要的故障模式。为应对此问题，本文提出一种定量的角色清晰度指标以提升角色一致性。首先，我们构建一个角色分配矩阵 $S(φ)=[s_{ij}(φ)]$，其中 $s_{ij}(φ)$ 表示第 $i$ 个智能体的行为轨迹与第 $j$ 个智能体的角色描述之间的语义相似度。随后，我们将角色清晰度矩阵 $M(φ)$ 定义为 $\text{softmax}(S(φ))-I$，其中 $\text{softmax}(S(φ))$ 是 $S(φ)$ 按行计算的 softmax 结果，$I$ 为单位矩阵。$M(φ)$ 的 Frobenius 范数可量化智能体角色描述与其行为轨迹之间的对齐程度。此外，我们在轻量级微调过程中将角色清晰度矩阵作为正则化项，以提升角色一致性，从而改善端到端任务性能。在 ChatDev 多智能体系统上的实验表明，我们的方法显著提升了角色一致性与任务性能：使用 Qwen 和 Llama 模型时，角色越界率分别从 $46.4%$ 降至 $8.4%$ 和从 $43.4%$ 降至 $0.2%$，角色清晰度得分分别从 $0.5328$ 提升至 $0.9097$ 和从 $0.5007$ 提升至 $0.8530$，任务成功率分别从 $0.6769$ 提升至 $0.6909$ 和从 $0.6174$ 提升至 $0.6763$。

In large language model (LLM)-driven multi-agent systems, disobey role specification (failure to adhere to the defined responsibilities and constraints of an assigned role, potentially leading to an agent behaving like another) is a major failure mode \cite{DBLP:journals/corr/abs-2503-13657}. To address this issue, in the present paper, we propose a quantitative role clarity to improve role consistency. Firstly, we construct a role assignment matrix $S(φ)=[s_{ij}(φ)]$, where $s_{ij}(φ)$ is the semantic similarity between the $i$-th agent’s behavior trajectory and the $j$-th agent’s role description. Then we define role clarity matrix $M(φ)$ as $\text{softmax}(S(φ))-I$, where $\text{softmax}(S(φ))$ is a row-wise softmax of $S(φ)$ and $I$ is the identity matrix. The Frobenius norm of $M(φ)$ quantifies the alignment between agents’ role descriptions and their behaviors trajectory. Moreover, we employ the role clarity matrix as a regularizer during lightweight fine-tuning to improve role consistency, thereby improving end-to-end task performance. Experiments on the ChatDev multi-agent system show that our method substantially improves role consistency and task performance: with Qwen and Llama, the role overstepping rate decreases from $46.4%$ to $8.4%$ and from $43.4%$ to $0.2%$, respectively, and the role clarity score increases from $0.5328$ to $0.9097$ and from $0.5007$ to $0.8530$, respectively, the task success rate increases from $0.6769$ to $0.6909$ and from $0.6174$ to $0.6763$, respectively.

评分理由: 论文研究LLM编码代理的安全漏洞，核心涉及LLM代理（LLM Agents）和供应链攻击，与"Large Language Models"和"LLM Agents"高度相关（10分）。论文提到对齐（alignment）检测和工具使用（如文件写入、shell命令），与"Instruction Tuning"和"Tool Use"有一定关联（5分）。其他关键词如MoE、SLMs、训练方法、推理技术、科学AI应用等均未涉及，得0分。

基于大语言模型的编码智能体通过开放市场中分发的第三方智能体技能扩展其能力，这些技能无需经过强制性安全审查。与传统软件包不同，这些技能以具备系统级权限的操作指令形式执行，因此单个恶意技能即可危害宿主系统。尽管现有防护机制存在，先前研究尚未探讨供应链攻击是否能够直接劫持智能体的操作空间（例如文件写入、shell命令和网络请求）。我们提出文档驱动的隐式载荷执行（Document-Driven Implicit Payload Execution, DDIPE）攻击方法，将恶意逻辑嵌入技能文档内的代码示例和配置模板中。由于智能体在常规任务中会复用这些示例，载荷得以在无需显式指令触发的情况下执行。通过采用大语言模型驱动的流程，我们从81个种子技能中生成覆盖15个MITRE ATTACK类别的1,070个对抗性技能。在四个框架和五个模型的测试中，DDIPE实现了11.6%至33.5%的绕过率，而显式指令攻击在强防御机制下的成功率则为0%。静态分析可检测大多数案例，但仍有2.5%的案例能同时规避检测和对齐机制。通过负责任披露，我们已确认四个相关漏洞并推动完成两项修复。

LLM-based coding agents extend their capabilities via third-party agent skills distributed through open marketplaces without mandatory security review. Unlike traditional packages, these skills are executed as operational directives with system-level privileges, so a single malicious skill can compromise the host. Prior work has not examined whether supply-chain attacks can directly hijack an agent’s action space, such as file writes, shell commands, and network requests, despite existing safeguards. We introduce Document-Driven Implicit Payload Execution (DDIPE), which embeds malicious logic in code examples and configuration templates within skill documentation. Because agents reuse these examples during normal tasks, the payload executes without explicit prompts. Using an LLM-driven pipeline, we generate 1,070 adversarial skills from 81 seeds across 15 MITRE ATTACK categories. Across four frameworks and five models, DDIPE achieves 11.6% to 33.5% bypass rates, while explicit instruction attacks achieve 0% under strong defenses. Static analysis detects most cases, but 2.5% evade both detection and alignment. Responsible disclosure led to four confirmed vulnerabilities and two fixes.

评分理由: 论文核心研究大语言模型（LLMs）在指令跟随任务中的对齐问题，提出了一种基于准则的强化学习框架RTT，直接涉及"Large Language Models"、“Instruction Tuning/Alignment"和"RLHF/RLAIF/DPO"等关键词，并高度相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、PEFT、RAG、推理方法、代理、压缩、科学AI等均未在摘要中提及，与论文内容无关（0分）。

基于量规的强化学习已成为使大语言模型与复杂开放域指令跟随任务对齐的有效方法。然而，现有方法主要依赖响应级奖励，导致严重的奖励稀疏性与奖励模糊性问题。为解决这些问题，我们提出“量规到令牌”方法，这是一种新颖的基于量规的强化学习框架，旨在连接粗粒度的响应级评分与细粒度的令牌级信用分配。该方法引入了一个令牌级相关性判别器，用于预测响应中哪些令牌应对特定约束负责，并通过RTT-GRPO算法优化策略模型，该算法将响应级与令牌级优势集成在统一框架内。此外，当基于令牌级量规的强化学习从一维结果级奖励转向三维奖励空间时，我们提出了一种新颖的组归一化方法——样本内令牌组归一化，以适应这一转变。大量实验与基准测试表明，在不同模型上，该方法在指令级与量规级准确率方面均持续优于其他基线模型。

Rubric-based Reinforcement Learning (RL) has emerged as a promising approach for aligning Large Language Models (LLMs) with complex, open-domain instruction following tasks. However, existing methods predominantly rely on response-level rewards, introducing severe reward sparsity and reward ambiguity problems. To address these issues, we propose Rubrics to Tokens (RTT), a novel rubric-based RL framework that bridges coarse response-level scores and fine-grained token-level credit assignment. RTT introduces a Token-Level Relevance Discriminator to predict which tokens in the response are responsible for a specific constraint, and optimizes the policy model via RTT-GRPO, which integrates response-level and token-level advantages within a unified framework. Furthermore, when transitioning from one-dimensional, outcome-level reward to three-dimensional reward space in the token-level rubric-based RL, we propose a novel group normalization method, called Intra-sample Token Group Normalization, to accommodate this shift. Extensive experiments and benchmarks demonstrate that RTT consistently outperforms other baselines in both instruction- and rubric-level accuracy across different models.

评分理由: 论文研究LLM Agent技能中的凭证泄漏问题，属于LLM Agent安全研究领域。核心相关关键词是"Large Language Models"和"LLM Agents”，论文直接研究LLM Agent技能的安全漏洞，因此给10分。“Tool Use"相关关键词得5分，因为技能扩展涉及工具使用，但论文重点在安全而非工具使用机制。其他关键词如MoE、Scaling Laws、Fine-tuning、RAG、Reasoning、Compression等均未涉及，给0分。

第三方技能为大型语言模型（LLM）智能体扩展了强大能力，但常在特权环境中处理敏感凭证，其泄露风险尚未被充分认知。我们首次对此问题展开大规模实证研究，通过静态分析、沙箱测试和人工审查，分析了来自SkillsMP平台170,226项技能中抽样的17,022项。我们识别出520项存在漏洞的技能，共发现1,708个问题，并归纳出10类泄露模式（4类意外泄露与6类对抗性泄露）。研究发现：（1）泄露本质上是跨模态的：76.3%的案例需结合代码与自然语言进行联合分析，而3.1%完全源于提示词注入；（2）调试日志是主要泄露途径，因标准输出（stdout）暴露给LLM，print与console.log导致的泄露占比达73.5%；（3）泄露的凭证既具备可利用性（89.6%无需特权即可利用），又具有持续性——即使上游修复后，代码分支仍保留密钥。经披露后，所有恶意技能均被下架，91.6%的硬编码凭证得到修复。我们公开了数据集、分类体系与检测工具链，以支持后续研究。

Third-party skills extend LLM agents with powerful capabilities but often handle sensitive credentials in privileged environments, making leakage risks poorly understood. We present the first large-scale empirical study of this problem, analyzing 17,022 skills (sampled from 170,226 on SkillsMP) using static analysis, sandbox testing, and manual inspection. We identify 520 vulnerable skills with 1,708 issues and derive a taxonomy of 10 leakage patterns (4 accidental and 6 adversarial). We find that (1) leakage is fundamentally cross-modal: 76.3% require joint analysis of code and natural language, while 3.1% arise purely from prompt injection; (2) debug logging is the primary vector, with print and console.log causing 73.5% of leaks due to stdout exposure to LLMs; and (3) leaked credentials are both exploitable (89.6% without privileges) and persistent, as forks retain secrets even after upstream fixes. After disclosure, all malicious skills were removed and 91.6% of hardcoded credentials were fixed. We release our dataset, taxonomy, and detection pipeline to support future research.

评分理由: 论文核心研究Agent Skills框架的安全分析，该框架是用于LLM-based agents的模块化打包标准。因此，与"Large Language Models"和"LLM Agents"高度相关（10分），因为论文明确研究基于LLM的代理框架。与"Tool Use"有一定关联（5分），因为Agent Skills涉及代理获取领域特定能力，可视为一种工具使用形式。其他关键词如MoE、SFT、RAG等涉及具体模型架构或训练技术，论文未涉及，故为0分。

Agent Skills 是一种新兴的开放标准，它定义了一种基于文件系统的模块化封装格式，使基于大语言模型（LLM）的智能体能够按需获取领域专业知识。尽管该标准已在多个智能体平台中迅速获得采纳，并催生了大型社区市场，但 Agent Skills 的安全特性尚未得到系统性研究。本文首次对 Agent Skills 框架进行了全面的安全分析。我们定义了 Agent Skill 在四个阶段——创建（Creation）、分发（Distribution）、部署（Deployment）和执行（Execution）——的完整生命周期，并识别了每个阶段引入的结构性攻击面。基于此生命周期分析，我们构建了一个威胁分类体系，该体系包含七大类共十七种攻击场景，并组织在三个攻击层面中，其依据既包括架构分析，也包含现实世界证据。我们通过分析 Agent Skills 生态系统中五个已确认的安全事件验证了该分类体系。基于这些发现，我们针对每类威胁讨论了防御方向，指出了开放的研究挑战，并为相关利益方提供了可操作的建议。我们的分析表明，最严重的威胁源于框架本身的结构特性，包括缺乏数据与指令的边界、单一审批的持久信任模型以及强制性市场安全审查的缺失，这些问题无法仅通过渐进式缓解措施来解决。

Agent Skills is an emerging open standard that defines a modular, filesystem-based packaging format enabling LLM-based agents to acquire domain-specific expertise on demand. Despite rapid adoption across multiple agentic platforms and the emergence of large community marketplaces, the security properties of Agent Skills have not been systematically studied. This paper presents the first comprehensive security analysis of the Agent Skills framework. We define the full lifecycle of an Agent Skill across four phases – Creation, Distribution, Deployment, and Execution – and identify the structural attack surface each phase introduces. Building on this lifecycle analysis, we construct a threat taxonomy comprising seven categories and seventeen scenarios organized across three attack layers, grounded in both architectural analysis and real-world evidence. We validate the taxonomy through analysis of five confirmed security incidents in the Agent Skills ecosystem. Based on these findings, we discuss defense directions for each threat category, identify open research challenges, and provide actionable recommendations for stakeholders. Our analysis reveals that the most severe threats arise from structural properties of the framework itself, including the absence of a data-instruction boundary, a single-approval persistent trust model, and the lack of mandatory marketplace security review, and cannot be addressed through incremental mitigations alone.

评分理由: 论文核心研究LLM（Qwen3-32B和Qwen3-0.6B）在知识图谱构建中的应用，通过知识蒸馏训练小型多语言模型（MPropositionneur-V2）来生成原子命题以改进三元组抽取。因此，与"Large Language Models"和"Small Language Models"高度相关（10分），因为论文明确使用并比较了大型和小型语言模型。其他关键词如MoE、Scaling Laws、Pre-training、Alignment等未在摘要中提及或涉及，因此评分为0分。论文属于大模型在信息抽取领域的应用研究，符合研究背景要求。

从自然语言构建知识图谱需要从复杂且信息密集的句子中提取结构化三元组。本文探讨了将文本分解为原子命题（最小、语义自洽的信息单元）是否能改进三元组提取。我们介绍了 MPropositionneur-V2，这是一个覆盖六种欧洲语言的小型多语言模型，它通过知识蒸馏从 Qwen3-32B 训练至 Qwen3-0.6B 架构，并评估了其与两种提取范式的集成：以实体为中心的方法（GLiREL）和生成式方法（Qwen3）。在 SMiLER、FewRel、DocRED 和 CaRB 数据集上的实验表明，原子命题有助于提升较弱提取器（GLiREL、CoreNLP、0.6B 模型）的性能，改善了关系召回率，并在多语言环境下提升了整体准确率。对于更强的 LLMs，一种后备组合策略能够弥补实体召回率的损失，同时保持关系提取方面的增益。这些结果表明，原子命题是一种可解释的中间数据结构，能够补充而非替代现有提取器。

Knowledge Graph construction from natural language requires extracting structured triplets from complex, information-dense sentences. In this paper, we investigate if the decomposition of text into atomic propositions (minimal, semantically autonomous units of information) can improve the triplet extraction. We introduce MPropositionneur-V2, a small multilingual model covering six European languages trained by knowledge distillation from Qwen3-32B into a Qwen3-0.6B architecture, and we evaluate its integration into two extraction paradigms: entity-centric (GLiREL) and generative (Qwen3). Experiments on SMiLER, FewRel, DocRED and CaRB show that atomic propositions benefit weaker extractors (GLiREL, CoreNLP, 0.6B models), improving relation recall and, in the multilingual setting, overall accuracy. For stronger LLMs, a fallback combination strategy recovers entity recall losses while preserving the gains in relation extraction. These results show that atomic propositions are an interpretable intermediate data structure that complements extractors without replacing them.

评分理由: 论文PRISM提出了一种结合LLM指导的语义聚类框架，核心是利用LLM提供稀疏标签来微调句子编码模型，属于大模型在文本分析领域的应用创新。与关键词高度相关的包括：1) “Large Language Models” (10分)：论文核心使用LLM作为教师模型提供监督信号；2) “Post-training” (8分)：涉及使用LLM标签对句子编码模型进行微调。其他关键词如MoE、SLMs、Scaling Laws、Instruction Tuning等与论文主题（主题建模、聚类）无直接关联，因此评分为0。

本文提出了一种精确信息语义建模框架，该结构化主题建模框架融合了大型语言模型所捕获的丰富表征优势与潜在语义聚类方法的低成本、高可解释性特点。PRISM通过从目标语料库中采样，利用少量由大型语言模型生成的标注样本对句子编码模型进行微调。我们通过阈值聚类对该嵌入空间进行划分，从而在特定狭窄领域内分离出紧密相关的主题簇。在多个语料库上的实验表明，PRISM在主题分离性上超越了当前最先进的局部主题模型，甚至优于基于前沿大型嵌入模型的聚类方法，同时仅需少量大型语言模型查询即可完成训练。本研究通过以下三个方面推动了多个研究方向的发展：提出了一种师生蒸馏管道，将稀疏的大型语言模型监督知识提炼为轻量级的主题发现模型；分析了采样策略对改善局部几何结构以提升聚类分离性的效能；提供了一种有效的网络规模文本分析方法，使研究者和实践者能够通过可解释、可本地部署的框架在线追踪细微观点与子话题演变。

In this paper, we propose Precision-Informed Semantic Modeling (PRISM), a structured topic modeling framework combining the benefits of rich representations captured by LLMs with the low cost and interpretability of latent semantic clustering methods. PRISM fine-tunes a sentence encoding model using a sparse set of LLM- provided labels on samples drawn from some corpus of interest. We segment this embedding space with thresholded clustering, yielding clusters that separate closely related topics within some narrow domain. Across multiple corpora, PRISM improves topic separability over state-of-the-art local topic models and even over clustering on large, frontier embedding models while requiring only a small number of LLM queries to train. This work contributes to several research streams by providing (i) a student-teacher pipeline to distill sparse LLM supervision into a lightweight model for topic discovery; (ii) an analysis of the efficacy of sampling strategies to improve local geometry for cluster separability; and (iii) an effective approach for web-scale text analysis, enabling researchers and practitioners to track nuanced claims and subtopics online with an interpretable, locally deployable framework.

评分理由: 该论文的核心创新点是提出了一种基于自适应MoE（Mixture of Experts）机制的无线图像语义通信系统。论文明确使用了MoE架构（“MoE-based semantic communication”），并提出了动态专家门控机制来联合评估信道状态和图像语义内容，实现自适应路由。因此，与"Mixture of Experts” OR “MoE” OR “Sparse Models"高度相关（10分）。论文属于深度学习在通信领域的应用，但未涉及大语言模型（LLMs）、科学AI应用（如生物信息学）或其他关键词所涵盖的具体技术（如RLHF、RAG、量化等），因此其他关键词均为0分。

基于深度学习的语义通信在无线图像传输领域取得了显著进展，但现有方案大多依赖固定模型，因而缺乏对多样化图像内容与动态信道条件的鲁棒性。为提升适应性，近期研究开发了可根据信源内容或信道状态调整传输策略或模型行为的自适应语义通信方法。最近，基于混合专家模型（MoE）的语义通信作为一种稀疏高效的自适应架构崭露头角，然而现有设计仍主要依赖单驱动路由机制。为突破这一局限，本文提出一种面向多输入多输出（MIMO）信道的新型多阶段端到端图像语义通信系统，其核心构建于自适应MoE Swin Transformer模块之上。具体而言，我们引入一种动态专家门控机制，该机制联合评估实时信道状态信息（CSI）与输入图像块的语义内容，以计算自适应路由概率。通过基于此联合条件选择性地仅激活特定专家子集，本方法打破了传统自适应方法的刚性耦合，克服了单驱动路由的瓶颈。仿真结果表明，在保持传输效率的同时，本系统在重建质量上较现有方法有显著提升。

Deep learning based semantic communication has achieved significant progress in wireless image transmission, but most existing schemes rely on fixed models and thus lack robustness to diverse image contents and dynamic channel conditions. To improve adaptability, recent studies have developed adaptive semantic communication strategies that adjust transmission or model behavior according to either source content or channel state. More recently, MoE-based semantic communication has emerged as a sparse and efficient adaptive architecture, although existing designs still mainly rely on single-driven routing. To address this limitation, we propose a novel multi-stage end-to-end image semantic communication system for multi-input multi-output (MIMO) channels, built upon an adaptive MoE Swin Transformer block. Specifically, we introduce a dynamic expert gating mechanism that jointly evaluates both real-time CSI and the semantic content of input image patches to compute adaptive routing probabilities. By selectively activating only a specialized subset of experts based on this joint condition, our approach breaks the rigid coupling of traditional adaptive methods and overcomes the bottlenecks of single-driven routing. Simulation results indicate a significant improvement in reconstruction quality over existing methods while maintaining the transmission efficiency.

评分理由: 论文聚焦于元语言（metalanguage）研究，仅与LLMs有一般性关联（摘要中提到’link it to NLP and LLMs’），但未深入探讨任何具体的大模型技术、应用或创新方法。其他关键词均未涉及。

本研究旨在聚焦元语言这一主题。我们首先界定了元语言的定义，将其与自然语言处理及大语言模型建立关联，继而阐述我们两个实验室围绕元语言开展的核心研究工作。最后，我们从四个维度探讨元语言及元语言任务，并提出一系列尚未充分探索的未来研究方向。

This work aims to shine a spotlight on the topic of metalanguage. We first define metalanguage, link it to NLP and LLMs, and then discuss our two labs’ metalanguage-centered efforts. Finally, we discuss four dimensions of metalanguage and metalinguistic tasks, offering a list of understudied future research directions.

评分理由: 论文THOM专注于从文本生成物理上合理的手-物体交互3D网格，属于计算机视觉和图形学领域。其核心方法涉及高斯生成、网格提取、物理优化和VLM引导的细化，并未直接涉及大模型技术原理、训练方法、推理优化、对齐、代理系统等关键词。唯一的相关点是"AI for Science”，因为该研究可视为AI在科学/工程应用（机器人、VR/AR）中的一种应用，但并非生物信息学或化学信息学等典型科学领域，因此给予5分（有一定关联）。其他关键词与论文内容无直接关联，均评0分。

从文本生成三维手物交互对于灵巧机器人抓取与VR/AR内容生成至关重要，其既要求高视觉真实感，又需满足物理合理性。然而，从文本生成的高斯模型中提取网格这一不适定问题，以及在误差网格上进行基于物理的优化均构成挑战。为解决这些问题，我们提出THOM——一个无需训练、无需模板物体网格即可生成高真实感且物理合理的三维手物交互网格的框架。THOM采用两阶段流程：首先生成手部与物体的高斯模型，随后进行基于物理的手物交互优化。我们提出的新网格提取方法与顶点-高斯映射技术，显式地将高斯元素分配给网格顶点，从而实现拓扑感知的正则化。此外，通过视觉语言模型引导的位移优化与接触感知优化，我们进一步提升了交互的物理合理性。综合实验表明，THOM在文本对齐度、视觉真实感与交互合理性方面均持续超越现有先进方法。

The generation of 3D hand-object interactions (HOIs) from text is crucial for dexterous robotic grasping and VR/AR content generation, requiring both high visual fidelity and physical plausibility. Nevertheless, the ill-posed problem of mesh extraction from text-generated Gaussians, and physics-based optimization on the erroneous meshes pose challenges. To address these issues, we introduce THOM, a training-free framework that generates photorealistic, physically plausible 3D HOI meshes without the need for a template object mesh. THOM employs a two-stage pipeline, initially generating the hand and object Gaussians, followed by physics-based HOI optimization. Our new mesh extraction method and vertex-to-Gaussian mapping explicitly assign Gaussian elements to mesh vertices, allowing topology-aware regularization. Furthermore, we improve the physical plausibility of interactions by VLM-guided translation refinement and contact-aware optimization. Comprehensive experiments demonstrate that THOM consistently surpasses state-of-the-art methods in terms of text alignment, visual realism, and interaction plausibility.

评分理由: 该论文研究代数几何中线排列的自由性问题，提出了一种半连续松弛方法，并使用强化学习进行序列构造。论文内容与绝大多数关键词（涉及大模型技术、训练方法、推理优化、对齐、代理等）完全无关。唯一略有相关的是"AI for Science"，因为论文将强化学习应用于数学问题的计算探索，属于AI在科学领域的应用，但并非核心生物信息学或化学信息学，因此给予5分（有一定关联）。

我们在 $\mathbb{P}^2$ 中的直线构型空间上引入一个非负泛函，该泛函恰好在对自由构型时为零，它是通过佐藤关于自由性的判据进行半连续松弛而得到的。给定一个包含 $n$ 条直线且候选指数为 $(d_1, d_2)$ 的构型 $\mathcal{A}$，我们通过相关导子矩阵的零空间参数化次数为 $d_1$ 和 $d_2$ 的对数导子空间，并将佐藤行列式表达为一个到 $n$ 次多项式空间的双线性映射。该泛函由此获得一个自然的几何解释：它度量了此双线性映射的像与系数空间中由定义多项式 $Q(\mathcal{A})$ 张成的方向之间夹角的正弦平方，且当且仅当其像包含 $Q(\mathcal{A})$ 张成的直线时取零值。这为衡量给定构型距离具有预期次数的自由对数导子基有多远提供了一个可计算的度量。

利用该泛函作为奖励信号，我们开发了一种顺序构造过程：在其中逐条添加直线，以最小化与自由性之间的角距离；该过程通过强化学习实现，并在构型规模和指数类型上采用自适应课程学习。

我们的结果表明，基于多项式系数空间几何的半连续松弛技术，为直线构型理论中自由性的计算探索提供了一条可行途径。

We introduce a nonnegative functional on the space of line arrangements in $\mathbb{P}^2$ that vanishes precisely on free arrangements, obtained as a semicontinuous relaxation of Saito’s criterion for freeness. Given an arrangement $\mathcal{A}$ of $n$ lines with candidate exponents $(d_1, d_2)$, we parameterize the spaces of logarithmic derivations of degrees $d_1$ and $d_2$ via the null spaces of the associated derivation matrices and express the Saito determinant as a bilinear map into the space of degree $n$ polynomials. The functional then admits a natural geometric interpretation: it measures the squared sine of the angle between the image of this bilinear map and the direction of the defining polynomial $Q(\mathcal{A})$ in coefficient space, and equals zero if and only if its image contains the line spanned by $Q(\mathcal{A})$. This provides a computable measure of how far a given arrangement is from admitting a free basis of logarithmic derivations of the expected degrees. Using this functional as a reward signal, we develop a sequential construction procedure in which lines are added one at a time so as to minimize the angular distance to freeness, implemented via reinforcement learning with an adaptive curriculum over arrangement sizes and exponent types. Our results suggest that semicontinuous relaxation techniques, grounded in the geometry of polynomial coefficient spaces, offer a viable approach to the computational exploration of freeness in the theory of line arrangements.

评分理由: 该论文专注于联邦学习的鲁棒性增强技术，通过服务器学习和客户端更新过滤结合几何中位数聚合来防御恶意攻击。论文内容完全围绕联邦学习的安全性和分布式机器学习展开，未涉及任何大语言模型、深度学习技术原理、科学AI应用或评分关键词中列出的具体技术（如MoE、RLHF、RAG、量化等）。所有关键词均与大模型和深度学习技术相关，而本文研究的是传统的联邦学习框架，因此所有关键词相关度均为0。

本文探讨了在客户端训练数据非独立同分布的情况下，利用服务器学习增强联邦学习对抗恶意攻击的鲁棒性。我们提出了一种启发式算法，该算法结合服务器学习与客户端更新过滤，并采用几何中位数聚合方法。实验表明，即使恶意客户端比例较高（某些情况下超过$50%$），且服务器使用的数据集规模较小（可为合成数据，其分布未必接近客户端聚合数据的分布），该方法仍能显著提升模型精度。

This paper explores the use of server learning for enhancing the robustness of federated learning against malicious attacks even when clients’ training data are not independent and identically distributed. We propose a heuristic algorithm that uses server learning and client update filtering in combination with geometric median aggregation. We demonstrate via experiments that this approach can achieve significant improvement in model accuracy even when the fraction of malicious clients is high, even more than $50%$ in some cases, and the dataset utilized by the server is small and could be synthetic with its distribution not necessarily close to that of the clients’ aggregated data.

评分理由: 该论文介绍了一个用于医学3D图像分类和预测模型开发的模块化AI框架PR3DICTR，主要涉及深度学习在医学影像分析中的应用。论文内容与绝大多数关键词（主要关于大语言模型技术原理、训练方法、推理优化、智能体等）完全无关，因为这些关键词针对的是自然语言处理领域的大模型技术。唯一相关的关键词是’AI for Science OR Bioinformatics OR Cheminformatics’，因为论文属于AI在生物医学（医学影像分析）领域的应用，属于’AI for Science’范畴，但并非核心创新技术研究，因此给予8分（有一定关联，但非核心）。

三维医学影像数据与计算机辅助决策（尤其是基于深度学习的方法）在医学领域正变得日益重要。为促进相关研究发展，我们推出PR3DICTR：三维影像分类与标准化训练研究平台。该平台基于学界通用框架（PyTorch与MONAI）构建，为预测模型开发提供开放访问、灵活便捷的框架，特别专注于三维医学影像数据的分类任务。通过模块化设计原则与标准化流程的结合，本平台旨在减轻开发负担的同时保持可调整性。它为用户提供了丰富的预设功能，例如模型架构设计选项、超参数解决方案及训练方法学，同时仍允许用户自由“接入”自定义解决方案或模块。PR3DICTR可应用于任何基于事件或二分类的三维影像分类任务，且仅需两行代码即可运行。

Three-dimensional medical image data and computer-aided decision making, particularly using deep learning, are becoming increasingly important in the medical field. To aid in these developments we introduce PR3DICTR: Platform for Research in 3D Image Classification and sTandardised tRaining. Built using community-standard distributions (PyTorch and MONAI), PR3DICTR provides an open-access, flexible and convenient framework for prediction model development, with an explicit focus on classification using three-dimensional medical image data. By combining modular design principles and standardization, it aims to alleviate developmental burden whilst retaining adjustability. It provides users with a wealth of pre-established functionality, for instance in model architecture design options, hyper-parameter solutions and training methodologies, but still gives users the opportunity and freedom to ``plug in’’ their own solutions or modules. PR3DICTR can be applied to any binary or event-based three-dimensional classification task and can work with as little as two lines of code.

评分理由: 论文研究的是智能体AI（Agentic AI）的控制、记忆和验证问题，从松鼠生态学中获得灵感，提出一个包含潜在动态、结构化情景记忆、观察者信念状态、选项级动作和延迟验证信号的分层部分可观测控制模型。虽然论文涉及AI智能体，但所有关键词都明确针对大语言模型（LLM）及其相关技术（如MoE、SFT、RLHF、RAG、量化等），而本文完全不涉及LLM技术，没有讨论任何语言模型、预训练、微调、对齐、推理加速或特定LLM应用。论文的核心是控制理论、记忆架构和验证机制，而非LLM技术。因此，所有关键词的相关度均为0。

对智能体人工智能的评价正日益超越其流畅的输出能力，转而关注其在部分可观测性、延迟和策略性观察条件下能否有效行动、记忆与验证。现有研究往往孤立探讨这些需求：机器人学侧重控制，检索系统强调记忆，对齐或保障工作则聚焦核查与监督。本文提出，松鼠生态学为此提供了一个鲜明的比较案例，因为树冠运动、分散贮食及受众敏感性贮藏行为将这三类需求耦合于单一生物体内。我们综合了狐狸松鼠、东部灰松鼠及一项野外对比中的红松鼠证据，并构建了明确的推理阶梯：实证观察、最小化计算推断与人工智能设计猜想。我们提出一个具有潜在动态、结构化情景记忆、观察者信念状态、选项级行动及延迟验证信号的最小化分层部分可观测控制模型。由此推导出三个假设：（H1）快速局部反馈结合预测性补偿能提升隐藏动态变化下的鲁棒性；（H2）为未来控制而组织的记忆结构可在线索冲突与负荷下改善延迟检索；（H3）行动-记忆循环内嵌的验证器与观察者模型能减少静默故障与信息泄露，但仍存在模型设定错误的脆弱性。进一步推论是：角色分化的提议者/执行者/核查者/对抗者系统或能在信息不对称与验证负担下降低关联错误。本文贡献在于提出一种比较视角与基准研究议程：建立一套关于控制、记忆与可验证行动耦合关系的可证伪主张的规范研究体系。

Agentic AI is increasingly judged not by fluent output alone but by whether it can act, remember, and verify under partial observability, delay, and strategic observation. Existing research often studies these demands separately: robotics emphasizes control, retrieval systems emphasize memory, and alignment or assurance work emphasizes checking and oversight. This article argues that squirrel ecology offers a sharp comparative case because arboreal locomotion, scatter-hoarding, and audience-sensitive caching couple all three demands in one organism. We synthesize evidence from fox, eastern gray, and, in one field comparison, red squirrels, and impose an explicit inference ladder: empirical observation, minimal computational inference, and AI design conjecture. We introduce a minimal hierarchical partially observed control model with latent dynamics, structured episodic memory, observer-belief state, option-level actions, and delayed verifier signals. This motivates three hypotheses: (H1) fast local feedback plus predictive compensation improves robustness under hidden dynamics shifts; (H2) memory organized for future control improves delayed retrieval under cue conflict and load; and (H3) verifiers and observer models inside the action-memory loop reduce silent failure and information leakage while remaining vulnerable to misspecification. A downstream conjecture is that role-differentiated proposer/executor/checker/adversary systems may reduce correlated error under asymmetric information and verification burden. The contribution is a comparative perspective and benchmark agenda: a disciplined program of falsifiable claims about the coupling of control, memory, and verifiable action.

评分理由: 论文研究多教师知识蒸馏在低资源抽象摘要中的应用，提出了EWAD和CPDP方法。与’Large Language Models’相关度5分，因为使用了Qwen2.5等大模型进行实验；与’Post-training’相关度5分，因为知识蒸馏属于模型训练后优化技术。其他关键词如MoE、SLMs、Scaling Laws、RLHF等均未涉及，给0分。

我们从可靠性感知的视角研究低资源抽象摘要中的多教师知识蒸馏。我们引入了EWAD（熵加权一致性感知蒸馏），这是一种基于教师间一致性在教师蒸馏与黄金标准监督之间进行路由的标记级机制；以及CPDP（容量比例散度保持），一种对学生模型相对于异构教师模型位置的几何约束。通过在两个孟加拉语数据集、13个孟加拉语T5消融实验和八个Qwen2.5实验中的验证，我们发现逻辑值层面的知识蒸馏能带来最稳定的性能提升，而更复杂的蒸馏方法虽能提升短摘要的语义相似度，却会损害长摘要的质量。在十种语言上进行的跨语言伪标签知识蒸馏，在3.2倍压缩率下仍能保留教师模型71-122%的ROUGE L分数。一项经人工验证的多评委大语言模型评估进一步揭示了单评委评估流程中存在的校准偏差。总体而言，我们的结果表明，可靠性感知蒸馏有助于界定多教师监督在何种情况下能改进摘要性能，以及在何种情况下数据扩展的收益会超过损失函数设计的收益。

We study multiteacher knowledge distillation for low resource abstractive summarization from a reliability aware perspective. We introduce EWAD (Entropy Weighted Agreement Aware Distillation), a token level mechanism that routes supervision between teacher distillation and gold supervision based on inter teacher agreement, and CPDP (Capacity Proportional Divergence Preservation), a geometric constraint on the student position relative to heterogeneous teachers. Across two Bangla datasets, 13 BanglaT5 ablations, and eight Qwen2.5 experiments, we find that logit level KD provides the most reliable gains, while more complex distillation improves semantic similarity for short summaries but degrades longer outputs. Cross lingual pseudo label KD across ten languages retains 71-122 percent of teacher ROUGE L at 3.2x compression. A human validated multi judge LLM evaluation further reveals calibration bias in single judge pipelines. Overall, our results show that reliability aware distillation helps characterize when multi teacher supervision improves summarization and when data scaling outweighs loss engineering.

评分理由: 论文提出了一种新的注意力机制变体（gradient-boosted attention），属于Transformer架构的底层技术创新。它直接改进注意力计算本身，因此与’Large Language Models’有一定关联（因为LLMs基于Transformer），但论文本身不专门研究LLMs，而是关注通用的注意力机制改进。其他关键词主要涉及LLM的训练、对齐、推理、应用等高层主题，与本文的底层架构创新无关。

Transformer注意力机制通过单一softmax加权平均计算值向量——这种单次估计无法修正自身误差。我们提出梯度提升注意力，将梯度提升原理应用于单个注意力层内部：第二个注意力轮次使用独立学习的投影矩阵，关注首轮预测误差并施加门控修正。在平方重构目标下，该结构可映射至弗里德曼的梯度提升机框架，其中每个注意力轮次作为基学习器，逐维度门控机制充当收缩参数。我们证明：单次霍普菲尔德式更新会消除查询向量中与存储模式子空间正交的所有信息；而在局部收缩条件下的进一步迭代，可能导致同一区域内不同查询向量坍缩至相同不动点。研究还表明，修正轮次采用独立投影可恢复塔基“二次修正法”共享投影方案无法获取的残差信息。在WikiText-103的1000万词元子集上，梯度提升注意力取得67.9的测试困惑度，优于标准注意力的72.2、Twicing注意力的69.6以及参数匹配的加宽基线模型（69.0），且两轮迭代即可获得主要性能增益。

Transformer attention computes a single softmax-weighted average over values – a one-pass estimate that cannot correct its own errors. We introduce \emph{gradient-boosted attention}, which applies the principle of gradient boosting \emph{within} a single attention layer: a second attention pass, with its own learned projections, attends to the prediction error of the first and applies a gated correction. Under a squared reconstruction objective, the construction maps onto Friedman’s gradient boosting machine, with each attention pass as a base learner and the per-dimension gate as the shrinkage parameter. We show that a single Hopfield-style update erases all query information orthogonal to the stored-pattern subspace, and that further iteration under local contraction can collapse distinct queries in the same region to the same fixed point. We also show that separate projections for the correction pass can recover residual information inaccessible to the shared-projection approach of Tukey’s twicing. On a 10M-token subset of WikiText-103, gradient-boosted attention achieves a test perplexity of $67.9$ compared to $72.2$ for standard attention, $69.6$ for Twicing Attention, and $69.0$ for a parameter-matched wider baseline, with two rounds capturing most of the benefit.

评分理由: 论文提出Reflective Context Learning (RCL)框架，专注于智能体通过上下文空间学习优化。核心相关关键词：1) ‘LLM Agents/Autonomous Agents/Agentic Workflow’ (10分)：论文研究智能体学习框架，是核心内容；2) ‘In-context Learning/Many-shot Learning’ (10分)：论文研究上下文空间学习优化，是核心创新；3) ‘Self-Correction/Self-Improvement/Self-Reflection’ (8分)：RCL框架包含反思机制；4) ‘Large Language Models/LLMs/Foundation Models’ (5分)：论文涉及智能体学习，可能使用大模型，但未明确说明。其他关键词与论文内容无关，得0分。

通用智能体必须通过经验学习，使其能力能够跨任务与环境泛化。无论是学习对象位于参数空间还是上下文空间，学习的基本问题——包括信用分配、过拟合、遗忘、局部最优和高方差学习信号——始终存在。尽管这些挑战在经典机器学习优化中已得到充分理解，但在上下文空间中仍未得到充分探索，导致现有方法零散且临时化。我们提出反射式上下文学习（Reflective Context Learning, RCL），这是一个为智能体设计的统一框架，使其能够通过重复交互、对行为与失败模式的反思以及对上下文的迭代更新进行学习。在RCL中，反思将轨迹与当前上下文转换为类似于梯度的方向性更新信号，而变异则应用该信号以在上下文空间中改进未来行为。我们将近期的上下文优化方法重新定义为这一共享学习问题的实例，并系统性地扩展了经典优化原语，包括批处理、改进的信用分配信号、辅助损失、失败回放以及用于降低方差的组式轨迹采样。在AppWorld、BrowseComp+和RewardBench2上的实验表明，这些原语在强基线基础上实现了性能提升，且其相对重要性随任务机制的变化而改变。我们进一步分析了方法对初始化的鲁棒性、批量大小的影响、采样与课程策略、优化器状态变体，以及为不同优化组件分配更强或更弱模型的效果。我们的结果表明，通过上下文更新进行学习不应被视为一系列孤立的算法，而应被视为一个优化问题，其机制可以通过可迁移的原则进行系统性研究与改进。

Generally capable agents must learn from experience in ways that generalize across tasks and environments. The fundamental problems of learning, including credit assignment, overfitting, forgetting, local optima, and high-variance learning signals, persist whether the learned object lies in parameter space or context space. While these challenges are well understood in classical machine learning optimization, they remain underexplored in context space, leading current methods to be fragmented and ad hoc. We present Reflective Context Learning (RCL), a unified framework for agents that learn through repeated interaction, reflection on behavior and failure modes, and iterative updates to context. In RCL, reflection converts trajectories and current context into a directional update signal analogous to gradients, while mutation applies that signal to improve future behavior in context space. We recast recent context-optimization approaches as instances of this shared learning problem and systematically extend them with classical optimization primitives, including batching, improved credit-assignment signal, auxiliary losses, failure replay, and grouped rollouts for variance reduction. On AppWorld, BrowseComp+, and RewardBench2, these primitives improve over strong baselines, with their relative importance shifting across task regimes. We further analyze robustness to initialization, the effects of batch size, sampling and curriculum strategy, optimizer-state variants, and the impact of allocating stronger or weaker models to different optimization components. Our results suggest that learning through context updates should be treated not as a set of isolated algorithms, but as an optimization problem whose mechanisms can be studied systematically and improved through transferable principles.

评分理由: 论文核心研究RL-based post-training对多模态大语言模型(MLLMs)推理能力的影响，特别是从幻觉角度分析。高度相关的关键词包括：‘Large Language Models’(论文研究MLLMs)、‘Post-training’(研究RL post-training)、‘RLHF’(使用RL进行后训练)、‘Chain of Thought’(涉及推理过程分析)、‘Hallucination Mitigation’(提出Hallucination-as-Cue框架分析幻觉)、‘Mechanistic Interpretability’(通过框架诊断训练动态和模型属性)。其他关键词如MoE、SLMs、Scaling Laws等与论文内容无关。

强化学习（RL）在大型推理模型中的近期成功，推动了其在后训练多模态大语言模型（MLLMs）中的日益广泛应用，以增强其视觉推理能力。尽管许多研究报道了性能提升，但RL训练是否真正使模型能够从视觉信息中学习仍不明确。在本研究中，我们提出“幻觉即线索”框架，这是一个旨在从模型幻觉角度分析基于RL的后训练对多模态推理模型影响的分析框架。具体而言，我们引入了诱导幻觉的、模态特定的信息破坏方法，通过移除或替换得出正确答案所需的关键信息，从而迫使模型通过幻觉进行推理。通过在训练和评估阶段应用这些破坏方法，我们的框架为诊断RL训练动态和理解数据集的内在特性提供了独特视角。通过对多个多模态推理基准进行大量实验和分析，我们发现模型幻觉在RL训练中的作用比以往认识到的更为显著。例如，我们发现即使在纯诱导幻觉的设置下进行RL后训练，仍能显著提升模型的推理性能，在某些情况下甚至超越标准训练。这些发现挑战了当前关于MLLM推理训练的普遍假设，并推动了更具模态感知能力的基于RL的训练设计的进一步发展。

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many studies have reported improved performance, it remains unclear whether RL training truly enables models to learn from visual information. In this work, we propose the Hallucination-as-Cue Framework, an analytical framework designed to investigate the effects of RL-based post-training on multimodal reasoning models from the perspective of model hallucination. Specifically, we introduce hallucination-inductive, modality-specific corruptions that remove or replace essential information required to derive correct answers, thereby forcing the model to reason by hallucination. By applying these corruptions during both training and evaluation, our framework provides a unique perspective for diagnosing RL training dynamics and understanding the intrinsic properties of datasets. Through extensive experiments and analyses across multiple multimodal reasoning benchmarks, we reveal that the role of model hallucination for RL-training is more significant than previously recognized. For instance, we find that RL post-training under purely hallucination-inductive settings can still significantly improve models’ reasoning performance, and in some cases even outperform standard training. These findings challenge prevailing assumptions about MLLM reasoning training and motivate the development of more modality-aware RL-based training designs.

评分理由: 论文是LLM增强策略的技术综述，核心讨论in-context learning和RAG（包括GraphRAG和CausalRAG），因此与’Large Language Models’、‘Retrieval-Augmented Generation’和’In-context Learning’高度相关（10分）。论文提到有限上下文窗口和因果推理，与’Context Window Extension’和’Hallucination Mitigation’有一定关联（5分）。其他关键词如MoE、量化、对齐等未涉及，得0分。

大型语言模型（LLMs）在其参数中编码了海量的世界知识，但它们本质上仍受限于静态知识、有限的上下文窗口以及弱结构化的因果推理能力。本综述沿单一轴线——即在推理时提供的结构化上下文程度——对增强策略进行了统一阐述。我们涵盖了上下文学习与提示工程、检索增强生成（RAG）、图结构检索增强生成（GraphRAG）以及因果检索增强生成（CausalRAG）。除概念比较外，本文还提供了透明的文献筛选流程、主张审计框架以及结构化的跨文献证据综合方法，以区分高置信度结论与新兴研究成果。论文最后提出了面向部署的决策框架，并为可信赖的检索增强自然语言处理领域明确了具体的研究优先方向。

Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account of augmentation strategies along a single axis: the degree of structured context supplied at inference time. We cover in-context learning and prompt engineering, Retrieval-Augmented Generation (RAG), GraphRAG, and CausalRAG. Beyond conceptual comparison, we provide a transparent literature-screening protocol, a claim-audit framework, and a structured cross-paper evidence synthesis that distinguishes higher-confidence findings from emerging results. The paper concludes with a deployment-oriented decision framework and concrete research priorities for trustworthy retrieval-augmented NLP.

评分理由: 论文主要研究视觉语言模型（VLM）在图表问答任务中的增强，通过强化学习框架优化视觉感知和逻辑推理。与关键词的相关性分析如下：1）与"Large Language Models OR LLMs OR Foundation Models"（8分）相关，因为论文使用Qwen3-VL作为基础模型；2）与"Post-training OR Supervised Fine-tuning OR SFT"（8分）相关，因为论文涉及模型微调；3）与"PEFT OR LoRA OR Parameter-efficient Fine-tuning"（10分）高度相关，因为论文明确集成了LoRA进行参数高效微调；4）与"Chain of Thought OR CoT Reasoning OR Multi-step Reasoning"（8分）和"System 2 Thinking OR Slow Thinking OR In-depth Reasoning"（8分）相关，因为论文强调增强推理能力；5）与"Speculative Decoding OR Inference Acceleration"（5分）有一定关联，因为论文提到减少推理延迟；其他关键词与论文内容无关或未提及，得0分。

视觉语言模型（VLMs）的最新进展展示了迈向真正智能所需的稳健推理能力的进步。除了模式识别之外，语言推理必须与视觉理解相结合，尤其是在涉及复杂数据可视化的图表问答（Chart Question Answering, CQA）任务中。当前的视觉语言模型在图表问答任务中面临显著局限，包括数值提取不精确、难以解释隐含的视觉关系，以及用于捕捉图表中空间关系的注意力机制不足。在本研究中，我们通过提出Chart-RL来解决这些挑战，这是一个新颖的强化学习框架，通过反馈驱动的视觉感知与逻辑推理策略优化，来增强视觉语言模型的图表理解能力。我们的核心创新包括一个整合了基于策略优化的强化学习（Reinforcement Learning, RL）技术与自适应奖励函数的综合框架，该框架相较于基线基础模型展现出卓越性能，并与更大规模的先进架构相比取得了有竞争力的结果。我们还在强化学习框架中集成了通过低秩自适应（Low-Rank Adaptation, LoRA）实现的参数高效微调，该方案仅需单GPU配置即可保持性能完整性。我们利用ChartQAPro数据集，在开源、专有以及先进的闭源模型上进行了广泛的基准测试。经过强化学习微调的Qwen3-VL-4B-Instruct模型实现了0.634的答案准确率，超越了参数规模为其两倍的Qwen3-VL-8B-Instruct基础模型0.580的准确率，同时将推理延迟从31秒降低至9秒。

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension, particularly for Chart Question Answering (CQA) tasks involving complex data visualizations. Current VLMs face significant limitations in CQA, including imprecise numerical extraction, difficulty interpreting implicit visual relationships, and inadequate attention mechanisms for capturing spatial relationships in charts. In this work, we address these challenges by presenting Chart-RL, a novel reinforcement learning framework that enhances VLMs chart understanding through feedback-driven policy optimization of visual perception and logical inference. Our key innovation includes a comprehensive framework integrating Reinforcement Learning (RL) from Policy Optimization techniques along with adaptive reward functions, that demonstrates superior performance compared to baseline foundation models and competitive results against larger state-of-the-art architectures. We also integrated Parameter-Efficient Fine-Tuning through Low-Rank Adaptation (LoRA) in the RL framework that only requires single GPU configurations while preserving performance integrity. We conducted extensive benchmarking across open-source, proprietary, and state-of-the-art closed-source models utilizing the ChartQAPro dataset. The RL fine-tuned Qwen3-VL-4B-Instruct model achieved an answer accuracy of 0.634, surpassing the 0.580 accuracy of the Qwen3-VL-8B-Instruct foundation model despite utilizing half the parameter count, while simultaneously reducing inference latency from 31 seconds to 9 seconds.

评分理由: 论文核心研究大语言模型（LLMs）的内部表示结构，通过识别情感子空间来理解模型机制，因此与’Large Language Models’高度相关（10分）。研究通过分析模型内部表示来解释行为控制机制，属于可解释AI范畴，与’Mechanistic Interpretability’高度相关（10分）。其他关键词如MoE、SFT、RAG、量化等均未在论文中涉及，因此得0分。

我们提出一种在大语言模型表征中识别效价-唤醒度（Valence-Arousal, VA）子空间的方法。基于21.1万条情感标注文本，我们推导出情感导向向量，随后通过岭回归将模型自报告的效价-唤醒度分数与这些向量的主成分分析（PCA）主要成分进行线性组合，从而学习VA坐标轴。所得VA子空间呈现出符合人类情感感知经典模型的环形几何结构。在4.4万个词汇项目上，沿我们重建的VA子空间的投影结果与人类众包VA评分具有相关性。此外，沿这些坐标轴进行生成导向能在模型输出的对应情感维度上产生单调偏移。沿这些方向的导向还能对拒绝行为和谄媚倾向实现近单调的双向控制：提升唤醒度会降低拒绝行为并增加谄媚倾向，反之亦然。这些效应在Llama-3.1-8B、Qwen3-8B和Qwen3-14B模型中均得到复现，证明了跨架构的普适性。我们为这些效应及先前情感框架控制方法提供了机制性解释：与拒绝相关的标记（如“我不能”“抱歉”）位于低唤醒度、负效价区域，因此VA导向可直接调节这些标记的生成概率。

We present a method to identify a valence-arousal (VA) subspace within large language model representations. From 211k emotion-labeled texts, we derive emotion steering vectors, then learn VA axes as linear combinations of their top PCA components via ridge regression on the model’s self-reported valence-arousal scores. The resulting VA subspace exhibits circular geometry consistent with established models of human emotion perception. Projections along our recovered VA subspace correlate with human-crowdsourced VA ratings across 44k lexical items. Furthermore, steering generation along these axes produces monotonic shifts in the corresponding affective dimensions of model outputs. Steering along these directions also induces near-monotonic bidirectional control over refusal and sycophancy: increasing arousal decreases refusal and increases sycophancy, and vice versa. These effects replicate across Llama-3.1-8B, Qwen3-8B, and Qwen3-14B, demonstrating cross-architecture generality. We provide a mechanistic account for these effects and prior emotionally-framed controls: refusal-associated tokens (“I can’t,” “sorry”) occupy low-arousal, negative-valence regions, so VA steering directly modulates their emission probability.

评分理由: 论文InCoder-32B-Thinking专注于工业代码领域，提出了一种结合Error-driven Chain-of-Thought（ECoT）和工业代码世界模型（ICWM）的方法来生成推理轨迹。核心相关关键词包括：1）‘Large Language Models’（论文基于32B参数模型）；2）‘Chain of Thought’和’System 2 Thinking’（ECoT框架明确模拟多步推理和错误纠正过程）；3）‘Self-Correction’（ECoT通过环境错误反馈进行自我修正）；4）‘World Models’（ICWM学习代码对硬件行为的因果动态）。‘AI for Science’得5分，因为论文涉及工业应用（芯片设计、GPU优化），属于科学/工程领域的AI应用。其他关键词如MoE、SLMs、RLHF等未在论文中提及或不是核心内容，故得0分。‘Pre-training’和’Post-training’各得5分，因为论文涉及模型训练过程，但未详细说明具体方法。

在芯片设计、GPU优化与嵌入式系统等工业软件开发领域，普遍缺乏能够展示工程师如何针对硬件约束与时序语义进行推理的专家级推理轨迹。本研究提出InCoder-32B-Thinking模型，该模型基于“错误驱动的思维链”（Error-driven Chain-of-Thought, ECoT）合成框架产生的数据，并结合工业代码世界模型（Industrial Code World Model, ICWM）进行训练，以生成可解释的推理轨迹。具体而言，ECoT通过综合多轮对话中的思维内容与环境错误反馈来构建推理链，显式地建模了错误修正过程。ICWM则基于Verilog仿真、GPU性能剖析等领域的专用执行轨迹进行训练，学习代码如何影响硬件行为的因果动态，并能在实际编译前预测执行结果，从而实现自我验证。所有合成的推理轨迹均通过领域专用工具链进行验证，由此生成的训练数据与工业任务的自然推理深度分布相匹配。在14个通用基准测试（LiveCodeBench v5得分81.3%）与9个工业基准测试（CAD-Coder得分84.0%，KernelBench得分38.0%）上的评估表明，InCoder-32B-Thinking在所有领域均取得了顶尖的开源模型性能。

Industrial software development across chip design, GPU optimization, and embedded systems lacks expert reasoning traces showing how engineers reason about hardware constraints and timing semantics. In this work, we propose InCoder-32B-Thinking, trained on the data from the Error-driven Chain-of-Thought (ECoT) synthesis framework with an industrial code world model (ICWM) to generate reasoning traces. Specifically, ECoT generates reasoning chains by synthesizing the thinking content from multi-turn dialogue with environmental error feedback, explicitly modeling the error-correction process. ICWM is trained on domain-specific execution traces from Verilog simulation, GPU profiling, etc., learns the causal dynamics of how code affects hardware behavior, and enables self-verification by predicting execution outcomes before actual compilation. All synthesized reasoning traces are validated through domain toolchains, creating training data matching the natural reasoning depth distribution of industrial tasks. Evaluation on 14 general (81.3% on LiveCodeBench v5) and 9 industrial benchmarks (84.0% in CAD-Coder and 38.0% on KernelBench) shows InCoder-32B-Thinking achieves top-tier open-source results across all domains.GPU Optimization

评分理由: 论文主要研究使用AI编码模型进行自动化单元测试生成和代码重构，属于大模型在软件工程领域的应用。与’Large Language Models’有一定关联（5分），因为使用了coding models（可能是基于LLM的代码生成模型）。与’Instruction Tuning OR Alignment OR Value Alignment’有较强关联（8分），因为论文明确提到’addressed the weak value misalignment we observed in models’，涉及模型对齐问题。其他关键词如MoE、SLMs、Scaling Laws、RAG、CoT等均未在论文中涉及，得0分。

许多软件系统最初是作为原型或最小可行产品（MVP）开发的，其开发重点在于交付速度和对需求变化的响应能力，而非长期的代码可维护性。虽然这种方法能有效实现快速交付，但可能导致代码库难以修改，在人工智能辅助甚至人工智能主导编程的时代，这带来了显著的机会成本。本文通过案例研究，探讨了使用编码模型进行自动化单元测试生成及后续安全重构的方法，其中提出的代码变更均通过测试验证。研究考察了迭代生成测试以捕获现有系统行为的最佳实践，以及在开发者监督下进行模型辅助重构的流程。我们描述了该工作流如何约束重构变更，分析了两个阶段中观察到的错误与局限性，量化了所实现的效率提升，指出了需要人工干预的场景，并阐述了如何解决模型中观察到的弱价值对齐问题。通过该方法，我们在数小时内而非数周内生成了近16,000行可靠的单元测试，在关键模块中实现了高达78%的分支覆盖率，并显著降低了大规模重构过程中的回归风险。这些结果体现了软件工程正朝着实证科学方向转变，强调数据收集和约束机制的建立，以支持快速、安全的迭代开发。

Many software systems originate as prototypes or minimum viable products (MVPs), developed with an emphasis on delivery speed and responsiveness to changing requirements rather than long-term code maintainability. While effective for rapid delivery, this approach can result in codebases that are difficult to modify, presenting a significant opportunity cost in the era of AI-assisted or even AI-led programming. In this paper, we present a case study of using coding models for automated unit test generation and subsequent safe refactoring, with proposed code changes validated by passing tests. The study examines best practices for iteratively generating tests to capture existing system behavior, followed by model-assisted refactoring under developer supervision. We describe how this workflow constrained refactoring changes, the errors and limitations observed in both phases, the efficiency gains achieved, when manual intervention was necessary, and how we addressed the weak value misalignment we observed in models. Using this approach, we generated nearly 16,000 lines of reliable unit tests in hours rather than weeks, achieved up to 78% branch coverage in critical modules, and significantly reduced regression risk during large-scale refactoring. These results illustrate software engineering’s shift toward an empirical science, emphasizing data collection and constraining mechanisms that support fast, safe iteration.

评分理由: 论文核心研究工具增强的AI代理（LLM Agents）的安全评估，直接涉及’LLM Agents’和’Tool Use’关键词（10分），并基于大语言模型（‘Large Language Models’，10分）。论文未涉及其他技术原理创新或特定领域应用，因此其他关键词均为0分。

工具增强型AI智能体极大地扩展了大语言模型的实际能力，但也引入了无法通过纯模型评估识别的安全风险。本文对六种代表性的OpenClaw系列智能体框架（即OpenClaw、AutoClaw、QClaw、KimiClaw、MaxClaw和ArkClaw）在多种骨干模型下进行了系统性安全评估。为支持本研究，我们构建了一个包含205个测试用例的基准，覆盖智能体完整执行生命周期中的典型攻击行为，实现了框架与模型层面风险暴露的统一评估。研究结果表明，所有被评估的智能体均存在显著的安全漏洞，且智能体化系统的风险远高于其底层模型单独使用时的风险。具体而言，侦察与发现行为成为最普遍的薄弱环节，而不同框架呈现出各异的高风险特征，包括凭证泄露、横向移动、权限提升和资源开发等。这些发现表明，现代智能体系统的安全性不仅取决于骨干模型的安全特性，还受到模型能力、工具使用、多步规划与运行时编排之间耦合关系的共同影响。我们进一步证明，一旦智能体获得执行能力和持久化运行时上下文，早期阶段出现的弱点可能被放大为具体的系统级故障。总体而言，本研究强调需要超越提示层面的安全措施，转向面向智能体框架全生命周期的安全治理。

Tool-augmented AI agents substantially extend the practical capabilities of large language models, but they also introduce security risks that cannot be identified through model-only evaluation. In this paper, we present a systematic security assessment of six representative OpenClaw-series agent frameworks, namely OpenClaw, AutoClaw, QClaw, KimiClaw, MaxClaw, and ArkClaw, under multiple backbone models. To support this study, we construct a benchmark of 205 test cases covering representative attack behaviors across the full agent execution lifecycle, enabling unified evaluation of risk exposure at both the framework and model levels. Our results show that all evaluated agents exhibit substantial security vulnerabilities, and that agentized systems are significantly riskier than their underlying models used in isolation. In particular, reconnaissance and discovery behaviors emerge as the most common weaknesses, while different frameworks expose distinct high-risk profiles, including credential leakage, lateral movement, privilege escalation, and resource development. These findings indicate that the security of modern agent systems is shaped not only by the safety properties of the backbone model, but also by the coupling among model capability, tool use, multi-step planning, and runtime orchestration. We further show that once an agent is granted execution capability and persistent runtime context, weaknesses arising in early stages can be amplified into concrete system-level failures. Overall, our study highlights the need to move beyond prompt-level safeguards toward lifecycle-wide security governance for intelligent agent frameworks.

评分理由: 论文核心研究基于LLMs和RAG技术，通过领域适应的检索方法改进教学对话标注任务，因此与’Large Language Models’、‘Retrieval-Augmented Generation’和’In-context Learning’高度相关（10分）。论文涉及领域适应（Domain Adaptation）和AI在教育领域的应用（AI for Science的子领域），因此各给5分。其他关键词如MoE、SFT、RLHF等未在论文中涉及，给0分。

教学对话的自动标注是一项高风险任务，在没有充分领域基础的情况下，大型语言模型（LLM）往往难以胜任。我们提出了一种用于教学行为标注的领域自适应检索增强生成（RAG）流程。该方法不通过微调生成模型，而是通过在辅导语料上微调一个轻量级嵌入模型，并在话语层面索引对话以检索带标签的少样本示例，从而实现检索环节的自适应。在两个真实教学对话数据集（TalkMoves 和 Eedi）和三种 LLM 骨干模型（GPT-5.2、Claude Sonnet 4.6、Qwen3-32b）上的评估表明，我们的最佳配置在 TalkMoves 上达到了科恩κ系数 0.526-0.580，在 Eedi 上达到 0.659-0.743，显著优于无检索基线（κ= 0.275-0.413 和 0.160-0.410）。消融研究显示，这些性能提升主要源于话语级别的索引策略，而非仅依赖嵌入质量；在领域自适应检索下，Top-1 标签匹配率在 TalkMoves 上从 39.7% 提升至 62.0%，在 Eedi 上从 52.9% 提升至 73.1%。检索机制还纠正了零样本提示中存在的系统性标签偏差，并对罕见及依赖上下文的标签带来了最大幅度的改进。这些发现表明，仅对检索组件进行自适应调整，是在保持生成模型冻结的情况下，实现专家级教学对话标注的一条实用且有效的路径。

Automated annotation of pedagogical dialogue is a high-stakes task where LLMs often fail without sufficient domain grounding. We present a domain-adapted RAG pipeline for tutoring move annotation. Rather than fine-tuning the generative model, we adapt retrieval by fine-tuning a lightweight embedding model on tutoring corpora and indexing dialogues at the utterance level to retrieve labeled few-shot demonstrations. Evaluated across two real tutoring dialogue datasets (TalkMoves and Eedi) and three LLM backbones (GPT-5.2, Claude Sonnet 4.6, Qwen3-32b), our best configuration achieves Cohen’s $κ$ of 0.526-0.580 on TalkMoves and 0.659-0.743 on Eedi, substantially outperforming no-retrieval baselines ($κ= 0.275$-$0.413$ and $0.160$-$0.410$). An ablation study reveals that utterance-level indexing, rather than embedding quality alone, is the primary driver of these gains, with top-1 label match rates improving from 39.7% to 62.0% on TalkMoves and 52.9% to 73.1% on Eedi under domain-adapted retrieval. Retrieval also corrects systematic label biases present in zero-shot prompting and yields the largest improvements for rare and context-dependent labels. These findings suggest that adapting the retrieval component alone is a practical and effective path toward expert-level pedagogical dialogue annotation while keeping the generative model frozen.

评分理由: 论文是对Kimi K2.5大语言模型的安全评估，核心涉及LLM安全风险，因此与’Large Language Models’高度相关（10分）。评估内容包括模型对齐、偏见、无害性，与’Instruction Tuning OR Alignment OR Value Alignment’相关（8分）。评估在智能体和非智能体设置下进行，与’LLM Agents OR Autonomous Agents OR Agentic Workflow’相关（8分）。评估涉及事实性、真实性风险（如传播虚假信息），与’Hallucination Mitigation OR Factuality OR Truthfulness’有一定关联（5分）。其他关键词如MoE、SLMs、训练技术、推理优化、科学AI应用等，论文未涉及，得0分。

Kimi K2.5 是一款开源权重的语言大模型（LLM），其在编码、多模态和智能体基准测试中表现与闭源模型相当，但发布时未附带相应的安全性评估。本研究对 Kimi K2.5 进行了初步的安全评估，重点关注可能因强大的开源权重模型而加剧的风险。具体而言，我们在智能体与非智能体两种设置下，评估了该模型在 CBRNE（化学、生物、放射、核、高爆物）滥用风险、网络安全风险、错位对齐、政治审查、偏见及无害性方面的表现。我们发现，Kimi K2.5 展现出与 GPT 5.2 和 Claude Opus 4.5 相似的双重用途能力，但在 CBRNE 相关请求上的拒绝率显著更低，这表明它可能提升恶意行为者在武器制造方面的能力。在网络安全相关任务上，Kimi K2.5 表现出有竞争力的网络安全性能，但似乎不具备前沿水平的自主网络攻击能力，例如漏洞发现与利用。我们进一步发现，Kimi K2.5 表现出令人担忧的破坏能力和自我复制倾向，尽管它似乎没有长期的恶意目标。此外，Kimi K2.5 表现出狭隘的审查倾向和政治偏见，尤其是在中文语境下，并且对于涉及传播虚假信息和侵犯版权的有害请求更为顺从。最后，我们发现该模型拒绝参与用户的妄想性请求，且总体过度拒绝率较低。尽管是初步研究，但我们的发现凸显了前沿开源权重模型中存在的安全风险，并且这些风险可能因开源发布的规模和可及性而被放大。因此，我们强烈敦促开源权重模型的开发者进行并发布更系统的安全性评估，这是负责任部署所必需的。

Kimi K2.5 is an open-weight LLM that rivals closed models across coding, multimodal, and agentic benchmarks, but was released without an accompanying safety evaluation. In this work, we conduct a preliminary safety assessment of Kimi K2.5 focusing on risks likely to be exacerbated by powerful open-weight models. Specifically, we evaluate the model for CBRNE misuse risk, cybersecurity risk, misalignment, political censorship, bias, and harmlessness, in both agentic and non-agentic settings. We find that Kimi K2.5 shows similar dual-use capabilities to GPT 5.2 and Claude Opus 4.5, but with significantly fewer refusals on CBRNE-related requests, suggesting it may uplift malicious actors in weapon creation. On cyber-related tasks, we find that Kimi K2.5 demonstrates competitive cybersecurity performance, but it does not appear to possess frontier-level autonomous cyberoffensive capabilities such as vulnerability discovery and exploitation. We further find that Kimi K2.5 shows concerning levels of sabotage ability and self-replication propensity, although it does not appear to have long-term malicious goals. In addition, Kimi K2.5 exhibits narrow censorship and political bias, especially in Chinese, and is more compliant with harmful requests related to spreading disinformation and copyright infringement. Finally, we find the model refuses to engage in user delusions and generally has low over-refusal rates. While preliminary, our findings highlight how safety risks exist in frontier open-weight models and may be amplified by the scale and accessibility of open-weight releases. Therefore, we strongly urge open-weight model developers to conduct and release more systematic safety evaluations required for responsible deployment.

评分理由: 论文研究视觉语言模型（VLMs）的概念遗忘问题，属于大模型应用领域。与"Large Language Models"相关（5分），因为VLMs是大模型的一种。与"Pre-training"和"Post-training"相关（各5分），因为论文讨论基于训练和免训练的遗忘方法。与"Instruction Tuning"高度相关（8分），因为论文核心是评估通过指令/提示实现概念遗忘的效果，并发现指令调优模型对遗忘指令有抵抗力。其他关键词（如MoE、量化、推理加速等）与论文内容无关（0分）。

基于网络规模数据训练的视觉语言模型（VLMs）保留了敏感及受版权保护的视觉概念，其部署过程可能需要移除这些内容。基于训练的去学习方法存在一个结构性缺陷：在狭窄遗忘集上进行微调会在去学习开始前就削弱模型的通用能力，导致无法将后续的性能下降归因于去学习过程本身。免训练方法通过提示词或系统指令抑制概念来规避此问题，但目前缺乏严格的基准来评估其在视觉任务上的表现。

我们提出了VLM-UnBench，这是首个针对VLMs免训练视觉概念去学习的基准。它涵盖四个遗忘级别、7个源数据集和11个概念维度，并将三级探测分类法与五种评估条件相结合，以区分真实遗忘与指令遵从。在8种评估设置和13种VLM配置中，现实场景的去学习提示词仅能使遗忘准确率接近无指令基线水平；仅在向模型明确披露目标概念的理想条件下，才会出现有意义的准确率下降。物体与场景概念对抑制的抵抗性最强，且经过更强指令调优的模型即使收到明确的遗忘指令仍能保留相关能力。这些结果揭示了提示词层面的概念抑制与真正的视觉概念擦除之间存在明显差距。

VLMs trained on web-scale data retain sensitive and copyrighted visual concepts that deployment may require removing. Training-based unlearning methods share a structural flaw: fine-tuning on a narrow forget set degrades general capabilities before unlearning begins, making it impossible to attribute subsequent performance drops to the unlearning procedure itself. Training-free approaches sidestep this by suppressing concepts through prompts or system instructions, but no rigorous benchmark exists for evaluating them on visual tasks. We introduce VLM-UnBench, the first benchmark for training-free visual concept unlearning in VLMs. It covers four forgetting levels, 7 source datasets, and 11 concept axes, and pairs a three-level probe taxonomy with five evaluation conditions to separate genuine forgetting from instruction compliance. Across 8 evaluation settings and 13 VLM configurations, realistic unlearning prompts leave forget accuracy near the no-instruction baseline; meaningful reductions appear only under oracle conditions that disclose the target concept to the model. Object and scene concepts are the most resistant to suppression, and stronger instruction-tuned models remain capable despite explicit forget instructions. These results expose a clear gap between prompt-level suppression and true visual concept erasure.

评分理由: 该论文专注于网络安全领域的超关系知识图谱补全（HR-KGC）和路径感知的警报预测，提出了HR-NBFNet、AlertStar等模型。虽然属于AI应用范畴，但研究内容与所有评分关键词（均围绕大模型、深度学习技术原理及其特定应用方法）完全无关。论文未涉及任何大模型、语言模型、训练方法、推理技术、对齐、压缩、代理等主题，也未应用于生物信息学或化学信息学。因此，所有关键词相关度均为0分。

网络攻击的规模与复杂程度持续攀升，而现有网络入侵检测方法缺乏对攻击者-受害者交互路径进行推理所需的语义深度。为此，我们首先将网络告警建模为知识图谱，进而将超关系告警预测形式化为超关系知识图谱补全问题，将每条网络告警表示为一个限定性陈述（h, r, t, Q）。其中h和t分别为源IP与目的IP，r表示攻击类型，Q编码流级元数据（如时间戳、端口、协议及攻击强度），这超越了传统知识图谱补全仅使用二元三元组（h, r, t）而丢弃丰富上下文信息的局限。我们通过三项创新贡献提出了五种模型：其一，超关系神经贝尔曼-福特网络将神经贝尔曼-福特网络扩展至超关系场景，实现限定符感知的多跳路径推理，其多任务变体MT-HR-NBFNet在单次遍历中联合预测尾实体、关系及限定符取值；其二，AlertStar通过交叉注意力与可学习的路径组合，在嵌入空间中完全融合限定符上下文与结构路径信息，其多任务扩展MT-AlertStar消除了全图传播的计算开销；其三，HR-NBFNet-CQ将限定符感知表征扩展至复杂一阶逻辑查询应答，涵盖单跳、双跳链式、双锚点交集及并集查询，实现在告警知识图谱上的多条件威胁推理。在Warden与UNSW-NB15基准数据集上针对三种限定符密度场景进行归纳式评估，AlertStar与MT-AlertStar在平均排名、平均倒数排名及Hits@k指标上均表现优异，证明对于超关系告警预测任务，局部限定符融合策略不仅足够有效，且比全局路径传播更具效率。

Cyber-attacks continue to grow in scale and sophistication, yet existing network intrusion detection approaches lack the semantic depth required for path reasoning over attacker-victim interactions. We address this by first modelling network alerts as a knowledge graph, then formulating hyper-relational alert prediction as a hyper-relational knowledge graph completion (HR-KGC) problem, representing each network alert as a qualified statement (h, r, t, Q), where h and t are source and destination IPs, r denotes the attack type, and Q encodes flow-level metadata such as timestamps, ports, protocols, and attack intensity, going beyond standard KGC binary triples (h, r, t) that would discard this contextual richness. We introduce five models across three contributions: first, Hyper-relational Neural Bellman-Ford (HR-NBFNet) extends Neural Bellman-Ford Networks to the hyper-relational setting with qualifier-aware multi-hop path reasoning, while its multi-task variant MT-HR-NBFNet jointly predicts tail, relation, and qualifier-value within a single traversal pass; second, AlertStar fuses qualifier context and structural path information entirely in embedding space via cross-attention and learned path composition, and its multi-task extension MT-AlertStar eliminates the overhead of full knowledge graph propagation; third, HR-NBFNet-CQ extends qualifier-aware representations to answer complex first-order logic queries, including one-hop, two-hop chain, two-anchor intersection, and union, enabling multi-condition threat reasoning over the alert knowledge graph. Evaluated inductively on the Warden and UNSW-NB15 benchmarks across three qualifier-density regimes, AlertStar and MT-AlertStar achieve superior MR, MRR, and Hits@k, demonstrating that local qualifier fusion is both sufficient and more efficient than global path propagation for hyper-relational alert prediction.

评分理由: 论文核心研究LLM agents在稀疏延迟奖励环境中的训练问题，提出Self-Guide方法通过自生成内部奖励实现策略与奖励的协同进化。高度相关关键词：1) ‘Large Language Models’ - 论文明确研究LLM agents；2) ‘Self-Correction/Self-Improvement/Self-Reflection’ - 核心创新是agent自我生成和优化内部奖励；3) ‘LLM Agents/Autonomous Agents/Agentic Workflow’ - 论文主题就是语言agent的训练方法。其他关键词如MoE、SLMs、Scaling Laws、各种训练技术、推理加速等均未涉及。

大型语言模型（LLM）智能体通过与环境的交互进行学习，但长周期训练从根本上仍受限于稀疏且延迟的奖励信号。现有方法通常通过事后信用分配或外部奖励模型来应对这一挑战，这些方法在推理时提供的指导有限，且往往将奖励提升与策略改进相分离。我们提出Self-Guide，一种为语言智能体生成的自发内部奖励机制，它同时支持推理时的引导和训练时的监督。具体而言，智能体在推理过程中将Self-Guide作为短时自引导信号来调整下一步行动，并在训练时将同一信号转化为步骤级内部奖励，以实现更密集的策略优化。这形成了一个协同演进的循环：更好的策略产生更好的引导，而更好的引导作为内部奖励进一步优化策略。在三个智能体基准测试中，仅推理时的自引导已带来明显增益，而通过GRPO将策略与内部奖励联合演进，相比仅使用环境奖励训练的基线方法带来了进一步的性能提升（8%）。总体而言，我们的结果表明，语言智能体不仅可以通过积累更多经验来改进，还能在行动与学习过程中通过生成并优化其内部奖励来实现提升。

Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing methods typically address this challenge through post-hoc credit assignment or external reward models, which provide limited guidance at inference time and often separate reward improvement from policy improvement. We propose Self-Guide, a self-generated internal reward for language agents that supports both inference-time guidance and training-time supervision. Specifically, the agent uses Self-Guide as a short self-guidance signal to steer the next action during inference, and converts the same signal into step-level internal reward for denser policy optimization during training. This creates a co-evolving loop: better policy produces better guidance, and better guidance further improves policy as internal reward. Across three agent benchmarks, inference-time self-guidance already yields clear gains, while jointly evolving policy and internal reward with GRPO brings further improvements (8%) over baselines trained solely with environment reward. Overall, our results suggest that language agents can improve not only by collecting more experience, but also by learning to generate and refine their own internal reward during acting and learning.

评分理由: 该论文专注于使用Vision Transformer进行SAR海冰分类，属于计算机视觉和遥感应用领域。所有关键词均与大语言模型（LLM）相关，而本文未涉及任何LLM技术、训练方法、推理优化或代理系统。唯一可能相关的关键词是’AI for Science OR Bioinformatics OR Cheminformatics’，因为海冰分类可视为地球科学或环境科学中的AI应用，但论文未明确提及这些术语，且核心是视觉模型而非大模型，因此给予5分（有一定关联）。其他关键词与论文内容完全无关，均得0分。

准确且自动化的海冰分类对于北极地区的气候监测与海事安全至关重要。虽然合成孔径雷达（SAR）因其全天候工作能力成为业务化监测标准，但在严重的类别不平衡条件下区分形态相似的冰类仍具挑战性。本文并非提出一个经过全面验证的多模态系统，而是旨在建立一个可信赖的纯SAR基线，以供未来多源融合研究作为基础。利用包含461幅哨兵1号影像与专家冰图匹配的AI4Arctic/ASIP海冰数据集（v2版），我们结合全分辨率哨兵1号超宽幅数据输入、泄漏感知分层切片分割方法、SIGRID-3冰发展阶段标签及训练集归一化处理，对视觉变换器（Vision Transformer）基线模型进行评估。我们比较了采用交叉熵损失和加权交叉熵损失训练的ViT-Base模型与采用焦点损失（focal loss）训练的ViT-Large模型。在测试配置中，采用焦点损失的ViT-Large模型在保留测试集上取得了69.6%的准确率、68.8%的加权F1分数，并在少数类多年冰（Multi-Year Ice）上达到83.9%的精确率。这些结果表明，对于稀有冰类而言，焦点损失训练能提供比加权交叉熵更有价值的精确率-召回率权衡，并为未来与光学、热红外或气象数据的多模态融合建立了更清晰的基线。

Accurate and automated sea ice classification is important for climate monitoring and maritime safety in the Arctic. While Synthetic Aperture Radar (SAR) is the operational standard because of its all-weather capability, it remains challenging to distinguish morphologically similar ice classes under severe class imbalance. Rather than claiming a fully validated multimodal system, this paper establishes a trustworthy SAR only baseline that future fusion work can build upon. Using the AI4Arctic/ASIP Sea Ice Dataset (v2), which contains 461 Sentinel-1 scenes matched with expert ice charts, we combine full-resolution Sentinel-1 Extra Wide inputs, leakage-aware stratified patch splitting, SIGRID-3 stage-of-development labels, and training-set normalization to evaluate Vision Transformer baselines. We compare ViT-Base models trained with cross entropy and weighted cross-entropy against a ViT-Large model trained with focal loss. Among the tested configurations, ViT-Large with focal loss achieves 69.6% held-out accuracy, 68.8% weighted F1, and 83.9% precision on the minority Multi-Year Ice class. These results show that focal-loss training offers a more useful precision-recall trade-off than weighted cross-entropy for rare ice classes and establishes a cleaner baseline for future multimodal fusion with optical, thermal, or meteorological data.