评分理由: 论文Argus提出了一种基于LLM的多智能体框架，用于静态应用安全测试中的漏洞检测。核心相关关键词包括：LLMs（论文明确使用LLMs进行漏洞检测）、RAG（集成RAG技术减少幻觉）、LLM Agents/Multi-agent Systems（首个专门用于漏洞检测的多智能体框架）、Hallucination Mitigation（旨在减少幻觉和误报）。Chain of Thought/System 2 Thinking/Tool Use有一定关联，因为框架涉及推理深度和工具集成。其他关键词如MoE、SLMs、训练方法、模型压缩等未在摘要中提及，与论文内容无关。

近期，大型语言模型（LLM）的进展引发了其在静态应用安全测试（SAST）中应用的广泛关注，这主要归因于其相较于传统符号化或基于规则的方法具有更优越的上下文推理能力。然而，现有的基于LLM的方法通常试图直接替代人类专家，而未与现有SAST工具进行有效整合。这种整合的缺失导致了诸多缺陷，包括高误报率、幻觉问题、有限的推理深度以及过高的令牌使用量，使其难以在工业场景中实际部署。为克服这些局限，我们提出了一种范式转变，将SAST工作流从当前LLM辅助的结构重新编排为一种以LLM为核心的新型工作流。我们引入了Argus（智能体化与检索增强的防护系统），这是首个专为漏洞检测设计的多智能体框架。Argus包含三项关键创新：全面的软件供应链分析、协作式多智能体工作流，以及整合了检索增强生成（RAG）和ReAct等前沿技术，以最大限度减少幻觉并增强推理能力。大量实证评估表明，Argus在检测出更多真实漏洞的同时，显著降低了误报率和运行成本，其性能明显优于现有方法。值得注意的是，Argus已成功识别出多个已分配CVE编号的关键零日漏洞。

Recent advancements in Large Language Models (LLMs) have sparked interest in their application to Static Application Security Testing (SAST), primarily due to their superior contextual reasoning capabilities compared to traditional symbolic or rule-based methods. However, existing LLM-based approaches typically attempt to replace human experts directly without integrating effectively with existing SAST tools. This lack of integration results in ineffectiveness, including high rates of false positives, hallucinations, limited reasoning depth, and excessive token usage, making them impractical for industrial deployment. To overcome these limitations, we present a paradigm shift that reorchestrates the SAST workflow from current LLM-assisted structure to a new LLM-centered workflow. We introduce Argus (Agentic and Retrieval-Augmented Guarding System), the first multi-agent framework designed specifically for vulnerability detection. Argus incorporates three key novelties: comprehensive supply chain analysis, collaborative multi-agent workflows, and the integration of state-of-the-art techniques such as Retrieval-Augmented Generation (RAG) and ReAct to minimize hallucinations and enhance reasoning. Extensive empirical evaluation demonstrates that Argus significantly outperforms existing methods by detecting a higher volume of true vulnerabilities while simultaneously reducing false positives and operational costs. Notably, Argus has identified several critical zero-day vulnerabilities with CVE assignments.

评分理由: 论文核心研究LLM在编程教育评估中的应用，特别是解决LLM生成代码但学生理解不足的问题。高度相关关键词：LLMs（论文明确使用LLMs）、LLM Agents（提出双代理对话层框架）、Hallucination Mitigation（讨论幻觉问题并设计防护措施）。中等相关关键词：Small Language Models（提及本地模型部署选项）、Chain of Thought/System 2 Thinking（涉及逐步推理和深入理解）、Multi-agent Systems（双代理架构）、Explainable AI（关注代码理解解释）。其他关键词如MoE、Scaling Laws、RLHF等与论文技术细节无关。

大型语言模型（LLM）对传统的自动化编程评估提出了挑战，因为学生现在能够生成功能正确的代码，却未必展示出相应的理解能力。本文作出两项贡献。首先，报告了一项基于饱和度的范围综述，聚焦于编程教育中的对话式评估方法。该综述识别出三种主流的架构类型：基于规则或模板驱动的系统、基于LLM的系统以及混合系统。纵观现有文献，对话智能体在提供可扩展的反馈和深入探查代码理解方面展现出潜力，但仍存在重要局限，包括幻觉问题、过度依赖、隐私安全、学术诚信以及部署限制。其次，本文将这些发现综合成一个混合苏格拉底框架，用于将对话式验证整合到自动化编程评估系统（APAS）中。该框架结合了确定性代码分析与双智能体对话层、知识追踪、支架式提问机制，以及将提示与运行时事实相绑定的防护措施。本文还讨论了针对LLM生成解释的实践性保障策略，包括监考部署模式、随机化的跟踪问题、与具体执行状态绑定的逐步推理，以及适用于隐私敏感环境的本地模型部署选项。该框架并非旨在取代传统测试，而是作为一种补充层，用于验证学生是否理解其提交的代码。

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it reports a saturation-based scoping review of conversational assessment approaches in programming education. The review identifies three dominant architectural families: rule-based or template-driven systems, LLM-based systems, and hybrid systems. Across the literature, conversational agents appear promising for scalable feedback and deeper probing of code understanding, but important limitations remain around hallucinations, over-reliance, privacy, integrity, and deployment constraints. Second, the paper synthesizes these findings into a Hybrid Socratic Framework for integrating conversational verification into Automated Programming Assessment Systems (APASs). The framework combines deterministic code analysis with a dual-agent conversational layer, knowledge tracking, scaffolded questioning, and guardrails that tie prompts to runtime facts. The paper also discusses practical safeguards against LLM-generated explanations, including proctored deployment modes, randomized trace questions, stepwise reasoning tied to concrete execution states, and local-model deployment options for privacy-sensitive settings. Rather than replacing conventional testing, the framework is intended as a complementary layer for verifying whether students understand the code they submit.

评分理由: 论文核心研究大语言模型（LLMs）在法语生物医学领域的领域自适应预训练（DAPT），与关键词1高度相关（10分）。论文明确使用DAPT进行领域适应，与关键词5高度相关（10分）。研究生物医学AI应用，与关键词27高度相关（10分）。论文提到使用中小型LLMs，与关键词3有一定关联（5分）。论文强调高质量法语生物医学文本的收集，与关键词4有一定关联（5分）。论文发现模型合并（model merging）对缓解泛化权衡至关重要，与关键词25高度相关（10分）。其他关键词如MoE、SFT、RLHF、RAG、推理方法、代理、压缩等未在摘要中提及，评为0分。

大型语言模型（LLM）已在多个领域展现出卓越能力，但其在专业领域——尤其是非英语语言环境中的适应仍具挑战性。本研究探讨了领域自适应预训练（DAPT）作为一种策略，通过持续预训练将中小型LLM专业化应用于法语生物医学领域。我们聚焦两个核心研究问题：专业化持续预训练对于领域适应的可行性，以及领域特定性能提升与通用能力退化之间的关系。本研究的贡献包括：发布一个完全开放许可、适用于商业和开源应用的法语生物医学语料库；训练并发布专业化的法语生物医学LLM；以及为DAPT实施提供新的见解。我们的方法涵盖高质量法语生物医学文本的收集与精炼、基于DAPT的因果语言建模方法探索，以及开展广泛的对比评估。与先前研究相反，我们的结果对DAPT的有效性提出了质疑，但同时指出在资源受限的小规模场景中，若条件得当，该策略仍具可行性。本文进一步发现，DAPT后的模型融合对于缓解泛化性能的权衡至关重要，在某些情况下甚至能提升DAPT所针对的专业任务表现。

Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains, yet their adaptation to specialized fields remains challenging, particularly for non-English languages. This study investigates domain-adaptive pre-training (DAPT) as a strategy for specializing small to mid-sized LLMs in the French biomedical domain through continued pre-training. We address two key research questions: the viability of specialized continued pre-training for domain adaptation and the relationship between domain-specific performance gains and general capability degradation. Our contributions include the release of a fully open-licensed French biomedical corpus suitable for commercial and open-source applications, the training and release of specialized French biomedical LLMs, and novel insights for DAPT implementation. Our methodology encompasses the collection and refinement of high-quality French biomedical texts, the exploration of causal language modeling approaches using DAPT, and conducting extensive comparative evaluations. Our results cast doubt on the efficacy of DAPT, in contrast to previous works, but we highlight its viability in smaller-scale, resource-constrained scenarios under the right conditions. Findings in this paper further suggest that model merging post-DAPT is essential to mitigate generalization trade-offs, and in some cases even improves performance on specialized tasks at which the DAPT was directed.

评分理由: 论文核心研究LLM作为自主代理在多步工具调用轨迹中的安全防护（guardrails），与"Large Language Models"、“LLM Agents”、“Tool Use"高度相关（10分）。涉及安全对齐（alignment）和幻觉缓解（hallucination mitigation），但非核心焦点，给5分。涉及多步推理（multi-step reasoning）评估，给5分。其他关键词如MoE、量化、RAG等未在摘要中提及，给0分。

随着大语言模型从静态聊天机器人演变为自主智能体，其主要脆弱性已从最终输出转向中间执行轨迹。尽管针对自然语言响应的安全护栏已有成熟的基准测试，但其在多步骤工具使用轨迹中的有效性仍未被充分探索。为填补这一空白，我们推出了TraceSafe-Bench——首个专门用于评估轨迹中安全性的综合基准。该基准涵盖12个风险类别，从安全威胁（如提示词注入、隐私泄露）到操作故障（如幻觉、接口不一致），包含超过1,000个独特的执行实例。通过对13个作为护栏的大语言模型和7个专用护栏的评估，我们得出三个关键发现：1）结构瓶颈：护栏效能更多取决于结构化数据处理能力（如JSON解析），而非语义安全对齐。其性能与结构化到文本的基准测试呈现强相关性（$ρ=0.79$），但与标准越狱鲁棒性几乎无关联。2）架构优于规模：模型架构对风险检测性能的影响显著大于模型规模，通用大语言模型在轨迹分析中始终优于专用安全护栏。3）时间稳定性：准确性在长轨迹中保持稳健。执行步骤的增加使模型能够从静态工具定义转向动态执行行为，反而提升了后期阶段的风险检测性能。我们的研究表明，保障智能体工作流程的安全需要联合优化结构化推理与安全对齐，以有效缓解轨迹中的风险。

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural language responses, their efficacy remains largely unexplored within multi-step tool-use trajectories. To address this gap, we introduce TraceSafe-Bench, the first comprehensive benchmark specifically designed to assess mid-trajectory safety. It encompasses 12 risk categories, ranging from security threats (e.g., prompt injection, privacy leaks) to operational failures (e.g., hallucinations, interface inconsistencies), featuring over 1,000 unique execution instances. Our evaluation of 13 LLM-as-a-guard models and 7 specialized guardrails yields three critical findings: 1) Structural Bottleneck: Guardrail efficacy is driven more by structural data competence (e.g., JSON parsing) than semantic safety alignment. Performance correlates strongly with structured-to-text benchmarks ($ρ=0.79$) but shows near-zero correlation with standard jailbreak robustness. 2) Architecture over Scale: Model architecture influences risk detection performance more significantly than model size, with general-purpose LLMs consistently outperforming specialized safety guardrails in trajectory analysis. 3) Temporal Stability: Accuracy remains resilient across extended trajectories. Increased execution steps allow models to pivot from static tool definitions to dynamic execution behaviors, actually improving risk detection performance in later stages. Our findings suggest that securing agentic workflows requires jointly optimizing for structural reasoning and safety alignment to effectively mitigate mid-trajectory risks.

评分理由: 论文提出TurboAgent，一个LLM驱动的自主多智能体框架，用于涡轮机械气动设计。核心是LLM作为任务规划和协调中心，结合多个专门智能体（生成设计、性能预测、优化、验证）。因此，与"Large Language Models”、“LLM Agents”、“Multi-agent Systems"高度相关（10分）。LLM协调专门智能体执行任务，与"Tool Use"有一定关联（5分）。应用领域是工程科学（涡轮机械设计），属于"AI for Science"范畴（10分）。其他关键词（如MoE、SFT、RAG、量化等）未在摘要中提及，与论文技术内容无关（0分）。

涡轮机械的气动设计是一个复杂且紧密耦合的多阶段过程，涉及几何生成、性能预测、优化和高保真物理验证。现有的智能设计方法通常侧重于单个阶段或依赖于松散耦合的流水线，这使得实现完全自主的端到端设计具有挑战性。为解决这一问题，本研究提出了TurboAgent，一个由大语言模型驱动、用于涡轮机械气动设计与优化的自主多智能体框架。该框架以大语言模型作为任务规划与协调的核心，同时由专门化的智能体负责生成式设计、快速性能预测、多目标优化以及基于物理的验证。该框架将传统的试错式设计转变为数据驱动的协同工作流，并保留高保真仿真用于最终验证。

研究采用一个跨音速单转子压气机进行验证。结果表明，目标性能、生成的设计与计算流体动力学仿真结果高度吻合。质量流量、总压比和等熵效率的决定系数均超过0.91，归一化均方根误差值低于8%。优化智能体进一步将等熵效率提升了1.61%，总压比提升了3.02%。在并行计算环境下，完整工作流可在约30分钟内执行完毕。

这些结果证明，TurboAgent能够实现从自然语言需求到最终设计生成的自主闭环设计流程，为涡轮机械气动设计提供了一种高效且可扩展的范式。

The aerodynamic design of turbomachinery is a complex and tightly coupled multi-stage process involving geometry generation, performance prediction, optimization, and high-fidelity physical validation. Existing intelligent design approaches typically focus on individual stages or rely on loosely coupled pipelines, making fully autonomous end-to-end design challenging.To address this issue, this study proposes TurboAgent, a large language model (LLM)-driven autonomous multi-agent framework for turbomachinery aerodynamic design and optimization. The LLM serves as the core for task planning and coordination, while specialized agents handle generative design, rapid performance prediction, multi-objective optimization, and physics-based validation. The framework transforms traditional trial-and-error design into a data-driven collaborative workflow, with high-fidelity simulations retained for final verification.A transonic single-rotor compressor is used for validation. The results show strong agreement between target performance, generated designs, and CFD simulations. The coefficients of determination (R2) for mass flow rate, total pressure ratio, and isentropic efficiency all exceed 0.91, with normalized RMSE values below 8%. The optimization agent further improves isentropic efficiency by 1.61% and total pressure ratio by 3.02%. The complete workflow can be executed within approximately 30 minutes under parallel computing. These results demonstrate that TurboAgent enables an autonomous closed-loop design process from natural language requirements to final design generation, providing an efficient and scalable paradigm for turbomachinery aerodynamic design

评分理由: 论文提出ReDAct框架，核心研究LLM Agents在顺序决策中的幻觉问题，通过结合小型和大型LLM，基于不确定性阈值进行决策延迟，以平衡成本与性能。因此，与"Large Language Models”、“Small Language Models”、“LLM Agents"和"Hallucination Mitigation"高度相关（10分），因为这些是论文的核心内容。与"Speculative Decoding"有一定关联（5分），因为论文涉及推理成本优化，但未直接讨论解码加速技术。其他关键词如MoE、Scaling Laws、Pre-training等未在论文中涉及，得0分。

近年来，基于大语言模型（LLM）的智能体在众多应用场景中日益普及，包括复杂的序列决策问题。然而，它们也继承了大语言模型容易产生幻觉的倾向，从而导致错误决策。在序列化环境中，即使单个错误也可能不可逆转地破坏任务轨迹，使得幻觉问题更为突出。尽管规模更大的大语言模型幻觉更少，但其每词元（per-token）计算成本显著更高。本文通过提出ReDAct（推理-延迟-执行）框架来解决这一权衡问题。在ReDAct中，智能体配备了两个大语言模型：一个默认使用的小型廉价模型，以及一个更可靠但昂贵的大型模型。当小型模型的预测不确定性超过校准阈值时，决策将被延迟交由大型模型处理。我们在ALFWorld和MiniGrid等基于文本的具身环境中评估了该方法，结果表明：仅将约15%的决策延迟交由大型模型处理，即可达到完全使用大型模型的质量水平，同时显著降低推理成本。

Recently, LLM-based agents have become increasingly popular across many applications, including complex sequential decision-making problems. However, they inherit the tendency of LLMs to hallucinate, leading to incorrect decisions. In sequential settings, even a single mistake can irreversibly degrade the trajectory, making hallucinations an even bigger problem. Although larger LLMs hallucinate less, they incur a significantly higher per-token cost. In this paper, we address this tradeoff by proposing ReDAct (Reason-Defer-Act). In ReDAct, an agent is equipped with two LLMs: a small, cheap model used by default, and a large, more reliable but expensive model. When the predictive uncertainty of the small model exceeds a calibrated threshold, the decision is deferred to the large model. We evaluate our approach in text-based embodied environments such as ALFWorld and MiniGrid and show that deferring only about 15% of decisions to the large model can match the quality of using it exclusively, while significantly reducing inference costs.

评分理由: 论文研究Vision-Language Models（VLMs）的推理一致性和自省能力，与LLMs相关（5分），涉及推理过程（Chain of Thought/System 2 Thinking各5分）、自省与校准（Self-Correction 8分）、事实性与幻觉缓解（Hallucination Mitigation 8分）、可解释性（Mechanistic Interpretability 8分）和世界知识先验（World Models 5分）。其他关键词如MoE、训练技术、压缩、代理等未涉及（0分）。

理解视觉-语言模型（VLMs）何时会出现意外行为、模型能否可靠预测自身行为，以及模型是否遵循其内省推理过程，是实现可信部署的核心挑战。为研究这些问题，我们引入了分级颜色归因（Graded Color Attribution, GCA）数据集——一个旨在激发决策规则并评估参与者对这些规则遵循程度的受控基准。GCA包含三种条件下像素级颜色覆盖度各异的线条图：基于世界知识的重新着色、反事实重新着色，以及无颜色先验的形状。通过GCA，视觉-语言模型与人类参与者均会建立一个阈值：物体必须包含特定颜色像素的最小百分比才能获得该颜色标签。随后我们将这些规则与它们后续的颜色归因决策进行比较。研究发现表明，模型会系统性违背其自身的内省规则。例如，在具有强颜色先验的物体上，GPT-5-mini在近60%的情况下违反了其声明的内省规则。人类参与者则始终遵循其声明的规则，任何表面上的违规行为均可通过一种有充分记录的倾向——即高估颜色覆盖度——来解释。相比之下，我们发现视觉-语言模型能出色地估计颜色覆盖度，却在最终响应中公然违背自身的推理过程。在所有模型及激发内省规则的策略中，世界知识先验会系统性降低遵循程度，且这种降低方式并不反映人类认知模式。我们的研究结果挑战了“视觉-语言模型推理失败源于任务难度”的观点，表明视觉-语言模型的内省自我认知存在校准偏差，这对高风险场景下的部署具有直接启示。

Understanding when Vision-Language Models (VLMs) will behave unexpectedly, whether models can reliably predict their own behavior, and if models adhere to their introspective reasoning are central challenges for trustworthy deployment. To study this, we introduce the Graded Color Attribution (GCA) dataset, a controlled benchmark designed to elicit decision rules and evaluate participant faithfulness to these rules. GCA consists of line drawings that vary pixel-level color coverage across three conditions: world-knowledge recolorings, counterfactual recolorings, and shapes with no color priors. Using GCA, both VLMs and human participants establish a threshold: the minimum percentage of pixels of a given color an object must have to receive that color label. We then compare these rules with their subsequent color attribution decisions. Our findings reveal that models systematically violate their own introspective rules. For example, GPT-5-mini violates its stated introspection rules in nearly 60% of cases on objects with strong color priors. Human participants remain faithful to their stated rules, with any apparent violations being explained by a well-documented tendency to overestimate color coverage. In contrast, we find that VLMs are excellent estimators of color coverage, yet blatantly contradict their own reasoning in their final responses. Across all models and strategies for eliciting introspective rules, world-knowledge priors systematically degrade faithfulness in ways that do not mirror human cognition. Our findings challenge the view that VLM reasoning failures are difficulty-driven and suggest that VLM introspective self-knowledge is miscalibrated, with direct implications for high-stakes deployment.

评分理由: 论文核心研究稀疏混合专家模型（MoE）的剪枝方法，与"Mixture of Experts"高度相关（15分），直接涉及LLM效率问题（10分）。论文提到"Empirical scaling laws”，与"Scaling Laws"相关（8分）。剪枝属于模型压缩范畴，与"Quantization"相关（8分）。其他关键词如SLMs、训练方法、推理技术、对齐、RAG、代理等均未涉及，得0分。

语言模型的实证缩放定律推动了大型语言模型（LLM）规模的持续扩大，尽管其计算和内存成本不断增长。稀疏专家混合模型（Sparse Mixture-of-Experts, MoE）提供了一种前景广阔的替代方案，它仅在每次前向传播中激活一部分专家，从而在不牺牲性能的前提下提升了效率。然而，大量的专家参数仍导致显著的内存消耗。

现有的剪枝方法通常在各层间均匀分配预算，忽视了稀疏MoE中产生的异构冗余。我们提出了GRAPE（面向专家的全局冗余感知剪枝），这是一种全局剪枝策略，能够基于跨层冗余动态分配剪枝预算。在Mixtral-8x7B、Mixtral-8x22B、DeepSeek-MoE、Qwen-MoE和GPT-OSS上的实验表明，在相同剪枝预算下，GRAPE始终能取得最佳的平均性能。在论文报告的三个主要模型上，相较于最强的局部基线方法，GRAPE在不同剪枝设置下的平均准确率平均提升了1.40%，最高提升可达2.45%。

Empirical scaling laws for language models have encouraged the development of ever-larger LLMs, despite their growing computational and memory costs. Sparse Mixture-of-Experts (MoEs) offer a promising alternative by activating only a subset of experts per forward pass, improving efficiency without sacrificing performance. However, the large number of expert parameters still leads to substantial memory consumption. Existing pruning methods typically allocate budgets uniformly across layers, overlooking the heterogeneous redundancy that arises in sparse MoEs. We propose GRAPE (Global Redundancy-Aware Pruning of Experts, a global pruning strategy that dynamically allocates pruning budgets based on cross-layer redundancy. Experiments on Mixtral-8x7B, Mixtral-8x22B, DeepSeek-MoE, Qwen-MoE, and GPT-OSS show that, under the same pruning budget, GRAPE consistently achieves the best average performance. On the three main models reported in the paper, it improves average accuracy over the strongest local baseline by 1.40% on average across pruning settings, with gains of up to 2.45%.

评分理由: 论文核心研究检索增强生成（RAG）在医学问答中的应用，因此与"Retrieval-Augmented Generation"高度相关（15分）。论文明确使用LLMs进行医学问答，与"Large Language Models"高度相关（10分）。研究属于AI在科学（医学）领域的应用，与"AI for Science"高度相关（10分）。论文提到RAG用于解决知识差距和事实基础问题，间接涉及幻觉缓解，因此与"Hallucination Mitigation"有一定关联（5分）。其他关键词如MoE、SLMs、训练技术、推理方法、代理系统等均未在摘要中提及，完全无关（0分）。

大语言模型（LLM）在医学问答任务中展现出强大能力；然而，纯参数化模型常受限于知识缺口与事实依据不足。检索增强生成（RAG）通过将外部知识检索整合至推理过程，有效应对了这一局限。尽管基于RAG的医学系统日益受到关注，但各检索组件对系统性能的具体影响仍未得到充分理解。本研究基于MedQA USMLE基准与结构化教科书知识库，对检索增强型医学问答进行了系统性评估。我们在包含四十种配置的统一实验框架内，分析了语言模型、嵌入模型、检索策略、查询重构与交叉编码器重排序之间的交互作用。结果表明，检索增强显著提升了零样本医学问答性能。最佳配置方案——结合查询重构与重排序的稠密检索——实现了60.49%的准确率。研究还发现，领域专用语言模型比通用模型能更有效地利用检索到的医学证据。进一步分析揭示了检索效能与计算成本间的明确权衡：较简单的稠密检索配置在保持高吞吐量的同时，仍能提供强劲性能。所有实验均在单张消费级GPU上完成，证明检索增强型医学问答系统的系统性评估可在适度计算资源下实现。

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG) addresses this limitation by integrating external knowledge retrieval into the reasoning process. Despite increasing interest in RAG-based medical systems, the impact of individual retrieval components on performance remains insufficiently understood. This study presents a systematic evaluation of retrieval-augmented medical question answering using the MedQA USMLE benchmark and a structured textbook-based knowledge corpus. We analyze the interaction between language models, embedding models, retrieval strategies, query reformulation, and cross-encoder reranking within a unified experimental framework comprising forty configurations. Results show that retrieval augmentation significantly improves zero-shot medical question answering performance. The best-performing configuration was dense retrieval with query reformulation and reranking achieved 60.49% accuracy. Domain-specialized language models were also found to better utilize retrieved medical evidence than general-purpose models. The analysis further reveals a clear tradeoff between retrieval effectiveness and computational cost, with simpler dense retrieval configurations providing strong performance while maintaining higher throughput. All experiments were conducted on a single consumer-grade GPU, demonstrating that systematic evaluation of retrieval-augmented medical QA systems can be performed under modest computational resources.

评分理由: 论文核心研究大语言模型（Qwen3.5-4B-Base）的表示几何特性，包括Voronoi镶嵌、表达性差距的线性缩放定律验证，以及通过边缘优化程序进行几何重组。因此，与"Large Language Models"和"Scaling Laws"高度相关（10分）。研究涉及模型内部表示和几何结构的分析，与"Mechanistic Interpretability"高度相关（10分）。论文提到bfloat16量化伪影，与"Quantization"有一定关联（5分）。研究涉及模型内部表示与最终输出的对齐，与"Alignment"有一定关联（5分）。其他关键词如MoE、SLMs、训练方法、推理加速、AI for Science等均未在摘要中涉及，评为0分。

语言模型在离散的标记上操作，但在连续的向量空间中计算，从而在表示流形上诱导出沃罗诺伊镶嵌结构。本研究基于Qwen3.5-4B-Base模型对此镶嵌结构进行了实证分析，并做出两项贡献。首先，通过采用float32边界重计算以消除bfloat16量化伪影，我们验证了Mabrok（2026）提出的表达能力间隙线性缩放定律（$R^2$ = 0.9997），这是迄今为止最强有力的证实；同时，我们发现了一个中间层的几何模糊区域（第24-28层，$ρ$ = -0.29），其中边界几何结构与交叉熵呈负相关，直至最终层才结晶为对齐状态（$ρ$ = 0.836）。

其次，我们证明收敛模型的沃罗诺伊镶嵌结构可通过边界优化程序进行重塑：这是一种无需重新训练的简短事后优化过程，旨在拓宽标记决策边界。我们在剂量反应扫描中比较了直接边界最大化与费舍尔信息距离最大化两种方法。两种方法均发现，在每评估256K个位置中，可修正位置的上限约为16,300个，但其关键差异在于附带损害。边界最大化的损害随干预强度增加而加剧，直至修正效果被淹没；而费舍尔方法在验证范围（$λ$ = 0.15-0.6）内损害保持恒定（约5,300个位置），在$λ$ = 0.6时实现中值边界提升+28%，且下游基准测试结果保持不变——这是一种压缩表达能力间隙同时保留其缩放定律的几何重组。然而，频率与标记类别审计显示，增益集中于高频结构标记（$λ$ = 0.6时净修正量的84%），而内容类及实体类标记的贡献随$λ$升高而缩减。因此，费舍尔边界优化程序是一种可行的几何精修工具，其实际上限并非由总体损害决定，而是取决于标记级收益的均匀性。

Language models operate on discrete tokens but compute in continuous vector spaces, inducing a Voronoi tessellation over the representation manifold. We study this tessellation empirically on Qwen3.5-4B-Base, making two contributions. First, using float32 margin recomputation to resolve bfloat16 quantization artifacts, we validate Mabrok’s (2026) linear scaling law of the expressibility gap with $R^2$ = 0.9997 - the strongest confirmation to date - and identify a mid-layer geometric ambiguity regime where margin geometry is anti-correlated with cross-entropy (layers 24-28, $ρ$ = -0.29) before crystallizing into alignment at the final layer ($ρ$ = 0.836). Second, we show that the Voronoi tessellation of a converged model is reshapable through margin refinement procedures (MRP): short post-hoc optimization runs that widen token-decision margins without retraining. We compare direct margin maximization against Fisher information distance maximization across a dose-response sweep. Both methods find the same ceiling of ~16,300 correctable positions per 256K evaluated, but differ critically in collateral damage. Margin maximization damage escalates with intervention strength until corrections are overwhelmed. Fisher damage remains constant at ~5,300 positions across the validated range ($λ$ = 0.15-0.6), achieving +28% median margin improvement at $λ$ = 0.6 with invariant downstream benchmarks - a geometric reorganization that compresses the expressibility gap while preserving its scaling law. However, frequency and token-class audits reveal that gains concentrate in high-frequency structural tokens (84% of net corrections at $λ$ = 0.6), with content and entity-like contributions shrinking at higher $λ$. Fisher MRP is therefore a viable geometric polishing tool whose practical ceiling is set not by aggregate damage but by the uniformity of token-level benefit.

评分理由: 论文核心研究LLMs长上下文推理中的KV缓存压缩问题，与"Large Language Models"、“Context Window Extension”、“KV Cache Compression"高度相关（10分）。论文提出StructKV框架，属于模型压缩和推理加速技术，与"Quantization”、“Speculative Decoding"有一定关联（5分）。其他关键词如MoE、SFT、RAG、AI for Science等未在论文中涉及，得0分。

随着大语言模型（LLM）扩展至支持超过百万令牌的上下文窗口，键值（KV）缓存的线性增长带来了严重的内存容量与带宽瓶颈，制约了长上下文推理的效率。现有的压缩方法通常基于局部显著性度量对令牌进行优先级排序，以将预填充计算与解码内存解耦。然而，这些方法往往依赖于特定网络层的局部显著性快照，从而系统性地丢弃了那些在整个网络深度中充当全局信息枢纽、但在选定进行剪枝的特定层上暂时处于休眠状态的令牌。为解决这一局限，我们提出了StructKV，一种结构感知的KV缓存压缩框架，其引入了三项核心创新：首先，全局入度中心性通过聚合网络深度上的注意力模式来识别全局信息枢纽。其次，动态枢纽检测利用信息论度量自适应地定位最佳压缩层。最后，结构传播与解耦将计算预算与内存存储预算分离。在LongBench和RULER基准测试上的实验结果表明，StructKV能有效保持长程依赖性与检索鲁棒性。

As Large Language Models (LLMs) scale to support context windows exceeding one million tokens, the linear growth of Key-Value (KV) cache imposes severe memory capacity and bandwidth bottlenecks, constraining the efficiency of long-context inference. Existing compression approaches typically prioritize tokens based on local saliency metrics to decouple prefill computation from decoding memory. However, these methods often rely on local saliency snapshots at a specific layer, thereby systematically discarding tokens that act as global information hubs across the network depth but appear temporarily dormant at the specific layer selected for pruning. To address this limitation, we propose StructKV, a structure-aware KV cache compression framework that introduces three core innovations: First, Global In-Degree Centrality aggregates attention patterns across the network depth to identify global information hubs. Second, Dynamic Pivot Detection utilizes information-theoretic metrics to adaptively locate the optimal layer for compression. Finally, Structural Propagation and Decoupling separates the computational budget from the memory storage budget. Experimental results on the LongBench and RULER benchmarks demonstrate that StructKV effectively preserves long-range dependencies and retrieval robustness.

评分理由: 论文提出COMLLM框架，将LLMs应用于移动边缘计算（MEC）中的任务卸载决策。核心相关性体现在：1）明确使用LLMs（高度相关）；2）采用Supervised Fine-Tuning（SFT）作为基线方法（高度相关）；3）提出多步蒙特卡洛推演（Monte Carlo rollouts）进行前瞻决策，与"Monte Carlo Tree Search”（MCTS）概念高度相关；4）框架实现多步推理，与"Chain of Thought"（CoT）高度相关。其他关键词如MoE、SLMs、Scaling Laws、RAG等未在摘要中提及或与论文主题无关。

新兴计算密集型应用对资源受限的移动设备提出了严格的延迟要求。移动边缘计算（Mobile Edge Computing, MEC）通过任务卸载应对这一挑战。然而，由于动态任务到达、时变信道以及服务器队列的时空耦合特性，设计高效策略仍然困难。传统启发式方法缺乏适应性，而深度强化学习（Deep Reinforcement Learning, DRL）存在泛化能力有限和架构僵化的问题，当网络拓扑变化时需要重新训练。尽管大语言模型（Large Language Models, LLMs）具备语义推理能力，但标准的监督微调（Supervised Fine-Tuning, SFT）会产生短视策略，仅贪婪地最小化即时延迟，而未考虑系统的长期演化。为克服这些局限，我们提出了COMLLM，一个支持在MEC系统中进行前瞻性决策的生成式框架。COMLLM将组相对策略优化（Group Relative Policy Optimization, GRPO）与前瞻协同仿真（Look-Ahead Collaborative Simulation, LACS）机制相结合，该机制在执行多步蒙特卡洛推演的同时联合建模服务器队列动态。通过将这些推演纳入奖励设计，框架能够捕捉当前决策对未来系统状态的长期影响。实验结果表明，COMLLM实现了接近最优的延迟并提升了负载均衡的公平性。值得注意的是，该框架展现出零样本拓扑可扩展性，使得在小型网络上训练的模型能够无需重新训练即可泛化到更大、未见过的拓扑结构，其性能优于SFT、DRL及启发式基线方法。

Emerging computation-intensive applications impose stringent latency requirements on resource-constrained mobile devices. Mobile Edge Computing (MEC) addresses this challenge through task offloading. However, designing effective policies remains difficult due to dynamic task arrivals, time-varying channels, and the spatio-temporal coupling of server queues. Conventional heuristics lack adaptability, while Deep Reinforcement Learning (DRL) suffers from limited generalization and architectural rigidity, requiring retraining when network topology changes. Although Large Language Models (LLMs) offer semantic reasoning capabilities, standard Supervised Fine-Tuning (SFT) yields myopic policies that greedily minimize immediate latency without accounting for long-term system evolution. To address these limitations, we propose COMLLM, a generative framework that enables foresighted decision-making in MEC systems. COMLLM integrates Group Relative Policy Optimization (GRPO) with a Look-Ahead Collaborative Simulation (LACS) mechanism, which performs multi-step Monte Carlo rollouts while jointly modeling server queue dynamics. By incorporating these rollouts into the reward design, the framework captures the long-term impact of current decisions on future system states. Experimental results demonstrate that COMLLM achieves near-optimal latency and improved load-balancing fairness. Notably, it exhibits zero-shot topological scalability, allowing a model trained on small-scale networks to generalize to larger, unseen topologies without retraining, outperforming SFT, DRL, and heuristic baselines.

评分理由: 论文核心研究LoRA（参数高效微调）在大型语言模型（LLMs）上的应用，用于自动化测试用例生成。因此，与"PEFT/LoRA"高度相关（15分），与"LLMs"和"Supervised Fine-tuning"直接相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、RAG、RLHF等未在论文中涉及，得0分。

基于自然语言需求自动生成测试用例仍是软件工程中的一个挑战性问题，这源于需求的模糊性以及需要生成结构化、可执行的测试制品。大语言模型的最新进展为解决该任务带来了希望；然而，其有效性取决于针对特定任务的适应性和高效的微调策略。本文对使用参数高效微调方法（特别是LoRA）进行基于需求的测试用例生成展开了全面的实证研究。我们在统一的实验流程下评估了包括开源模型和专有模型在内的多个大语言模型家族。该研究系统性地探讨了LoRA关键超参数（包括秩、缩放因子和丢弃率）对下游性能的影响。我们提出了一个基于GPT-4o的自动化评估框架，从九个质量维度对生成的测试用例进行评估。实验结果表明，基于LoRA的微调显著提升了所有开源模型的性能，其中Ministral-8B模型取得了最佳效果。此外，我们发现经过微调的8B开源模型可以达到与未经微调的GPT-4.1模型相当的性能，这凸显了参数高效适应方法的有效性。虽然GPT-4.1模型取得了最高的整体性能，但微调后专有模型与开源模型之间的性能差距显著缩小。这些发现为自动化测试生成的模型选择、微调策略和评估方法提供了重要见解。特别地，研究证明，结合精心设计的微调方法，具有成本效益、可本地部署的开源模型能够成为专有系统的可行替代方案。

Automated test case generation from natural language requirements remains a challenging problem in software engineering due to the ambiguity of requirements and the need to produce structured, executable test artifacts. Recent advances in LLMs have shown promise in addressing this task; however, their effectiveness depends on task-specific adaptation and efficient fine-tuning strategies. In this paper, we present a comprehensive empirical study on the use of parameter-efficient fine-tuning, specifically LoRA, for requirement-based test case generation. We evaluate multiple LLM families, including open-source and proprietary models, under a unified experimental pipeline. The study systematically explores the impact of key LoRA hyperparameters, including rank, scaling factor, and dropout, on downstream performance. We propose an automated evaluation framework based on GPT-4o, which assesses generated test cases across nine quality dimensions. Experimental results demonstrate that LoRA-based fine-tuning significantly improves the performance of all open-source models, with Ministral-8B achieving the best results among them. Furthermore, we show that a fine-tuned 8B open-source model can achieve performance comparable to pre-fine-tuned GPT-4.1 models, highlighting the effectiveness of parameter-efficient adaptation. While GPT-4.1 models achieve the highest overall performance, the performance gap between proprietary and open-source models is substantially reduced after fine-tuning. These findings provide important insights into model selection, fine-tuning strategies, and evaluation methods for automated test generation. In particular, they demonstrate that cost-efficient, locally deployable open-source models can serve as viable alternatives to proprietary systems when combined with well-designed fine-tuning approaches.

评分理由: 论文核心是LLM在网络安全领域的应用，明确提到使用LLM驱动安全培训，因此"Large Language Models"得10分。使用量化Phi-4模型，与"Quantization"高度相关得10分。模型针对网络安全领域微调，与"Pre-training"和"Post-training"有一定关联各得5分。使用量化模型在普通硬件上部署，与"Small Language Models"有一定关联得5分。其他关键词如MoE、Scaling Laws、RAG、RLHF等未涉及得0分。

网络安全领域面临两大相互关联的挑战：全球范围内合格从业人员的短缺，以及持续存在的人为因素弱点——后者是大多数安全事件的主要原因。为应对这些问题，我们提出了SentinelSphere，这是一个由人工智能驱动的平台，它将基于机器学习的威胁识别与大型语言模型（LLM）驱动的安全培训相结合。其检测模块采用一个增强型深度神经网络（DNN），该网络在CIC-IDS2017和CIC-DDoS2019基准数据集上训练，并辅以新颖的HTTP层特征工程，以捕捉应用层攻击特征。在教育组件方面，我们部署了Phi-4模型的量化变体（Q4_K_M），该模型针对网络安全领域进行了微调，使其能够在仅需16 GB RAM、无需专用GPU资源的商用硬件上部署。实验结果表明，相较于基线模型，增强型DNN在保持高检测准确率的同时，显著降低了误报率，并且在DDoS、暴力破解及基于网络的漏洞利用等关键攻击类别上保持了强大的召回率。涉及行业专业人士和大学生的验证研讨会证实，其“交通灯”可视化系统和对话式AI助手对于非技术背景用户而言既直观又有效。SentinelSphere表明，将智能威胁检测与自适应的、LLM驱动的安全教育相结合，能够在一个统一、连贯的框架内有意义地应对技术和人为因素两方面的网络安全漏洞。

The field of cybersecurity is confronted with two interrelated challenges: a worldwide deficit of qualified practitioners and ongoing human-factor weaknesses that account for the bulk of security incidents. To tackle these issues, we present SentinelSphere, a platform driven by artificial intelligence that unifies machine learning-based threat identification with security training powered by a Large Language Model (LLM). The detection module uses an Enhanced Deep Neural Network (DNN) trained on the CIC-IDS2017 and CIC-DDoS2019 benchmark datasets, enriched with novel HTTP-layer feature engineering that captures application level attack signatures. For the educational component, we deploy a quantised variant of Phi-4 model (Q4_K_M), fine-tuned for the cybersecurity domain, enabling deployment on commodity hardware requiring only 16 GB of RAM without dedicated GPU resources. Experimental results show that the Enhanced DNN attains high detection accuracy while substantially lowering false positives relative to baseline models, and maintains strong recall across critical attack categories such as DDoS, brute force, and web-based exploits. Validation workshops involving industry professionals and university students confirmed that the Traffic Light visualisation system and conversational AI assistant are both intuitive and effective for users without technical backgrounds. SentinelSphere illustrates that coupling intelligent threat detection with adaptive, LLM-driven security education can meaningfully address both technical and human-factor cybersecurity vulnerabilities within a single, cohesive framework.

评分理由: 论文核心研究LLM生成虚假信息的风险评估，直接涉及LLM关键词（10分）。研究评估LLM作为评估代理与人类读者的一致性，与"Alignment"（5分）和"Explainable AI"（5分）相关。研究虚假信息风险与"Hallucination Mitigation"（8分）在事实性和真实性方面有间接关联。其他关键词如MoE、Scaling Laws、RLHF、RAG等均未在论文中涉及，得0分。

大型语言模型（LLM）能够大规模生成具有说服力的叙事，这引发了人们对其可能被用于虚假信息活动的担忧。评估这一风险最终需要理解读者如何接收此类内容。然而在实践中，LLM评判者正日益被用作直接人类评估的低成本替代品，尽管它们是否能够忠实反映读者反应尚不明确。我们将此情境下的评估重新界定为代理效度问题，并依据人类读者反应对LLM评判者进行审计。通过使用290篇校准文章、2,043组配对的人类评分以及八个前沿评判模型的输出，我们从整体评分、项目级排序和信号依赖性三个方面检验了评判者与人类的一致性。我们发现评判者与人类之间存在持续性的差距。相较于人类，评判者通常更为严苛，仅能微弱地复现项目级的人类排序，并且依赖不同的文本信号——更注重逻辑严谨性，同时对情感强度给予更强的负面评价。与此同时，评判者彼此之间的共识度远高于其与人类读者的共识度。这些结果表明，LLM评判者形成了一个内部高度一致的评价群体，其内部一致性远高于其与人类读者的一致性，这表明内部共识并不能作为其作为读者反应代理的有效性证据。

Large language models (LLMs) can generate persuasive narratives at scale, raising concerns about their potential use in disinformation campaigns. Assessing this risk ultimately requires understanding how readers receive such content. In practice, however, LLM judges are increasingly used as a low-cost substitute for direct human evaluation, even though whether they faithfully track reader responses remains unclear. We recast evaluation in this setting as a proxy-validity problem and audit LLM judges against human reader responses. Using 290 aligned articles, 2,043 paired human ratings, and outputs from eight frontier judges, we examine judge–human alignment in terms of overall scoring, item-level ordering, and signal dependence. We find persistent judge–human gaps throughout. Relative to humans, judges are typically harsher, recover item-level human rankings only weakly, and rely on different textual signals, placing more weight on logical rigour while penalizing emotional intensity more strongly. At the same time, judges agree far more with one another than with human readers. These results suggest that LLM judges form a coherent evaluative group that is much more aligned internally than it is with human readers, indicating that internal agreement is not evidence of validity as a proxy for reader response.

评分理由: 论文核心研究奖励模型（RMs）在个性化对齐评估中的表现，与LLMs和Alignment高度相关（核心内容，10分），与RLHF相关（论文提到PPO和奖励模型评估，有一定关联，8分），其他关键词未涉及（0分）。

多元对齐已成为大型语言模型发展的关键前沿领域，其中奖励模型作为捕捉多样化人类价值观的核心机制。尽管针对通用响应质量的基准测试已较为普遍，但如何评估奖励模型对个体用户偏好的建模能力仍是一个开放挑战。为填补这一空白，我们提出了个性化奖励基准——一种旨在严格评估奖励模型建模个性化偏好能力的新型基准。我们基于对用户特定准则的严格遵守（或违反）构建了优选与拒选响应配对，确保偏好区分完全针对个体量身定制。特别值得注意的是，人工评估证实配对间的主要区分因素严格限于个人偏好，且两种响应均保持较高的通用质量（如正确性、相关性和帮助性）。广泛测试表明，现有最先进的奖励模型在个性化任务上表现显著不足，最高准确率仅为75.94%。关键的是，由于有效的奖励模型基准应能预测其在下游任务中的表现，我们通过实验证明：与现有基线相比，该基准在最佳N采样和近端策略优化两种下游任务中，与奖励模型性能的相关性均显著更高。这些发现确立了个性化奖励基准作为评估奖励模型下游应用性能的稳健且精确的代理标准。

Pluralistic alignment has emerged as a critical frontier in the development of Large Language Models (LLMs), with reward models (RMs) serving as a central mechanism for capturing diverse human values. While benchmarks for general response quality are prevalent, evaluating how well reward models account for individual user preferences remains an open challenge. To bridge this gap, we introduce Personalized RewardBench, a novel benchmark designed to rigorously assess reward models’ capacity to model personalized preferences. We construct chosen and rejected response pairs based on strict adherence to (or violation of) user-specific rubrics, ensuring that preference distinctions are uniquely tailored to the individual. In particular, human evaluations confirm that the primary discriminative factor between pairs is strictly personal preference, with both responses maintaining high general quality (e.g., correctness, relevance and helpfulness). Extensive testing reveals that existing state-of-the-art reward models struggle significantly with personalization, peaking at an accuracy of just 75.94%. Crucially, because an effective reward model benchmark should predict a reward model’s performance on downstream tasks, we conduct experiments demonstrating that our benchmark exhibits a significantly higher correlation with downstream performance in both Best-of-N (BoN) sampling and Proximal Policy Optimization (PPO) compared to existing baselines. These findings establish Personalized RewardBench as a robust and accurate proxy for evaluating reward models’ performance in downstream applications.

评分理由: 论文Argus提出了一种基于LLM的多智能体框架，用于静态应用安全测试中的漏洞检测。核心相关关键词包括：LLMs（论文明确使用LLMs进行漏洞检测）、RAG（集成RAG技术减少幻觉）、LLM Agents/Multi-agent Systems（首个专门用于漏洞检测的多智能体框架）、Hallucination Mitigation（旨在减少幻觉和误报）。Chain of Thought/System 2 Thinking/Tool Use有一定关联，因为框架涉及推理深度和工具集成。其他关键词如MoE、SLMs、训练方法、模型压缩等未在摘要中提及，与论文内容无关。

近期，大型语言模型（LLM）的进展引发了其在静态应用安全测试（SAST）中应用的广泛关注，这主要归因于其相较于传统符号化或基于规则的方法具有更优越的上下文推理能力。然而，现有的基于LLM的方法通常试图直接替代人类专家，而未与现有SAST工具进行有效整合。这种整合的缺失导致了诸多缺陷，包括高误报率、幻觉问题、有限的推理深度以及过高的令牌使用量，使其难以在工业场景中实际部署。为克服这些局限，我们提出了一种范式转变，将SAST工作流从当前LLM辅助的结构重新编排为一种以LLM为核心的新型工作流。我们引入了Argus（智能体化与检索增强的防护系统），这是首个专为漏洞检测设计的多智能体框架。Argus包含三项关键创新：全面的软件供应链分析、协作式多智能体工作流，以及整合了检索增强生成（RAG）和ReAct等前沿技术，以最大限度减少幻觉并增强推理能力。大量实证评估表明，Argus在检测出更多真实漏洞的同时，显著降低了误报率和运行成本，其性能明显优于现有方法。值得注意的是，Argus已成功识别出多个已分配CVE编号的关键零日漏洞。

Recent advancements in Large Language Models (LLMs) have sparked interest in their application to Static Application Security Testing (SAST), primarily due to their superior contextual reasoning capabilities compared to traditional symbolic or rule-based methods. However, existing LLM-based approaches typically attempt to replace human experts directly without integrating effectively with existing SAST tools. This lack of integration results in ineffectiveness, including high rates of false positives, hallucinations, limited reasoning depth, and excessive token usage, making them impractical for industrial deployment. To overcome these limitations, we present a paradigm shift that reorchestrates the SAST workflow from current LLM-assisted structure to a new LLM-centered workflow. We introduce Argus (Agentic and Retrieval-Augmented Guarding System), the first multi-agent framework designed specifically for vulnerability detection. Argus incorporates three key novelties: comprehensive supply chain analysis, collaborative multi-agent workflows, and the integration of state-of-the-art techniques such as Retrieval-Augmented Generation (RAG) and ReAct to minimize hallucinations and enhance reasoning. Extensive empirical evaluation demonstrates that Argus significantly outperforms existing methods by detecting a higher volume of true vulnerabilities while simultaneously reducing false positives and operational costs. Notably, Argus has identified several critical zero-day vulnerabilities with CVE assignments.

评分理由: 论文核心研究LLM在编程教育评估中的应用，特别是解决LLM生成代码但学生理解不足的问题。高度相关关键词：LLMs（论文明确使用LLMs）、LLM Agents（提出双代理对话层框架）、Hallucination Mitigation（讨论幻觉问题并设计防护措施）。中等相关关键词：Small Language Models（提及本地模型部署选项）、Chain of Thought/System 2 Thinking（涉及逐步推理和深入理解）、Multi-agent Systems（双代理架构）、Explainable AI（关注代码理解解释）。其他关键词如MoE、Scaling Laws、RLHF等与论文技术细节无关。

大型语言模型（LLM）对传统的自动化编程评估提出了挑战，因为学生现在能够生成功能正确的代码，却未必展示出相应的理解能力。本文作出两项贡献。首先，报告了一项基于饱和度的范围综述，聚焦于编程教育中的对话式评估方法。该综述识别出三种主流的架构类型：基于规则或模板驱动的系统、基于LLM的系统以及混合系统。纵观现有文献，对话智能体在提供可扩展的反馈和深入探查代码理解方面展现出潜力，但仍存在重要局限，包括幻觉问题、过度依赖、隐私安全、学术诚信以及部署限制。其次，本文将这些发现综合成一个混合苏格拉底框架，用于将对话式验证整合到自动化编程评估系统（APAS）中。该框架结合了确定性代码分析与双智能体对话层、知识追踪、支架式提问机制，以及将提示与运行时事实相绑定的防护措施。本文还讨论了针对LLM生成解释的实践性保障策略，包括监考部署模式、随机化的跟踪问题、与具体执行状态绑定的逐步推理，以及适用于隐私敏感环境的本地模型部署选项。该框架并非旨在取代传统测试，而是作为一种补充层，用于验证学生是否理解其提交的代码。

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it reports a saturation-based scoping review of conversational assessment approaches in programming education. The review identifies three dominant architectural families: rule-based or template-driven systems, LLM-based systems, and hybrid systems. Across the literature, conversational agents appear promising for scalable feedback and deeper probing of code understanding, but important limitations remain around hallucinations, over-reliance, privacy, integrity, and deployment constraints. Second, the paper synthesizes these findings into a Hybrid Socratic Framework for integrating conversational verification into Automated Programming Assessment Systems (APASs). The framework combines deterministic code analysis with a dual-agent conversational layer, knowledge tracking, scaffolded questioning, and guardrails that tie prompts to runtime facts. The paper also discusses practical safeguards against LLM-generated explanations, including proctored deployment modes, randomized trace questions, stepwise reasoning tied to concrete execution states, and local-model deployment options for privacy-sensitive settings. Rather than replacing conventional testing, the framework is intended as a complementary layer for verifying whether students understand the code they submit.

评分理由: 论文核心研究大语言模型（LLMs）在法语生物医学领域的领域自适应预训练（DAPT），与关键词1高度相关（10分）。论文明确使用DAPT进行领域适应，与关键词5高度相关（10分）。研究生物医学AI应用，与关键词27高度相关（10分）。论文提到使用中小型LLMs，与关键词3有一定关联（5分）。论文强调高质量法语生物医学文本的收集，与关键词4有一定关联（5分）。论文发现模型合并（model merging）对缓解泛化权衡至关重要，与关键词25高度相关（10分）。其他关键词如MoE、SFT、RLHF、RAG、推理方法、代理、压缩等未在摘要中提及，评为0分。

大型语言模型（LLM）已在多个领域展现出卓越能力，但其在专业领域——尤其是非英语语言环境中的适应仍具挑战性。本研究探讨了领域自适应预训练（DAPT）作为一种策略，通过持续预训练将中小型LLM专业化应用于法语生物医学领域。我们聚焦两个核心研究问题：专业化持续预训练对于领域适应的可行性，以及领域特定性能提升与通用能力退化之间的关系。本研究的贡献包括：发布一个完全开放许可、适用于商业和开源应用的法语生物医学语料库；训练并发布专业化的法语生物医学LLM；以及为DAPT实施提供新的见解。我们的方法涵盖高质量法语生物医学文本的收集与精炼、基于DAPT的因果语言建模方法探索，以及开展广泛的对比评估。与先前研究相反，我们的结果对DAPT的有效性提出了质疑，但同时指出在资源受限的小规模场景中，若条件得当，该策略仍具可行性。本文进一步发现，DAPT后的模型融合对于缓解泛化性能的权衡至关重要，在某些情况下甚至能提升DAPT所针对的专业任务表现。

Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains, yet their adaptation to specialized fields remains challenging, particularly for non-English languages. This study investigates domain-adaptive pre-training (DAPT) as a strategy for specializing small to mid-sized LLMs in the French biomedical domain through continued pre-training. We address two key research questions: the viability of specialized continued pre-training for domain adaptation and the relationship between domain-specific performance gains and general capability degradation. Our contributions include the release of a fully open-licensed French biomedical corpus suitable for commercial and open-source applications, the training and release of specialized French biomedical LLMs, and novel insights for DAPT implementation. Our methodology encompasses the collection and refinement of high-quality French biomedical texts, the exploration of causal language modeling approaches using DAPT, and conducting extensive comparative evaluations. Our results cast doubt on the efficacy of DAPT, in contrast to previous works, but we highlight its viability in smaller-scale, resource-constrained scenarios under the right conditions. Findings in this paper further suggest that model merging post-DAPT is essential to mitigate generalization trade-offs, and in some cases even improves performance on specialized tasks at which the DAPT was directed.

评分理由: 论文核心研究LLM作为自主代理在多步工具调用轨迹中的安全防护（guardrails），与"Large Language Models"、“LLM Agents”、“Tool Use"高度相关（10分）。涉及安全对齐（alignment）和幻觉缓解（hallucination mitigation），但非核心焦点，给5分。涉及多步推理（multi-step reasoning）评估，给5分。其他关键词如MoE、量化、RAG等未在摘要中提及，给0分。

随着大语言模型从静态聊天机器人演变为自主智能体，其主要脆弱性已从最终输出转向中间执行轨迹。尽管针对自然语言响应的安全护栏已有成熟的基准测试，但其在多步骤工具使用轨迹中的有效性仍未被充分探索。为填补这一空白，我们推出了TraceSafe-Bench——首个专门用于评估轨迹中安全性的综合基准。该基准涵盖12个风险类别，从安全威胁（如提示词注入、隐私泄露）到操作故障（如幻觉、接口不一致），包含超过1,000个独特的执行实例。通过对13个作为护栏的大语言模型和7个专用护栏的评估，我们得出三个关键发现：1）结构瓶颈：护栏效能更多取决于结构化数据处理能力（如JSON解析），而非语义安全对齐。其性能与结构化到文本的基准测试呈现强相关性（$ρ=0.79$），但与标准越狱鲁棒性几乎无关联。2）架构优于规模：模型架构对风险检测性能的影响显著大于模型规模，通用大语言模型在轨迹分析中始终优于专用安全护栏。3）时间稳定性：准确性在长轨迹中保持稳健。执行步骤的增加使模型能够从静态工具定义转向动态执行行为，反而提升了后期阶段的风险检测性能。我们的研究表明，保障智能体工作流程的安全需要联合优化结构化推理与安全对齐，以有效缓解轨迹中的风险。

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural language responses, their efficacy remains largely unexplored within multi-step tool-use trajectories. To address this gap, we introduce TraceSafe-Bench, the first comprehensive benchmark specifically designed to assess mid-trajectory safety. It encompasses 12 risk categories, ranging from security threats (e.g., prompt injection, privacy leaks) to operational failures (e.g., hallucinations, interface inconsistencies), featuring over 1,000 unique execution instances. Our evaluation of 13 LLM-as-a-guard models and 7 specialized guardrails yields three critical findings: 1) Structural Bottleneck: Guardrail efficacy is driven more by structural data competence (e.g., JSON parsing) than semantic safety alignment. Performance correlates strongly with structured-to-text benchmarks ($ρ=0.79$) but shows near-zero correlation with standard jailbreak robustness. 2) Architecture over Scale: Model architecture influences risk detection performance more significantly than model size, with general-purpose LLMs consistently outperforming specialized safety guardrails in trajectory analysis. 3) Temporal Stability: Accuracy remains resilient across extended trajectories. Increased execution steps allow models to pivot from static tool definitions to dynamic execution behaviors, actually improving risk detection performance in later stages. Our findings suggest that securing agentic workflows requires jointly optimizing for structural reasoning and safety alignment to effectively mitigate mid-trajectory risks.

评分理由: 论文提出TurboAgent，一个LLM驱动的自主多智能体框架，用于涡轮机械气动设计。核心是LLM作为任务规划和协调中心，结合多个专门智能体（生成设计、性能预测、优化、验证）。因此，与"Large Language Models”、“LLM Agents”、“Multi-agent Systems"高度相关（10分）。LLM协调专门智能体执行任务，与"Tool Use"有一定关联（5分）。应用领域是工程科学（涡轮机械设计），属于"AI for Science"范畴（10分）。其他关键词（如MoE、SFT、RAG、量化等）未在摘要中提及，与论文技术内容无关（0分）。

涡轮机械的气动设计是一个复杂且紧密耦合的多阶段过程，涉及几何生成、性能预测、优化和高保真物理验证。现有的智能设计方法通常侧重于单个阶段或依赖于松散耦合的流水线，这使得实现完全自主的端到端设计具有挑战性。为解决这一问题，本研究提出了TurboAgent，一个由大语言模型驱动、用于涡轮机械气动设计与优化的自主多智能体框架。该框架以大语言模型作为任务规划与协调的核心，同时由专门化的智能体负责生成式设计、快速性能预测、多目标优化以及基于物理的验证。该框架将传统的试错式设计转变为数据驱动的协同工作流，并保留高保真仿真用于最终验证。

研究采用一个跨音速单转子压气机进行验证。结果表明，目标性能、生成的设计与计算流体动力学仿真结果高度吻合。质量流量、总压比和等熵效率的决定系数均超过0.91，归一化均方根误差值低于8%。优化智能体进一步将等熵效率提升了1.61%，总压比提升了3.02%。在并行计算环境下，完整工作流可在约30分钟内执行完毕。

这些结果证明，TurboAgent能够实现从自然语言需求到最终设计生成的自主闭环设计流程，为涡轮机械气动设计提供了一种高效且可扩展的范式。

The aerodynamic design of turbomachinery is a complex and tightly coupled multi-stage process involving geometry generation, performance prediction, optimization, and high-fidelity physical validation. Existing intelligent design approaches typically focus on individual stages or rely on loosely coupled pipelines, making fully autonomous end-to-end design challenging.To address this issue, this study proposes TurboAgent, a large language model (LLM)-driven autonomous multi-agent framework for turbomachinery aerodynamic design and optimization. The LLM serves as the core for task planning and coordination, while specialized agents handle generative design, rapid performance prediction, multi-objective optimization, and physics-based validation. The framework transforms traditional trial-and-error design into a data-driven collaborative workflow, with high-fidelity simulations retained for final verification.A transonic single-rotor compressor is used for validation. The results show strong agreement between target performance, generated designs, and CFD simulations. The coefficients of determination (R2) for mass flow rate, total pressure ratio, and isentropic efficiency all exceed 0.91, with normalized RMSE values below 8%. The optimization agent further improves isentropic efficiency by 1.61% and total pressure ratio by 3.02%. The complete workflow can be executed within approximately 30 minutes under parallel computing. These results demonstrate that TurboAgent enables an autonomous closed-loop design process from natural language requirements to final design generation, providing an efficient and scalable paradigm for turbomachinery aerodynamic design

评分理由: 论文提出ReDAct框架，核心研究LLM Agents在顺序决策中的幻觉问题，通过结合小型和大型LLM，基于不确定性阈值进行决策延迟，以平衡成本与性能。因此，与"Large Language Models”、“Small Language Models”、“LLM Agents"和"Hallucination Mitigation"高度相关（10分），因为这些是论文的核心内容。与"Speculative Decoding"有一定关联（5分），因为论文涉及推理成本优化，但未直接讨论解码加速技术。其他关键词如MoE、Scaling Laws、Pre-training等未在论文中涉及，得0分。

近年来，基于大语言模型（LLM）的智能体在众多应用场景中日益普及，包括复杂的序列决策问题。然而，它们也继承了大语言模型容易产生幻觉的倾向，从而导致错误决策。在序列化环境中，即使单个错误也可能不可逆转地破坏任务轨迹，使得幻觉问题更为突出。尽管规模更大的大语言模型幻觉更少，但其每词元（per-token）计算成本显著更高。本文通过提出ReDAct（推理-延迟-执行）框架来解决这一权衡问题。在ReDAct中，智能体配备了两个大语言模型：一个默认使用的小型廉价模型，以及一个更可靠但昂贵的大型模型。当小型模型的预测不确定性超过校准阈值时，决策将被延迟交由大型模型处理。我们在ALFWorld和MiniGrid等基于文本的具身环境中评估了该方法，结果表明：仅将约15%的决策延迟交由大型模型处理，即可达到完全使用大型模型的质量水平，同时显著降低推理成本。

Recently, LLM-based agents have become increasingly popular across many applications, including complex sequential decision-making problems. However, they inherit the tendency of LLMs to hallucinate, leading to incorrect decisions. In sequential settings, even a single mistake can irreversibly degrade the trajectory, making hallucinations an even bigger problem. Although larger LLMs hallucinate less, they incur a significantly higher per-token cost. In this paper, we address this tradeoff by proposing ReDAct (Reason-Defer-Act). In ReDAct, an agent is equipped with two LLMs: a small, cheap model used by default, and a large, more reliable but expensive model. When the predictive uncertainty of the small model exceeds a calibrated threshold, the decision is deferred to the large model. We evaluate our approach in text-based embodied environments such as ALFWorld and MiniGrid and show that deferring only about 15% of decisions to the large model can match the quality of using it exclusively, while significantly reducing inference costs.

评分理由: 论文研究Vision-Language Models（VLMs）的推理一致性和自省能力，与LLMs相关（5分），涉及推理过程（Chain of Thought/System 2 Thinking各5分）、自省与校准（Self-Correction 8分）、事实性与幻觉缓解（Hallucination Mitigation 8分）、可解释性（Mechanistic Interpretability 8分）和世界知识先验（World Models 5分）。其他关键词如MoE、训练技术、压缩、代理等未涉及（0分）。

理解视觉-语言模型（VLMs）何时会出现意外行为、模型能否可靠预测自身行为，以及模型是否遵循其内省推理过程，是实现可信部署的核心挑战。为研究这些问题，我们引入了分级颜色归因（Graded Color Attribution, GCA）数据集——一个旨在激发决策规则并评估参与者对这些规则遵循程度的受控基准。GCA包含三种条件下像素级颜色覆盖度各异的线条图：基于世界知识的重新着色、反事实重新着色，以及无颜色先验的形状。通过GCA，视觉-语言模型与人类参与者均会建立一个阈值：物体必须包含特定颜色像素的最小百分比才能获得该颜色标签。随后我们将这些规则与它们后续的颜色归因决策进行比较。研究发现表明，模型会系统性违背其自身的内省规则。例如，在具有强颜色先验的物体上，GPT-5-mini在近60%的情况下违反了其声明的内省规则。人类参与者则始终遵循其声明的规则，任何表面上的违规行为均可通过一种有充分记录的倾向——即高估颜色覆盖度——来解释。相比之下，我们发现视觉-语言模型能出色地估计颜色覆盖度，却在最终响应中公然违背自身的推理过程。在所有模型及激发内省规则的策略中，世界知识先验会系统性降低遵循程度，且这种降低方式并不反映人类认知模式。我们的研究结果挑战了“视觉-语言模型推理失败源于任务难度”的观点，表明视觉-语言模型的内省自我认知存在校准偏差，这对高风险场景下的部署具有直接启示。

Understanding when Vision-Language Models (VLMs) will behave unexpectedly, whether models can reliably predict their own behavior, and if models adhere to their introspective reasoning are central challenges for trustworthy deployment. To study this, we introduce the Graded Color Attribution (GCA) dataset, a controlled benchmark designed to elicit decision rules and evaluate participant faithfulness to these rules. GCA consists of line drawings that vary pixel-level color coverage across three conditions: world-knowledge recolorings, counterfactual recolorings, and shapes with no color priors. Using GCA, both VLMs and human participants establish a threshold: the minimum percentage of pixels of a given color an object must have to receive that color label. We then compare these rules with their subsequent color attribution decisions. Our findings reveal that models systematically violate their own introspective rules. For example, GPT-5-mini violates its stated introspection rules in nearly 60% of cases on objects with strong color priors. Human participants remain faithful to their stated rules, with any apparent violations being explained by a well-documented tendency to overestimate color coverage. In contrast, we find that VLMs are excellent estimators of color coverage, yet blatantly contradict their own reasoning in their final responses. Across all models and strategies for eliciting introspective rules, world-knowledge priors systematically degrade faithfulness in ways that do not mirror human cognition. Our findings challenge the view that VLM reasoning failures are difficulty-driven and suggest that VLM introspective self-knowledge is miscalibrated, with direct implications for high-stakes deployment.

评分理由: 论文核心研究稀疏混合专家模型（MoE）的剪枝方法，与"Mixture of Experts"高度相关（15分），直接涉及LLM效率问题（10分）。论文提到"Empirical scaling laws”，与"Scaling Laws"相关（8分）。剪枝属于模型压缩范畴，与"Quantization"相关（8分）。其他关键词如SLMs、训练方法、推理技术、对齐、RAG、代理等均未涉及，得0分。

语言模型的实证缩放定律推动了大型语言模型（LLM）规模的持续扩大，尽管其计算和内存成本不断增长。稀疏专家混合模型（Sparse Mixture-of-Experts, MoE）提供了一种前景广阔的替代方案，它仅在每次前向传播中激活一部分专家，从而在不牺牲性能的前提下提升了效率。然而，大量的专家参数仍导致显著的内存消耗。

现有的剪枝方法通常在各层间均匀分配预算，忽视了稀疏MoE中产生的异构冗余。我们提出了GRAPE（面向专家的全局冗余感知剪枝），这是一种全局剪枝策略，能够基于跨层冗余动态分配剪枝预算。在Mixtral-8x7B、Mixtral-8x22B、DeepSeek-MoE、Qwen-MoE和GPT-OSS上的实验表明，在相同剪枝预算下，GRAPE始终能取得最佳的平均性能。在论文报告的三个主要模型上，相较于最强的局部基线方法，GRAPE在不同剪枝设置下的平均准确率平均提升了1.40%，最高提升可达2.45%。

Empirical scaling laws for language models have encouraged the development of ever-larger LLMs, despite their growing computational and memory costs. Sparse Mixture-of-Experts (MoEs) offer a promising alternative by activating only a subset of experts per forward pass, improving efficiency without sacrificing performance. However, the large number of expert parameters still leads to substantial memory consumption. Existing pruning methods typically allocate budgets uniformly across layers, overlooking the heterogeneous redundancy that arises in sparse MoEs. We propose GRAPE (Global Redundancy-Aware Pruning of Experts, a global pruning strategy that dynamically allocates pruning budgets based on cross-layer redundancy. Experiments on Mixtral-8x7B, Mixtral-8x22B, DeepSeek-MoE, Qwen-MoE, and GPT-OSS show that, under the same pruning budget, GRAPE consistently achieves the best average performance. On the three main models reported in the paper, it improves average accuracy over the strongest local baseline by 1.40% on average across pruning settings, with gains of up to 2.45%.

评分理由: 论文核心研究检索增强生成（RAG）在医学问答中的应用，因此与"Retrieval-Augmented Generation"高度相关（15分）。论文明确使用LLMs进行医学问答，与"Large Language Models"高度相关（10分）。研究属于AI在科学（医学）领域的应用，与"AI for Science"高度相关（10分）。论文提到RAG用于解决知识差距和事实基础问题，间接涉及幻觉缓解，因此与"Hallucination Mitigation"有一定关联（5分）。其他关键词如MoE、SLMs、训练技术、推理方法、代理系统等均未在摘要中提及，完全无关（0分）。

大语言模型（LLM）在医学问答任务中展现出强大能力；然而，纯参数化模型常受限于知识缺口与事实依据不足。检索增强生成（RAG）通过将外部知识检索整合至推理过程，有效应对了这一局限。尽管基于RAG的医学系统日益受到关注，但各检索组件对系统性能的具体影响仍未得到充分理解。本研究基于MedQA USMLE基准与结构化教科书知识库，对检索增强型医学问答进行了系统性评估。我们在包含四十种配置的统一实验框架内，分析了语言模型、嵌入模型、检索策略、查询重构与交叉编码器重排序之间的交互作用。结果表明，检索增强显著提升了零样本医学问答性能。最佳配置方案——结合查询重构与重排序的稠密检索——实现了60.49%的准确率。研究还发现，领域专用语言模型比通用模型能更有效地利用检索到的医学证据。进一步分析揭示了检索效能与计算成本间的明确权衡：较简单的稠密检索配置在保持高吞吐量的同时，仍能提供强劲性能。所有实验均在单张消费级GPU上完成，证明检索增强型医学问答系统的系统性评估可在适度计算资源下实现。

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG) addresses this limitation by integrating external knowledge retrieval into the reasoning process. Despite increasing interest in RAG-based medical systems, the impact of individual retrieval components on performance remains insufficiently understood. This study presents a systematic evaluation of retrieval-augmented medical question answering using the MedQA USMLE benchmark and a structured textbook-based knowledge corpus. We analyze the interaction between language models, embedding models, retrieval strategies, query reformulation, and cross-encoder reranking within a unified experimental framework comprising forty configurations. Results show that retrieval augmentation significantly improves zero-shot medical question answering performance. The best-performing configuration was dense retrieval with query reformulation and reranking achieved 60.49% accuracy. Domain-specialized language models were also found to better utilize retrieved medical evidence than general-purpose models. The analysis further reveals a clear tradeoff between retrieval effectiveness and computational cost, with simpler dense retrieval configurations providing strong performance while maintaining higher throughput. All experiments were conducted on a single consumer-grade GPU, demonstrating that systematic evaluation of retrieval-augmented medical QA systems can be performed under modest computational resources.

评分理由: 论文核心研究大语言模型（Qwen3.5-4B-Base）的表示几何特性，包括Voronoi镶嵌、表达性差距的线性缩放定律验证，以及通过边缘优化程序进行几何重组。因此，与"Large Language Models"和"Scaling Laws"高度相关（10分）。研究涉及模型内部表示和几何结构的分析，与"Mechanistic Interpretability"高度相关（10分）。论文提到bfloat16量化伪影，与"Quantization"有一定关联（5分）。研究涉及模型内部表示与最终输出的对齐，与"Alignment"有一定关联（5分）。其他关键词如MoE、SLMs、训练方法、推理加速、AI for Science等均未在摘要中涉及，评为0分。

语言模型在离散的标记上操作，但在连续的向量空间中计算，从而在表示流形上诱导出沃罗诺伊镶嵌结构。本研究基于Qwen3.5-4B-Base模型对此镶嵌结构进行了实证分析，并做出两项贡献。首先，通过采用float32边界重计算以消除bfloat16量化伪影，我们验证了Mabrok（2026）提出的表达能力间隙线性缩放定律（$R^2$ = 0.9997），这是迄今为止最强有力的证实；同时，我们发现了一个中间层的几何模糊区域（第24-28层，$ρ$ = -0.29），其中边界几何结构与交叉熵呈负相关，直至最终层才结晶为对齐状态（$ρ$ = 0.836）。

其次，我们证明收敛模型的沃罗诺伊镶嵌结构可通过边界优化程序进行重塑：这是一种无需重新训练的简短事后优化过程，旨在拓宽标记决策边界。我们在剂量反应扫描中比较了直接边界最大化与费舍尔信息距离最大化两种方法。两种方法均发现，在每评估256K个位置中，可修正位置的上限约为16,300个，但其关键差异在于附带损害。边界最大化的损害随干预强度增加而加剧，直至修正效果被淹没；而费舍尔方法在验证范围（$λ$ = 0.15-0.6）内损害保持恒定（约5,300个位置），在$λ$ = 0.6时实现中值边界提升+28%，且下游基准测试结果保持不变——这是一种压缩表达能力间隙同时保留其缩放定律的几何重组。然而，频率与标记类别审计显示，增益集中于高频结构标记（$λ$ = 0.6时净修正量的84%），而内容类及实体类标记的贡献随$λ$升高而缩减。因此，费舍尔边界优化程序是一种可行的几何精修工具，其实际上限并非由总体损害决定，而是取决于标记级收益的均匀性。

Language models operate on discrete tokens but compute in continuous vector spaces, inducing a Voronoi tessellation over the representation manifold. We study this tessellation empirically on Qwen3.5-4B-Base, making two contributions. First, using float32 margin recomputation to resolve bfloat16 quantization artifacts, we validate Mabrok’s (2026) linear scaling law of the expressibility gap with $R^2$ = 0.9997 - the strongest confirmation to date - and identify a mid-layer geometric ambiguity regime where margin geometry is anti-correlated with cross-entropy (layers 24-28, $ρ$ = -0.29) before crystallizing into alignment at the final layer ($ρ$ = 0.836). Second, we show that the Voronoi tessellation of a converged model is reshapable through margin refinement procedures (MRP): short post-hoc optimization runs that widen token-decision margins without retraining. We compare direct margin maximization against Fisher information distance maximization across a dose-response sweep. Both methods find the same ceiling of ~16,300 correctable positions per 256K evaluated, but differ critically in collateral damage. Margin maximization damage escalates with intervention strength until corrections are overwhelmed. Fisher damage remains constant at ~5,300 positions across the validated range ($λ$ = 0.15-0.6), achieving +28% median margin improvement at $λ$ = 0.6 with invariant downstream benchmarks - a geometric reorganization that compresses the expressibility gap while preserving its scaling law. However, frequency and token-class audits reveal that gains concentrate in high-frequency structural tokens (84% of net corrections at $λ$ = 0.6), with content and entity-like contributions shrinking at higher $λ$. Fisher MRP is therefore a viable geometric polishing tool whose practical ceiling is set not by aggregate damage but by the uniformity of token-level benefit.

评分理由: 论文核心研究LLMs长上下文推理中的KV缓存压缩问题，与"Large Language Models"、“Context Window Extension”、“KV Cache Compression"高度相关（10分）。论文提出StructKV框架，属于模型压缩和推理加速技术，与"Quantization”、“Speculative Decoding"有一定关联（5分）。其他关键词如MoE、SFT、RAG、AI for Science等未在论文中涉及，得0分。

随着大语言模型（LLM）扩展至支持超过百万令牌的上下文窗口，键值（KV）缓存的线性增长带来了严重的内存容量与带宽瓶颈，制约了长上下文推理的效率。现有的压缩方法通常基于局部显著性度量对令牌进行优先级排序，以将预填充计算与解码内存解耦。然而，这些方法往往依赖于特定网络层的局部显著性快照，从而系统性地丢弃了那些在整个网络深度中充当全局信息枢纽、但在选定进行剪枝的特定层上暂时处于休眠状态的令牌。为解决这一局限，我们提出了StructKV，一种结构感知的KV缓存压缩框架，其引入了三项核心创新：首先，全局入度中心性通过聚合网络深度上的注意力模式来识别全局信息枢纽。其次，动态枢纽检测利用信息论度量自适应地定位最佳压缩层。最后，结构传播与解耦将计算预算与内存存储预算分离。在LongBench和RULER基准测试上的实验结果表明，StructKV能有效保持长程依赖性与检索鲁棒性。

As Large Language Models (LLMs) scale to support context windows exceeding one million tokens, the linear growth of Key-Value (KV) cache imposes severe memory capacity and bandwidth bottlenecks, constraining the efficiency of long-context inference. Existing compression approaches typically prioritize tokens based on local saliency metrics to decouple prefill computation from decoding memory. However, these methods often rely on local saliency snapshots at a specific layer, thereby systematically discarding tokens that act as global information hubs across the network depth but appear temporarily dormant at the specific layer selected for pruning. To address this limitation, we propose StructKV, a structure-aware KV cache compression framework that introduces three core innovations: First, Global In-Degree Centrality aggregates attention patterns across the network depth to identify global information hubs. Second, Dynamic Pivot Detection utilizes information-theoretic metrics to adaptively locate the optimal layer for compression. Finally, Structural Propagation and Decoupling separates the computational budget from the memory storage budget. Experimental results on the LongBench and RULER benchmarks demonstrate that StructKV effectively preserves long-range dependencies and retrieval robustness.

评分理由: 论文提出COMLLM框架，将LLMs应用于移动边缘计算（MEC）中的任务卸载决策。核心相关性体现在：1）明确使用LLMs（高度相关）；2）采用Supervised Fine-Tuning（SFT）作为基线方法（高度相关）；3）提出多步蒙特卡洛推演（Monte Carlo rollouts）进行前瞻决策，与"Monte Carlo Tree Search”（MCTS）概念高度相关；4）框架实现多步推理，与"Chain of Thought"（CoT）高度相关。其他关键词如MoE、SLMs、Scaling Laws、RAG等未在摘要中提及或与论文主题无关。

新兴计算密集型应用对资源受限的移动设备提出了严格的延迟要求。移动边缘计算（Mobile Edge Computing, MEC）通过任务卸载应对这一挑战。然而，由于动态任务到达、时变信道以及服务器队列的时空耦合特性，设计高效策略仍然困难。传统启发式方法缺乏适应性，而深度强化学习（Deep Reinforcement Learning, DRL）存在泛化能力有限和架构僵化的问题，当网络拓扑变化时需要重新训练。尽管大语言模型（Large Language Models, LLMs）具备语义推理能力，但标准的监督微调（Supervised Fine-Tuning, SFT）会产生短视策略，仅贪婪地最小化即时延迟，而未考虑系统的长期演化。为克服这些局限，我们提出了COMLLM，一个支持在MEC系统中进行前瞻性决策的生成式框架。COMLLM将组相对策略优化（Group Relative Policy Optimization, GRPO）与前瞻协同仿真（Look-Ahead Collaborative Simulation, LACS）机制相结合，该机制在执行多步蒙特卡洛推演的同时联合建模服务器队列动态。通过将这些推演纳入奖励设计，框架能够捕捉当前决策对未来系统状态的长期影响。实验结果表明，COMLLM实现了接近最优的延迟并提升了负载均衡的公平性。值得注意的是，该框架展现出零样本拓扑可扩展性，使得在小型网络上训练的模型能够无需重新训练即可泛化到更大、未见过的拓扑结构，其性能优于SFT、DRL及启发式基线方法。

Emerging computation-intensive applications impose stringent latency requirements on resource-constrained mobile devices. Mobile Edge Computing (MEC) addresses this challenge through task offloading. However, designing effective policies remains difficult due to dynamic task arrivals, time-varying channels, and the spatio-temporal coupling of server queues. Conventional heuristics lack adaptability, while Deep Reinforcement Learning (DRL) suffers from limited generalization and architectural rigidity, requiring retraining when network topology changes. Although Large Language Models (LLMs) offer semantic reasoning capabilities, standard Supervised Fine-Tuning (SFT) yields myopic policies that greedily minimize immediate latency without accounting for long-term system evolution. To address these limitations, we propose COMLLM, a generative framework that enables foresighted decision-making in MEC systems. COMLLM integrates Group Relative Policy Optimization (GRPO) with a Look-Ahead Collaborative Simulation (LACS) mechanism, which performs multi-step Monte Carlo rollouts while jointly modeling server queue dynamics. By incorporating these rollouts into the reward design, the framework captures the long-term impact of current decisions on future system states. Experimental results demonstrate that COMLLM achieves near-optimal latency and improved load-balancing fairness. Notably, it exhibits zero-shot topological scalability, allowing a model trained on small-scale networks to generalize to larger, unseen topologies without retraining, outperforming SFT, DRL, and heuristic baselines.

评分理由: 论文核心研究LoRA（参数高效微调）在大型语言模型（LLMs）上的应用，用于自动化测试用例生成。因此，与"PEFT/LoRA"高度相关（15分），与"LLMs"和"Supervised Fine-tuning"直接相关（10分）。其他关键词如MoE、SLMs、Scaling Laws、RAG、RLHF等未在论文中涉及，得0分。

基于自然语言需求自动生成测试用例仍是软件工程中的一个挑战性问题，这源于需求的模糊性以及需要生成结构化、可执行的测试制品。大语言模型的最新进展为解决该任务带来了希望；然而，其有效性取决于针对特定任务的适应性和高效的微调策略。本文对使用参数高效微调方法（特别是LoRA）进行基于需求的测试用例生成展开了全面的实证研究。我们在统一的实验流程下评估了包括开源模型和专有模型在内的多个大语言模型家族。该研究系统性地探讨了LoRA关键超参数（包括秩、缩放因子和丢弃率）对下游性能的影响。我们提出了一个基于GPT-4o的自动化评估框架，从九个质量维度对生成的测试用例进行评估。实验结果表明，基于LoRA的微调显著提升了所有开源模型的性能，其中Ministral-8B模型取得了最佳效果。此外，我们发现经过微调的8B开源模型可以达到与未经微调的GPT-4.1模型相当的性能，这凸显了参数高效适应方法的有效性。虽然GPT-4.1模型取得了最高的整体性能，但微调后专有模型与开源模型之间的性能差距显著缩小。这些发现为自动化测试生成的模型选择、微调策略和评估方法提供了重要见解。特别地，研究证明，结合精心设计的微调方法，具有成本效益、可本地部署的开源模型能够成为专有系统的可行替代方案。

Automated test case generation from natural language requirements remains a challenging problem in software engineering due to the ambiguity of requirements and the need to produce structured, executable test artifacts. Recent advances in LLMs have shown promise in addressing this task; however, their effectiveness depends on task-specific adaptation and efficient fine-tuning strategies. In this paper, we present a comprehensive empirical study on the use of parameter-efficient fine-tuning, specifically LoRA, for requirement-based test case generation. We evaluate multiple LLM families, including open-source and proprietary models, under a unified experimental pipeline. The study systematically explores the impact of key LoRA hyperparameters, including rank, scaling factor, and dropout, on downstream performance. We propose an automated evaluation framework based on GPT-4o, which assesses generated test cases across nine quality dimensions. Experimental results demonstrate that LoRA-based fine-tuning significantly improves the performance of all open-source models, with Ministral-8B achieving the best results among them. Furthermore, we show that a fine-tuned 8B open-source model can achieve performance comparable to pre-fine-tuned GPT-4.1 models, highlighting the effectiveness of parameter-efficient adaptation. While GPT-4.1 models achieve the highest overall performance, the performance gap between proprietary and open-source models is substantially reduced after fine-tuning. These findings provide important insights into model selection, fine-tuning strategies, and evaluation methods for automated test generation. In particular, they demonstrate that cost-efficient, locally deployable open-source models can serve as viable alternatives to proprietary systems when combined with well-designed fine-tuning approaches.

评分理由: 论文核心是LLM在网络安全领域的应用，明确提到使用LLM驱动安全培训，因此"Large Language Models"得10分。使用量化Phi-4模型，与"Quantization"高度相关得10分。模型针对网络安全领域微调，与"Pre-training"和"Post-training"有一定关联各得5分。使用量化模型在普通硬件上部署，与"Small Language Models"有一定关联得5分。其他关键词如MoE、Scaling Laws、RAG、RLHF等未涉及得0分。

网络安全领域面临两大相互关联的挑战：全球范围内合格从业人员的短缺，以及持续存在的人为因素弱点——后者是大多数安全事件的主要原因。为应对这些问题，我们提出了SentinelSphere，这是一个由人工智能驱动的平台，它将基于机器学习的威胁识别与大型语言模型（LLM）驱动的安全培训相结合。其检测模块采用一个增强型深度神经网络（DNN），该网络在CIC-IDS2017和CIC-DDoS2019基准数据集上训练，并辅以新颖的HTTP层特征工程，以捕捉应用层攻击特征。在教育组件方面，我们部署了Phi-4模型的量化变体（Q4_K_M），该模型针对网络安全领域进行了微调，使其能够在仅需16 GB RAM、无需专用GPU资源的商用硬件上部署。实验结果表明，相较于基线模型，增强型DNN在保持高检测准确率的同时，显著降低了误报率，并且在DDoS、暴力破解及基于网络的漏洞利用等关键攻击类别上保持了强大的召回率。涉及行业专业人士和大学生的验证研讨会证实，其“交通灯”可视化系统和对话式AI助手对于非技术背景用户而言既直观又有效。SentinelSphere表明，将智能威胁检测与自适应的、LLM驱动的安全教育相结合，能够在一个统一、连贯的框架内有意义地应对技术和人为因素两方面的网络安全漏洞。

The field of cybersecurity is confronted with two interrelated challenges: a worldwide deficit of qualified practitioners and ongoing human-factor weaknesses that account for the bulk of security incidents. To tackle these issues, we present SentinelSphere, a platform driven by artificial intelligence that unifies machine learning-based threat identification with security training powered by a Large Language Model (LLM). The detection module uses an Enhanced Deep Neural Network (DNN) trained on the CIC-IDS2017 and CIC-DDoS2019 benchmark datasets, enriched with novel HTTP-layer feature engineering that captures application level attack signatures. For the educational component, we deploy a quantised variant of Phi-4 model (Q4_K_M), fine-tuned for the cybersecurity domain, enabling deployment on commodity hardware requiring only 16 GB of RAM without dedicated GPU resources. Experimental results show that the Enhanced DNN attains high detection accuracy while substantially lowering false positives relative to baseline models, and maintains strong recall across critical attack categories such as DDoS, brute force, and web-based exploits. Validation workshops involving industry professionals and university students confirmed that the Traffic Light visualisation system and conversational AI assistant are both intuitive and effective for users without technical backgrounds. SentinelSphere illustrates that coupling intelligent threat detection with adaptive, LLM-driven security education can meaningfully address both technical and human-factor cybersecurity vulnerabilities within a single, cohesive framework.

评分理由: 论文核心研究LLM生成虚假信息的风险评估，直接涉及LLM关键词（10分）。研究评估LLM作为评估代理与人类读者的一致性，与"Alignment"（5分）和"Explainable AI"（5分）相关。研究虚假信息风险与"Hallucination Mitigation"（8分）在事实性和真实性方面有间接关联。其他关键词如MoE、Scaling Laws、RLHF、RAG等均未在论文中涉及，得0分。

大型语言模型（LLM）能够大规模生成具有说服力的叙事，这引发了人们对其可能被用于虚假信息活动的担忧。评估这一风险最终需要理解读者如何接收此类内容。然而在实践中，LLM评判者正日益被用作直接人类评估的低成本替代品，尽管它们是否能够忠实反映读者反应尚不明确。我们将此情境下的评估重新界定为代理效度问题，并依据人类读者反应对LLM评判者进行审计。通过使用290篇校准文章、2,043组配对的人类评分以及八个前沿评判模型的输出，我们从整体评分、项目级排序和信号依赖性三个方面检验了评判者与人类的一致性。我们发现评判者与人类之间存在持续性的差距。相较于人类，评判者通常更为严苛，仅能微弱地复现项目级的人类排序，并且依赖不同的文本信号——更注重逻辑严谨性，同时对情感强度给予更强的负面评价。与此同时，评判者彼此之间的共识度远高于其与人类读者的共识度。这些结果表明，LLM评判者形成了一个内部高度一致的评价群体，其内部一致性远高于其与人类读者的一致性，这表明内部共识并不能作为其作为读者反应代理的有效性证据。

Large language models (LLMs) can generate persuasive narratives at scale, raising concerns about their potential use in disinformation campaigns. Assessing this risk ultimately requires understanding how readers receive such content. In practice, however, LLM judges are increasingly used as a low-cost substitute for direct human evaluation, even though whether they faithfully track reader responses remains unclear. We recast evaluation in this setting as a proxy-validity problem and audit LLM judges against human reader responses. Using 290 aligned articles, 2,043 paired human ratings, and outputs from eight frontier judges, we examine judge–human alignment in terms of overall scoring, item-level ordering, and signal dependence. We find persistent judge–human gaps throughout. Relative to humans, judges are typically harsher, recover item-level human rankings only weakly, and rely on different textual signals, placing more weight on logical rigour while penalizing emotional intensity more strongly. At the same time, judges agree far more with one another than with human readers. These results suggest that LLM judges form a coherent evaluative group that is much more aligned internally than it is with human readers, indicating that internal agreement is not evidence of validity as a proxy for reader response.

评分理由: 论文核心研究奖励模型（RMs）在个性化对齐评估中的表现，与LLMs和Alignment高度相关（核心内容，10分），与RLHF相关（论文提到PPO和奖励模型评估，有一定关联，8分），其他关键词未涉及（0分）。

多元对齐已成为大型语言模型发展的关键前沿领域，其中奖励模型作为捕捉多样化人类价值观的核心机制。尽管针对通用响应质量的基准测试已较为普遍，但如何评估奖励模型对个体用户偏好的建模能力仍是一个开放挑战。为填补这一空白，我们提出了个性化奖励基准——一种旨在严格评估奖励模型建模个性化偏好能力的新型基准。我们基于对用户特定准则的严格遵守（或违反）构建了优选与拒选响应配对，确保偏好区分完全针对个体量身定制。特别值得注意的是，人工评估证实配对间的主要区分因素严格限于个人偏好，且两种响应均保持较高的通用质量（如正确性、相关性和帮助性）。广泛测试表明，现有最先进的奖励模型在个性化任务上表现显著不足，最高准确率仅为75.94%。关键的是，由于有效的奖励模型基准应能预测其在下游任务中的表现，我们通过实验证明：与现有基线相比，该基准在最佳N采样和近端策略优化两种下游任务中，与奖励模型性能的相关性均显著更高。这些发现确立了个性化奖励基准作为评估奖励模型下游应用性能的稳健且精确的代理标准。

Pluralistic alignment has emerged as a critical frontier in the development of Large Language Models (LLMs), with reward models (RMs) serving as a central mechanism for capturing diverse human values. While benchmarks for general response quality are prevalent, evaluating how well reward models account for individual user preferences remains an open challenge. To bridge this gap, we introduce Personalized RewardBench, a novel benchmark designed to rigorously assess reward models’ capacity to model personalized preferences. We construct chosen and rejected response pairs based on strict adherence to (or violation of) user-specific rubrics, ensuring that preference distinctions are uniquely tailored to the individual. In particular, human evaluations confirm that the primary discriminative factor between pairs is strictly personal preference, with both responses maintaining high general quality (e.g., correctness, relevance and helpfulness). Extensive testing reveals that existing state-of-the-art reward models struggle significantly with personalization, peaking at an accuracy of just 75.94%. Crucially, because an effective reward model benchmark should predict a reward model’s performance on downstream tasks, we conduct experiments demonstrating that our benchmark exhibits a significantly higher correlation with downstream performance in both Best-of-N (BoN) sampling and Proximal Policy Optimization (PPO) compared to existing baselines. These findings establish Personalized RewardBench as a robust and accurate proxy for evaluating reward models’ performance in downstream applications.

评分理由: 论文核心研究LLM的提示优化框架aPSF，通过分解提示结构为语义因子并进行干预性更新，以提升推理性能。因此，与"Large Language Models"高度相关（10分），因为论文明确使用LLMs并针对其进行优化。与"Chain of Thought"和"System 2 Thinking"有一定关联（8分），因为论文在高级推理基准上测试aPSF，涉及多步推理和深度思考过程，但并非直接研究CoT或System 2本身。其他关键词如MoE、SFT、RAG等与论文内容无关，均得0分。

自动化提示优化对于从大语言模型（LLM）中激发可靠推理至关重要，然而大多数仅依赖API的提示优化器会迭代式地编辑整体提示，导致各组件相互耦合、归因模糊，从而限制了可控性并造成令牌浪费。我们提出自适应提示结构因子化（Adaptive Prompt Structure Factorization，aPSF），这是一个仅使用API的框架（提示输入/文本输出；无需访问模型内部），它利用一个架构模型来发现任务特定的提示结构作为语义因子。aPSF随后执行干预式的单因子更新：干预性因子级评分通过验证性能的变化估计每个因子的边际贡献，而误差引导的因子选择则将更新定向至当前主要失败来源，从而实现更高效的样本优化。在多个高级推理基准测试中，aPSF超越了包括具备原理感知能力的优化器在内的强基线，平均准确率最高提升2.16个百分点，并在MultiArith任务上减少45%至87%的令牌优化成本，同时仅需一步即可达到峰值验证效果。

Automated prompt optimization is crucial for eliciting reliable reasoning from large language models (LLMs), yet most API-only prompt optimizers iteratively edit monolithic prompts, coupling components and obscuring credit assignment, limiting controllability, and wasting tokens. We propose Adaptive Prompt Structure Factorization (aPSF), an API-only framework (prompt-in/text-out; no access to model internals) that uses an Architect model to discover task-specific prompt structures as semantic factors. aPSF then performs interventional, single-factor updates: interventional factor-level scoring estimates each factor’s marginal contribution via validation-performance changes, and error-guided factor selection routes updates to the current dominant failure source for more sample-efficient optimization. Across multiple advanced reasoning benchmarks, aPSF outperforms strong baselines including principle-aware optimizers, improving accuracy by up to +2.16 percentage points on average, and reduces optimization cost by 45–87% tokens on MultiArith while reaching peak validation in 1 step.

评分理由: 论文研究多模态大语言模型（MLLMs）的幻觉问题，特别是幻觉的可验证性控制。核心相关关键词是"Large Language Models"（论文明确研究MLLMs）和"Hallucination Mitigation"（论文直接研究幻觉检测和控制）。“Explainable AI"有一定关联，因为论文通过激活空间干预方法分析模型行为，但并非核心解释性AI研究。其他关键词如MoE、SFT、RAG等均未在摘要中提及或相关。

由多模态大语言模型驱动的AI应用易产生幻觉现象，并对人类用户构成显著风险。关键在于，此类幻觉并非同等严重：部分幻觉内容可被人类用户识别（即明显幻觉），而另一些则常被忽略或需更多验证成本（即隐蔽幻觉）。这表明多模态AI幻觉的可验证性存在显著差异。然而，现有研究鲜少探索如何针对不同安全性与可用性需求的AI应用控制这一特性。为填补此空白，我们基于4,470份人类对AI生成幻觉的反馈构建数据集，并依据人类用户的可验证性将其归类为明显与隐蔽两种类型。进一步，我们提出一种激活空间干预方法，通过学习针对明显幻觉与隐蔽幻觉的独立探针，揭示二者引发不同的干预探针，从而实现对模型可验证性的细粒度调控。实证结果表明该方法的有效性，并证明定向干预在调节相应可验证性方面具有优越性能。此外，仅通过混合这些干预策略即可灵活适配不同场景所需的可验证性水平。

AI applications driven by multimodal large language models (MLLMs) are prone to hallucinations and pose considerable risks to human users. Crucially, such hallucinations are not equally problematic: some hallucination contents could be detected by human users(i.e., obvious hallucinations), while others are often missed or require more verification effort(i.e., elusive hallucinations). This indicates that multimodal AI hallucinations vary significantly in their verifiability. Yet, little research has explored how to control this property for AI applications with diverse security and usability demands. To address this gap, we construct a dataset from 4,470 human responses to AI-generated hallucinations and categorize these hallucinations into obvious and elusive types based on their verifiability by human users. Further, we propose an activation-space intervention method that learns separate probes for obvious and elusive hallucinations. We reveal that obvious and elusive hallucinations elicit different intervention probes, allowing for fine-grained control over the model’s verifiability. Empirical results demonstrate the efficacy of this approach and show that targeted interventions yield superior performance in regulating corresponding verifiability. Moreover, simply mixing these interventions enables flexible control over the verifiability required for different scenarios.

评分理由: 论文FedDetox专注于联邦学习环境下的小语言模型（SLMs）安全对齐问题，核心贡献在于通过设备端数据净化来防止意外数据中毒。因此，与"Small Language Models (SLMs)“高度相关（10分），因为论文明确针对SLMs在资源受限设备上的应用；与"Alignment"高度相关（10分），因为论文核心是解决联邦对齐中的安全对齐问题；与"Large Language Models (LLMs)“有一定关联（5分），因为论文提到使用大规模安全对齐的教师模型进行知识蒸馏，但LLMs本身不是研究重点。其他关键词如MoE、Scaling Laws、RLHF、RAG等均未在论文中涉及，因此得0分。

随着高质量公共数据日益稀缺，联邦学习（FL）为在保护隐私的同时利用有价值的私有用户数据提供了关键路径。然而，现实场景中的客户端数据常包含有害或不安全信息。这引发了一个我们定义为非预期数据投毒的关键问题，其可能在联邦对齐过程中严重破坏全局模型的安全性对齐。为解决该问题，我们提出FedDetox——一个专为资源受限边缘设备上的轻量化语言模型（SLMs）设计的鲁棒性框架。我们首先采用知识蒸馏技术，将大规模安全对齐教师模型中复杂的安全对齐能力迁移至适用于资源受限边缘设备的轻量级学生分类器。具体而言，在面向人类偏好对齐的联邦学习过程中，边缘客户端在数据源头识别不安全样本，并将其替换为拒绝模板，从而将潜在毒性数据有效转化为正向安全信号。实验表明，我们的方法能在保持模型通用性能的前提下，将模型安全性维持在接近集中式基线模型的水平。

As high quality public data becomes scarce, Federated Learning (FL) provides a vital pathway to leverage valuable private user data while preserving privacy. However, real-world client data often contains toxic or unsafe information. This leads to a critical issue we define as unintended data poisoning, which can severely damage the safety alignment of global models during federated alignment. To address this, we propose FedDetox, a robust framework tailored for Small Language Models (SLMs) on resource-constrained edge devices. We first employ knowledge distillation to transfer sophisticated safety alignment capabilities from large scale safety aligned teacher models into light weight student classifiers suitable for resource constrained edge devices. Specifically, during federated learning for human preference alignment, the edge client identifies unsafe samples at the source and replaces them with refusal templates, effectively transforming potential poisons into positive safety signals. Experiments demonstrate that our approach preserves model safety at a level comparable to centralized baselines without compromising general utility.

评分理由: 论文核心研究LLM在社会科学模拟中的应用，特别是通过受众分割方法恢复异质性，因此与"Large Language Models"高度相关（10分）。论文使用了Mixtral 8x22B模型，该模型基于MoE架构，因此与"Mixture of Experts"有一定关联（5分）。研究涉及LLM模拟社会态度和行为，可视为LLM代理的一种应用，与"LLM Agents"有一定关联（5分）。其他关键词如模型训练技术、推理优化、特定科学领域等均未在论文中涉及，得0分。

大型语言模型（LLM）正日益被用于模拟社会态度与行为，提供可扩展的“硅基样本”以近似人类数据。然而，当前的模拟实践常将多样性简化为“平均人格”，掩盖了作为社会现实核心的亚群体差异。本研究引入受众细分作为系统性方法，以恢复基于LLM的社会模拟中的异质性。利用美国气候意见调查数据，我们在两个开源权重LLM（Llama 3.1-70B 和 Mixtral 8x22B）上比较了六种细分配置，分别调整了细分标识符的粒度、简洁性及选择逻辑（理论驱动、数据驱动和基于测量工具）。我们通过一个涵盖分布保真度、结构保真度和预测保真度的三维评估框架来评价模拟性能。结果显示，增加标识符粒度并未带来一致的改进：适度丰富标识符可提升性能，但进一步扩展并不能稳定地改善效果，甚至可能损害结构保真度和预测保真度。在简洁性比较中，紧凑配置常能匹配或优于更复杂的替代方案，尤其在结构保真度和预测保真度方面，而分布保真度仍取决于具体度量指标。标识符选择逻辑决定了哪个保真度维度受益最大：基于测量工具的选择最能保持分布形态，而数据驱动的选择最能恢复组间结构及标识符与结果的关联。总体而言，没有任何单一配置能在所有维度上占优，且一个维度的性能提升可能伴随另一维度的损失。这些发现确立了受众细分作为实现有效LLM社会模拟的核心方法论，并强调需要采用关注异质性的评估策略和保持方差的建模方法。

Large Language Models (LLMs) are increasingly used to simulate social attitudes and behaviors, offering scalable “silicon samples” that can approximate human data. However, current simulation practice often collapses diversity into an “average persona,” masking subgroup variation that is central to social reality. This study introduces audience segmentation as a systematic approach for restoring heterogeneity in LLM-based social simulation. Using U.S. climate-opinion survey data, we compare six segmentation configurations across two open-weight LLMs (Llama 3.1-70B and Mixtral 8x22B), varying segmentation identifier granularity, parsimony, and selection logic (theory-driven, data-driven, and instrument-based). We evaluate simulation performance with a three-dimensional evaluation framework covering distributional, structural, and predictive fidelity. Results show that increasing identifier granularity does not produce consistent improvement: moderate enrichment can improve performance, but further expansion does not reliably help and can worsen structural and predictive fidelity. Across parsimony comparisons, compact configurations often match or outperform more comprehensive alternatives, especially in structural and predictive fidelity, while distributional fidelity remains metric dependent. Identifier selection logic determines which fidelity dimension benefits most: instrument-based selection best preserves distributional shape, whereas data-driven selection best recovers between-group structure and identifier-outcome associations. Overall, no single configuration dominates all dimensions, and performance gains in one dimension can coincide with losses in another. These findings position audience segmentation as a core methodological approach for valid LLM-based social simulation and highlight the need for heterogeneity-aware evaluation and variance-preserving modeling strategies.

评分理由: 该论文研究大语言模型（LLMs）中的语用推理，特别是标量多样性，通过激活导向方法（CIS）和数据集（GraSD）来评估LLMs的语用敏感性。因此，与"Large Language Models"高度相关（10分），因为论文核心是评估LLMs的语用能力；与"Mechanistic Interpretability"高度相关（10分），因为论文通过激活导向来探测LLMs的内部表示和解释性。其他关键词如MoE、SFT、RAG等未在论文中涉及，因此得0分。

语用推理本质上是渐变的。不同词汇项引发的语用充实程度存在差异，等级含义通过量表多样性体现了这一特性——不同量表项目产生的含义强度各不相同。然而，当前对大语言模型语用推理能力的评估常依赖基于提示词的操控。除提示层面影响外，本研究提出连续解释性导向法，通过将激活层导向强度作为连续实验变量，探究渐变的语用解释现象。为支持此分析，本研究构建了包含渐变量表多样性的新数据集GraSD。在四个大语言模型上的实验表明：均匀激活导向虽能全局提升语用解释倾向，却会消除项目级差异；而渐变激活导向能产生与量表多样性等级相匹配的差异化解释偏移。这证明渐变敏感性已编码于表征空间中，并能通过受控干预系统性地恢复。连续解释性导向法与GraSD数据集共同构成了评估大语言模型渐变语用敏感性的理论框架。

Pragmatic inference is inherently graded. Different lexical items give rise to pragmatic enrichment to different degrees. Scalar implicature exemplifies this property through scalar diversity, where implicature strength varies across scalar items. However, evaluations of pragmatic inference in large language models (LLMs) often rely on prompt-based manipulations. Beyond prompt-level effects, this study introduces Continuous Interpretive Steering (CIS), a method that probes graded pragmatic interpretation by treating activation-level steering strength as a continuous experimental variable. To support this analysis, this study introduces a new dataset, GraSD, which encodes graded scalar diversity. Experiments on four LLMs show that uniform activation steering increases pragmatic interpretations globally but collapses item-level variation, whereas graded activation steering yields differentiated interpretive shifts aligned with scalar diversity grades. It indicates that graded sensitivity is encoded in the representation space and can be systematically recovered through controlled intervention. Together, CIS and GraSD provide a principled framework for evaluating graded pragmatic sensitivity in LLMs.

评分理由: 论文STQuant专注于大模型训练中的量化技术，核心贡献是提出一个动态量化框架来减少优化器状态的内存占用。与关键词的相关性分析如下：1) “Quantization"高度相关（10分），因为论文核心就是量化技术；2) “Large Language Models"和"Pre-training"有一定关联（各5分），论文实验使用了GPT-2（LLM）并在训练阶段应用量化；3) 其他关键词如MoE、SFT、RAG等与论文内容无关（0分），论文未涉及这些具体技术。

量化是降低大规模模型训练内存开销的有效途径。然而，现有方法大多采用固定精度策略，忽视了优化器状态分布在模型各层与训练步骤间存在显著差异的事实。这种统一的设计往往导致明显的精度损失。为突破固定量化的限制，我们提出了STQuant——一种分布式训练框架，它通过在模型层间、状态变量间及训练步骤间动态分配精度，在保持模型质量的同时显著降低优化器状态的内存占用。在训练中直接应用动态量化面临两大挑战：首先，优化器状态对数值变化敏感，量化噪声可能破坏训练稳定性；其次，同时考虑多状态、多层的量化会形成巨大的组合搜索空间。STQuant通过两项关键技术应对这些挑战：1）一种可证明近似最优的因子选择策略，能精准识别对精度调整影响最大的关键因子；2）一种动态转换决策算法，将搜索成本从指数复杂度降至线性复杂度。在GPT-2和ViT上的实验表明，相较于现有方案，STQuant将优化器状态内存降低84.4%，平均位宽降至5.1比特。此外，STQuant仅产生O(N/K)的计算开销，且仅需O(1)的额外存储空间。

Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies, which ignore the fact that optimizer-state distributions vary significantly across layers and training steps. Such uniform designs often introduce noticeable accuracy degradation. To move beyond fixed quantization, we propose STQuant, a distributed training framework that reduces the memory footprint of optimizer states via dynamic precision allocation across layers, state variables, and training steps, while maintaining model quality. Naively applying dynamic quantization during training is challenging for two reasons. First, optimizer states are numerically sensitive, and quantization noise can destabilize quality. Second, jointly considering multiple states and layers induces a large combinatorial search space. STQuant addresses these challenges with two key techniques: 1) a provably near-optimal factor selection strategy that accurately identifies the most influential factors for precision adaptation. 2) a dynamic transition decision algorithm that reduces the search cost from exponential to linear complexity. Experiments on GPT-2 and ViT show that STQuant reduces optimizer-state memory by 84.4%, achieving an average bit-width of as low as 5.1 bits, compared with existing solutions. Moreover, STQuant incurs only O(N/K) computational overhead and requires O(1) extra space.

评分理由: 论文核心是使用大语言模型（LLMs）进行ESG情感分析，因此与"Large Language Models"高度相关（10分）。论文提到对SloBERTa进行微调，这与"Post-training"有一定关联（5分）。其他关键词如MoE、SLMs、Scaling Laws、Instruction Tuning、RAG、Agents等均未在摘要中提及或与论文主题无关，因此得0分。

环境、社会和治理（Environmental, Social, and Governance，简称ESG）考量日益成为评估企业绩效、声誉和长期可持续性的重要组成部分。然而，针对小型企业和新兴市场的可靠ESG评级仍然有限。本文首次引入了公开可用的斯洛文尼亚语ESG情感数据集，以及一套用于自动检测ESG情感的模型。该数据集源自MaCoCu斯洛文尼亚语新闻语料库，结合了大型语言模型（Large Language Model, LLM）辅助过滤与人工标注的公司相关ESG内容。我们评估了单语模型（SloBERTa）和多语模型（XLM-R）、基于嵌入的分类器（TabPFN）、分层集成架构以及大型语言模型的性能。结果显示，在环境（Gemma3-27B，宏观F1分数：0.61）和社会维度（gpt-oss 20B，宏观F1分数：0.45）上，大型语言模型表现最佳；而在治理分类任务中，经过微调的SloBERTa模型表现最优（宏观F1分数：0.54）。随后，我们通过一个小型案例研究展示了性能最佳的分类器（gpt-oss）如何应用于对选定公司在长时间跨度内的ESG表现进行分析。

Environmental, Social, and Governance (ESG) considerations are increasingly integral to assessing corporate performance, reputation, and long-term sustainability. Yet, reliable ESG ratings remain limited for smaller companies and emerging markets. We introduce the first publicly available Slovene ESG sentiment dataset and a suite of models for automatic ESG sentiment detection. The dataset, derived from the MaCoCu Slovene news collection, combines large language model (LLM)-assisted filtering with human annotation of company-related ESG content. We evaluate the performance of monolingual (SloBERTa) and multilingual (XLM-R) models, embedding-based classifiers (TabPFN), hierarchical ensemble architectures, and large language models. Results show that LLMs achieve the strongest performance on Environmental (Gemma3-27B, F1-macro: 0.61) and Social aspects (gpt-oss 20B, F1-macro: 0.45), while fine-tuned SloBERTa is the best model on Governance classification (F1-macro: 0.54). We then show in a small case study how the best-preforming classifier (gpt-oss) can be applied to investigate ESG aspects for selected companies across a long time frame.

评分理由: 论文标题和摘要明确聚焦于大语言模型（LLMs）的隐私成本研究，直接匹配第一个关键词"Large Language Models” OR “LLMs” OR “Foundation Models”，因此给予10分。论文研究的是LLMs在训练数据隐私保护（差分隐私）下的理论性能分析，属于大模型技术原理的创新（隐私保护方向），符合研究背景要求。其他关键词涉及模型架构、训练方法、推理优化、应用领域等具体技术或应用，论文未涉及这些具体方面，因此均评为0分。

随着大语言模型（LLMs）越来越多地基于敏感用户数据进行训练，理解语言学习中隐私的基本代价变得至关重要。我们首次在不可知统计设定下，系统研究了差分隐私（Differentially Private, DP）的语言识别与生成任务，建立了算法并给出了匹配的下界，从而精确量化了隐私的代价。对于这两项任务，采用常数 $\varepsilon > 0$ 的近似 $(\varepsilon, \delta)$-DP 能够恢复非隐私的错误率：识别任务为 $\exp(-r(n))$（对于任意 $r(n) = o(n)$），生成任务为 $\exp(-Ω(n))$。在纯 $\varepsilon$-DP 下，指数项会衰减一个 $\min{1, \varepsilon}$ 的乘法因子，我们证明该因子在常数范围内是紧的。值得注意的是，在温和假设下，对于纯 DP 的生成任务，其上界 $\exp(-\min{1,\varepsilon} \cdot Ω(n))$ 与下界在常数范围内匹配，从而确立了最优速率。我们的结果表明，语言学习中的隐私代价出人意料地温和：在近似 DP 下完全不存在，而在纯 DP 下则恰好表现为指数项上的一个 $\min{1,\varepsilon}$ 因子。

As large language models (LLMs) are increasingly trained on sensitive user data, understanding the fundamental cost of privacy in language learning becomes essential. We initiate the study of differentially private (DP) language identification and generation in the agnostic statistical setting, establishing algorithms and matching lower bounds that precisely quantify the cost of privacy. For both tasks, approximate $(\varepsilon, δ)$-DP with constant $\varepsilon > 0$ recovers the non-private error rates: $\exp(-r(n))$ for identification (for any $r(n) = o(n)$) and $\exp(-Ω(n))$ for generation. Under pure $\varepsilon$-DP, the exponents degrade by a multiplicative factor of $\min{1, \varepsilon}$, which we show is tight up to constants. Notably, for generation under pure DP with mild assumptions, the upper bound $\exp(-\min{1,\varepsilon} \cdot Ω(n))$ matches the lower bound up to some constants, establishing an optimal rate. Our results show that the cost of privacy in language learning is surprisingly mild: absent entirely under approximate DP, and exactly a $\min{1,\varepsilon}$ factor in the exponent under pure DP.

评分理由: 该论文的核心是评估LLM在Text-to-SQL生成中的结构可靠性，并提出了SQLStructEval框架。因此，它与关键词"Large Language Models” OR “LLMs” OR “Foundation Models"高度相关（10分），因为论文直接研究LLM生成的SQL查询。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、Fine-tuning、Alignment、RLHF、PEFT、RAG、Context Window、KV Cache、Reasoning、Agents、Tool Use、Quantization、Inference、Hallucination、Interpretability、World Models、Model Merging、In-context Learning、AI for Science等，论文未涉及这些具体技术或应用领域，因此评分为0分。

尽管在文本到SQL基准测试中表现强劲，大型语言模型生成的SQL程序是否具有结构可靠性仍不明确。本研究探究了LLM生成的SQL查询的结构行为，并提出了SQLStructEval框架，该框架通过规范抽象语法树表示来分析程序结构。我们在Spider基准上的实验表明，即使执行结果正确，现代LLM对相同输入也常生成结构差异显著的查询，且这种差异常由表层输入变化（如释义或模式呈现方式）触发。我们进一步证明，通过编译式流程在结构化空间中生成查询，能同时提升执行准确性与结构一致性。这些发现表明，结构可靠性是评估基于LLM的程序生成系统时关键但被忽视的维度。代码发布于https://anonymous.4open.science/r/StructEval-2435。

Despite strong performance on Text-to-SQL benchmarks, it remains unclear whether LLM-generated SQL programs are structurally reliable. In this work, we investigate the structural behavior of LLM-generated SQL queries and introduce SQLStructEval, a framework for analyzing program structures through canonical abstract syntax tree (AST) representations. Our experiments on the Spider benchmark show that modern LLMs often produce structurally diverse queries for the same input, even when execution results are correct, and that such variance is frequently triggered by surface-level input changes such as paraphrases or schema presentation. We further show that generating queries in a structured space via a compile-style pipeline can improve both execution accuracy and structural consistency. These findings suggest that structural reliability is a critical yet overlooked dimension for evaluating LLM-based program generation systems. Our code is available at https://anonymous.4open.science/r/StructEval-2435.

评分理由: 论文专注于事件相机的人脸识别，属于计算机视觉领域，而非大语言模型或深度学习技术原理的创新。唯一相关的关键词是"PEFT” OR “LoRA” OR “Parameter-efficient Fine-tuning”，因为论文明确使用了LoRA（Low-Rank Adaptation）来迁移预训练RGB人脸模型的结构先验到事件域，这是核心方法之一，因此给10分。其他关键词均未涉及，故给0分。

事件相机因其在光照鲁棒性和隐私友好性方面的固有优势，为人脸识别提供了一种前景广阔的传感模式。然而，由于事件流缺乏传统基于RGB的人脸识别系统所依赖的稳定光度外观，我们认为基于事件的人脸识别应当对由刚性面部运动与个体面部几何结构塑造的结构驱动的时空身份表征进行建模。由于目前仍缺乏专门用于基于事件的人脸识别的数据集，我们构建了EFace——一个在刚性面部运动下采集的小规模基于事件的人脸数据集。为了从这些有限的事件数据中有效学习，我们进一步提出了EventFace，这是一个用于基于事件的人脸识别的框架，它整合了空间结构和时间动态以进行身份建模。具体而言，我们采用低秩自适应（Low-Rank Adaptation, LoRA）技术，将结构化的面部先验知识从预训练的RGB人脸模型迁移到事件域，从而为身份建模建立一个可靠的空间基础。在此基础上，我们进一步引入了一个运动提示编码器（Motion Prompt Encoder, MPE）来显式编码时间特征，以及一个时空调制器（Spatiotemporal Modulator, STM）将其与空间特征融合，从而增强对身份相关事件模式的表征能力。大量实验表明，EventFace在所评估的基线方法中取得了最佳性能，其Rank-1识别率达到94.19%，等错误率（Equal Error Rate, EER）为5.35%。结果进一步表明，与竞争方法相比，EventFace在光照条件恶化时表现出更强的鲁棒性。此外，学习到的表征显示出降低的模板可重构性。

Event cameras offer a promising sensing modality for face recognition due to their inherent advantages in illumination robustness and privacy-friendliness. However, because event streams lack the stable photometric appearance relied upon by conventional RGB-based face recognition systems, we argue that event-based face recognition should model structure-driven spatiotemporal identity representations shaped by rigid facial motion and individual facial geometry. Since dedicated datasets for event-based face recognition remain lacking, we construct EFace, a small-scale event-based face dataset captured under rigid facial motion. To learn effectively from this limited event data, we further propose EventFace, a framework for event-based face recognition that integrates spatial structure and temporal dynamics for identity modeling. Specifically, we employ Low-Rank Adaptation (LoRA) to transfer structural facial priors from pretrained RGB face models to the event domain, thereby establishing a reliable spatial basis for identity modeling. Building on this foundation, we further introduce a Motion Prompt Encoder (MPE) to explicitly encode temporal features and a Spatiotemporal Modulator (STM) to fuse them with spatial features, thereby enhancing the representation of identity-relevant event patterns. Extensive experiments demonstrate that EventFace achieves the best performance among the evaluated baselines, with a Rank-1 identification rate of 94.19% and an equal error rate (EER) of 5.35%. Results further indicate that EventFace exhibits stronger robustness under degraded illumination than the competing methods. In addition, the learned representations exhibit reduced template reconstructability.

评分理由: 论文专注于计算机视觉领域的视觉上下文学习（Visual In-Context Learning），特别是将静态模型（如DeLVM）转化为交互式系统（Interactive DeLVM），允许用户通过涂鸦、点击或画框等视觉线索动态引导模型预测。论文的核心是视觉任务（如交互式分割、超分辨率、对象移除）的交互式适应，而非大语言模型（LLMs）或深度学习技术原理的创新。因此，仅与关键词“In-context Learning”高度相关（10分），因为论文直接涉及视觉上下文学习的概念和应用。其他关键词均与大语言模型、模型训练、推理优化、代理系统、科学AI应用等无关，故评分为0分。加权总分计算为10.0（10 × 1.0）。

视觉上下文学习模型旨在通过利用一组示例输入-输出对来适应新任务，从而无需任务特定微调即可实现快速泛化。然而，这些模型本质上运行于一种静态范式：尽管它们能够适应新任务，却缺乏任何机制来整合用户提供的引导信号（如涂鸦、点击或边界框）以引导或优化预测过程。这一限制在现实应用中尤为突出，因为用户往往希望主动引导模型预测，例如通过高亮目标对象以进行分割、指示应进行视觉修改的区域，或在复杂场景中隔离特定人物以运行针对性姿态估计。在本研究中，我们提出了一种简单方法，将静态视觉上下文学习模型（特别是DeLVM方法）转化为高度可控的用户驱动系统，即交互式DeLVM，使其能够通过涂鸦、点击或绘制边界框等自然视觉线索实现无缝交互。具体而言，通过将交互直接编码到示例输入-输出对中，我们保持了视觉上下文学习的核心理念不变：使用户能够通过未见过的交互方式提示模型而无需微调，并赋能用户通过个性化交互动态引导模型预测。我们的实验表明，现有最先进的视觉上下文学习模型无法有效利用交互线索，常常完全忽略用户引导。相比之下，我们的方法在可控的用户引导场景中表现卓越，在交互式分割任务中实现了$+7.95%$交并比提升，在定向超分辨率任务中实现了$+2.46$峰值信噪比提升，在交互式对象移除任务中实现了$-3.14%$学习感知图像块相似度降低。由此，我们的工作弥合了以用户为中心的视觉上下文学习中僵化的静态任务适应与流畅交互性之间的鸿沟。

Visual in-context learning models are designed to adapt to new tasks by leveraging a set of example input-output pairs, enabling rapid generalization without task-specific fine-tuning. However, these models operate in a fundamentally static paradigm: while they can adapt to new tasks, they lack any mechanism to incorporate user-provided guidance signals such as scribbles, clicks, or bounding boxes to steer or refine the prediction process. This limitation is particularly restrictive in real-world applications, where users want to actively guide model predictions, e.g., by highlighting the target object for segmentation, indicating a region which should be visually altered, or isolating a specific person in a complex scene to run targeted pose estimation. In this work, we propose a simple method to transform static visual in-context learners, particularly the DeLVM approach, into highly controllable, user-driven systems, i.e., Interactive DeLVM, enabling seamless interaction through natural visual cues such as scribbles, clicks, or drawing boxes. Specifically, by encoding interactions directly into the example input-output pairs, we keep the philosophy of visual in-context learning intact: enabling users to prompt models with unseen interactions without fine-tuning and empowering them to dynamically steer model predictions with personalized interactions. Our experiments demonstrate that SOTA visual in-context learning models fail to effectively leverage interaction cues, often ignoring user guidance entirely. In contrast, our method excels in controllable, user-guided scenarios, achieving improvements of $+7.95%$ IoU for interactive segmentation, $+2.46$ PSNR for directed super-resolution, and $-3.14%$ LPIPS for interactive object removal. With this, our work bridges the gap between rigid static task adaptation and fluid interactivity for user-centric visual in-context learning.

评分理由: 论文研究稀疏性在函数学习中的应用，属于深度学习理论领域，与大多数大模型技术关键词（如LLM、微调、对齐、推理等）无关。唯一相关的是"Mixture of Experts” OR “MoE” OR “Sparse Models”，因为论文核心涉及稀疏模型（sparse models）和稀疏特征提取，但并非专门针对MoE架构，因此给5分（有一定关联）。其他关键词均未涉及。

深度神经网络已成为学习定义在无限维函数空间上的算子的强大工具。然而，现有理论常面临与维数过高和可解释性有限相关的困难。本研究探讨了稀疏性如何帮助解决函数学习（算子学习的核心组成部分）中的这些挑战。我们提出了一个框架，该框架利用卷积架构从有限数量的样本中提取稀疏特征，并结合深度全连接网络来有效逼近非线性泛函。通过通用离散化方法，我们证明了稀疏逼近器能够从离散样本中实现稳定恢复。此外，确定性采样方案与随机采样方案均足以支持我们的分析。这些发现使得在各类函数空间（包括具有快速频率衰减和混合光滑性的空间）中获得了更优的逼近速率并减少了所需样本量。它们也为稀疏性如何缓解函数学习中的维度诅咒问题提供了新的理论见解。

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited interpretability. This work investigates how sparsity can help address these challenges in functional learning, a central ingredient in operator learning. We propose a framework that employs convolutional architectures to extract sparse features from a finite number of samples, together with deep fully connected networks to effectively approximate nonlinear functionals. Using universal discretization methods, we show that sparse approximators enable stable recovery from discrete samples. In addition, both the deterministic and the random sampling schemes are sufficient for our analysis. These findings lead to improved approximation rates and reduced sample sizes in various function spaces, including those with fast frequency decay and mixed smoothness. They also provide new theoretical insights into how sparsity can alleviate the curse of dimensionality in functional learning.

评分理由: 该论文专注于计算机视觉领域的3D/4D重建任务，提出了一种名为Elastic Test-Time Training的方法来改进LaCT（Large Chunk Test-Time Training），并基于此构建了Fast Spatial Memory（FSM）模型。论文的核心是处理长序列视觉数据的测试时训练、快速权重更新和空间记忆建模，属于深度学习在视觉科学计算中的应用。然而，论文内容与绝大多数评分关键词（主要围绕大语言模型的技术原理、训练方法、推理优化、对齐、代理系统等）完全无关。唯一略有相关的是"Pre-training”，因为论文提到FSM在大型3D/4D数据上进行了预训练，但这并非论文的核心创新点，只是模型构建的一个步骤，因此给予5分（有一定关联）。其他关键词均未涉及。

大块测试时训练（LaCT）在长上下文三维重建任务中表现出色，但其完全可塑的推理时更新仍易受灾难性遗忘和过拟合的影响。因此，LaCT通常被实例化为覆盖整个输入序列的单一大型数据块，未能实现单次处理任意长序列的更广泛目标。受弹性权重巩固启发，我们提出弹性测试时训练方法，通过围绕固定锚点状态的费舍尔加权弹性先验来稳定LaCT的快速权重更新。该锚点以过去快速权重的指数移动平均形式演化，以平衡稳定性与可塑性。基于此更新架构，我们引入快速空间记忆（FSM）——一种高效可扩展的四维重建模型，能够从长观测序列中学习时空表征，并渲染新颖的视角-时间组合。我们在大规模精选三维/四维数据上对FSM进行预训练，以捕捉复杂空间环境的动态特性与语义信息。大量实验表明，FSM支持长序列的快速适应，能够以更小的数据块实现高质量的三维/四维重建，同时缓解相机插值捷径问题。总体而言，我们希望推动LaCT突破有限单块处理的限制，实现稳健的多块适应能力——这是向真正长序列泛化的必要步骤，同时显著缓解激活内存瓶颈问题。

Large Chunk Test-Time Training (LaCT) has shown strong performance on long-context 3D reconstruction, but its fully plastic inference-time updates remain vulnerable to catastrophic forgetting and overfitting. As a result, LaCT is typically instantiated with a single large chunk spanning the full input sequence, falling short of the broader goal of handling arbitrarily long sequences in a single pass. We propose Elastic Test-Time Training inspired by elastic weight consolidation, that stabilizes LaCT fast-weight updates with a Fisher-weighted elastic prior around a maintained anchor state. The anchor evolves as an exponential moving average of past fast weights to balance stability and plasticity. Based on this updated architecture, we introduce Fast Spatial Memory (FSM), an efficient and scalable model for 4D reconstruction that learns spatiotemporal representations from long observation sequences and renders novel view-time combinations. We pre-trained FSM on large-scale curated 3D/4D data to capture the dynamics and semantics of complex spatial environments. Extensive experiments show that FSM supports fast adaptation over long sequences and delivers high-quality 3D/4D reconstruction with smaller chunks and mitigating the camera-interpolation shortcut. Overall, we hope to advance LaCT beyond the bounded single-chunk setting toward robust multi-chunk adaptation, a necessary step for generalization to genuinely longer sequences, while substantially alleviating the activation-memory bottleneck.