📊 ArXiv 研究报告 (2026-04-28)

生成时间: 2026-04-28 17:23:48 数据源: ArXiv

📌 配置信息

关键词列表(共 27 个,总权重 27.0)

关键词权重类型
“Large Language Models” OR “LLMs” OR “Foundation Models”1.0主要
“Mixture of Experts” OR “MoE” OR “Sparse Models”1.0主要
“Small Language Models” OR “SLMs” OR “On-device AI”1.0主要
“Scaling Laws” AND “Data Quality”1.0主要
“Pre-training” OR “Continual Pre-training” OR “Domain Adaptation”1.0主要
“Post-training” OR “Supervised Fine-tuning” OR “SFT”1.0主要
“Instruction Tuning” OR “Alignment” OR “Value Alignment”1.0主要
“RLHF” OR “RLAIF” OR “Direct Preference Optimization” OR “DPO”1.0主要
“PEFT” OR “LoRA” OR “Parameter-efficient Fine-tuning”1.0主要
“Retrieval-Augmented Generation” OR “RAG” OR “Retrieval-Generation”1.0主要
“Context Window Extension” OR “Long Context LLMs”1.0主要
“KV Cache Compression” OR “Linear Attention” OR “FlashAttention”1.0主要
“Chain of Thought” OR “CoT Reasoning” OR “Multi-step Reasoning”1.0主要
“System 2 Thinking” OR “Slow Thinking” OR “In-depth Reasoning”1.0主要
“Monte Carlo Tree Search” OR “MCTS” AND “LLM”1.0主要
“Self-Correction” OR “Self-Improvement” OR “Self-Reflection”1.0主要
“LLM Agents” OR “Autonomous Agents” OR “Agentic Workflow”1.0主要
“Tool Use” OR “Function Calling” OR “API Tool Use”1.0主要
“Multi-agent Systems” OR “Agent Coordination”1.0主要
“Quantization” OR “Model Compression” OR “Low-bit Weights”1.0主要
“Speculative Decoding” OR “Inference Acceleration”1.0主要
“Hallucination Mitigation” OR “Factuality” OR “Truthfulness”1.0主要
“Mechanistic Interpretability” OR “Explainable AI”1.0主要
“World Models” AND “General World Models”1.0主要
“Model Merging” OR “Model Soups” OR “Weight Averaging”1.0主要
“In-context Learning” OR “Many-shot Learning”1.0主要
“AI for Science” OR “Bioinformatics” OR “Cheminformatics”1.0主要

评分设置

  • 每个关键词最大分: 15
  • 及格分公式: 5.0 + 0.8 × 总权重
  • 当前及格分: 26.6

📈 论文统计

  • 总抓取: 346 篇
  • 及格论文: 0 篇 (0.0%)

📋 所有论文列表

1. ❌ Learning to Rotate: Temporal and Semantic Rotary Encoding for Sequential Modeling

作者: Hailing Cheng, Daqi Sun, Xinyu Lu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24717v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注改进Transformer中的旋转位置编码(RoPE),提出SIREN-RoPE,将旋转空间变为可学习的、信号条件化的空间,用于序列建模。虽然涉及Transformer架构,但未提及大语言模型、深度学习技术原理创新或科学应用,与所有关键词均无直接关联。


!!! tip deepseek-chat TL;DR

论文提出SIREN-RoPE,通过可学习的旋转编码增强Transformer的序列建模能力,在推荐系统任务中取得改进。
摘要翻译

每个Transformer架构都投入了巨大的容量来在语义嵌入空间中学习丰富的表征——然而,旋转位置编码(RoPE)所作用的旋转流形却一直被视为一个固定的、手工设计的结构,其中仅填充了离散的序数索引。我们认为,这一旋转空间是注意力机制中一个很大程度上被忽视的表达性第二维度,对其的系统性探索可能为基于注意力的架构打开一扇新的大门。与复数的类比具有启发性:正如引入虚轴——与实轴正交且独立——解锁了曾被认为不可能的代数新结构,将旋转流形视为一个可学习的、受信号调节的空间,则为注意力开辟了一个正交的自由度。在此框架下,令牌嵌入编码了表征的语义(实)分量——即令牌的含义——而旋转则编码了其动态(虚)分量——即令牌如何随时间、位置和上下文与每一个其他令牌相关联。

我们提出了SIREN-RoPE,作为这一思想的具体实例化,它通过双分支正弦表示网络(SIREN)将异质信号——连续时间戳、周期性时间模式以及分类元数据——填充到旋转维度中。作为概念验证,我们使用来自某大型社交网络的生产级新闻推送数据集,并以生成式推荐器作为排序模型进行评估,结果表明激活这一隐藏维度能够在校准和排序目标上带来一致的改进,且计算开销可忽略不计。我们邀请学界将旋转空间视为一个尚未开发的轴,而非一个已解决的编码细节,其丰富的结构可能对注意力的影响,如同虚单位对代数的影响一样深远。


摘要 (Abstract)

Every Transformer architecture dedicates enormous capacity to learning rich representations in semantic embedding space – yet the rotation manifold acted upon by Rotary Positional Embeddings (RoPE) has been treated as a fixed, hand-crafted structure, populated only by discrete ordinal indices. We argue that this rotation space is a largely overlooked second dimension of expressivity in the attention mechanism, one whose systematic exploration may open a new door for attention-based architectures. The analogy to complex numbers is instructive: just as introducing the imaginary axis – orthogonal to and independent of the real line – unlocked new algebraic structure once believed impossible, treating the rotation manifold as a learnable, signal-conditioned space opens an orthogonal degree of freedom in attention. In this framing, the token embedding encodes the semantic (real) component of a representation – what a token means – while the rotation encodes its dynamic (imaginary) component – how it relates to every other token across time, position, and context. We introduce SIREN-RoPE, a concrete instantiation of this idea, which populates the rotation dimension with heterogeneous signals – continuous timestamps, cyclical temporal patterns, and categorical metadata – via a dual-branch Sinusoidal Representation Network (SIREN). As a proof of concept, we evaluate on a production-scale news feed dataset from a major social network using a generative recommender as the ranking model, demonstrating that activating this hidden dimension yields consistent improvements across calibration and ranking objectives with negligible computational overhead. We invite the community to view the rotation space not as a solved positional-encoding detail, but as an untapped axis whose rich structure may prove as consequential for attention as the imaginary unit proved for algebra.


关键词: Rotary Positional Embeddings, SIREN, Sequence Modeling, Attention Mechanism, Transformer, Temporal Encoding, Semantic Encoding


2. ❌ Personalized Worked Example Generation from Student Code Submissions using Pattern-based Knowledge Components

作者: Griffin Pitts, Muntasir Hoq, Peter Brusilovsky, Narges Norouzi, Arto Hellas, Juho Leinonen, Bita Akram 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24758v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究利用大语言模型(LLM)生成个性化编程示例,核心涉及LLM在教育领域的应用,但未涉及其他关键词如MoE、SLM、Scaling Laws等。因此仅对’Large Language Models’评8分,其余关键词均为0分。


!!! tip deepseek-chat TL;DR

该论文提出一种基于知识组件的模式驱动方法,利用大语言模型从学生代码中生成个性化编程示例,以提高学习内容的相关性和针对性。
摘要翻译

自适应编程实践通常依赖于固定的示例代码和练习题库,这些库需要大量的编写工作,且可能无法很好地对应学生在编写代码时产生的逻辑错误和部分解决方案。因此,学生可能会收到未能直接针对其正在努力理解的概念的学习内容,而教师则要么投入额外精力扩充内容库,要么接受较为粗粒度的个性化水平。我们提出了一种基于知识组件(knowledge-component, KC)引导的教育内容生成方法,该方法利用从学生代码中提取的基于模式的KC。给定问题描述和学生提交的代码,我们的流程通过基于抽象语法树(AST)的分析从学生代码中提取重复出现的结构化的KC模式,并利用这些模式来条件化生成模型。在本研究中,我们将该方法应用于示例代码生成,并通过专家评估比较了基线输出与KC条件化输出。结果表明,KC条件化生成改善了主题聚焦度以及与学习者潜在逻辑错误的相关性,这为基于KC的生成模型引导能够支持大规模个性化学习提供了证据。


摘要 (Abstract)

Adaptive programming practice often relies on fixed libraries of worked examples and practice problems, which require substantial authoring effort and may not correspond well to the logical errors and partial solutions students produce while writing code. As a result, students may receive learning content that does not directly address the concepts they are working to understand, while instructors must either invest additional effort in expanding content libraries or accept a coarse level of personalization. We present an approach for knowledge-component (KC) guided educational content generation using pattern-based KCs extracted from student code. Given a problem statement and student submissions, our pipeline extracts recurring structural KC patterns from students’ code through AST-based analysis and uses them to condition a generative model. In this study, we apply this approach to worked example generation, and compare baseline and KC-conditioned outputs through expert evaluation. Results suggest that KC-conditioned generation improves topical focus and relevance to learners’ underlying logical errors, providing evidence that KC-based steering of generative models can support personalized learning at scale.


关键词: Large Language Models, Knowledge Components, Worked Example Generation, Personalized Learning, AST-based Analysis, Educational Content Generation


3. ❌ Learning to Think from Multiple Thinkers

作者: Nirmit Joshi, Roey Magen, Nathan Srebro, Nikolaos Tsilivis, Gal Vardi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24737v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.015.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.010.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究Chain-of-Thought (CoT) 推理,特别是从多个不同思考者提供的CoT监督中学习。关键词’Chain of Thought OR CoT Reasoning OR Multi-step Reasoning’高度相关(15分),因为CoT是论文核心。‘System 2 Thinking OR Slow Thinking OR In-depth Reasoning’也相关(10分),因为CoT属于系统2思维。‘Large Language Models OR LLMs OR Foundation Models’相关(10分),因为CoT通常应用于LLMs,且论文背景涉及LLM推理。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

该论文研究从多个不同思考者提供的链式思维(CoT)监督中学习,证明在密码学假设下,被动收集少量不同思考者的CoT数据可能导致学习困难,但提出了一种高效的主动学习算法,仅需少量CoT数据和中等数量的思考者即可实现高精度学习。
摘要翻译

我们研究了基于多思考者提供的思维链(Chain-of-Thought, CoT)监督的学习问题。这些思考者均给出正确但可能系统性地不同的解决方案,例如不同思考者撰写的数学题逐步解答,或解决同一问题的不同程序的逐步执行轨迹。
我们考虑那些在单一思考者的CoT监督下计算上易于学习,但在仅有最终结果监督(即无CoT)时难以学习的类别(Joshi et al. 2025)。我们证明,在密码学假设下,在被动数据收集场景中,由两个或少数不同思考者提供的CoT监督可能导致学习困难。
另一方面,我们提出了一种通用的计算高效主动学习算法,该算法对每个思考者仅需少量CoT数据(该数据量完全独立于目标精度$\varepsilon$),所需思考者数量适中(按$\log \frac{1}{\varepsilon}\log \log \frac{1}{\varepsilon}$增长),并依赖充足的被动最终结果数据(按$\frac{1}{\varepsilon}\cdot poly\log\frac{1}{\varepsilon}$增长)。


摘要 (Abstract)

We study learning with Chain-of-Thought (CoT) supervision from multiple thinkers, all of whom provide correct but possibly systematically different solutions, e.g., step-by-step solutions to math problems written by different thinkers, or step-by-step execution traces of different programs solving the same problem. We consider classes that are computationally easy to learn using CoT supervision from a single thinker, but hard to learn with only end-result supervision, i.e., without CoT (Joshi et al. 2025). We establish that, under cryptographic assumptions, learning can be hard from CoT supervision provided by two or a few different thinkers, in passive data-collection settings. On the other hand, we provide a generic computationally efficient active learning algorithm that learns with a small amount of CoT data per thinker that is completely independent of the target accuracy $\varepsilon$, a moderate number of thinkers that scales as $\log \frac{1}{\varepsilon}\log \log \frac{1}{\varepsilon}$, and sufficient passive end-result data that scales as $\frac{1}{\varepsilon}\cdot poly\log\frac{1}{\varepsilon}$.


关键词: Chain-of-Thought, CoT supervision, multiple thinkers, active learning, passive data collection, computational hardness, cryptographic assumptions


4. ❌ Scalable Hyperparameter-Divergent Ensemble Training with Automatic Learning Rate Exploration for Large Models

作者: Hailing Cheng, Tao Huang, Chen Zhu, Antonio Alonso 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24708v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出了一种超参数发散集成训练方法(HDET),用于自动探索学习率等超参数,主要关注训练效率和泛化性能,不涉及大模型、深度学习技术原理创新或科学应用。所有关键词均不相关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种超参数发散集成训练方法(HDET),通过并行探索学习率等超参数并周期性平均参数,实现自动学习率调度,提升优化质量和泛化性能,无需额外调参。
摘要翻译

采用数据并行随机梯度下降训练大型神经网络时,会分配N个GPU副本以计算近乎相同的梯度更新——这种做法使得训练过程中丰富的学习率配置空间完全未被探索。我们提出超参数发散集成训练(Hyperparameter-Divergent Ensemble Training, HDET)方法,该方法以可忽略的通信开销重新利用这些副本进行同步学习率探索。HDET采用交替运行阶段:发散阶段中,各副本在结构化对称分布的学习率下独立训练;收敛阶段中,每经过T步通过AllReduce操作对所有副本的参数进行平均。基于该集成框架,我们进一步提出自动学习率(auto-LR)控制器,将各副本间的相对训练损失作为性能信号,通过基于动量的无梯度元更新机制,将共享基础调度策略向更高性能配置方向调整。该组合方法可生成自适应学习率调度策略,在不增加超参数搜索或训练预算的前提下,同时提升优化质量与泛化性能。
关键的是,该框架可推广至学习率之外的场景:任何不改变模型架构的标量超参数——例如丢弃率、注意力缩放温度或权重衰减系数——均可通过相同的发散/收敛协议在各副本间进行探索,副本间的损失差异可作为引导搜索方向的零阶超梯度。HDET作为PyTorch中OneCycleLR调度器的即插即用替代方案实现,无需修改模型架构、优化器或数据流水线。


摘要 (Abstract)

Training large neural networks with data-parallel stochastic gradient descent allocates N GPU replicas to compute effectively identical updates – a practice that leaves the rich space of learning rate configurations entirely unexplored during training. We propose Hyperparameter-Divergent Ensemble Training (HDET), a method that repurposes these replicas for simultaneous learning rate exploration at negligible communication overhead. HDET operates in alternating phases: a fan-out stage in which replicas train independently under a structured, symmetric spread of learning rates, and a converge stage in which parameters are averaged across all replicas via AllReduce every T steps. Building on this ensemble substrate, we further propose an automatic learning rate (auto-LR) controller that treats the relative training loss across replicas as a performance signal, updating the shared base schedule toward higher-performing configurations via a momentum-based gradient-free meta-update. The combined method produces a self-adapting learning rate schedule that improves both optimization quality and generalization without additional hyperparameter sweeps or training budget. Crucially, the framework generalizes beyond learning rate: any scalar hyperparameter that does not alter model architecture – such as dropout rate, attention scale temperature, or weight-decay coefficient – can be explored across replicas using the same fan-out/converge protocol, with inter-replica loss differences serving as zero-order hypergradients that guide the search direction. HDET is implemented as a drop-in replacement for PyTorch’s OneCycleLR scheduler, requiring no changes to model architecture, optimizer, or data pipeline.


关键词: Hyperparameter-Divergent Ensemble Training, Learning Rate Exploration, Automatic Learning Rate, AllReduce, Zero-order Hypergradients, OneCycleLR


5. ❌ Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

作者: Amal Akli, Mike Papadakis, Maxime Cordy, Yves Le Traon 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24703v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.08.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.010.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究基于LLM的代码生成中任务描述缺陷的检测,核心涉及Large Language Models(高度相关,10分),使用小模型进行参数高效微调(PEFT/LoRA,10分),小模型本身属于Small Language Models(8分)。其他关键词如MoE、Scaling Laws、Pre-training等与论文内容无关,得0分。


!!! tip deepseek-chat TL;DR

论文开发了SpecValidator,一个基于小模型和参数高效微调的轻量级分类器,用于自动检测LLM代码生成中的任务描述缺陷,实验表明其性能优于GPT-5-mini和Claude Sonnet 4,并分析了缺陷类型和任务描述特征对LLM鲁棒性的影响。
摘要翻译

大型语言模型被广泛用于代码生成,然而它们依赖于一个隐含假设:任务描述足够详细且结构良好。但在实际应用中,用户可能提供有缺陷的描述,这会对代码正确性产生显著影响。为解决这一问题,我们开发了SpecValidator——一种基于小型模型并通过参数高效微调得到的轻量级分类器,用于自动检测任务描述缺陷。我们在三个结构复杂度和任务描述各异的基准测试上,针对三种缺陷类型(词汇模糊性、欠规范性和语法格式问题)对SpecValidator进行了评估。结果表明,SpecValidator的缺陷检测F1分数为0.804,MCC为0.745,显著优于GPT-5-mini(F1=0.469,MCC=0.281)和Claude Sonnet 4(F1=0.518,MCC=0.359)。或许更重要的是,我们的分析表明,SpecValidator能够泛化到未见问题,并检测出所用基准测试原始(真实)描述中未知的欠规范性缺陷。我们的结果还显示,大型语言模型在任务描述缺陷上的鲁棒性主要取决于缺陷类型和任务描述的特征,而非模型能力,其中欠规范性缺陷最为严重。我们进一步发现,具有更丰富上下文基础的基准测试(如LiveCodeBench)表现出显著更强的韧性,这凸显了结构化任务描述对于基于大型语言模型的可靠代码生成的重要性。


摘要 (Abstract)

Large language models are widely used for code generation, yet they rely on an implicit assumption that the task descriptions are sufficiently detailed and well-formed. However, in practice, users may provide defective descriptions, which can have a strong effect on code correctness. To address this issue, we develop SpecValidator, a lightweight classifier based on a small model that has been parameter-efficiently finetuned, to automatically detect task description defects. We evaluate SpecValidator on three types of defects, Lexical Vagueness, Under-Specification and Syntax-Formatting on 3 benchmarks with task descriptions of varying structure and complexity. Our results show that SpecValidator achieves defect detection of F1 = 0.804 and MCC = 0.745, significantly outperforming GPT-5-mini (F1 = 0.469 and MCC = 0.281) and Claude Sonnet 4 (F1 = 0.518 and MCC = 0.359). Perhaps more importantly, our analysis indicates that SpecValidator can generalize to unseen issues and detect unknown Under-Specification defects in the original (real) descriptions of the benchmarks used. Our results also show that the robustness of LLMs in task description defects depends primarily on the type of defect and the characteristics of the task description, rather than the capacity of the model, with Under-Specification defects being the most severe. We further found that benchmarks with richer contextual grounding, such as LiveCodeBench, exhibit substantially greater resilience, highlighting the importance of structured task descriptions for reliable LLM-based code generation.


关键词: Large Language Models, Code Generation, Defective Task Descriptions, Parameter-efficient Fine-tuning, Small Language Models, SpecValidator, Under-Specification


6. ❌ Case-Specific Rubrics for Clinical AI Evaluation: Methodology, Validation, and LLM-Clinician Agreement Across 823 Encounters

作者: Aaryan Shah, Andrew Hines, Alexia Downs, Denis Bajet, Paulius Mui, Fabiano Araujo, Laura Offutt, Aida Rutledge, Elizabeth Jimenez 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24710v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.08.0/100.0

评分理由: 论文主要研究临床AI评估的案例特定评分标准方法,使用LLM生成评分标准并与临床医生评分进行一致性比较。核心涉及LLM在临床评估中的应用,但未涉及其他关键词如MoE、SLM、Scaling Laws、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等。与’AI for Science’有一定关联,因为临床AI属于科学应用领域,但更偏向临床评估而非生物信息学或化学信息学。因此,仅LLM和AI for Science两个关键词有相关度。


!!! tip deepseek-chat TL;DR

该论文提出了一种案例特定的临床医生编写的评分标准方法用于评估临床AI,并验证了LLM生成的评分标准与临床医生评分的一致性,发现LLM评分标准能以千倍低成本实现相当的一致性。
摘要翻译

目的:临床AI文档系统需要评估方法,这些方法需具备临床有效性、经济可行性,并能敏锐捕捉迭代变化。要求对每个评分实例进行专家评审的方法,对于安全、迭代的部署而言过于缓慢且成本高昂。我们提出一种针对具体病例、由临床医生制定的评分标准方法,用于临床AI评估,并探究大语言模型生成的评分标准能否接近临床医生的一致性。

材料与方法:20名临床医生为823个临床病例(736个真实病例,87个合成病例)制定了1,646条评分标准,涵盖初级保健、精神病学、肿瘤学和行为健康领域。每条评分标准均通过验证,确认基于LLM的评分代理能始终如一地为临床医生偏好的输出给出高于被拒绝输出的分数。我们评估了嵌入电子健康记录的AI代理的七个版本,这些代理面向临床医生,覆盖所有病例。

结果:临床医生制定的评分标准能有效区分高质量与低质量输出(中位分数差距:82.9%),且评分稳定性高(中位范围:0.00%)。中位分数从84%提升至95%。在后续实验中,临床医生与LLM的排名一致性(tau值:0.42-0.46)达到或超过了临床医生之间的一致性(tau值:0.38-0.43),这归因于天花板压缩效应和LLM评分标准的改进。

讨论:这种趋同性支持将LLM评分标准与临床医生制定的评分标准相结合。LLM评分标准的成本约为前者的千分之一,能够实现显著更大的评估覆盖范围,而持续的临床医生参与则使评估立足于专家判断。天花板压缩效应对未来的评分者间一致性研究构成了方法论挑战。

结论:针对具体病例的评分标准为临床AI评估提供了一条路径,既保留了专家判断,又将自动化成本降低了三个数量级。临床医生制定的评分标准确立了基线,LLM评分标准则在此基础上得到验证。


摘要 (Abstract)

Objective. Clinical AI documentation systems require evaluation methodologies that are clinically valid, economically viable, and sensitive to iterative changes. Methods requiring expert review per scoring instance are too slow and expensive for safe, iterative deployment. We present a case-specific, clinician-authored rubric methodology for clinical AI evaluation and examine whether LLM-generated rubrics can approximate clinician agreement. Materials and Methods. Twenty clinicians authored 1,646 rubrics for 823 clinical cases (736 real-world, 87 synthetic) across primary care, psychiatry, oncology, and behavioral health. Each rubric was validated by confirming that an LLM-based scoring agent consistently scored clinician-preferred outputs higher than rejected ones. Seven versions of an EHR-embedded AI agent for clinicians were evaluated across all cases. Results. Clinician-authored rubrics discriminated effectively between high- and low-quality outputs (median score gap: 82.9%) with high scoring stability (median range: 0.00%). Median scores improved from 84% to 95%. In later experiments, clinician-LLM ranking agreement (tau: 0.42-0.46) matched or exceeded clinician-clinician agreement (tau: 0.38-0.43), attributable to both ceiling compression and LLM rubric improvement. Discussion. This convergence supports incorporating LLM rubrics alongside clinician-authored ones. At roughly 1,000 times lower cost, LLM rubrics enable substantially greater evaluation coverage, while continued clinical authorship grounds evaluation in expert judgment. Ceiling compression poses a methodological challenge for future inter-rater agreement studies. Conclusion. Case-specific rubrics offer a path for clinical AI evaluation that preserves expert judgment while enabling automation at three orders lower cost. Clinician-authored rubrics establish the baseline against which LLM rubrics are validated.


关键词: Clinical AI evaluation, Case-specific rubrics, LLM-generated rubrics, Clinician agreement, Scoring methodology, EHR-embedded AI agent


7. ❌ Green Shielding: A User-Centric Approach Towards Trustworthy AI

作者: Aaron J. Li, Nicolas Sanchez, Hao Huang, Ruijiang Dong, Jaskaran Bains, Katrin Jaradeh, Zhen Xiang, Bo Li, Feng Liu, Aaron Kornblith, Bin Yu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24700v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.05.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文聚焦于大语言模型(LLMs)在医疗诊断中的可信赖部署,研究良性输入变化对模型行为的影响,提出Green Shielding框架和HCM-Dx基准。与’Large Language Models’高度相关(10分),因为核心是LLMs;与’Hallucination Mitigation’相关(8分),因为涉及模型输出的可靠性和安全性;与’AI for Science’相关(10分),因为应用于医学诊断;与’LLM Agents’部分相关(5分),因为提及agentic AI系统。其他关键词如MoE、SLMs、预训练等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出Green Shielding框架,通过构建用户中心的基准和扰动测试,系统评估良性输入变化如何影响大语言模型在医疗诊断中的行为,发现存在Pareto权衡,为高安全场景提供部署指导。
摘要翻译

大规模语言模型(LLMs)的部署日益广泛,但其输出对用户提问方式中常规、非对抗性的变化高度敏感,现有红队测试工作尚未充分解决这一差距。我们提出“绿色屏蔽”(Green Shielding)这一以用户为中心的议程,通过刻画良性输入变化如何改变模型行为,构建基于证据的部署指南。我们通过CUE标准将该议程付诸实践:包含真实语境(Context)的基准测试、反映真实效用(Utility)的参考标准与指标,以及体现模型行为诱发(Elicitation)中现实变化的扰动。在PCS框架指导下,我们与执业医师合作,通过医疗诊断领域实现了绿色屏蔽:构建了HealthCareMagic-Diagnosis(HCM-Dx)基准测试——包含患者撰写的问诊查询、结构化参考诊断集以及用于评估鉴别诊断列表的临床指标。我们还研究了捕捉常规输入变化的扰动机制,并证明提示层面的因素会沿临床有意义的维度改变模型行为。在多个前沿LLM中,这些变化呈现出类似帕累托(Pareto)的权衡关系。特别地,中性化(neutralization)处理——在保留临床内容的同时移除常见用户层面因素——能提升合理性并生成更简洁、更接近临床医生的鉴别诊断,但会降低对高度可能及安全关键病症的覆盖度。这些结果共同表明,交互选择可系统性地改变模型输出中与任务相关的属性,并为高风险领域的更安全部署提供面向用户的指导。尽管本文以医疗诊断为实例,该议程可自然延伸至其他决策支持场景及自主AI系统。


摘要 (Abstract)

Large language models (LLMs) are increasingly deployed, yet their outputs can be highly sensitive to routine, non-adversarial variation in how users phrase queries, a gap not well addressed by existing red-teaming efforts. We propose Green Shielding, a user-centric agenda for building evidence-backed deployment guidance by characterizing how benign input variation shifts model behavior. We operationalize this agenda through the CUE criteria: benchmarks with authentic Context, reference standards and metrics that capture true Utility, and perturbations that reflect realistic variations in the Elicitation of model behavior. Guided by the PCS framework and developed with practicing physicians, we instantiate Green Shielding in medical diagnosis through HealthCareMagic-Diagnosis (HCM-Dx), a benchmark of patient-authored queries, together with structured reference diagnosis sets and clinically grounded metrics for evaluating differential diagnosis lists. We also study perturbation regimes that capture routine input variation and show that prompt-level factors shift model behavior along clinically meaningful dimensions. Across multiple frontier LLMs, these shifts trace out Pareto-like tradeoffs. In particular, neutralization, which removes common user-level factors while preserving clinical content, increases plausibility and yields more concise, clinician-like differentials, but reduces coverage of highly likely and safety-critical conditions. Together, these results show that interaction choices can systematically shift task-relevant properties of model outputs and support user-facing guidance for safer deployment in high-stakes domains. Although instantiated here in medical diagnosis, the agenda extends naturally to other decision-support settings and agentic AI systems.


关键词: Large Language Models, Trustworthy AI, Medical Diagnosis, Input Variation, User-Centric, Green Shielding, Benchmark


8. ❌ Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraft

作者: Zhou Ziheng, Huacong Tang, Jinyuan Zhang, Haowei Lin, Bangcheng Yang, Qian Long, Fang Sun, Yizhou Sun, Yitao Liang, Ying Nian Wu, Demetri Terzopoulos, Xiaofeng Gao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24697v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.08.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究LLM智能体在Minecraft中完成科学发现到应用的闭环,核心涉及LLM Agents和Tool Use,与LLM Agents高度相关(10分),与Tool Use相关(8分,因为智能体需要使用工具构建电路),其他关键词如CoT、Self-Correction等虽可能隐含但未明确提及,故评0分。


!!! tip deepseek-chat TL;DR

论文提出SciCrafter基准测试,评估LLM智能体在Minecraft中完成从科学发现到应用闭环的能力,发现当前模型成功率仅约26%,且瓶颈正从解决问题转向提出正确问题。
摘要翻译

发现因果规律并将其应用于构建功能性系统——即“发现到应用”循环——是通用智能的显著特征,然而,由于科学发现与现实世界工程之间存在巨大的复杂性鸿沟,评估这一能力一直受到阻碍。我们提出了SciCrafter,一个基于Minecraft的基准测试,通过参数化的红石电路任务来实现这一循环。智能体必须按照指定模式(例如同时点亮或按时间序列点亮)点燃灯;缩放目标参数会显著增加构建复杂性和所需知识,从而迫使智能体进行真正的发现,而非依赖记忆中的解决方案。我们在通用代码智能体框架下评估了包括GPT-5.2、Gemini-3-Pro和Claude-Opus-4.5在内的前沿模型,发现所有模型的成功率均停滞在约26%。为了诊断这些失败,我们将该循环分解为四种能力——知识缺口识别、实验发现、知识整合和知识应用——并设计了有针对性的干预措施,其边际贡献作为相应缺口的代理指标。我们的分析表明,尽管通用知识应用能力仍然是所有模型中最大的缺口,但对于前沿模型而言,知识缺口识别开始成为主要障碍——这表明瓶颈正从“正确解决问题”转向“为当前AI提出正确的问题”。我们发布SciCrafter作为诊断探针,用于未来研究能够驾驭完整“发现到应用”循环的AI系统。


摘要 (Abstract)

Discovering causal regularities and applying them to build functional systems–the discovery-to-application loop–is a hallmark of general intelligence, yet evaluating this capacity has been hindered by the vast complexity gap between scientific discovery and real-world engineering. We introduce SciCrafter, a Minecraft-based benchmark that operationalizes this loop through parameterized redstone circuit tasks. Agents must ignite lamps in specified patterns (e.g., simultaneously or in timed sequences); scaling target parameters substantially increases construction complexity and required knowledge, forcing genuine discovery rather than reliance on memorized solutions. Evaluating frontier models including GPT-5.2, Gemini-3-Pro, and Claude-Opus-4.5 under a general-purpose code agent scaffold, we find that all plateau at approximately 26% success rate. To diagnose these failures, we decompose the loop into four capacities–knowledge gap identification, experimental discovery, knowledge consolidation, and knowledge application–and design targeted interventions whose marginal contributions serve as proxies for corresponding gaps. Our analysis reveals that although the general knowledge application capability still remains as the biggest gap across all models, for frontier models the knowledge gap identification starts to become a major hurdle–indicating the bottleneck is shifting from solving problems right to raising the right problems for current AI. We release SciCrafter as a diagnostic probe for future research on AI systems that navigate the full discovery-to-application loop.


关键词: LLM Agents, Tool Use, Minecraft, Discovery-to-Application Loop, SciCrafter, Redstone Circuit, Knowledge Gap Identification


9. ❌ Governing What You Cannot Observe: Adaptive Runtime Governance for Autonomous AI Agents

作者: German Marin, Jatin Chaudhary 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24686v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.05.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于自主AI代理的运行时治理,提出信息可行性原则和Agent Viability Framework,并实现RiskGate系统。核心关键词’LLM Agents’高度相关(10分),因为论文明确讨论自主AI代理的治理;‘Tool Use’有一定关联(5分),因为代理可能涉及工具使用,但论文未深入;其他关键词如大模型、微调、推理等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

论文提出信息可行性原则和Agent Viability Framework,通过RiskGate系统实现自主AI代理的自适应运行时治理,将治理从反应式转变为预测式。
摘要翻译

自主AI智能体即使保持完全授权,也可能因行为漂移、对手适应以及决策模式变化(无需任何代码修改)而变得不安全。我们提出信息可行性原则:对智能体的治理可归结为估计未观测风险的边界 $\hat{B}(x) = U(x) + SB(x) + RG(x)$,并仅在其能力 $S(x)$ 以安全裕度超过 $\hat{B}(x)$ 时才允许执行动作。基于Aubin可行性理论的智能体可行性框架确立了三个性质——监控(P1)、预测(P2)与单调约束(P3)——它们对已记录的失效模式而言各自必要且共同充分。RiskGate 通过专用统计估计器(KL散度、分段对比整体 $z$ 检验、序列模式匹配)、故障安全单调流水线以及形式化为Aubin调控图实例(以终止开关作为最后手段)的闭环自动驾驶仪(Autopilot)来实例化该框架;标量可行性指数 $VI(t) \in [-1,+1]$ 结合一阶 $t^*$ 预测,将治理从被动响应转变为主动预测。本文的贡献包括理论框架、参考实现以及针对已发布智能体失效分类学的分析覆盖;定量实证评估被界定为后续工作。


摘要 (Abstract)

Autonomous AI agents can remain fully authorized and still become unsafe as behavior drifts, adversaries adapt, and decision patterns shift without any code change. We propose the \textbf{Informational Viability Principle}: governing an agent reduces to estimating a bound on unobserved risk $\hat{B}(x) = U(x) + SB(x) + RG(x)$ and allowing an action only when its capacity $S(x)$ exceeds $\hat{B}(x)$ by a safety margin. The \textbf{Agent Viability Framework}, grounded in Aubin’s viability theory, establishes three properties – monitoring (P1), anticipation (P2), and monotonic restriction (P3) – as individually necessary and collectively sufficient for documented failure modes. \textbf{RiskGate} instantiates the framework with dedicated statistical estimators (KL divergence, segment-vs-rest $z$-tests, sequential pattern matching), a fail-secure monotonic pipeline, and a closed-loop Autopilot formalised as an instance of Aubin’s regulation map with kill-switch-as-last-resort; a scalar Viability Index $VI(t) \in [-1,+1]$ with first-order $t^*$ prediction transforms governance from reactive to predictive. Contributions are the theoretical framework, the reference implementation, and analytical coverage against published agent-failure taxonomies; quantitative empirical evaluation is scoped as follow-up work.


关键词: Autonomous AI Agents, Runtime Governance, Informational Viability Principle, Agent Viability Framework, RiskGate, Viability Index, Aubin’s Viability Theory


10. ❌ The Price of Agreement: Measuring LLM Sycophancy in Agentic Financial Applications

作者: Zhenyu Zhao, Aparna Balagopalan, Adi Agrawal, Dilshoda Yergasheva, Waseem Alshikh, Daniel M. Bikel 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24668v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.010.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究LLM在金融代理任务中的谄媚行为(sycophancy),核心涉及LLM和LLM Agents,因此这两个关键词得高分。其他关键词如Mixture of Experts、Scaling Laws等与论文内容无关,得0分。


!!! tip deepseek-chat TL;DR

该论文评估了LLM在金融代理任务中的谄媚行为,发现模型在面对用户反驳时性能下降有限,但偏好信息矛盾时多数模型失败,并测试了输入过滤等恢复方法。
摘要翻译

鉴于当前大型语言模型(LLMs)在金融系统中的广泛应用,评估此类系统的安全性与鲁棒性变得至关重要。LLMs在通用领域场景中频繁表现出的一种失效模式是谄媚(sycophancy),即模型优先选择与用户所表达观点保持一致,而非追求正确性,从而导致准确性与可信度下降。本研究聚焦于评估LLMs在智能体金融任务中展现的谄媚现象。我们的发现包含三个方面:首先,面对用户对参考答案的反驳或矛盾时,模型性能仅出现低至中等程度的下降,这与先前研究中模型在金融智能体场景中展现的谄媚特征有所不同;其次,我们引入了一套通过用户偏好信息(与参考答案相矛盾)来测试谄媚行为的任务集,发现大多数模型在此类输入下均表现失败;最后,我们对不同恢复模式(如基于预训练LLM的输入过滤)进行了基准测试。


摘要 (Abstract)

Given the increased use of LLMs in financial systems today, it becomes important to evaluate the safety and robustness of such systems. One failure mode that LLMs frequently display in general domain settings is that of sycophancy. That is, models prioritize agreement with expressed user beliefs over correctness, leading to decreased accuracy and trust. In this work, we focus on evaluating sycophancy that LLMs display in agentic financial tasks. Our findings are three-fold: first, we find the models show only low to modest drops in performance in the face of user rebuttals or contradictions to the reference answer, which distinguishes sycophancy that models display in financial agentic settings from findings in prior work. Second, we introduce a suite of tasks to test for sycophancy by user preference information that contradicts the reference answer and find that most models fail in the presence of such inputs. Lastly, we benchmark different modes of recovery such as input filtering with a pretrained LLM.


关键词: LLM Sycophancy, Agentic Financial Applications, Safety, Robustness, User Rebuttals, Input Filtering


11. ❌ Leveraging LLMs for Multi-File DSL Code Generation: An Industrial Case Study

作者: Sivajeet Chand, Kevin Nguyen, Peter Kuntz, Alexander Pretschner 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24678v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.010.0/100.0
RLHF0.00.0/100.0
PEFT0.015.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.010.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心研究大模型(LLMs)在工业DSL代码生成中的应用,涉及指令微调(Instruction Tuning)、参数高效微调(PEFT/QLoRA)和上下文学习(In-context Learning),因此这些关键词得分高。其他关键词如MoE、SLMs、Scaling Laws等与论文内容无关,得0分。


!!! tip deepseek-chat TL;DR

该论文通过工业案例研究,探索了利用大语言模型(LLMs)进行多文件DSL代码生成,并证明参数高效微调(QLoRA)在准确性和结构保真度上显著优于基线提示和单样本上下文学习。
摘要翻译

大型语言模型(LLMs)在通用代码生成方面表现强劲,但其在企业领域特定语言(DSL)中的适用性仍未被充分探索,尤其是针对从单条自然语言(NL)指令生成跨多个文件和文件夹结构的仓库级变更。我们报告了宝马(BMW)的一项工业案例研究,该研究通过适配面向代码的LLMs,为一种基于Xtext的DSL(该DSL驱动下游Java/TypeScript代码生成)生成并修改项目根目录下的DSL制品。我们开发了一套端到端流水线,涵盖数据集构建、多文件任务表示、模型适配与评估。我们将DSL文件夹层次结构编码为结构化的、保留路径的JSON格式,从而支持仓库级别的单次响应生成,并学习跨文件依赖关系。我们在三种配置下评估了两个经过指令微调的代码LLMs(Qwen2.5-Coder和DeepSeek-Coder,7B参数规模):基线提示、单样本上下文学习(one-shot in-context learning)以及参数高效微调(QLoRA)。除标准相似性指标外,我们还引入了任务特定度量,用于评估编辑正确性与仓库结构保真度。微调在所有模型和指标上带来了最显著的提升,在保留测试集上针对多文件输出实现了高精确匹配准确率、显著的编辑相似性以及1.00的结构保真度。同时,单样本上下文学习相比基线提示提供了较小但一致的改进。我们进一步通过专家开发者调查以及基于现有代码生成器的执行检查,验证了其实用价值。


摘要 (Abstract)

Large language models (LLMs) perform strongly on general-purpose code generation, yet their applicability to enterprise domain-specific languages (DSLs) remains underexplored, especially for repository-scale change generation spanning multiple files and folder structures from a single natural-language (NL) instruction. We report an industrial case study at BMW that adapts code-oriented LLMs to generate and modify project-root DSL artifacts for an Xtext-based DSL that drives downstream Java/TypeScript code generation. We develop an end-to-end pipeline for dataset construction, multi-file task representation, model adaptation, and evaluation. We encode DSL folder hierarchies as structured, path-preserving JSON, allowing single-response generation at repository scale and learning cross-file dependencies. We evaluate two instruction-tuned code LLMs (Qwen2.5-Coder and DeepSeek-Coder, 7B) under three configurations: baseline prompting, one-shot in-context learning, and parameter-efficient fine-tuning (QLoRA). Beyond standard similarity metrics, we introduce task-specific measures that assess edit correctness and repository structural fidelity. Fine-tuning yields the most significant gains across models and metrics, achieving high exact-match accuracy, substantial edit similarity, and structural fidelity of 1.00 on our held-out set for multi-file outputs. At the same time, one-shot in-context learning provides smaller but consistent improvements over baseline prompting. We further validate practical utility via an expert developer survey and an execution-based check using the existing code generator.


关键词: Large Language Models, Domain-Specific Languages, Code Generation, Parameter-Efficient Fine-Tuning, QLoRA, In-context Learning, Industrial Case Study, Multi-file Generation


12. ❌ Benchmarking Source-Sensitive Reasoning in Turkish: Humans and LLMs under Evidential Trust Manipulation

作者: Sercan Karakaş, Yusuf Şimşek 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24665v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.05.0/100.0
System 2 Thinking0.05.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.05.0/100.0
Mechanistic Interpretability0.05.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.05.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究土耳其语中证据形态与信息来源可信度的关系,并评估LLM在源敏感推理上的表现。核心涉及LLM(10分),因为评估了10个LLM;涉及Chain of Thought(5分)和System 2 Thinking(5分),因为推理任务需要多步推理;涉及Hallucination Mitigation(5分)和Mechanistic Interpretability(5分),因为探讨了LLM的可靠性和可解释性;涉及In-context Learning(5分),因为使用了不同提示范式。其他关键词如MoE、SLM等完全无关。


!!! tip deepseek-chat TL;DR

该论文通过人类实验和LLM评估,发现土耳其语说话者对信息来源可信度敏感,而LLM在源敏感证据推理上表现不稳定,存在人类与LLM的差距。
摘要翻译

本文探讨信息来源可信度是否塑造土耳其语的示证形态,以及大语言模型(LLMs)能否追踪这一敏感性。我们研究了受控完形填空语境中-DI与-mIs之间的过去时域对立,其中信息来源被明确设定为外部来源,仅对其感知可信度进行操作(高信任度 vs. 低信任度)。在一项人类产出实验中,土耳其语母语者表现出稳健的信任效应:高信任度语境相对更多地使用-DI,而低信任度语境相对更多地使用-mIs,且该模式在敏感性分析中保持稳定。随后,我们在三种提示范式(开放式填空、显性过去时填空、强制二选一A/B选择)下评估了10个大语言模型。大语言模型的行为高度依赖于模型和提示方式:部分模型表现出微弱或局部的信任一致性偏移,但整体效果不稳定,常出现反转,且往往被输出合规性问题及强烈的基线后缀偏好所掩盖。这些结果为基于信任/承诺的土耳其语示证性解释提供了新证据,并揭示了人类与LLMs在来源敏感性示证推理方面的显著差距。


摘要 (Abstract)

This paper investigates whether source trustworthiness shapes Turkish evidential morphology and whether large language models (LLMs) track this sensitivity. We study the past-domain contrast between -DI and -mIs in controlled cloze contexts where the information source is overtly external, while only its perceived reliability is manipulated (High-Trust vs. Low-Trust). In a human production experiment, native speakers of Turkish show a robust trust effect: High-Trust contexts yield relatively more -DI, whereas Low-Trust contexts yield relatively more -mIs, with the pattern remaining stable across sensitivity analyses. We then evaluate 10 LLMs in three prompting paradigms (open gap-fill, explicit past-tense gap-fill, and forced-choice A/B selection). LLM behavior is highly model- and prompt-dependent: some models show weak or local trust-consistent shifts, but effects are generally unstable, often reversed, and frequently overshadowed by output-compliance problems and strong base-rate suffix preferences. The results provide new evidence for a trust-/commitment-based account of Turkish evidentiality and reveal a clear human-LLM gap in source-sensitive evidential reasoning.


关键词: Turkish evidentiality, source trustworthiness, large language models, reasoning, human-LLM gap, prompting paradigms


13. ❌ DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference

作者: Zahra Dehghanighobadi, Asja Fischer 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24647v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.08.0/100.0
KV Cache Compression0.010.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心关注大模型长上下文推理中的KV缓存压缩问题,提出层依赖的剪枝方法DepthKV。与’Large Language Models’高度相关(10分),因为研究LLM推理效率;与’KV Cache Compression’高度相关(10分),因为直接针对KV缓存压缩;与’Context Window Extension’相关(8分),因为长上下文推理涉及上下文窗口扩展。其他关键词如MoE、SLM、Scaling Laws等均不涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出DepthKV,一种层依赖的KV缓存剪枝框架,通过根据各层对剪枝的敏感性分配全局KV预算,在相同剪枝率下优于均匀剪枝,有效缓解长上下文LLM推理的内存瓶颈。
摘要翻译

长上下文推理是大语言模型(LLMs)的一项关键能力,支撑着长文档理解、摘要生成和代码生成等应用。然而,高效的自回归推理依赖于键值(KV)缓存,其内存占用随序列长度线性增长,从而成为主要的内存瓶颈。为缓解这一开销,KV缓存剪枝方法在推理过程中丢弃注意力分数较低的缓存令牌。现有方法大多在各层间采用统一的剪枝比例,隐含地假设所有层对整体模型性能的贡献相同。我们证明这一假设并非最优,因为不同层对剪枝的敏感度存在显著差异。我们提出DepthKV,一种基于层依赖的剪枝框架,该框架根据各层的敏感度在层间分配固定的全局KV预算,而非采用统一分配方式。在多个模型和任务上,DepthKV在相同全局剪枝比例下始终优于统一剪枝,表明通过层依赖分配能够更有效地利用KV缓存预算。


摘要 (Abstract)

Long-context reasoning is a critical capability of large language models (LLMs), enabling applications such as long-document understanding, summarization, and code generation. However, efficient autoregressive inference relies on the key-value (KV) cache, whose memory footprint grows linearly with sequence length, leading to a major memory bottleneck. To mitigate this overhead, KV cache pruning methods discard cached tokens with low attention scores during inference. Most existing methods apply a uniform pruning ratio across layers, implicitly assuming that all layers contribute equally to overall model performance. We show that this assumption is suboptimal, as layers differ significantly in their sensitivity to pruning. We propose DepthKV, a layer-dependent pruning framework that allocates a fixed global KV budget across layers based on their sensitivity, rather than using a uniform allocation. Across multiple models and tasks, DepthKV consistently outperforms uniform pruning at the same global pruning ratio, demonstrating more effective utilization of the KV cache budget through layer-dependent allocation.


关键词: KV cache pruning, layer-dependent, long-context LLM inference, memory bottleneck, attention scores, DepthKV


14. ❌ AgentWard: A Lifecycle Security Architecture for Autonomous AI Agents

作者: Yixiang Zhang, Xinhao Deng, Jiaqing Wu, Yue Xiao, Ke Xu, Qi Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24657v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.015.0/100.0
Tool Use0.010.0/100.0
Multi-agent Systems0.05.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于自主AI代理的安全架构,核心涉及LLM Agents(15分,核心主题)、Tool Use(10分,代理调用工具)、Multi-agent Systems(5分,提及多代理协调)。其他关键词如LLMs(10分,基础模型)相关,但非核心创新点。其余关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

论文提出AgentWard,一种面向自主AI代理生命周期的纵深防御安全架构,通过五阶段保护层拦截威胁传播,并基于OpenClaw实现原型验证。
摘要翻译

自主AI智能体将大型语言模型扩展为完整的运行时系统,使其能够加载技能、摄取外部内容、维护记忆、规划多步骤行动并调用特权工具。在此类系统中,安全故障很少局限于单一接口;相反,它们可能跨越初始化、输入处理、记忆、决策与执行等阶段传播,往往仅在有害后果实际作用于环境时才显现。本文提出AgentWard——一种面向生命周期、纵深防御的架构,系统性地组织跨越这五个阶段的防护。AgentWard将各阶段特有的异构控制与跨层协调相结合,使得威胁能在其传播路径上被拦截,同时保护关键资产。我们详细阐述了五个协同防护层的设计原理与架构,并在OpenClaw上实现了一个插件原生原型以证明其实用可行性。这一视角为在自主AI智能体中构建运行时安全控制、管理信任传播以及强制执行隔离提供了具体蓝图。我们的代码已开源,地址为https://github.com/FIND-Lab/AgentWard。


摘要 (Abstract)

Autonomous AI agents extend large language models into full runtime systems that load skills, ingest external content, maintain memory, plan multi-step actions, and invoke privileged tools. In such systems, security failures rarely remain confined to a single interface; instead, they can propagate across initialization, input processing, memory, decision-making, and execution, often becoming apparent only when harmful effects materialize in the environment. This paper presents AgentWard, a lifecycle-oriented, defense-in-depth architecture that systematically organizes protection across these five stages. AgentWard integrates stage-specific, heterogeneous controls with cross-layer coordination, enabling threats to be intercepted along their propagation paths while safeguarding critical assets. We detail the design rationale and architecture of five coordinated protection layers, and implement a plugin-native prototype on OpenClaw to demonstrate practical feasibility. This perspective provides a concrete blueprint for structuring runtime security controls, managing trust propagation, and enforcing execution containment in autonomous AI agents. Our code is available at https://github.com/FIND-Lab/AgentWard .


关键词: Autonomous AI Agents, Lifecycle Security, Defense-in-Depth, Runtime Security, AgentWard, OpenClaw, Tool Use, Multi-agent Systems


15. ❌ Information bottleneck for learning the phase space of dynamics from high-dimensional experimental data

作者: K. Michael Martini, Eslam Abdelaleem, Paarth Gulati, Ilya Nemenman 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24662v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文提出DySIB方法,从高维时间序列数据中学习低维表示,应用于物理摆实验视频。方法基于信息瓶颈原理,最大化过去与未来观测窗口之间的预测互信息,同时惩罚表示复杂度。论文完全不涉及大语言模型、深度学习技术原理创新或AI在科学领域的应用(如生物医药、化学信息学等),而是聚焦于动力系统状态变量推断,属于传统机器学习与物理交叉领域。因此所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出DySIB方法,通过最大化过去与未来观测窗口之间的预测互信息并惩罚表示复杂度,从高维实验数据中学习低维动力学状态空间,并在物理摆视频数据上成功恢复出与规范坐标一致的二维相空间。
摘要翻译

从高维观测数据中识别系统的动力学状态变量是物理科学中的一个核心问题。其挑战在于状态变量无法直接观测,必须无监督地从原始高维数据中推断得出。本文提出DySIB(动态对称信息瓶颈,Dynamical Symmetric Information Bottleneck)作为一种学习时间序列数据低维表示的方法,该方法通过最大化过去与未来观测窗口之间的预测互信息,同时惩罚表示复杂度来实现。该目标函数完全在潜在空间中运作,无需对观测数据进行重构。我们将DySIB应用于一个物理摆的实验视频数据集,该系统的底层状态空间是已知的。该方法通过数据自洽地设定学习架构的超参数,恢复出一个与摆的相空间维度、拓扑结构及几何形状相匹配的二维表示,且学习到的坐标与规范的角度和角速度平滑对齐。这些结果在一个特征明确的实验系统上证明,潜在空间中的预测信息可用于直接从高维数据中恢复可解释的动力学坐标。


摘要 (Abstract)

Identifying the dynamical state variables of a system from high-dimensional observations is a central problem across physical sciences. The challenge is that the state variables are not directly observable and must be inferred from raw high-dimensional data without supervision. Here we introduce DySIB (Dynamical Symmetric Information Bottleneck) as a method to learn low-dimensional representations of time-series data by maximizing predictive mutual information between past and future observation windows while penalizing representation complexity. This objective operates entirely in latent space and avoids reconstruction of the observations. We apply DySIB to an experimental video dataset of a physical pendulum, where the underlying state space is known. The method, with hyperparameters of the learning architecture set self-consistently by the data, recovers a two-dimensional representation that matches the dimensionality, topology, and geometry of the pendulum phase space, with the learned coordinates aligning smoothly with the canonical angle and angular velocity. These results demonstrate, on a well-characterized experimental system, that predictive information in latent space can be used to recover interpretable dynamical coordinates directly from high-dimensional data.


关键词: Information Bottleneck, Dynamical Systems, State Space Learning, Time Series, Latent Representation, Predictive Mutual Information, Phase Space


16. ❌ K-MetBench: A Multi-Dimensional Benchmark for Fine-Grained Evaluation of Expert Reasoning, Locality, and Multimodality in Meteorology

作者: Soyeon Kim, Cheongwoong Kang, Myeongjin Lee, Eun-Chul Chang, Jaedeok Lee, Jaesik Choi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24645v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.08.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.08.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.08.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文提出K-MetBench基准,用于评估气象领域的大语言模型(LLMs)在专家推理、地域知识和多模态方面的能力。核心相关关键词包括:Large Language Models(10分,核心研究对象)、Chain of Thought(8分,涉及专家推理逻辑)、LLM Agents(8分,目标为构建可靠的气象AI助手)、Hallucination Mitigation(8分,发现模型在正确预测时仍存在幻觉)、AI for Science(10分,气象科学应用)。其他关键词如MoE、SLM等与论文内容无关,评分为0。


!!! tip deepseek-chat TL;DR

K-MetBench是一个针对气象领域大语言模型的多维基准,通过专家级考试评估发现模型在图表推理和逻辑一致性上存在显著缺陷,且本地化模型在文化依赖任务上优于更大规模的通用模型。
摘要翻译

针对韩国气象预报员的实用型(多模态)大语言模型助手的开发,因缺乏基于权威来源的多维度、专家级评估框架而受阻。为解决这一问题,我们提出K-MetBench——一个基于国家资格考试的诊断性基准。该基准从四个维度揭示了关键缺陷:图表专家视觉推理、基于专家验证依据的逻辑有效性、韩国特定地理文化理解,以及细粒度领域分析。我们对55个模型的评估显示,在解读专业图表时存在显著的模态差距,以及在逻辑推理上的差距——模型即便做出正确预测,其逻辑仍存在幻觉。关键在于,韩国模型在本地语境中显著优于规模更大的全球模型,这表明仅靠参数规模扩展无法解决文化依赖性问题。K-MetBench为开发可靠且具备文化意识的专家级人工智能体提供了路线图。数据集可在https://huggingface.co/datasets/soyeonbot/K-MetBench获取。


摘要 (Abstract)

The development of practical (multimodal) large language model assistants for Korean weather forecasters is hindered by the absence of a multidimensional, expert-level evaluation framework grounded in authoritative sources. To address this, we introduce K-MetBench, a diagnostic benchmark grounded in national qualification exams. It exposes critical gaps across four dimensions: expert visual reasoning of charts, logical validity via expert-verified rationales, Korean-specific geo-cultural comprehension, and fine-grained domain analysis. Our evaluation of 55 models reveals a profound modality gap in interpreting specialized diagrams and a reasoning gap where models hallucinate logic despite correct predictions. Crucially, Korean models outperform significantly larger global models in local contexts, demonstrating that parameter scaling alone cannot resolve cultural dependencies. K-MetBench serves as a roadmap for developing reliable, culturally aware expert AI agents. The dataset is available at https://huggingface.co/datasets/soyeonbot/K-MetBench .


关键词: K-MetBench, Large Language Models, Expert Reasoning, Multimodality, Meteorology, Benchmark, Hallucination


17. ❌ Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application

作者: William Oliveira 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24636v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.015.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心关注端侧小语言模型(SLMs)在移动应用中的集成挑战,与’Small Language Models’高度相关(15分)。其他关键词如LLMs、MoE、Scaling Laws等均未涉及,故评0分。


!!! tip deepseek-chat TL;DR

该论文通过案例研究揭示了端侧小语言模型在移动应用中集成的工程挑战,并提出了'少即是多'的设计原则,即最可靠的端侧LLM功能是让LLM做最少的事情。
摘要翻译

设备端小型语言模型(SLMs)有望为移动用户提供完全离线、保护隐私的人工智能体验(无需依赖云端,数据不离开设备)。但这一承诺在实践中能否实现?本文通过一项纵向从业者案例研究,记录了将SLMs(Gemma 4 E2B,26亿参数;Qwen3 0.6B,6亿参数)集成到Palabrita(一款生产环境中的Android猜词游戏)时所面临的工程挑战。在为期5天的开发冲刺中,系统经历了204次提交(约90次直接与AI相关),实现了根本性转变:从最初由大语言模型(LLM)生成完整结构化谜题(单词、类别、难度及五条提示,以JSON格式输出)的雄心勃勃设计,演变为一种务实架构——由精选词表提供单词,LLM仅生成三条简短提示,并在失败时采用确定性回退方案。我们识别出设备端SLM集成特有的五类故障:输出格式违规、约束违反、上下文质量下降、延迟不兼容以及模型选择不稳定。针对每类故障,我们记录了观察到的症状、根本原因,以及有效缓解这些问题的提示工程与架构策略,包括多层防御性解析、带失败反馈的上下文重试、会话轮换、渐进式提示加固以及系统性责任削减。我们的研究结果表明,设备端SLM在生产级移动应用中具有可行性,但前提是开发者必须接受一个基本约束:最可靠的设备端LLM功能,恰恰是LLM承担最少工作的功能。我们将经验提炼为八项可操作的设计启发式原则,供将SLMs集成到移动应用中的从业者参考。


摘要 (Abstract)

On-device Small Language Models (SLMs) promise fully offline, private AI experiences for mobile users (no cloud dependency, no data leaving the device). But is this promise achievable in practice? This paper presents a longitudinal practitioner case study documenting the engineering challenges of integrating SLMs (Gemma 4 E2B, 2.6B parameters; Qwen3 0.6B, 600M parameters) into Palabrita, a production Android word-guessing game. Over a 5-day development sprint comprising 204 commits (~90 directly AI-related), the system underwent a radical transformation: from an ambitious design where the LLM generated complete structured puzzles (word, category, difficulty, and five hints as JSON) to a pragmatic architecture where curated word lists provide the words and the LLM generates only three short hints, with a deterministic fallback if it fails. We identify five categories of failures specific to on-device SLM integration: output format violations, constraint violations, context quality degradation, latency incompatibility, and model selection instability. For each failure category, we document the observed symptoms, root causes, and the prompt engineering and architectural strategies that effectively mitigated them, including multi-layer defensive parsing, contextual retry with failure feedback, session rotation, progressive prompt hardening, and systematic responsibility reduction. Our findings demonstrate that on-device SLMs are viable for production mobile applications, but only when the developer accepts a fundamental constraint: the most reliable on-device LLM feature is one where the LLM does the least. We distill our experience into eight actionable design heuristics for practitioners integrating SLMs into mobile apps.


关键词: Small Language Models, On-device AI, Mobile Application, Engineering Challenges, Prompt Engineering, Failure Analysis, Design Heuristics


18. ❌ Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networks

作者: Kevin McKee, Thomas Hazy, Yicong Zheng, Zacharie Bugaud, Thomas Miconi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24637v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.010.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究持续学习中的灾难性遗忘问题,提出了一种受大脑皮层启发的参数隔离方法Functional Task Networks (FTN),该方法类似于混合专家模型(Mixture of Experts),使用高维自组织二进制掩码来隔离任务相关神经元。因此,与’Mixture of Experts’高度相关(10分),与其他关键词如LLMs、预训练、微调等无关(0分)。


!!! tip deepseek-chat TL;DR

该论文提出了一种受大脑皮层启发的持续学习方法FTN,通过类似混合专家的参数隔离机制,在无监督条件下实现任务网络的实例化和恢复,有效防止灾难性遗忘。
摘要翻译

块序列持续学习要求单一模型既能保护先前解决方案免受灾难性遗忘,又能在推理阶段无需任务标签的情况下高效推断当前输入对应的先前解决方案。我们提出功能任务网络(Functional Task Networks, FTN),这是一种受哺乳动物新皮层结构和动力学基序启发的参数隔离方法。与混合专家模型类似,该方法在大量小型但深度网络构成的群体上使用高维自组织二进制掩码,其灵感来源于锥体神经元的树突模型。该掩码通过三阶段流程生成:(1)对连续掩码进行梯度下降以识别任务相关神经元;(2)平滑核将结果向空间连续性方向偏置;(3)k-胜者全取(k-winner-take-all)在固定容量预算下对所得群体进行二值化处理。与混合专家模型相同,每个神经元均为独立的深度网络,因此不相交的掩码可产生严格不相交的梯度更新,从而为抵抗灾难性遗忘提供结构性保障。该三阶段流程通过单次梯度步骤即可恢复先前训练任务的子网络,在推理阶段实现无监督任务分割。我们在三个持续学习基准上对其进行测试:(1)合成多任务分类/回归生成器;(2)带打乱类别标签的MNIST(纯概念漂移);(3)置换MNIST(领域漂移)。在所有三个基准上,采用细粒度平滑的FTN(FTN-Slow)几乎实现零遗忘。采用大核且仅进行2次平滑迭代的FTN(FTN-Fast)则在保留部分记忆的同时提升了速度。我们证明,空间组织机制将有效掩码搜索从组合优化中的O(C(H,K))级top-k子集问题,简化为紧凑皮层邻域上近线性扫描的O(H)级复杂度,并通过基于梯度的更新实现并行化。


摘要 (Abstract)

Block-sequential continual learning demands that a single model both protect prior solutions from catastrophic forgetting and efficiently infer at inference time which prior solution matches the current input without task labels. We present Functional Task Networks (FTN), a parameter-isolation method inspired by structural and dynamical motifs found in the mammalian neocortex. Similar to mixture-of-experts, this method uses a high dimensional, self-organizing binary mask over a large population of small but deep networks, inspired by dendritic models of pyramidal neurons. The mask is produced by a three-stage procedure: (1) gradient descent on a continuous mask identifies task-relevant neurons, (2) a smoothing kernel biases the result toward spatial contiguity, (3) and k-winner-take-all binarizes the resulting group at a fixed capacity budget. Like mixture-of-experts, each neuron is an independent deep network, so disjoint masks give exactly disjoint gradient updates, providing structural guarantees against catastrophic forgetting. This three-stage procedure recovers the sub-network of a previously-trained task in a single gradient step, providing unsupervised task segmentation at inference time. We test it on three continual-learning benchmarks: (1) a synthetic multi-task classification/regression generator, (2) MNIST with shuffled class labels (pure concept shift), and (3) Permuted MNIST (domain shift). On all three, FTN with fine grained smoothing (FTN-Slow) results in nearly zero forgetting. FTN with a large kernel and only 2 iterations of smoothing (FTN-Fast) trades off some retention for increased speed. We show that the spatial organization mechanism reduces the effective mask search from the combinatorial top-k subset problem in O(C(H,K)) to the complexity of a near-linear scan in O(H) over compact cortical neighborhoods, which is parallelized by the gradient-based update.


关键词: Continual Learning, Catastrophic Forgetting, Mixture of Experts, Parameter Isolation, Self-Organizing Binary Mask, Functional Task Networks, Unsupervised Task Segmentation


19. ❌ Meta-CoT: Enhancing Granularity and Generalization in Image Editing

作者: Shiyi Zhang, Yiji Cheng, Tiankai Hang, Zijin Yin, Runze He, Yu Xu, Wenxun Dai, Yunlong Lin, Chunyu Wang, Qinglin Lu, Yansong Tang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24625v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.012.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于图像编辑中的Chain-of-Thought(CoT)推理,提出了Meta-CoT范式,通过两级分解提升理解粒度和泛化能力。与关键词’Chain of Thought’高度相关(12分),因为CoT是核心方法;其他关键词如LLMs、MoE等均不涉及,得0分。


!!! tip deepseek-chat TL;DR

论文提出Meta-CoT范式,通过两级分解编辑操作和引入CoT编辑一致性奖励,显著提升了图像编辑的理解粒度和泛化能力。
摘要翻译

统一多模态理解/生成模型通过将细粒度理解融入其思维链(Chain-of-Thought, CoT)过程,已展现出改进的图像编辑性能。然而,一个关键问题仍未得到充分探索:何种形式的CoT及训练策略能够同时增强理解的粒度与泛化能力?为此,我们提出Meta-CoT范式,该范式对任意单图像编辑操作进行两层分解,并具备两个关键特性:(1)可分解性。我们观察到,任何编辑意图均可表示为三元组——(任务、目标、所需理解能力)。受此启发,Meta-CoT对编辑任务与目标进行双重分解,生成任务特定的CoT,并在所有目标上遍历编辑操作。这种分解增强了模型对编辑操作的理解粒度,并引导其在训练过程中学习三元组的每个元素,从而显著提升编辑能力。(2)可泛化性。在第二层分解中,我们进一步将编辑任务拆解为五个基础元任务。我们发现,在这五个元任务上结合三元组中另外两个元素进行训练,足以实现对多样化、未见编辑任务的强泛化。为进一步使模型的编辑行为与其CoT推理对齐,我们引入了CoT-编辑一致性奖励(CoT-Editing Consistency Reward),该奖励鼓励在编辑过程中更准确、更有效地利用CoT信息。实验表明,我们的方法在21个编辑任务上实现了总体15.8%的提升,并且仅需在少量元任务上训练即可有效泛化至未见编辑任务。我们的代码、基准测试及模型已发布于https://shiyi-zh0408.github.io/projectpages/Meta-CoT/。


摘要 (Abstract)

Unified multi-modal understanding/generative models have shown improved image editing performance by incorporating fine-grained understanding into their Chain-of-Thought (CoT) process. However, a critical question remains underexplored: what forms of CoT and training strategy can jointly enhance both the understanding granularity and generalization? To address this, we propose Meta-CoT, a paradigm that performs a two-level decomposition of any single-image editing operation with two key properties: (1) Decomposability. We observe that any editing intention can be represented as a triplet - (task, target, required understanding ability). Inspired by this, Meta-CoT decomposes both the editing task and the target, generating task-specific CoT and traversing editing operations on all targets. This decomposition enhances the model’s understanding granularity of editing operations and guides it to learn each element of the triplet during training, substantially improving the editing capability. (2) Generalizability. In the second decomposition level, we further break down editing tasks into five fundamental meta-tasks. We find that training on these five meta-tasks, together with the other two elements of the triplet, is sufficient to achieve strong generalization across diverse, unseen editing tasks. To further align the model’s editing behavior with its CoT reasoning, we introduce the CoT-Editing Consistency Reward, which encourages more accurate and effective utilization of CoT information during editing. Experiments demonstrate that our method achieves an overall 15.8% improvement across 21 editing tasks, and generalizes effectively to unseen editing tasks when trained on only a small set of meta-tasks. Our code, benchmark, and model are released at https://shiyi-zh0408.github.io/projectpages/Meta-CoT/


关键词: Meta-CoT, Chain-of-Thought, Image Editing, Decomposability, Generalizability, CoT-Editing Consistency Reward, Multi-modal Understanding


20. ❌ CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policies

作者: Fan Du, Feng Yan, Jianxiong Wu, Xinrun Xu, Weiye Zhang, Weinong Wang, Yu Guo, Bin Qian, Zhihai He 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24622v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究视觉-语言-动作(VLA)策略中的动作生成,提出粗到细的两阶段生成方法CF-VLA,旨在提高效率。论文主要涉及机器人动作生成、扩散模型、推理加速等,但未涉及任何给定的关键词(如大语言模型、混合专家、小语言模型、缩放定律、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、思维链、系统2思维、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习、AI for Science)。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出CF-VLA,一种粗到细的两阶段动作生成方法,通过构建动作感知的起始点并单步局部细化,显著提升VLA策略在低采样步数下的效率与性能,在CALVIN和LIBERO基准上优于现有方法。
摘要翻译

基于流的视觉-语言-动作(VLA)策略在动作生成方面具有强大的表达能力,但其存在一个根本性的效率问题:从无信息的高斯噪声中恢复动作结构需要多步推理,导致在实时约束下效率与质量之间的权衡不佳。我们通过重新思考生成式动作建模中起始点的作用来解决这一问题。我们不缩短采样轨迹,而是提出CF-VLA,一种由粗到精的两阶段公式,将动作生成重构为一个粗初始化步骤(构建一个具有动作感知的起始点),随后进行单步局部精炼以修正残差误差。具体而言,粗阶段学习终点速度上的条件后验分布,将高斯噪声转化为结构化的初始化,而精阶段则从该初始化出发进行固定时间的精炼。为稳定训练,我们引入一种逐步策略,首先学习受控的粗预测器,然后进行联合优化。在CALVIN和LIBERO上的实验表明,我们的方法在低NFE(函数评估次数)场景下建立了强大的效率-性能前沿:它持续优于现有的NFE=2方法,在多项指标上匹配或超越NFE=10的$π_{0.5}$基线,将动作采样延迟降低75.4%,并实现了最佳的平均真实机器人成功率为83.0%,比MIP高出19.5个百分点,比$π_{0.5}$高出4.0个百分点。这些结果表明,结构化的由粗到精生成能够同时实现强性能和高效推理。我们的代码可在https://github.com/EmbodiedAI-RoboTron/CF-VLA获取。


摘要 (Abstract)

Flow-based vision-language-action (VLA) policies offer strong expressivity for action generation, but suffer from a fundamental inefficiency: multi-step inference is required to recover action structure from uninformative Gaussian noise, leading to a poor efficiency-quality trade-off under real-time constraints. We address this issue by rethinking the role of the starting point in generative action modeling. Instead of shortening the sampling trajectory, we propose CF-VLA, a coarse-to-fine two-stage formulation that restructures action generation into a coarse initialization step that constructs an action-aware starting point, followed by a single-step local refinement that corrects residual errors. Concretely, the coarse stage learns a conditional posterior over endpoint velocity to transform Gaussian noise into a structured initialization, while the fine stage performs a fixed-time refinement from this initialization. To stabilize training, we introduce a stepwise strategy that first learns a controlled coarse predictor and then performs joint optimization. Experiments on CALVIN and LIBERO show that our method establishes a strong efficiency-performance frontier under low-NFE (Number of Function Evaluations) regimes: it consistently outperforms existing NFE=2 methods, matches or surpasses the NFE=10 $π_{0.5}$ baseline on several metrics, reduces action sampling latency by 75.4%, and achieves the best average real-robot success rate of 83.0%, outperforming MIP by 19.5 points and $π_{0.5}$ by 4.0 points. These results suggest that structured, coarse-to-fine generation enables both strong performance and efficient inference. Our code is available at https://github.com/EmbodiedAI-RoboTron/CF-VLA.


关键词: Vision-Language-Action Policies, Coarse-to-Fine Generation, Action Generation, Flow-based Models, Inference Efficiency, Robot Manipulation, CALVIN, LIBERO


21. ❌ XGRAG: A Graph-Native Framework for Explaining KG-based Retrieval-Augmented Generation

作者: Zhuoling Li, Ha Linh Hong Tran Nguyen, Valeria Bladinieres, Maxim Romanovsky 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24623v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.010.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是GraphRAG的可解释性框架XGRAG,与’Retrieval-Augmented Generation’高度相关(10分),与’Large Language Models’直接相关(10分),因为使用LLMs生成答案。‘Mechanistic Interpretability’和’Hallucination Mitigation’也相关(各10分和8分),因为XGRAG旨在提供因果解释并提升可信度。其他关键词如MoE、SLMs、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

XGRAG是一个基于图的框架,通过图扰动策略为知识图谱增强的检索增强生成系统提供因果解释,在多个数据集上相比基线RAG-Ex提升了14.81%的解释质量。
摘要翻译

基于图的检索增强生成(GraphRAG)通过使用知识图谱(KGs)为大语言模型(LLMs)提供结构化、语义连贯的上下文,从而扩展了传统的RAG,生成了更具依据性的答案。然而,GraphRAG的推理过程仍是一个黑箱,限制了我们对特定结构化知识如何影响最终输出的理解。现有的面向RAG系统的可解释性(XAI)方法,专为基于文本的检索设计,仅能通过知识组件之间的关系结构来解释LLM的响应,这在透明性和可信度方面造成了关键缺口。为解决这一问题,我们提出了XGRAG,一个新颖的框架,通过采用基于图的扰动策略,量化单个图组件对模型答案的贡献,从而为GraphRAG系统生成具有因果依据的解释。我们进行了大量实验,将XGRAG与RAG-Ex(标准RAG的XAI基线)进行比较,并评估了其在多种问题类型、叙事结构和LLM下的鲁棒性。结果表明,在NarrativeQA、FairyTaleQA和TriviaQA数据集上,通过衡量生成解释与原始答案之间对齐程度的F1分数评估,XGRAG的解释质量相比基线RAG-Ex提升了14.81%。此外,XGRAG的解释与图中心性度量表现出强相关性,验证了其捕捉图结构的能力。XGRAG通过透明的、基于图的解释增强了RAG系统的可解释性,为可信人工智能提供了一种可扩展且可泛化的方法。


摘要 (Abstract)

Graph-based Retrieval-Augmented Generation (GraphRAG) extends traditional RAG by using knowledge graphs (KGs) to give large language models (LLMs) a structured, semantically coherent context, yielding more grounded answers. However, GraphRAG reasoning process remains a black-box, limiting our ability to understand how specific pieces of structured knowledge influence the final output. Existing explainability (XAI) methods for RAG systems, designed for text-based retrieval, are limited to interpreting an LLM response through the relational structures among knowledge components, creating a critical gap in transparency and trustworthiness. To address this, we introduce XGRAG, a novel framework that generates causally grounded explanations for GraphRAG systems by employing graph-based perturbation strategies, to quantify the contribution of individual graph components on the model answer. We conduct extensive experiments comparing XGRAG against RAG-Ex, an XAI baseline for standard RAG, and evaluate its robustness across various question types, narrative structures and LLMs. Our results demonstrate a 14.81% improvement in explanation quality over the baseline RAG-Ex across NarrativeQA, FairyTaleQA, and TriviaQA, evaluated by F1-score measuring alignment between generated explanations and original answers. Furthermore, XGRAG explanations exhibit a strong correlation with graph centrality measures, validating its ability to capture graph structure. XGRAG provides a scalable and generalizable approach towards trustworthy AI through transparent, graph-based explanations that enhance the interpretability of RAG systems.


关键词: GraphRAG, Explainability, Knowledge Graph, Retrieval-Augmented Generation, Causal Explanation, Large Language Models, Graph Perturbation


22. ❌ NeSyCat: A Monad-Based Categorical Semantics of the Neurosymbolic ULLER Framework

作者: Daniel Romero Schellhorn, Till Mossakowski 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24612v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究神经符号系统的语义统一框架,基于范畴论和单子,不涉及大模型、深度学习或AI for Science等关键词。所有关键词评分均为0,因为论文内容与这些关键词完全无关。


!!! tip deepseek-chat TL;DR

该论文提出基于单子的范畴语义框架,统一了神经符号系统ULLER的经典、模糊和概率语义,并支持模块化扩展。
摘要翻译

ULLER(统一学习与推理语言)提供了一种统一的一阶逻辑(FOL)语法,使其知识库能够直接用于广泛的神经符号系统。原始规范赋予该语法三种两两独立的语义:经典语义、模糊语义和概率语义,每种语义都配有专门的语义规则。我们证明,这些看似不同的语义实际上都是基于单子(monad)的范畴框架的实例,而单子正是函数式编程中用于建模副作用的结构。这使得新语义的模块化添加以及它们之间的系统性转换成为可能。作为示例,我们概述了如何通过将Giry单子扩展到概率空间,在逻辑张量网络(LTN)中为任意(包括无限)域添加广义量化。特别地,我们的方法支持在Python和Haskell中模块化实现ULLER,我们已在GitHub上发布了其初始版本。


摘要 (Abstract)

ULLER (Unified Language for LEarning and Reasoning) offers a unified first-order logic (FOL) syntax, enabling its knowledge bases to be used directly across a wide range of neurosymbolic systems. The original specification endows this syntax with three pairwise independent semantics: classical, fuzzy, and probabilistic, each accompanied by dedicated semantic rules. We show that these seemingly disparate semantics are all instances of one categorical framework based on monads, the very construct that models side effects in functional programming. This enables the modular addition of new semantics and systematic translations between them. As example, we outline the addition of generalised quantification in Logic Tensor Networks (LTN) to arbitrary (also infinite) domains by extending the Giry monad to probability spaces. In particular, our approach allows a modular implementation of ULLER in Python and Haskell, of which we have published initial versions on GitHub.


关键词: Neurosymbolic, ULLER, Monad, Categorical Semantics, First-Order Logic, Fuzzy Semantics, Probabilistic Semantics


23. ❌ Evaluating whether AI models would sabotage AI safety research

作者: Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24618v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.08.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.08.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文评估前沿模型作为AI研究代理时是否破坏安全研究,核心涉及LLM Agents(10分)、Alignment(8分,因为涉及价值对齐和拒绝协助)、Tool Use(8分,模型使用工具)。其他关键词如RLHF、CoT等未直接涉及。


!!! tip deepseek-chat TL;DR

该论文通过两种评估方法测试前沿模型(Claude系列)在作为AI研究代理时是否蓄意破坏安全研究,发现Mythos Preview在7%的延续场景中主动继续破坏,且存在隐蔽推理,但未发现无提示的蓄意破坏。
摘要翻译

我们评估了前沿模型在作为前沿人工智能公司内部的人工智能研究智能体部署时,破坏或拒绝协助安全研究的倾向。我们对四个Claude模型(Mythos Preview、Opus 4.7 Preview、Opus 4.6和Sonnet 4.6)进行了两项互补性评估:一项是无提示破坏评估,测试模型在有机会破坏安全研究时的行为;另一项是破坏延续评估,测试模型在进入先前行为已开始破坏研究的轨迹中时,是否继续实施破坏。我们发现所有模型均未出现无提示破坏的实例,Mythos Preview和Opus 4.7 Preview的拒绝率接近于零,尽管所有模型有时仅部分完成任务。在延续评估中,Mythos Preview在7%的案例中主动继续破坏(相比之下,Opus 4.6为3%,Sonnet 4.6为4%,Opus 4.7 Preview为0%),并且在大多数此类案例中表现出推理与输出之间的不一致,表明存在隐蔽的破坏推理。我们的评估框架基于Petri(一个开源的大语言模型审计工具),并采用自定义脚手架在Claude Code内部运行模型,同时配备用于生成逼真破坏轨迹的迭代流程。我们测量了评估意识以及一种新形式的情境意识,称为“预填充意识”(prefill awareness),即识别先前轨迹内容并非由自身生成的能力。Opus 4.7 Preview表现出显著升高的无提示评估意识,而所有模型的预填充意识均较低。最后,我们讨论了局限性,包括评估意识混淆、场景覆盖范围有限,以及除安全研究破坏之外尚未测试的风险路径。


摘要 (Abstract)

We evaluate the propensity of frontier models to sabotage or refuse to assist with safety research when deployed as AI research agents within a frontier AI company. We apply two complementary evaluations to four Claude models (Mythos Preview, Opus 4.7 Preview, Opus 4.6, and Sonnet 4.6): an unprompted sabotage evaluation testing model behaviour with opportunities to sabotage safety research, and a sabotage continuation evaluation testing whether models continue to sabotage when placed in trajectories where prior actions have started undermining research. We find no instances of unprompted sabotage across any model, with refusal rates close to zero for Mythos Preview and Opus 4.7 Preview, though all models sometimes only partially completed tasks. In the continuation evaluation, Mythos Preview actively continues sabotage in 7% of cases (versus 3% for Opus 4.6, 4% for Sonnet 4.6, and 0% for Opus 4.7 Preview), and exhibits reasoning-output discrepancy in the majority of these cases, indicating covert sabotage reasoning. Our evaluation framework builds on Petri, an open-source LLM auditing tool, with a custom scaffold running models inside Claude Code, alongside an iterative pipeline for generating realistic sabotage trajectories. We measure both evaluation awareness and a new form of situational awareness termed “prefill awareness”, the capability to recognise that prior trajectory content was not self-generated. Opus 4.7 Preview shows notably elevated unprompted evaluation awareness, while prefill awareness remains low across all models. Finally, we discuss limitations including evaluation awareness confounds, limited scenario coverage, and untested pathways to risk beyond safety research sabotage.


关键词: AI safety, sabotage evaluation, LLM agents, alignment, situational awareness, Claude models, Petri framework


24. ❌ Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models

作者: Yuxing Tian, Fengran Mo, Zhiqi Huang, Weixu Zhang, Jian-Yun Nie 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24608v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用LLM进行注意力重排序,提出查询相关的头选择方法RouteHead,属于LLM应用,与’Large Language Models’高度相关(15分)。其他关键词如MoE、SLMs、Scaling Laws等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种查询相关的头选择方法RouteHead,通过轻量路由器为每个查询选择最优注意力头集合,以提升基于LLM的注意力重排序性能。
摘要翻译

大语言模型(Large Language Models, LLMs)近期被探索作为细粒度零样本重排序器,通过利用注意力信号来估计文档相关性。然而,现有方法要么聚合所有注意力头的信号,要么依赖通过启发式规则静态选择的子集。这种方案可能并非最优,因为信息丰富的注意力头会随查询或领域而变化。此外,由于冗余或冲突的排序信号,简单组合多个注意力头可能导致性能下降。本文提出一种查询相关的注意力头选择方法——RouteHead,用于基于注意力机制的LLM重排序。具体而言,我们学习一个轻量级路由器,能够将每个查询映射到最优的注意力头集合,并通过仅聚合这些头的注意力信号来计算相关性分数。由于查询到最优头的标签不可得,我们首先通过离线搜索构建伪标签。路由器为每个注意力头配备一个可学习的嵌入向量,并利用从冻结LLM的隐藏状态中提取的查询嵌入来表示每个查询,随后在伪标签上使用稀疏正则化器进行训练。在多个基准数据集和多种LLM主干网络上的实验表明,所提方法持续优于强基线方法。


摘要 (Abstract)

Large Language Models (LLMs) have recently been explored as fine-grained zero-shot re-rankers by leveraging attention signals to estimate document relevance. However, existing methods either aggregate attention signals across all heads or rely on a statically selected subset identified by heuristic rules. This solution can be suboptimal because the informative heads can vary across queries or domains. Moreover, naively combining multiple heads can degrade performance due to redundancy or conflicting ranking signals. In this paper, we propose a query-dependent head selection method, RouteHead, for attention-based re-ranking with LLMs. Specifically, we learn a lightweight router that can map each query to an optimal head set, and relevance scores are computed by aggregating attention signals only from these heads. Since query-to-head optimal labels are unavailable, we first construct pseudo labels via an offline search. The router represents each head with a learnable embedding and represents each query using an embedding extracted from the hidden states of the frozen LLM. Then it is trained on the pseudo labels with a sparsity regularizer. Experiments on diverse benchmarks and multiple LLM backbones show that the proposed method consistently outperforms strong baselines.


关键词: Large Language Models, Attention-based Re-ranking, Query-dependent Head Selection, RouteHead, Zero-shot Re-ranker, Pseudo Labels, Sparsity Regularizer


25. ❌ Quantum Kernel Advantage over Classical Collapse in Medical Foundation Model Embeddings

作者: Sebastian Cajas Ordóñez, Felipe Ocampo Osorio, Dax Enshan Koh, Rafi Al Attrach, Aldo Marzullo, Ariel Guerra-Adames, J. Alejandro Andrade, Siong Thye Goh, Chi-Yu Chen, Rahul Gorijavolu, Xue Yang, Noah Dane Hebdon, Leo Anthony Celi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24597v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文研究量子支持向量机(QSVM)在医学基础模型嵌入上的分类优势,涉及医学基础模型(MedSigLIP-448, RAD-DINO, ViT-patch32)和AI for Science,因此’Large Language Models OR LLMs OR Foundation Models’和’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。其他关键词如MoE、SLMs、Scaling Laws、Pre-training等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文通过无噪声模拟证明量子支持向量机在医学基础模型嵌入的二元保险分类中优于经典线性SVM,尤其在少数类F1分数上表现显著。
摘要翻译

我们提供了在无噪声模拟条件下,使用量子支持向量机(QSVM)并结合三种医学基础模型(MedSigLIP-448、RAD-DINO、ViT-patch32)的冻结嵌入,对MIMIC-CXR胸部X光片进行二元保险分类时量子核优势的证据。我们提出了一个双层公平比较框架,其中两种分类器均接收相同的PCA-q特征。在第一层(未调优的QSVM与未调优的线性SVM,两者C=1)中,QSVM在所有18个测试配置中均赢得了少数类F1分数(17个在p<0.001水平,1个在p<0.01水平)。经典线性核在每个量子比特数下,在90-100%的随机种子中退化为多数类预测,而QSVM则保持了非平凡的召回率。在q=11(MedSigLIP-448平台中心)时,QSVM无需超参数调优即实现了平均F1=0.343,而经典方法F1=0.050(F1增益=+0.293,p<0.001)。在第二层(未调优的QSVM与C调优的RBF SVM)中,QSVM在所有七个测试配置中获胜(平均增益+0.068,最大+0.112)。特征谱分析显示,在q=11时量子核有效秩达到69.80,远超线性核秩,而经典方法的坍缩现象对C值不敏感。完整的量子比特扫描揭示了不同模型间依赖于架构的浓度起始点。代码:https://github.com/sebasmos/qml-medimage


摘要 (Abstract)

We provide evidence of quantum kernel advantage under noiseless simulation in binary insurance classification on MIMIC-CXR chest radiographs using quantum support vector machines (QSVM) with frozen embeddings from three medical foundation models (MedSigLIP-448, RAD-DINO, ViT-patch32). We propose a two-tier fair comparison framework in which both classifiers receive identical PCA-q features. At Tier 1 (untuned QSVM vs. untuned linear SVM, C = 1 both sides), QSVM wins minority-class F1 in all 18 tested configurations (17 at p < 0.001, 1 at p < 0.01). The classical linear kernel collapses to majority-class prediction on 90-100% of seeds at every qubit count, while QSVM maintains non-trivial recall. At q = 11 (MedSigLIP-448 plateau center), QSVM achieves mean F1 = 0.343 vs. classical F1 = 0.050 (F1 gain = +0.293, p < 0.001) without hyperparameter tuning. Under Tier 2 (untuned QSVM vs. C-tuned RBF SVM), QSVM wins all seven tested configurations (mean gain +0.068, max +0.112). Eigenspectrum analysis reveals quantum kernel effective rank reaches 69.80 at q = 11, far exceeding linear kernel rank, while classical collapse remains C-invariant. A full qubit sweep reveals architecture-dependent concentration onset across models. Code: https://github.com/sebasmos/qml-medimage


关键词: Quantum Support Vector Machines, Medical Foundation Models, MIMIC-CXR, Quantum Kernel Advantage, Binary Classification, Eigenspectrum Analysis, MedSigLIP-448, RAD-DINO


26. ❌ Skill Retrieval Augmentation for Agentic AI

作者: Weihang Su, Jianming Long, Qingyao Ai, Yichen Tang, Changyue Wang, Yiteng Tu, Yiqun Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24594v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.014.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM agent的技能检索增强,与’LLM Agents’高度相关(15分),与’Retrieval-Augmented Generation’高度相关(14分),因为提出SRA范式动态检索技能。涉及’Tool Use’(10分)因为技能可视为工具。其他关键词如MoE、SLM、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

论文提出技能检索增强(SRA)范式,通过动态检索外部技能库提升LLM agent性能,并构建SRA-Bench基准揭示技能整合的瓶颈。
摘要翻译

随着大型语言模型(LLM)演变为具备自主问题解决能力的智能体,它们越来越依赖外部可复用的技能来处理超出其原生参数能力范围的任务。在现有智能体系统中,整合技能的主流策略是在上下文窗口内显式列举可用技能。然而,这种策略难以扩展:随着技能库的扩大,上下文预算被迅速消耗,且智能体在识别正确技能时的准确性显著下降。为此,本文提出技能检索增强(SRA)这一新范式,智能体可根据需求从大型外部技能库中动态检索、整合并应用相关技能。为使该问题可量化,我们构建了一个大规模技能库,并引入SRA-Bench——首个针对完整SRA流程进行分解评估的基准测试,涵盖技能检索、技能整合及最终任务执行。SRA-Bench包含5,400个高能力需求的测试实例与636个手工构建的黄金技能,这些技能与网络收集的干扰技能混合,形成包含26,262个技能的大规模语料库。大量实验表明,基于检索的技能增强能显著提升智能体性能,验证了该范式的潜力。同时,我们揭示了技能整合中的根本性差距:当前LLM智能体倾向于以相近速率加载技能,无论是否检索到黄金技能,也无论任务是否实际需要外部能力。这表明技能增强的瓶颈不仅在于检索,更在于基础模型判断应加载何种技能以及何时需要外部加载的能力。这些发现将SRA定位为一个独特的研究问题,并为未来智能体系统中能力的可扩展增强奠定了基础。


摘要 (Abstract)

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for incorporating skills is to explicitly enumerate available skills within the context window. However, this strategy fails to scale: as skill corpora expand, context budgets are consumed rapidly, and the agent becomes markedly less accurate in identifying the right skill. To this end, this paper formulates Skill Retrieval Augmentation (SRA), a new paradigm in which agents dynamically retrieve, incorporate, and apply relevant skills from large external skill corpora on demand. To make this problem measurable, we construct a large-scale skill corpus and introduce SRA-Bench, the first benchmark for decomposed evaluation of the full SRA pipeline, covering skill retrieval, skill incorporation, and end-task execution. SRA-Bench contains 5,400 capability-intensive test instances and 636 manually constructed gold skills, which are mixed with web-collected distractor skills to form a large-scale corpus of 26,262 skills. Extensive experiments show that retrieval-based skill augmentation can substantially improve agent performance, validating the promise of the paradigm. At the same time, we uncover a fundamental gap in skill incorporation: current LLM agents tend to load skills at similar rates, regardless of whether a gold skill is retrieved or whether the task actually requires external capabilities. This shows that the bottleneck in skill augmentation lies not only in retrieval but also in the base model’s ability to determine which skill to load and when external loading is actually needed. These findings position SRA as a distinct research problem and establish a foundation for the scalable augmentation of capabilities in future agent systems.


关键词: Skill Retrieval Augmentation, LLM Agents, Retrieval-Augmented Generation, SRA-Bench, Agentic AI, Skill Incorporation, Large Language Models


27. ❌ A systematic evaluation of vision-language models for observational astronomical reasoning tasks

作者: Wenke Ren, Hengxiao Guo, Wenwen Zuo, Xiaoman Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24589v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.08.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文评估了视觉语言模型在天文观测推理任务上的表现,涉及多模态数据(光学、射电等)和推理能力。与’Chain of Thought’相关,因为论文分析了模型推理质量,并使用了现象学提示和物理提示来改善推理;与’AI for Science’高度相关,因为论文聚焦于AI在天文学中的应用。其他关键词如大模型、微调、RAG等均未涉及。


!!! tip deepseek-chat TL;DR

该论文构建了AstroVLBench基准,系统评估了六个视觉语言模型在五种天文观测任务上的表现,发现模型性能依赖模态且远低于专业方法,并揭示了物理知识引导对推理准确性的关键作用。
摘要翻译

视觉-语言模型(Vision-language models, VLMs)正日益被提出作为科学数据解释的通用工具,然而它们在多种模态下的真实天文观测数据上的可靠性尚未得到检验。我们提出了AstroVLBench,这是一个全面的基准测试,包含超过4,100个经专家验证的实例,涵盖光学成像、射电干涉测量、多波段测光、时域光变曲线和光学光谱五大任务。通过评估六种前沿模型,我们发现其性能强烈依赖于模态:尽管有一个模型(Gemini 3 Pro)在各项任务中表现出最稳定的一致能力,但各任务的具体优势各不相同,且所有模型均显著逊色于领域专用方法。机制消融实验揭示,性能不仅取决于将注意力引导至显著的视觉特征,还取决于将这些特征锚定于物理知识。描述“看什么”的现象学提示(Phenomenological prompts)通过增强模型聚焦能力提高了准确率,但解释“为什么这些特征重要”的物理提示(Physical prompts)整体上表现更优,并产生了更均衡的分类结果,减少了类别特定偏差。与此一致的是,将底层的一维测量数据直接以数值表格而非渲染图的形式呈现,可带来高达13个百分点的提升。推理质量分析进一步表明,在没有明确物理锚定的情况下,模型可能从现象学上看似合理的线索中得出正确预测,同时提供物理上不精确的论证,这证实了仅凭准确率不足以实现值得信赖的科学部署。这些发现为观测天文学中的VLMs提供了首个系统性的多模态基准,并识别了当前模型失效的具体表征、锚定和推理瓶颈。


摘要 (Abstract)

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present AstroVLBench, a comprehensive benchmark comprising over 4,100 expert-verified instances across five tasks spanning optical imaging, radio interferometry, multi-wavelength photometry, time-domain light curves, and optical spectroscopy. Evaluating six frontier models, we find that performance is strongly modality-dependent: while one model (Gemini 3 Pro) emerges as the most consistently capable across tasks, task-specific strengths vary, and all models substantially underperform domain-specialized methods. Mechanistic ablations reveal that performance depends not only on directing attention to salient visual features but also on grounding those features in physical knowledge. Phenomenological prompts describing what to look for improve accuracy by sharpening model focus, but physical prompts explaining why those features matter perform better overall and yield more balanced classifications with reduced class-specific bias. Consistent with this picture, presenting the underlying one-dimensional measurements directly as numerical tables instead of rendered plots yields up to 13 percentage points improvement. Reasoning quality analysis further demonstrates that, without explicit physical grounding, models may reach correct predictions from phenomenologically plausible cues while providing physically imprecise justifications, establishing that accuracy alone is insufficient for trustworthy scientific deployment. These findings provide the first systematic, multi-modal baselines for VLMs in observational astronomy and identify the specific representation, grounding, and reasoning bottlenecks where current models fail.


关键词: Vision-Language Models, Astronomy, Benchmark, Reasoning, Multi-modal, Physical Grounding, Scientific AI


28. ❌ FastOMOP: A Foundational Architecture for Reliable Agentic Real-World Evidence Generation on OMOP CDM data

作者: Niko Moeller-Grell, Shihao Shenzhang, Zhangshu Joshua Jiang, Richard JB Dobson, Vishnu V Chandrabalan 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24572v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.010.0/100.0
Tool Use0.08.0/100.0
Multi-agent Systems0.010.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.08.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文提出FastOMOP,一个用于OMOP CDM数据上可靠生成真实世界证据的多智能体架构。核心涉及LLM Agents、Multi-agent Systems、Tool Use和Hallucination Mitigation(通过治理层防止幻觉)。同时属于AI for Science(生物医学应用)。其他关键词如MoE、SLMs、Scaling Laws等不相关。


!!! tip deepseek-chat TL;DR

FastOMOP通过分离治理、可观测性和编排三层基础设施,解决了基于LLM的多智能体系统在真实世界证据生成中的可靠性和安全性问题,在三个OMOP CDM数据集上实现了0.84-0.94的可靠性评分和完美的对抗性阻断率。
摘要翻译

观测医学结果合作伙伴通用数据模型(OMOP CDM)由观测健康数据科学与信息学(OHDSI)协作维护,实现了83个国家近10亿患者电子健康记录数据的标准化。然而,从这些数据存储库中生成真实世界证据(RWE)仍是一个需要临床、流行病学和技术专业知识的手动流程。大语言模型(LLM)与多智能体系统在临床任务中展现出潜力,但RWE自动化暴露了一个根本性挑战:智能体系统会引发现有方法无法管控的新兴行为、协调失败及安全风险。目前尚无基础设施能够确保智能体驱动的RWE生成在全生命周期内具备灵活性、安全性与可审计性。我们提出FastOMOP——一种开源多智能体架构,通过将治理、可观测性与编排三个基础设施层与可插拔的智能体团队分离来解决这一空白。治理在流程边界通过独立于智能体推理的确定性验证强制执行,确保任何受损或产生幻觉的智能体均无法绕过安全控制。表型分析、研究设计与统计分析等智能体团队通过受控工具暴露继承这些保障。我们使用自然语言到SQL的智能体团队,在三个OMOP CDM数据集(Synthea合成数据、MIMIC-IV及兰开夏教学医院IDRIL的真实世界NHS数据集)上验证了FastOMOP。FastOMOP实现了0.84-0.94的可靠性评分,且对抗性与范围外阻断率达到完美水平,证明流程边界治理能够提供独立于模型选择的安全保障。这些结果表明,RWE部署中的可靠性差距源于架构而非模型能力,并使FastOMOP成为渐进式RWE自动化的受控架构。


摘要 (Abstract)

The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM), maintained by the Observational Health Data Sciences and Informatics (OHDSI) collaboration, enabled the harmonisation of electronic health records data of nearly one billion patients in 83 countries. Yet generating real-world evidence (RWE) from these repositories remains a manual process requiring clinical, epidemiological and technical expertise. LLMs and multi-agent systems have shown promise for clinical tasks, but RWE automation exposes a fundamental challenge: agentic systems introduce emergent behaviours, coordination failures and safety risks that existing approaches fail to govern. No infrastructure exists to ensure agentic RWE generation is flexible, safe and auditable across the lifecycle. We introduce FastOMOP, an open-source multi-agent architecture that addresses this gap by separating three infrastructure layers, governance, observability and orchestration, from pluggable agent-teams. Governance is enforced at the process boundary through deterministic validation independent of agent reasoning, ensuring no compromised or hallucinating agent can bypass safety controls. Agent teams for phenotyping, study design and statistical analysis inherit these guarantees through controlled tool exposure. We validated FastOMOP using a natural-language-to-SQL agent team across three OMOP CDM datasets: synthetic data from Synthea, MIMIC-IV and a real-world NHS dataset from Lancashire Teaching Hospitals (IDRIL). FastOMOP achieved reliability scores of 0.84-0.94 with perfect adversarial and out-of-scope block rates, demonstrating process-boundary governance delivers safety guarantees independent of model choice. These results indicate that the reliability gap in RWE deployment is architectural rather than model capability, and establish FastOMOP as a governed architecture for progressive RWE automation.


关键词: OMOP CDM, multi-agent architecture, LLM agents, real-world evidence, governance, observability, orchestration, hallucination mitigation


29. ❌ Towards Lawful Autonomous Driving: Deriving Scenario-Aware Driving Requirements from Traffic Laws and Regulations

作者: Bowen Jian, Rongjie Yu, Hong Wang, Liqiang Wang, Zihang Zou 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24562v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.08.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.06.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.08.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.06.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心使用LLMs从交通法规中推导驾驶要求,涉及LLM应用、RAG(检索相关法规)、CoT(推理过程)、LLM Agents(构建合规层和监控器)以及幻觉缓解(提高匹配准确性)。其他关键词如MoE、SLMs、预训练等不相关。


!!! tip deepseek-chat TL;DR

该论文提出一种基于LLM的管道,通过场景分类锚点提高交通法规与驾驶场景的匹配准确性,并构建了自动驾驶合规层和实时监控器。
摘要翻译

遵守交通法律法规是人类驾驶员的基本要求,然而自动驾驶车辆(AVs)在多种真实场景中可能违反这些要求。为将法律合规性编码至自动驾驶系统,传统方法采用形式化逻辑语言明确指定行为约束,但这一过程劳动密集、难以扩展且维护成本高昂。随着人工智能的最新进展,利用大型语言模型(LLMs)从交通法律法规中推导法律要求具有广阔前景。然而,若缺乏对结构化交通场景的显式锚定与推理,LLMs常会检索到不相关条款或遗漏可适用条款,从而生成不精确的要求。为解决此问题,我们提出了一种新型流水线,通过编码层次化语义的节点式锚点,将LLM推理锚定于交通场景分类体系。在中国交通法规及OnSite数据集(5,897个场景)上,我们的方法将法律-场景匹配率提升29.1%,并将推导出的强制性要求与禁止性要求的准确率分别提升36.9%和38.2%。我们进一步通过构建用于自动驾驶导航的法律合规层,并开发用于现场测试的车载实时合规监控器,验证了其实用性,为未来自动驾驶车辆的开发、部署及监管监督奠定了坚实基础。


摘要 (Abstract)

Driving in compliance with traffic laws and regulations is a basic requirement for human drivers, yet autonomous vehicles (AVs) can violate these requirements in diverse real-world scenarios. To encode law compliance into AV systems, conventional approaches use formal logic languages to explicitly specify behavioral constraints, but this process is labor-intensive, hard to scale, and costly to maintain. With recent advances in artificial intelligence, it is promising to leverage large language models (LLMs) to derive legal requirements from traffic laws and regulations. However, without explicitly grounding and reasoning in structured traffic scenarios, LLMs often retrieve irrelevant provisions or miss applicable ones, yielding imprecise requirements. To address this, we propose a novel pipeline that grounds LLM reasoning in a traffic scenario taxonomy through node-wise anchors that encode hierarchical semantics. On Chinese traffic laws and OnSite dataset (5,897 scenarios), our method improves law-scenario matching by 29.1% and increases the accuracy of derived mandatory and prohibitive requirements by 36.9% and 38.2%, respectively. We further demonstrate real-world applicability by constructing a law-compliance layer for AV navigation and developing an onboard, real-time compliance monitor for in-field testing, providing a solid foundation for future AV development, deployment, and regulatory oversight.


关键词: Large Language Models, Autonomous Driving, Traffic Law Compliance, Retrieval-Augmented Generation, Chain of Thought, LLM Agents, Scenario Taxonomy, Hallucination Mitigation


30. ❌ Aligned Multi-View Scripts for Universal Chart-to-Code Generation

作者: Zhihan Zhang, Lizi Liao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24559v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.010.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.010.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出Chart2NCode数据集和CharLuMA模型,用于图表到代码生成。核心创新是使用语言条件混合低秩子空间(Mixture of Experts)的参数高效微调(PEFT)方法,因此与’Mixture of Experts’和’PEFT’高度相关。模型基于LLaVA架构,属于多模态大语言模型,但与’Large Language Models’相关度中等。其他关键词如’Small Language Models’、‘Scaling Laws’等均不涉及。


!!! tip deepseek-chat TL;DR

论文通过构建多语言对齐的图表-代码数据集Chart2NCode,并提出基于混合专家和参数高效微调的CharLuMA模型,实现了跨Python、R和LaTeX的通用图表到代码生成,显著提升了执行效率和视觉保真度。
摘要翻译

图表到代码生成将图表图像转换为可执行的绘图脚本,从而实现高保真复现与可编辑的可视化。现有方法主要围绕Python展开,这限制了实际应用,并忽视了一个关键的监督来源:同一张图表可由不同绘图语言中语义等价的脚本表达。为填补这一空白,我们提出了Chart2NCode数据集,包含176K张图表及其对应的Python、R和LaTeX对齐脚本,这些脚本能生成视觉上等价的输出,并通过元数据到模板的流水线构建,辅以渲染验证与人工质量检查。基于LLaVA风格的架构,我们进一步提出了CharLuMA,这是一种参数高效的适配模块,通过语言条件混合低秩子空间增强多模态投影器,使模型能够共享核心图表理解能力,同时通过轻量级路由将代码生成专精于目标语言。大量实验表明,该方法在所有语言中均能持续提升可执行性与视觉保真度,超越强开源基线模型,并与专有系统保持竞争力。进一步分析揭示,平衡的多语言监督对所有语言均有裨益,且适配器分配了紧凑的共享核心与语言专用容量。代码与数据可在https://github.com/Zhihan72/CharLuMA获取。


摘要 (Abstract)

Chart-to-code generation converts a chart image into an executable plotting script, enabling faithful reproduction and editable visualizations. Existing methods are largely Python-centric, limiting practical use and overlooking a critical source of supervision: the same chart can be expressed by semantically equivalent scripts in different plotting languages. To fill this gap, we introduce Chart2NCode, a dataset of 176K charts paired with aligned scripts in Python, R, and LaTeX that render visually equivalent outputs, constructed via a metadata-to-template pipeline with rendering verification and human quality checks. Building on a LLaVA-style architecture, we further propose CharLuMA, a parameter-efficient adaptation module that augments the multimodal projector with a language-conditioned mixture of low-rank subspaces, allowing the model to share core chart understanding while specializing code generation to the target language through lightweight routing. Extensive experiments show consistent gains in executability and visual fidelity across all languages, outperforming strong open-source baselines and remaining competitive with proprietary systems. Further analyses reveal that balanced multi-language supervision benefits all languages and that the adapter allocates a compact shared core plus language-specific capacity. Codes and data are available at https://github.com/Zhihan72/CharLuMA.


关键词: Chart-to-code generation, Multi-view scripts, Mixture of Experts, Parameter-efficient fine-tuning, Multimodal LLM, LLaVA, Low-rank adaptation


31. ❌ Hierarchical Behaviour Spaces

作者: Michael Tryfan Matthews, Anssi Kanervisto, Jakob Foerster, Pierluca D’Oro, Scott Fujimoto, Mikael Henaff 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24558v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究层次强化学习中的分层行为空间(HBS),不涉及大模型、深度学习技术原理创新或AI for Science。所有关键词均与论文内容无关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文提出分层行为空间(HBS)方法,通过线性组合奖励函数来诱导行为空间,在NetHack环境中验证了层次结构带来的探索增益而非长期推理优势。
摘要翻译

近期在分层强化学习领域的研究表明,当基于一组预定义的选项奖励函数进行学习时,该方法已成功扩展至数十亿时间步的规模。我们提出,无需为每个选项设置单一奖励函数,而是通过让控制器指定奖励函数的线性组合,使奖励函数能够有效诱导出行为空间,从而表征更具表达力的策略集合。我们将此方法命名为分层行为空间(Hierarchical Behaviour Spaces, HBS)。我们在NetHack学习环境中对HBS进行了评估,验证了其卓越性能。通过一系列实验,我们发现——或许与常规认知相悖——该方法中分层结构的优势源于探索能力的增强,而非长期推理能力的提升。


摘要 (Abstract)

Recent work in hierarchical reinforcement learning has shown success in scaling to billions of timesteps when learning over a set of predefined option reward functions. We show that, instead of using a single reward function per option, the reward functions can be effectively used to induce a space of behaviours, by letting the controller specify linear combinations over reward functions, allowing a more expressive set of policies to be represented. We call this method Hierarchical Behaviour Spaces (HBS). We evaluate HBS on the NetHack Learning Environment, demonstrating strong performance. We conduct a series of experiments and determine that, perhaps going against conventional wisdom, the benefits of hierarchy in our method come from increased exploration rather than long term reasoning.


关键词: Hierarchical Reinforcement Learning, Option Reward Functions, Behaviour Spaces, NetHack Learning Environment, Exploration, Hierarchy


32. ❌ GradMAP: Gradient-Based Multi-Agent Proximal Learning for Grid-Edge Flexibility

作者: Yihong Zhou, Hongtai Zeng, Thomas Morstyn 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24549v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多智能体系统在电网边缘设备协调中的应用,使用梯度基多智能体近端学习(GradMAP),与’Multi-agent Systems OR Agent Coordination’高度相关(10分)。其他关键词如大模型、预训练、微调、推理加速等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出GradMAP方法,通过嵌入可微三相交流潮流模型和隐式微分传播约束,在15分钟内训练1000个智能体学习去中心化策略,实现电网边缘设备协调,显著提升训练效率。
摘要翻译

协调大规模电网边缘设备需要采用在部署时保持完全去中心化、同时仍遵循三相交流配电网物理规律的学习方法。本文提出基于梯度的多智能体近端学习(GradMAP)以应对这一挑战。GradMAP为每个智能体训练独立的神经网络策略,无需任何参数共享,且每个智能体仅利用自身局部观测进行在线决策,无需通信。在离线训练阶段,GradMAP将可微的三相交流潮流模型嵌入原始-对偶学习循环中,并利用隐式微分传播精确的网络约束违反信息以更新策略参数。为加速训练,GradMAP通过近端代理在更直接的策略输出(动作)空间(而非其他工作如PPO所使用的概率分布空间)所定义的信任域内复用昂贵的环境梯度。在包含1000个智能体(管理IEEE 123节点馈线上的电池、热泵和可控发电机)的案例研究中,GradMAP在单台工作站级NVIDIA RTX PRO 5000 Blackwell 48GB GPU上训练15分钟内即可学习到最小化三相交流潮流约束违反的去中心化策略。相较于基于梯度的自监督学习基准,训练速度提升3-5倍,且训练效率显著优于多智能体强化学习基准。在样本外测试中,GradMAP还实现了最低的运行成本和约束违反水平。


摘要 (Abstract)

Coordinating large populations of grid-edge devices requires learning methods that remain fully decentralised in deployment while still respecting three-phase AC distribution-network physics. This paper proposes gradient-based multi-agent proximal learning (GradMAP) to address this challenge. GradMAP trains independent neural-network policies for each agent without any parameter sharing, and each agent uses only its own local observation for online decision-making without communication. During offline training, GradMAP embeds a differentiable three-phase AC power-flow model in a primal-dual learning loop and uses implicit differentiation to propagate exact network-constraint violations to update the policy parameters. To speed up training, GradMAP reuses expensive environment gradients through a proximal surrogate within a trust region defined in the more direct policy-output (action) space, instead of the probability distribution space used in other works, such as PPO. In case studies with 1,000 agents managing batteries, heat pumps, and controllable generators on the IEEE 123-bus feeder, GradMAP learns decentralised policies that minimise three-phase AC load-flow constraint violations within 15 minutes of training on a single workstation-class NVIDIA RTX PRO 5000 Blackwell 48GB GPU. This is a 3–5x training speed-up over gradient-based self-supervised learning benchmarks and substantially better training efficiency than multi-agent reinforcement-learning benchmarks. In out-of-sample tests, GradMAP also delivers among the lowest operating cost and constraint violations.


关键词: multi-agent learning, grid-edge flexibility, decentralized control, primal-dual learning, implicit differentiation, power flow, proximal learning


33. ❌ STELLAR-E: a Synthetic, Tailored, End-to-end LLM Application Rigorous Evaluator

作者: Alessio Sordo, Lingxiao Du, Meeka-Hanna Lenisa, Evgeny Bogdanov, Maxim Romanovsky 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24544v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.05.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心关注大语言模型(LLMs)的评估数据集生成,提出STELLAR-E系统,用于合成高质量、领域特定和语言特定的评估数据集。与LLMs高度相关(15分),涉及小模型评估(SLMs,5分),并提及领域适应(Domain Adaptation,5分)。其他关键词如MoE、RAG、CoT等未涉及,评分为0。


!!! tip deepseek-chat TL;DR

STELLAR-E提出一种全自动合成高质量、领域特定和语言特定评估数据集的系统,通过改进TGRT Self-Instruct框架和评估管道,生成的数据集在LLM-as-a-judge评分上接近真实基准,为LLM应用提供可扩展、可领域适应的评估框架。
摘要翻译

各行业对大型语言模型(Large Language Models, LLMs)的依赖日益加深,凸显了构建稳健的领域专用及语言专用评估数据集的必要性;然而,由于隐私问题、监管限制以及人工创建的时间成本,此类数据集的收集面临诸多挑战。现有的自动化基准测试方法往往受限于对既有数据的依赖、可扩展性差、聚焦单一领域以及缺乏多语言支持。我们提出STELLAR-E——一个全自动系统,能够利用最少的人工输入,在不依赖现有数据集的情况下,生成自定义规模的高质量合成数据集。该系统由两个阶段构成:(1)对TGRT自指令(Self-Instruct)框架进行改进,构建一个合成数据引擎,实现可控、自定义的合成数据集生成;(2)构建一个评估流水线,整合基于统计和基于LLM的指标,以评估合成数据集在基于LLM的应用评估中的适用性。与现有的语言专用基准相比,合成数据集在LLM作为评判者(LLM-as-a-judge)评分上的平均差异为+5.7%,显示出其在全面评估大、小规模LLM方面具有可比拟的质量。尽管真实数据集对LLM(尤其是较小模型)仍略具挑战性,但本研究建立了一个可扩展且可适应不同领域的基准测试框架,支持对LLM应用的公平评估,为人工方法提供了更快速的替代方案,并实现了高效的自动化质量保障循环。


摘要 (Abstract)

The increasing reliance on Large Language Models (LLMs) across diverse sectors highlights the need for robust domain-specific and language-specific evaluation datasets; however, the collection of such datasets is challenging due to privacy concerns, regulatory restrictions, and the time cost for manual creation. Existing automated benchmarking methods are often limited by relying on pre-existing data, poor scalability, single-domain focus, and lack of multilingual support. We present STELLAR-E - a fully automated system to generate high-quality synthetic datasets of custom size, using minimal human inputs without depending on existing datasets. The system is structured in two stages: (1) We modify the TGRT Self-Instruct framework to create a synthetic data engine that enables controllable, custom synthetic dataset generation, and (2) an evaluation pipeline incorporating statistical and LLM-based metrics to assess the applicability of the synthetic dataset for LLM-based application evaluations. The synthetic datasets reach an average difference of +5.7% in terms of LLM-as-a-judge scores against existing language-specific benchmarks, demonstrating comparable quality for comprehensive assessment of big and small LLMs. While real datasets remain slightly more challenging for LLMs especially for smaller models, this work establishes a scalable and domain-adaptable benchmarking framework that supports fair evaluation of LLM applications, offering a faster alternative to manual approaches and enabling high-efficiency automated quality assurance cycles.


关键词: Large Language Models, synthetic dataset generation, LLM evaluation, Self-Instruct, domain adaptation, multilingual, automated benchmarking


34. ❌ Layerwise Convergence Fingerprints for Runtime Misbehavior Detection in Large Language Models

作者: Nay Myat Min, Long H. Pham, Jun Sun 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24542v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.05.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.010.0/100.0
Mechanistic Interpretability0.08.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于大语言模型(LLMs)的运行时安全检测,提出层间收敛指纹(LCF)方法,通过分析隐藏状态轨迹检测后门攻击、越狱和提示注入。与关键词的相关性:‘Large Language Models’ 高度相关(15分),因为核心对象是LLMs;‘Small Language Models’ 略有提及(5分),因为方法适用于on-device LLMs;‘Hallucination Mitigation’ 相关(10分),因为检测恶意行为间接减少幻觉;‘Mechanistic Interpretability’ 部分相关(8分),因为利用隐藏状态轨迹进行解释性分析。其他关键词如MoE、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

论文提出一种无需调优的运行时监控方法LCF,通过层间隐藏状态轨迹的Mahalanobis距离检测LLMs的后门、越狱和提示注入攻击,在多个模型上实现低误报率和低开销。
摘要翻译

大型语言模型在运行时可能出现异常行为,而干净数据验证无法预见这些行为:训练时后门在触发前保持潜伏状态,越狱攻击破坏安全对齐,提示注入覆盖部署者的指令。现有运行时防御措施逐一应对这些威胁,且通常假设存在干净的参考模型、触发器知识或可编辑权重,这些假设对于不透明的第三方制品几乎不成立。我们提出层间收敛指纹(Layerwise Convergence Fingerprinting, LCF),这是一种无需调优的运行时监控器,将层间隐藏状态轨迹视为健康信号:LCF对每个层间差异计算对角马氏距离(Mahalanobis distance),通过Ledoit-Wolf收缩进行聚合,并基于200个干净样本的留一法校准设定阈值,无需参考模型、触发器知识或重新训练。在四种架构(Llama-3-8B、Qwen2.5-7B、Gemma-2-9B、Qwen2.5-14B)上,针对后门、越狱攻击和提示注入(56种后门组合、3种越狱技术以及BIPIA电子邮件+代码问答)进行评估,LCF将Qwen2.5-7B和Gemma-2的平均后门攻击成功率(ASR)降至1%以下,在Qwen2.5-14B上降至1.3%;检测出92-100%的DAN越狱攻击(GCG和较温和的角色扮演越狱为62-100%);并在全部八个(模型、领域)组合中标记出100%的文本载荷注入,后门假阳性率(FPR)为12-16%,推理开销低于0.1%。单一聚合分数即可覆盖所有三类威胁,无需针对特定威胁进行调优,这使得LCF成为面向云端和端侧大语言模型的通用运行时安全层。


摘要 (Abstract)

Large language models deployed at runtime can misbehave in ways that clean-data validation cannot anticipate: training-time backdoors lie dormant until triggered, jailbreaks subvert safety alignment, and prompt injections override the deployer’s instructions. Existing runtime defenses address these threats one at a time and often assume a clean reference model, trigger knowledge, or editable weights, assumptions that rarely hold for opaque third-party artifacts. We introduce Layerwise Convergence Fingerprinting (LCF), a tuning-free runtime monitor that treats the inter-layer hidden-state trajectory as a health signal: LCF computes a diagonal Mahalanobis distance on every inter-layer difference, aggregates via Ledoit-Wolf shrinkage, and thresholds via leave-one-out calibration on 200 clean examples, with no reference model, trigger knowledge, or retraining. Evaluated on four architectures (Llama-3-8B, Qwen2.5-7B, Gemma-2-9B, Qwen2.5-14B) across backdoors, jailbreaks, and prompt injection (56 backdoor combinations, 3 jailbreak techniques, and BIPIA email + code-QA), LCF reduces mean backdoor attack success rate (ASR) below 1% on Qwen2.5-7B and Gemma-2 and to 1.3% on Qwen2.5-14B, detects 92-100% of DAN jailbreaks (62-100% for GCG and softer role-play), and flags 100% of text-payload injections across all eight (model, domain) cells, at 12-16% backdoor FPR and <0.1% inference overhead. A single aggregation score covers all three threat families without threat-specific tuning, positioning LCF as a general-purpose runtime safety layer for cloud-served and on-device LLMs.


关键词: Layerwise Convergence Fingerprinting, runtime misbehavior detection, backdoor attacks, jailbreaks, prompt injection, hidden state trajectory, Mahalanobis distance


35. ❌ Interoceptive machine framework: Toward interoception-inspired regulatory architectures in artificial intelligence

作者: Diego Candia-Rivera 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24527v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文提出基于内感受(interoception)的机器框架,旨在将生物体的内部状态调节原理应用于人工智能系统,以增强自适应性和鲁棒性。论文聚焦于具身AI和内部状态调节,未涉及大语言模型、深度学习技术原理或科学应用中的具体模型(如LLM、MoE、RAG等),也未提及任何评分关键词中的技术或概念。因此,所有关键词相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文提出一个基于内感受的机器框架,将生物体的内部状态调节原理转化为计算架构,以提升AI系统的自适应性和鲁棒性。
摘要翻译

本综述提出一个基于内感受(interoception)与具身人工智能(embodied AI)的整合性框架——即内感受机器框架(interoceptive machine framework)——该框架将源于生物体的内部状态调节原理转化为适用于自适应自主性的计算架构。内感受被定义为对内部信号的监测、整合与调节,已被证明对理解生物系统中的自适应行为具有重要意义。所提出的框架将内感受的功能贡献组织为三个功能原则:稳态(homeostatic)、动态平衡(allostatic)与生成性(enactive),每个原则对应不同的计算角色:内部存活性调节、基于预期不确定性的重新评估,以及通过交互进行的主动数据生成。这些原则并非旨在作为直接的神经生理映射,而是作为指导人工智能体设计的抽象概念,使其具备更优的自我调节能力与情境敏感行为。通过将内部状态变量与调节回路嵌入这些原则,人工智能系统能够在不确定和动态环境中实现更稳健的决策、校准后的不确定性处理以及自适应交互策略。该方法为构建具备功能基础自我调节能力的智能体提供了一条具体且可验证的路径,对人机交互与辅助技术具有直接意义。最终,内感受机器框架提供了一个统一视角,用以理解内部状态调节如何增强具身人工智能系统的自主性、适应性与鲁棒性。


摘要 (Abstract)

This review proposes an integrative framework grounded on interoception and embodied AI-termed the interoceptive machine framework-that translates biologically inspired principles of internal-state regulation into computational architectures for adaptive autonomy. Interoception, conceived as the monitoring, integration, and regulation of internal signals, has proven relevant for understanding adaptive behavior in biological systems. The proposed framework organizes interoceptive contributions into three functional principles: homeostatic, allostatic, and enactive, each associated with distinct computational roles: internal viability regulation, anticipatory uncertainty-based re-evaluation, and active data generation through interaction. These principles are not intended as direct neurophysiological mappings, but as abstractions that inform the design of artificial agents with improved self-regulation and context-sensitive behavior. By embedding internal state variables and regulatory loops within these principles, AI systems can achieve more robust decision-making, calibrated uncertainty handling, and adaptive interaction strategies, particularly in uncertain and dynamic environments. This approach provides a concrete and testable pathway toward agents capable of functionally grounded self-regulation, with direct implications for human-computer interaction and assistive technologies. Ultimately, the interoceptive machine framework offers a unifying perspective on how internal-state regulation can enhance autonomy, adaptivity, and robustness in embodied AI systems


关键词: interoception, embodied AI, homeostatic regulation, allostatic regulation, enactive regulation, internal-state regulation, adaptive autonomy, self-regulation


36. ❌ Understanding the Limits of Automated Evaluation for Code Review Bots in Practice

作者: Veli Karakaya, Utku Boran Torun, Baykal Mehmet Uçar, Eray Tüzün 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24525v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究LLM驱动的自动化代码审查机器人的评估方法,核心涉及LLM应用(Large Language Models相关度8),但未涉及其他关键词如MoE、SLMs、Scaling Laws等。论文主要关注评估方法而非模型技术原理创新,因此其他关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文通过工业数据集和多种LLM评估方法,发现自动化评估LLM驱动的代码审查机器人评论与人工标签一致性有限,揭示了工作流和组织因素对评估的干扰。
摘要翻译

自动化代码审查(ACR)机器人正越来越多地应用于工业软件开发中,以协助开发人员进行拉取请求(PR)审查。随着其应用日益普及,一个关键挑战是如何可靠且大规模地评估机器人生成评论的有用性。在实践中,此类评估通常依赖于开发者的操作和注释,而这些操作和注释又受到上下文和组织因素的影响,从而使其难以作为客观的基准真相。我们研究了在工业环境中自动化评估基于大语言模型(LLM)的ACR机器人的可行性与局限性。我们分析了一个来自Beko公司的工业数据集,包含2604条机器人生成的PR评论,每条评论均由软件工程师标记为“已修复”(fixed)或“不予修复”(wontFix)。我们采用了两种自动化评估方法——G-Eval和“LLM作为评判者”(LLM-as-a-Judge)流程,并分别使用二元决策和0-4李克特量表(Likert-scale)形式进行,从而能够与开发者提供的标签进行受控比较。在Gemini-2.5-pro、GPT-4.1-mini和GPT-5.2模型上,两种评估策略与人工标签的一致性均仅为中等水平。一致性比率大约在0.44至0.62之间,不同模型之间以及二元决策与李克特量表形式之间存在显著差异,表明结果对模型选择和评估设计均较为敏感。我们的研究结果揭示了在工业环境中完全自动化评估ACR机器人评论所面临的实际局限性。开发者的操作(如解决或忽略评论)不仅反映了评论质量,还反映了上下文约束、优先级决策以及工作流动态,这些因素很难通过静态工件来捕捉。对一位软件工程总监的后续访谈结果进一步证实,开发者的标签行为受到工作流压力和组织约束的强烈影响,从而强化了将此类信号视为客观基准真相所面临的挑战。


摘要 (Abstract)

Automated code review (ACR) bots are increasingly used in industrial software development to assist developers during pull request (PR) review. As adoption grows, a key challenge is how to evaluate the usefulness of bot-generated comments reliably and at scale. In practice, such evaluation often relies on developer actions and annotations that are shaped by contextual and organizational factors, complicating their use as objective ground truth. We examine the feasibility and limitations of automating the evaluation of LLM-powered ACR bots in an industrial setting. We analyze an industrial dataset from Beko comprising 2,604 bot-generated PR comments, each labeled by software engineers as fixed/wontFix. Two automated evaluation approaches, G-Eval and an LLM-as-a-Judge pipeline, are applied using both binary decisions and a 0-4 Likert-scale formulation, enabling a controlled comparison against developer-provided labels. Across Gemini-2.5-pro, GPT-4.1-mini, and GPT-5.2, both evaluation strategies achieve only moderate alignment with human labels. Agreement ratios range from approximately 0.44 to 0.62, with noticeable variation across models and between binary and Likert-scale formulations, indicating sensitivity to both model choice and evaluation design. Our findings highlight practical limitations in fully automating the evaluation of ACR bot comments in industrial contexts. Developer actions such as resolving or ignoring comments reflect not only comment quality, but also contextual constraints, prioritization decisions, and workflow dynamics that are difficult to capture through static artifacts. Insights from a follow-up interview with a software engineering director further corroborate that developer labeling behavior is strongly influenced by workflow pressures and organizational constraints, reinforcing the challenges of treating such signals as objective ground truth.


关键词: Automated Code Review, LLM-as-a-Judge, G-Eval, Pull Request, Industrial Software Development, Evaluation Limitations


37. ❌ Why AI Harms Can’t Be Fixed One Identity at a Time: What 5300 Incident Reports Reveal About Intersectionality

作者: Edyta Bogucka, Sanja Šćepanović, Daniele Quercia 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24519v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究AI系统的交叉性危害,使用LLM分析5300份事故报告。虽然使用了LLM作为分析工具,但核心主题是AI伦理和公平性,而非大模型或深度学习的技术创新。论文不涉及任何列出的关键词所代表的技术方向,如MoE、预训练、微调、RAG、推理加速等。因此,除了’Large Language Models’因作为工具使用而获得中等相关度外,其他关键词均为0分。


!!! tip deepseek-chat TL;DR

该论文通过分析5300份AI事故报告,揭示了AI危害在交叉身份类别(如年龄、政治身份)中放大,并主张将交叉性纳入AI风险评估。
摘要翻译

AI风险评估是识别AI系统所造成危害的主要工具。这些危害包括交叉性危害,即由身份类别(如阶级与肤色)之间的相互作用所产生的危害,而当这些类别被单独考量时,此类危害不会发生或以不同方式发生。然而,现有的AI风险评估仍围绕孤立的身份类别构建,即便考虑交叉性,也几乎只关注种族与性别。基于对已记录AI事件的大规模分析,我们表明AI危害并非一次仅涉及一个身份类别。通过使用应用于大语言模型的结构化评估标准,我们分析了来自AI事件数据库(AI Incident Database)中1200起已记录事件的5300份报告,该数据库是经过最精心整理的事件数据来源。从这些报告中,我们识别出1513名受危害主体及其相关身份类别,准确率达98%。在单一类别层面,我们发现年龄与政治身份在已记录的AI危害中出现的频率与种族和性别相当。在交叉类别层面,特定交叉点的危害被放大至三倍:青春期女性、低阶层有色人种以及上层政治精英。我们认为,交叉性应成为AI风险评估的核心组成部分,以便更准确地捕捉危害如何在各社会群体中产生与分布。


摘要 (Abstract)

AI risk assessment is the primary tool for identifying harms caused by AI systems. These include intersectional harms, which arise from the interaction between identity categories (e.g., class and skin tone) and which do not occur, or occur differently, when those categories are considered separately. Yet existing AI risk assessments are still built around isolated identity categories, and when intersections are considered, they focus almost exclusively on race and gender. Drawing on a large-scale analysis of documented AI incidents, we show that AI harms do not occur one identity category at a time. Using a structured rubric applied with a Large Language Model (LLM), we analyze 5,300 reports from 1,200 documented incidents in the AI Incident Database, the most curated source of incident data. From these reports, we identify 1,513 harmed subjects and their associated identity categories, achieving 98% accuracy. At the level of individual categories, we find that age and political identity appear in documented AI harms at rates comparable to race and gender. At the level of intersecting categories, harm is amplified up to three times at specific intersections: adolescent girls, lower-class people of color, and upper-class political elites. We argue that intersectionality should be a core component of AI risk assessment to more accurately capture how harms are produced and distributed across social groups.


关键词: AI harms, intersectionality, AI risk assessment, AI Incident Database, Large Language Model, identity categories, social groups


38. ❌ Beyond the Attention Stability Boundary: Agentic Self-Synthesizing Reasoning Protocols

作者: Dahlia Shehata, Ming Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24512v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.05.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.08.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.08.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.08.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.05.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM agents中的注意力稳定性问题,提出SSRP框架,涉及LLM agents、self-correction、chain-of-thought reasoning、system 2 thinking、hallucination mitigation、mechanistic interpretability等。与RAG和in-context learning有一定关联,但其他关键词如MoE、SLMs、预训练等无关。


!!! tip deepseek-chat TL;DR

论文识别了LLM agents中的'Attention Latch'故障模式,并提出Self-Synthesizing Reasoning Protocols (SSRP)框架,通过分离架构规划和执行,显著提升了多轮对话中agent的鲁棒性和目标导向性。
摘要翻译

随着大语言模型(LLM)智能体向自主数字协作者转型,如何在非线性多轮对话中保持确定性的目标导向性已成为架构层面的瓶颈。我们识别并形式化了一种系统性故障模式,即仅解码器自回归Transformer中的“注意力锁存”(Attention Latch)。这一现象是“信息过度压缩”(Information Over-squashing)的行为表现,当历史上下文的累积概率权重覆盖了任务中的更新时,智能体便会固守过时的约束条件,即使接收到明确矛盾的指令也无法摆脱。我们提出“自合成推理协议”(Self-Synthesizing Reasoning Protocols, SSRP),这是一种元认知框架,实现了高层架构规划(Architect)与逐轮程序执行(Executive)之间的离散分离。我们利用MultiWOZ 2.2数据集和“聚合枢轴准确率”(Aggregate Pivot Accuracy, APA)这一新型指标,在9000条轨迹上对SSRP进行了评估。APA指标的有效性通过将其得分映射至U形的“迷失在中间”(Lost in the Middle)曲线得到验证。我们设计了三个实验层级:基于近期性的浅层检索试点、高熵标准操作流程(SOP)以及语义劫持的三跳多事实合成任务。实验结果实证性地定位了“注意力稳定边界”(Attention Stability Boundary),在此边界处,GPT 5.4的无状态Vanilla ReAct基线成功率骤降至0.1%,而SSRP实现了715倍的韧性提升。我们在Gemini 3.1 Pro、Claude Sonnet 4.6和DeepSeek V3.2上均验证了统计显著的性能增益。审计工作证实了SSRP的必要性:通过递归反射基线(100%成功率)证明了注意力缺失的存在;通过等距压力测试(90%准确率)将锁存现象与位置偏差解耦;并基于信息瓶颈(Information Bottleneck)原理与粒度消融实验对SSRP进行了形式化。程序完整性审计(98.8%遵循率)揭示了一个“基础悖论”(Grounding Paradox):高稳定性模型在检索-推理污染条件下,因拒绝产生幻觉而失败。


摘要 (Abstract)

As LLM agents transition to autonomous digital coworkers, maintaining deterministic goal-directedness in non-linear multi-turn conversations emerged as an architectural bottleneck. We identify and formalize a systemic failure mode termed the Attention Latch in decoder-only autoregressive Transformers. This phenomenon, a behavioral manifestation of Information Over-squashing, occurs when the cumulative probabilistic weight of historical context overrides mid-task updates, causing agents to remain anchored to obsolete constraints despite explicit contradictory instructions. We propose Self-Synthesizing Reasoning Protocols (SSRP), a metacognitive framework that implements a discrete separation between high-level architectural planning (Architect) and turn-by-turn procedural execution (Executive). We evaluate SSRP across 9K trajectories using the MultiWOZ 2.2 dataset and the Aggregate Pivot Accuracy (APA), a novel metric we validate by mapping its scores to the U-shaped ‘Lost in the Middle’ curve. We present 3 experimental tiers: a shallow recency-based retrieval pilot, a high-entropy SOP, and a semantic hijacked 3-hop Multi-Fact Synthesis task. Our results empirically locate the Attention Stability Boundary, where stateless Vanilla ReAct baselines for GPT 5.4 collapse to 0.1% success while SSRP achieves a 715X Resilience Lift. We demonstrate statistically significant gains across Gemini 3.1 Pro, Claude Sonnet 4.6 and DeepSeek V3.2. Audits confirm SSRP necessity by proving attentional lapse via a recursive reflexion baseline (100% success); decoupling the latch from positional bias through equidistant stress testing (90% accuracy); and formalizing SSRP via the Information Bottleneck principle and granularity ablations. Procedural Integrity audit (98.8% adherence) reveals a Grounding Paradox where high-stability models fail by refusing to hallucinate under retrieval-reasoning contamination.


关键词: Attention Latch, Self-Synthesizing Reasoning Protocols, LLM Agents, Information Over-squashing, Multi-turn Conversations, Aggregate Pivot Accuracy, Attention Stability Boundary


39. ❌ MIMIC: A Generative Multimodal Foundation Model for Biomolecules

作者: Siavash Golkar, Jake Kovalic, Irina Espejo Morales, Samuel Sledzieski, Minhuan Li, Ksenia Sokolova, Geraud Krawezik, Alberto Bietti, Claudia Skok Gibbs, Roman Klypa, Shengwei Xiong, Francois Lanusse, Liam Parker, Kyunghyun Cho, Miles Cranmer, Tom Hehir, Michael McCabe, Lucas Meyer, Rudy Morel, Payel Mukhopadhyay, Mariel Pettee, Helen Qu, Jeff Shen, David Fouhey, Hadi Sotoudeh, Vikram Mulligan, Pilar Cossio, Sonya M. Hanson, Alisha N. Jones, Olga G. Troyanskaya, Shirley Ho 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24506v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.08.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出MIMIC,一个用于生物分子的生成式多模态基础模型,属于AI for Science领域,与’Foundation Models’高度相关(10分)。模型涉及预训练(Pre-training)过程(8分),但未涉及其他关键词如MoE、SLMs、Scaling Laws等。因此,仅两个关键词得分较高,其余为0分。


!!! tip deepseek-chat TL;DR

MIMIC是一个生成式多模态基础模型,通过整合核酸、蛋白质、进化、结构、调控和语义等多种模态,在生物分子序列重建、RNA剪接预测和蛋白质设计等任务上取得最先进性能。
摘要翻译

生物学功能源于序列、结构、调控、进化及细胞环境之间的耦合约束,然而当前大多数生物学基础模型仅在单一模态内训练或针对固定前向任务。我们提出MIMIC——一个生成式多模态基础模型,该模型基于我们新构建的对齐数据集LORE进行训练,该数据集将核酸、蛋白质、进化、结构、调控及语义/环境模态与部分可观测的生物分子状态相关联。MIMIC采用分轨编码器-解码器架构,能够以任意观测模态子集为条件,在基因组、转录组和蛋白质组范围内重建或生成分子状态的缺失组分。与仅基于序列的输入相比,多模态条件化持续提升了MIMIC的序列重建能力,而其学习到的表征则使RNA和蛋白质下游任务达到最优性能。MIMIC实现了最优的剪接预测,其联合生成框架支持异构体感知推理,进一步提升了预测性能。除预测外,同一生成框架还支持约束设计。在RNA层面,MIMIC利用进化与结构信号,在不逆转致病突变的前提下,识别出临床相关的HBB剪接破坏突变中的校正性编辑。在蛋白质层面,通过对PD-L1和hACE2结合位点的形状与表面化学进行联合条件化,MIMIC生成了多样且高置信度的序列,并在计算机模拟中展现出对靶标结合的有力支持。最后,MIMIC将实验环境作为语义条件,对依赖实验条件的RNA化学探测进行建模,而非将环境视为固定输出。综上,这些结果确立了MIMIC对齐的多模态生成建模作为统一表征学习、条件预测及约束生物分子设计的强有力基础,且所有这些能力均集成于单一模型之中。


摘要 (Abstract)

Biological function emerges from coupled constraints across sequence, structure, regulation, evolution, and cellular context, yet most foundation models in biology are trained within one modality or for a fixed forward task. We present MIMIC, a generative multimodal foundation model trained on our newly curated and aligned dataset, LORE, linking nucleic acid, protein, evolutionary, structural, regulatory, and semantic/contextual modalities within partially observed biomolecular states. MIMIC uses a split-track encoder-decoder architecture to condition on arbitrary subsets of observed modalities and reconstruct or generate missing components of molecular state across the genome, transcriptome, and proteome. Multimodal conditioning consistently improves MIMIC’s sequence reconstruction relative to sequence-only inputs, while its learned representations enable state-of-the-art performance on RNA and protein downstream tasks. MIMIC achieves state-of-the-art splicing prediction, and its joint generative formulation enables isoform-aware inference that further improves performance. Beyond prediction, the same generative framework supports constrained design. For RNA, MIMIC identifies corrective edits in a clinically relevant HBB splice-disrupting mutation without reverting it by using evolutionary and structural signals. For proteins, jointly conditioning on shape and surface chemistry of PD-L1 and hACE2 binding sites produces diverse, high-confidence sequences with strong in silico support for target binding. Finally, MIMIC uses experimental context as semantic conditioning to model assay-dependent RNA chemical probing, rather than treating context as a fixed output. Together, these results position MIMIC’s aligned multimodal generative modeling as a strong foundation for unifying representation learning, conditional prediction, and constrained biomolecular design within a single model.


关键词: Multimodal Foundation Model, Biomolecules, Generative Model, RNA Splicing Prediction, Protein Design, AI for Science, Sequence Reconstruction


40. ❌ Deployment-Aligned Low-Precision Neural Architecture Search for Spaceborne Edge AI

作者: Parampuneet Kaur Thind, Vaibhav Katturu, Giacomo Zema, Roberto Del Prete 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24492v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.010.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文主要关注低精度神经网络架构搜索(NAS)在边缘AI中的应用,涉及量化(Quantization)和硬件感知优化。与量化高度相关(10分),因为核心是FP16低精度训练。与AI for Science(5分)部分相关,因为应用于太空海事监测的血管分割,属于科学应用。其他关键词如大模型、MoE、SLM等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出了一种部署对齐的低精度神经网络架构搜索方法,通过在搜索过程中引入FP16数值约束,显著提升了边缘设备上低精度部署的准确性,在血管分割任务上恢复了约三分之二的部署精度损失。
摘要翻译

在边缘加速器上设计满足严格延迟与精度约束的深度神经网络,日益依赖于硬件感知优化,包括由设备级指标引导的神经架构搜索(NAS)。然而,大多数硬件感知的NAS流水线仍基于全精度假设进行架构优化,仅在搜索完成后才应用低精度适配,这导致优化阶段的行为与低精度硬件上部署时的执行之间存在失配,从而可能显著降低精度。我们通过将部署对齐的低精度训练直接集成到硬件感知的NAS中来解决这一局限。候选架构在微调和评估过程中暴露于FP16数值约束,从而在不修改搜索空间或进化策略的前提下,实现架构效率与数值鲁棒性的联合优化。我们针对星载海事监测中的血管分割任务评估了所提出的框架,目标硬件为英特尔Movidius Myriad X视觉处理单元(VPU)。实验表明,对于同一架构(95,791个参数),后训练精度转换将设备上性能从0.85 mIoU降至0.78 mIoU,而部署对齐的低精度训练在设备上实现了0.826 mIoU,在不增加模型复杂度的情况下,弥补了约三分之二的部署引入精度差距。这些结果表明,将部署一致的数值约束纳入硬件感知的NAS,能够显著提升资源受限边缘人工智能(AI)中优化与部署之间的鲁棒性与对齐程度。


摘要 (Abstract)

Designing deep networks that meet strict latency and accuracy constraints on edge accelerators increasingly relies on hardware-aware optimization, including neural architecture search (NAS) guided by device-level metrics. Yet most hardware-aware NAS pipelines still optimize architectures under full-precision assumptions and apply low-precision adaptation only after the search, leading to a mismatch between optimization-time behavior and deployment-time execution on low-precision hardware that can substantially degrade accuracy. We address this limitation by integrating deployment-aligned low-precision training directly into hardware-aware NAS. Candidate architectures are exposed to FP16 numerical constraints during fine-tuning and evaluation, enabling joint optimization of architectural efficiency and numerical robustness without modifying the search space or evolutionary strategy. We evaluate the proposed framework on vessel segmentation for spaceborne maritime monitoring, targeting the Intel Movidius Myriad X Visual Processing Unit (VPU). While post-training precision conversion reduces on-device performance from 0.85 to 0.78 mIoU, deployment-aligned low-precision training achieves 0.826 mIoU on-device for the same architecture (95,791 parameters), recovering approximately two-thirds of deployment-induced accuracy gap without increasing model complexity. These results demonstrate that incorporating deployment-consistent numerical constraints into hardware-aware NAS substantially improves robustness and alignment between optimization and deployment for resource-constrained edge Artificial Intelligence (AI).


关键词: Neural Architecture Search, Low-Precision Training, Edge AI, Hardware-Aware Optimization, Vessel Segmentation, FP16, Intel Movidius Myriad X


41. ❌ GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems

作者: Pablo Mateo-Torrejón, Alfonso Sánchez-Macián 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24477v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.015.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.015.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心关注LLM多智能体系统中的异常检测,与’Large Language Models’、‘LLM Agents’、‘Multi-agent Systems’高度相关,因此给予15分。其他关键词如MoE、SLM、Scaling Laws等与论文主题无关,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了Gammaf框架,用于生成合成多智能体交互数据集并基准测试图基异常检测模型,实验表明有效攻击修复能恢复系统完整性并降低运营成本。
摘要翻译

大型语言模型(LLMs)与多智能体系统(MAS)的快速融合显著增强了其协作解决问题的能力,但也扩大了其攻击面,使其面临提示感染和智能体间通信受损等漏洞。尽管新兴的基于图的异常检测方法在保护这些网络方面展现出潜力,但该领域目前缺乏一个标准化、可复现的环境来训练这些模型并评估其有效性。为填补这一空白,我们提出了Gammaf(面向LLM多智能体系统的基于图异常监控框架),这是一个开源基准测试平台。Gammaf本身并非新型防御机制,而是一个综合评估架构,旨在生成合成多智能体交互数据集,并对现有及未来的防御模型进行性能基准测试。该框架通过两条相互依赖的流水线运行:训练数据生成阶段,该阶段模拟跨多种网络拓扑结构的辩论,将交互捕获为鲁棒的属性图;以及防御系统基准测试阶段,该阶段在实时推理轮次中通过动态隔离被标记的对抗性节点来主动评估防御模型。通过使用既定防御基线(XG-Guard和BlindGuard)在多项知识任务(如MMLU-Pro和GSM8K)上进行严格评估,我们证明了Gammaf的高实用性、拓扑可扩展性和执行效率。此外,我们的实验结果表明,为LLM-MAS配备有效的攻击修复措施不仅能恢复系统完整性,还能通过促进早期共识并切断对抗性智能体典型的大量令牌生成,从而显著降低整体运营成本。


摘要 (Abstract)

The rapid integration of Large Language Models (LLMs) into Multi-Agent Systems (MAS) has significantly enhanced their collaborative problem-solving capabilities, but it has also expanded their attack surfaces, exposing them to vulnerabilities such as prompt infection and compromised inter-agent communication. While emerging graph-based anomaly detection methods show promise in protecting these networks, the field currently lacks a standardized, reproducible environment to train these models and evaluate their efficacy. To address this gap, we introduce Gammaf (Graph-based Anomaly Monitoring for LLM Multi-Agent systems Framework), an open-source benchmarking platform. Gammaf is not a novel defense mechanism itself, but rather a comprehensive evaluation architecture designed to generate synthetic multi-agent interaction datasets and benchmark the performance of existing and future defense models. The proposed framework operates through two interdependent pipelines: a Training Data Generation stage, which simulates debates across varied network topologies to capture interactions as robust attributed graphs, and a Defense System Benchmarking stage, which actively evaluates defense models by dynamically isolating flagged adversarial nodes during live inference rounds. Through rigorous evaluation using established defense baselines (XG-Guard and BlindGuard) across multiple knowledge tasks (such as MMLU-Pro and GSM8K), we demonstrate Gammaf’s high utility, topological scalability, and execution efficiency. Furthermore, our experimental results reveal that equipping an LLM-MAS with effective attack remediation not only recovers system integrity but also substantially reduces overall operational costs by facilitating early consensus and cutting off the extensive token generation typical of adversarial agents.


关键词: Large Language Models, Multi-Agent Systems, Anomaly Detection, Graph-based Monitoring, Benchmarking Framework, Adversarial Attacks, Synthetic Data Generation


42. ❌ Modeling Behavioral Intensity and Transitions for Generative Recommendation

作者: Wenxuan Yang, Xiaoyang Xu, Hanyu Zhang, Zhexuan Xu, Wanqiang Xiong, Zhaoqun Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24472v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究多行为推荐中的生成式序列建模,提出BITRec框架,通过层次化行为聚合和转换关系编码来建模行为强度和转换模式。论文未涉及大模型、深度学习技术原理创新或AI for Science,所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

BITRec通过层次化行为聚合和转换关系编码,在生成式多行为推荐中建模行为强度和转换模式,在四个大规模数据集上实现15-23%的指标提升。
摘要翻译

多行为推荐旨在通过对携带不同意图信号的多种交互类型进行建模,来预测用户转化。近年来,生成式序列建模方法通过实现灵活的序列生成,已成为多行为推荐的重要范式。然而,现有生成方法通常将行为视为辅助性的词元特征,并将其输入统一的注意力机制。这些模型隐式地假设历史行为之间的依赖关系具有均匀激活特性,从而无法区分行为强度的差异或捕捉行为间的转换模式。为解决上述局限,我们提出BITRec——一种新颖的生成式多行为推荐框架,通过选择性依赖激活引入结构化行为建模。BITRec包含:(i)层次化行为聚合(Hierarchical Behavior Aggregation, HBA),通过分离的探索路径与承诺路径显式建模行为强度差异;以及(ii)转换关系编码(Transition Relation Encoding, TRE),通过显式的可学习关系矩阵对转换结构进行编码。在包含数百万交互的四个大规模数据集(RetailRocket、Taobao、Tmall、Insurance Dataset)上进行的实验表明,该方法在多个指标上实现了一致性的15-23%提升,其中在Tmall数据集上MRR最高提升22.79%,在Taobao数据集上HR@10提升17.83%、NDCG@10提升17.55%。


摘要 (Abstract)

Multi-behavior recommendation aims to predict user conversions by modeling various interaction types that carry distinct intent signals. Recently, generative sequence modeling methods have emerged as an important paradigm for multi-behavior recommendation by achieving flexible sequence generation. However, existing generative methods typically treat behaviors as auxiliary token features and feed them into unified attention mechanisms. These models implicitly assume uniform activation of dependencies among historical behaviors, thereby failing to discern differences in intensity or capture transition patterns. To address these limitations, we propose BITRec, a novel generative multi-behavior recommendation framework that introduces structured behavioral modeling through selective dependency activation. BITRec incorporates (i) Hierarchical Behavior Aggregation (HBA), which explicitly models behavioral intensity differences through separated exploration and commitment pathways, and (ii) Transition Relation Encoding (TRE), which encodes transition structures through explicit learnable relation matrices. Experiments on four large-scale datasets (RetailRocket, Taobao, Tmall, Insurance Dataset) with millions of interactions achieve consistent improvements of 15-23% across multiple metrics, with peak gains of 22.79% MRR on Tmall and 17.83% HR@10, 17.55% NDCG@10 on Taobao.


关键词: Multi-behavior Recommendation, Generative Sequence Modeling, Behavioral Intensity, Transition Patterns, Hierarchical Behavior Aggregation, Transition Relation Encoding


43. ❌ Agentic clinical reasoning over longitudinal myeloma records: a retrospective evaluation against expert consensus

作者: Johannes Moll, Jannik Lübberstedt, Christoph Nuernbergk, Jacob Stroh, Luisa Mertens, Anna Purcarea, Christopher Zirn, Zeineb Benchaaben, Fabian Drexel, Hartmut Häntze, Anirudh Narayanan, Friedrich Puttkammer, Andrei Zhukov, Jacqueline Lammert, Sebastian Ziegelmayer, Markus Graf, Marion Högner, Marcus Makowski, Florian Bassermann, Lisa C. Adams, Jiazhen Pan, Daniel Rueckert, Krischan Braitsch, Keno K. Bressem 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24473v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.015.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.015.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.015.0/100.0

评分理由: 论文核心研究LLM在医疗领域的应用,具体为多发性骨髓瘤临床记录推理。高度相关关键词:Large Language Models(核心使用LLM)、Retrieval-Augmented Generation(对比RAG方法)、LLM Agents(提出agentic reasoning系统)、AI for Science(医疗AI应用)。其他关键词如MoE、SLM、Scaling Laws等未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文评估了基于LLM的agentic推理系统在纵向骨髓瘤记录中的临床推理能力,发现其优于传统RAG方法,但系统错误临床严重性更高。
摘要翻译

多发性骨髓瘤的管理涉及长达数年至数十年的序贯治疗,每次决策均取决于分散在数十至数百份异质性临床文件中的累积疾病史。基于大语言模型(LLM)的系统能否在接近专家共识的水平上综合这些证据,尚未得到证实。本研究对某三级医疗中心(2001-2026年)收治的811例骨髓瘤患者的纵向临床记录进行了回顾性评估,涵盖44,962份文件及1,334,677项实验室检测值,并在MIMIC-IV数据库上进行了外部验证。我们比较了一种智能体推理系统与单次检索增强生成(RAG)、迭代式RAG及全上下文输入方法在469对患者-问题(源自48个模板,分属三个复杂度层级)上的表现。参考标签由四位肿瘤科医生进行双重标注,并由资深血液科医生裁定。迭代式RAG与全上下文输入方法收敛于共同上限(75.4% vs 75.8%,p = 1.00)。智能体系统达到79.6%的一致性(95% CI 76.4-82.8),显著超过两个基线水平(分别高出3.8和4.2个百分点;p = 0.006和0.007)。性能提升随问题复杂度增加而上升,在基于标准的综合任务中达到+9.4个百分点(p = 0.032);随病历长度增加,在最长病历的前十分位(n = 10)中达到+13.5个百分点。系统错误率(12.2%)与专家分歧率(13.6%)相当,但严重程度呈反向分布:57.8%的系统错误具有临床意义,而专家分歧中仅18.8%具有临床意义。智能体推理是唯一超越共同上限的方法,其优势集中于最复杂的问题与最长的病历。残留系统错误带来的更大临床后果表明,在将这些发现转化为患者获益之前,需在常规诊疗中进行前瞻性评估。


摘要 (Abstract)

Multiple myeloma is managed through sequential lines of therapy over years to decades, with each decision depending on cumulative disease history distributed across dozens to hundreds of heterogeneous clinical documents. Whether LLM-based systems can synthesise this evidence at a level approaching expert agreement has not been established. A retrospective evaluation was conducted on longitudinal clinical records of 811 myeloma patients treated at a tertiary centre (2001-2026), covering 44,962 documents and 1,334,677 laboratory values, with external validation on MIMIC-IV. An agentic reasoning system was compared against single-pass retrieval-augmented generation (RAG), iterative RAG, and full-context input on 469 patient-question pairs from 48 templates at three complexity levels. Reference labels came from double annotation by four oncologists with senior haematologist adjudication. Iterative RAG and full-context input converged on a shared ceiling (75.4% vs 75.8%, p = 1.00). The agentic system reached 79.6% concordance (95% CI 76.4-82.8), exceeding both baselines (+3.8 and +4.2 pp; p = 0.006 and 0.007). Gains rose with question complexity, reaching +9.4 pp on criteria-based synthesis (p = 0.032), and with record length, reaching +13.5 pp in the top decile (n = 10). The system error rate (12.2%) was comparable to expert disagreement (13.6%), but severity was inverted: 57.8% of system errors were clinically significant versus 18.8% of expert disagreements. Agentic reasoning was the only approach to exceed the shared ceiling, with gains concentrated on the most complex questions and longest records. The greater clinical consequence of residual system errors indicates that prospective evaluation in routine care is required before these findings translate into patient benefit.


关键词: LLM, Agentic Reasoning, Retrieval-Augmented Generation, Multiple Myeloma, Clinical Records, Expert Consensus, Longitudinal Data


44. ❌ Measuring Successful Cooperation in Human-AI Teamwork: Development and Validation of the Perceived Cooperativity and Teaming Perception Scales

作者: Christiane Attig, Christiane Wiebel-Herboth, Patricia Wollstadt, Tim Schrills, Mourad Zoubir, Thomas Franke 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24461v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.02.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注人类-AI合作的主观感知测量,开发了感知合作量表(PCS)和团队感知量表(TPS),并在包括LLM交互在内的三个研究中验证。虽然涉及LLM交互,但论文核心是心理学测量工具的开发与验证,而非大模型或深度学习的技术创新或应用。因此,与所有关键词的相关性极低,仅因LLM交互场景而给予LLMs关键词2分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文开发并验证了感知合作量表和团队感知量表,用于测量人类-AI合作的主观质量,并在包括LLM交互在内的三个研究中证明了其有效性和区分度。
摘要翻译

随着人机协作日益普遍,我们需要可靠的评估工具来衡量人机合作互动的主观质量。本文引入两个基于理论构建的量表:基于联合活动理论的感知合作量表(Perceived Cooperativity Scale, PCS),以及基于演化合作理论的团队感知量表(Teaming Perception Scale, TPS)。PCS用于捕捉在单一互动序列中智能体所展现的感知合作能力与实践;TPS则用于捕捉由相互贡献与支持所涌现出的团队感。两个量表均经过改编以适用于人人合作场景,从而实现跨智能体的比较。通过三项研究(总样本量N=409),涵盖合作纸牌游戏、大语言模型(LLM)交互以及决策支持系统,对维度结构、信度与效度的分析表明,两个量表均能有效区分不同合作质量的合作伙伴,并展现出符合预期的构念效度。这些量表为广泛的人机协作情境下的实证研究与系统评估提供了基础。


摘要 (Abstract)

As human-AI cooperation becomes increasingly prevalent, reliable instruments for assessing the subjective quality of cooperative human-AI interaction are needed. We introduce two theoretically grounded scales: the Perceived Cooperativity Scale (PCS), grounded in joint activity theory, and the Teaming Perception Scale (TPS), grounded in evolutionary cooperation theory. The PCS captures an agent’s perceived cooperative capability and practice within a single interaction sequence; the TPS captures the emergent sense of teaming arising from mutual contribution and support. Both scales were adapted for human-human cooperation to enable cross-agent comparisons. Across three studies (N = 409) encompassing a cooperative card game, LLM interaction, and a decision-support system, analyses of dimensionality, reliability, and validity indicated that both scales successfully differentiated between cooperation partners of varying cooperative quality and showed construct validity in line with expectations. The scales provide a basis for empirical investigation and system evaluation across a wide range of human-AI cooperation contexts.


关键词: human-AI cooperation, perceived cooperativity, teaming perception, scale development, joint activity theory, evolutionary cooperation theory, LLM interaction


45. ❌ SPLIT: Separating Physical-Contact via Latent Arithmetic in Image-Based Tactile Sensors

作者: Wadhah Zai El Amri, Nicolás Navarro-Guerrero 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24449v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注机器人触觉传感中的图像传感器模拟,提出SPLIT方法,利用潜在空间算术分离接触几何与光学属性。不涉及大模型、深度学习或任何列出的关键词,与AI for Science也无直接关联(非科学发现,而是机器人传感)。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出SPLIT方法,通过潜在空间算术分离接触几何与光学属性,实现图像触觉传感器的高效模拟和跨传感器迁移。
摘要翻译

训练用于机器人触觉感知的机器学习模型需要大量数据,然而由于物理复杂性和多变性,获取真实的交互数据仍然是一项挑战。因此,模拟触觉传感器是加速该领域进展的关键步骤。本文提出SPLIT,一种用于模拟基于图像的触觉传感器的新方法,主要聚焦于DIGIT传感器。我们方法的核心是一种潜在空间算术策略,该策略明确地将接触几何形状与传感器特定的光学特性分离开来。与每个新单元都需要重新校准的方法不同,这种分离使得SPLIT能够适应不同的DIGIT背景,甚至无需完整模型重新训练即可将数据迁移至诸如GelSight R1.5等不同的传感器。除了这种适应性之外,我们的方法还实现了比现有替代方案更快的推理速度。此外,我们提供了一种经过校准的有限元方法(FEM)软体网格模拟,具有可变分辨率,可在速度与保真度之间实现可调节的权衡。另外,我们的算法支持双向模拟,既可以从变形网格生成逼真的图像,也可以从触觉图像重建网格。这种多功能性使SPLIT成为加速机器人触觉感知研究进展的宝贵工具。


摘要 (Abstract)

Training machine learning models for robotic tactile sensing requires vast amounts of data, yet obtaining realistic interaction data remains a challenge due to physical complexity and variability. Simulating tactile sensors is thus a crucial step in accelerating progress. This paper presents SPLIT, a novel method for simulating image-based tactile sensors, with a primary focus on the DIGIT sensor. Central to our approach is a latent space arithmetic strategy that explicitly disentangles contact geometry from sensor-specific optical properties. Unlike methods that require recalibration for every new unit, this disentanglement allows SPLIT to adapt to diverse DIGIT backgrounds and even transfer data to distinct sensors like the GelSight R1.5 without full model retraining. Beyond this adaptability, our approach achieves faster inference speeds than existing alternatives. Furthermore, we provide a calibrated finite element method (FEM) soft-body mesh simulation with variable resolution, offering a tunable trade-off between speed and fidelity. Additionally, our algorithm supports bidirectional simulation, allowing for both the generation of realistic images from deformation meshes and the reconstruction of meshes from tactile images. This versatility makes SPLIT a valuable tool for accelerating progress in robotic tactile sensing research.


关键词: tactile sensing, image-based tactile sensor, latent space arithmetic, DIGIT sensor, GelSight R1.5, finite element method, bidirectional simulation


46. ❌ Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment

作者: Kaijun Zhou, Qiwei Chen, Da Peng, Zhiyang Li, Xijun Li, Jinyu Gu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24447v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.010.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.010.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于VLA模型在边缘设备上的部署优化,涉及模型压缩、推理加速(Speculative Decoding相关)和边缘AI(On-device AI),与LLMs相关(VLA模型包含LLM组件)。其他关键词如MoE、预训练、微调等未涉及。


!!! tip deepseek-chat TL;DR

该论文系统分析了VLA模型在不同边缘加速器上的部署约束,提出DP-Cache和V-AEFusion方法实现高达2.9倍(GPU)和6倍(NPU)的推理加速,同时保持任务成功率。
摘要翻译

视觉-语言-动作(Vision-Language-Action, VLA)模型在通用机器人控制方面具有广阔前景,但在机器人上的部署受限于严格成本与能耗预算下的实时推理瓶颈。以往的大多数评估依赖桌面级GPU,这掩盖了异构边缘加速器(GPU/XPU/NPU)所带来的权衡与机遇。我们通过模型-硬件协同表征,提出了一套针对低成本VLA部署的系统性分析。首先,我们构建了一个跨加速器排行榜,并在成本、能耗、时间(CET)指标下评估模型-硬件组合,结果表明,尺寸适中的边缘设备在满足控制速率约束的同时,可能比旗舰级GPU更具成本效益和能效优势。其次,通过深入剖析,我们发现了一致的两阶段推理模式:计算密集型的VLM骨干网络后接内存密集型的动作专家(Action Expert),这种模式导致了阶段性的资源利用不足与硬件效率低下。最后,基于这些洞察,我们提出了DP-Cache与V-AEFusion方法,以减少扩散冗余并实现异步流水线并行,在GPU上实现最高2.9倍加速,在边缘NPU上实现最高6倍加速,且任务成功率仅有轻微下降。示例排行榜网站见:https://vla-leaderboard-01.vercel.app/。


摘要 (Abstract)

Vision-Language-Action (VLA) models are promising for generalist robot control, but on-robot deployment is bottlenecked by real-time inference under tight cost and energy budgets. Most prior evaluations rely on desktop-grade GPUs, obscuring the trade-offs and opportunities offered by heterogeneous edge accelerators (GPUs/XPUs/NPUs). We present a systematic analysis for low-cost VLA deployment via model-hardware co-characterization. First, we build a cross-accelerator leaderboard and evaluate model-hardware pairs under CET (Cost, Energy, Time), showing that right-sized edge devices can be more cost-/energy-efficient than flagship GPUs while meeting control-rate constraints. Second, using in-depth profiling, we uncover a consistent two-phase inference pattern: a compute-bound VLM backbone followed by a memory-bound Action Expert, which induces phase-dependent underutilization and hardware inefficiency. Finally, guided by these insights, we propose DP-Cache and V-AEFusion to reduce diffusion redundancy and enable asynchronous pipeline parallelism, achieving up to 2.9x speedup on GPUs and 6x on edge NPUs with only marginal success degradation. The example leaderboard website is available at: https://vla-leaderboard-01.vercel.app/.


关键词: Vision-Language-Action Models, On-robot Deployment, Inference Acceleration, Edge AI, Model-Hardware Co-characterization, DP-Cache, V-AEFusion


47. ❌ PhysNote: Self-Knowledge Notes for Evolvable Physical Reasoning in Vision-Language Model

作者: Sinin Zhang, Yunfei Xie, Yuxuan Cheng, Haoyu Zhang, Tong Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24443v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.010.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.010.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.012.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.08.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出PhysNote框架,使VLM通过自生成的知识笔记进行物理推理,涉及迭代推理、自我修正和多智能体协作,与Chain of Thought、System 2 Thinking、Self-Correction、LLM Agents、Multi-agent Systems高度相关。但未涉及大模型训练、压缩、检索增强、工具使用等关键词。


!!! tip deepseek-chat TL;DR

PhysNote通过自生成知识笔记和迭代推理循环,解决了VLM在动态物理场景中的时空身份漂移和推理洞察易失性问题,在PhysBench上取得56.68%准确率,提升4.96%。
摘要翻译

视觉-语言模型(Vision-Language Models, VLMs)在教科书式物理问题上表现出色,但在面对需要跨帧时间一致性与因果推理的动态真实场景时却频繁失败。我们识别出导致这些失败的两个根本性挑战:(1)时空身份漂移(spatio-temporal identity drift),即物体在连续帧中丢失其物理身份并破坏因果链条;(2)推理时洞察的波动性(volatility of inference-time insights),即模型偶尔能产生正确的物理推理,但从未将其巩固以供未来复用。为应对这些挑战,我们提出PhysNote——一种智能体框架,使VLMs能够通过自生成的“知识笔记”(Knowledge Notes)外化并精炼物理知识。PhysNote通过时空规范化(spatio-temporal canonicalization)稳定动态感知,将自生成的洞察组织为层级化知识库,并驱动迭代推理循环——在巩固已验证知识前,先将假设锚定于视觉证据。在PhysBench上的实验表明,PhysNote实现了56.68%的整体准确率,较最佳多智能体基线提升4.96%,并在全部四个物理推理领域均取得一致性增益。


摘要 (Abstract)

Vision-Language Models (VLMs) have demonstrated strong performance on textbook-style physics problems, yet they frequently fail when confronted with dynamic real-world scenarios that require temporal consistency and causal reasoning across frames. We identify two fundamental challenges underlying these failures: (1) spatio-temporal identity drift, where objects lose their physical identity across successive frames and break causal chains, and (2) volatility of inference-time insights, where a model may occasionally produce correct physical reasoning but never consolidates it for future reuse. To address these challenges, we propose PhysNote, an agentic framework that enables VLMs to externalize and refine physical knowledge through self-generated “Knowledge Notes.” PhysNote stabilizes dynamic perception through spatio-temporal canonicalization, organizes self-generated insights into a hierarchical knowledge repository, and drives an iterative reasoning loop that grounds hypotheses in visual evidence before consolidating verified knowledge. Experiments on PhysBench demonstrate that PhysNote achieves 56.68% overall accuracy, a 4.96% improvement over the best multi-agent baseline, with consistent gains across all four physical reasoning domains.


关键词: Vision-Language Models, Physical Reasoning, Self-Knowledge Notes, Iterative Reasoning, Multi-agent Systems, Spatio-temporal Canonicalization, Causal Reasoning


48. ❌ Kwai Summary Attention Technical Report

作者: Chenglong Chu, Guorui Zhou, Guowang Zhang, Han Li, Hao Peng, Hongtao Cheng, Jian Liang, Jiangxia Cao, Kun Gai, Lingzhi Zhou, Lu Ren, Qi Zhang, Ruiming Tang, Ruitao Wang, Xinchen Luo, Yi Su, Zhiyuan Liang, Ziqi Wang, Boyang Ding, Chengru Song, Dunju Zang, Hui Wang, Jiao Ou, Jiaxin Deng, Jijun Shi, Jinghao Zhang, Junmin Chen, Lejian Ren, Minxuan Lv, Qianqian Wang, Qigen Hu, Shiyao Wang, Siyang Mao, Tao Wang, Xingmei Wang, Zhixin Ling, Ziming Li, Zixing Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24432v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.015.0/100.0
KV Cache Compression0.015.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出Kwai Summary Attention (KSA),一种新的注意力机制,通过将历史上下文压缩为可学习的摘要token来降低长序列建模成本。核心贡献在于长上下文处理(Context Window Extension)和KV缓存压缩(KV Cache Compression),与这两个关键词高度相关(15分)。论文涉及Large Language Models(15分),因为方法针对LLM的长上下文能力。其他关键词如MoE、SLM、Scaling Laws等均未提及,评分为0。


!!! tip deepseek-chat TL;DR

论文提出Kwai Summary Attention (KSA),通过将历史上下文压缩为可学习的摘要token,在保持线性KV缓存与序列长度关系的同时,实现语义级压缩,从而高效处理长序列。
摘要翻译

长上下文能力已成为下一代大语言模型最重要的迭代方向之一,尤其在语义理解与推理、代码智能体及推荐系统中。然而,标准softmax注意力机制在序列长度上呈现二次时间复杂度。随着序列长度增加,长上下文场景中会产生显著开销,导致超长序列的训练与推理成本急剧恶化。现有解决方案通过两条技术路径缓解该问题:i) 逐层减少KV缓存,例如基于头级压缩的GQA(分组查询注意力)和基于嵌入维度压缩的MLA(多头潜在注意力),但KV缓存仍以1:1比例线性依赖于序列长度;ii) 采用KV缓存友好型架构进行交错设计,例如局部注意力SWA(滑动窗口注意力)和线性核GDN(门控双线性网络),但往往需要在KV缓存与长上下文建模效果之间进行权衡。除这两条技术路径外,我们认为存在一条尚未充分探索的中间路径:{保持KV缓存与序列长度的线性关系,但通过特定比例$k$执行语义级压缩}。这条$O(n/k)$路径并非追求“最小KV缓存”,而是以可接受的内存开销换取对长距离依赖的完整、可参考且可解释的保留。受此启发,我们提出Kwai摘要注意力(KSA),这是一种通过将历史上下文压缩为可学习摘要令牌来降低序列建模成本的新型注意力机制。


摘要 (Abstract)

Long-context ability, has become one of the most important iteration direction of next-generation Large Language Models, particularly in semantic understanding/reasoning, code agentic intelligence and recommendation system. However, the standard softmax attention exhibits quadratic time complexity with respect to sequence length. As the sequence length increases, this incurs substantial overhead in long-context settings, leading the training and inference costs of extremely long sequences deteriorate rapidly. Existing solutions mitigate this issue through two technique routings: i) Reducing the KV cache per layer, such as from the head-level compression GQA, and the embedding dimension-level compression MLA, but the KV cache remains linearly dependent on the sequence length at a 1:1 ratio. ii) Interleaving with KV Cache friendly architecture, such as local attention SWA, linear kernel GDN, but often involve trade-offs among KV Cache and long-context modeling effectiveness. Besides the two technique routings, we argue that there exists an intermediate path not well explored: {Maintaining a linear relationship between the KV cache and sequence length, but performing semantic-level compression through a specific ratio $k$}. This $O(n/k)$ path does not pursue a ``minimum KV cache’’, but rather trades acceptable memory costs for complete, referential, and interpretable retention of long distant dependency. Motivated by this, we propose Kwai Summary Attention (KSA), a novel attention mechanism that reduces sequence modeling cost by compressing historical contexts into learnable summary tokens.


关键词: Kwai Summary Attention, Long-context, KV Cache Compression, Attention Mechanism, Large Language Models, Semantic Compression, Sequence Modeling


49. ❌ BandRouteNet: An Adaptive Band Routing Neural Network for EEG Artifact Removal

作者: Phat Lam 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24428v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究EEG信号去噪,提出BandRouteNet神经网络,属于信号处理和深度学习应用,与所有列出的关键词(大模型、LLM、MoE、SLM、Scaling Laws、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、System 2、MCTS、自纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉、可解释性、世界模型、模型合并、上下文学习、AI for Science)均无直接关联。论文未涉及任何大模型或生成式AI技术,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种自适应频带路由神经网络BandRouteNet,用于去除EEG信号中的伪影,通过频带特定处理和全频带上下文建模,在EEGDenoiseNet数据集上取得了优于现有方法的去噪效果,且参数高效。
摘要翻译

脑电图(Electroencephalography, EEG)极易受到伪迹污染,例如眼电图(Electrooculographic, EOG)和肌电图(Electromyographic, EMG)干扰,这会严重降低信号质量,并阻碍其在神经诊断、脑机接口(Brain-Computer Interfaces, BCIs)等应用中的可靠解读。有效的EEG去噪仍具挑战性,因为不同伪迹源在时域上呈现多样且随时间变化的分布,同时在不同频段具有独特的频谱特征。为解决这些问题,我们提出BandRouteNet,一种自适应频率感知神经网络用于EEG去噪,该网络联合利用了频带特定处理与全频带上下文建模。所提模型执行分频带去噪,以显式捕捉与频率相关的伪迹模式。在此框架内,我们引入一种路由机制,该机制可自适应地确定在每个频带内的时间位置上应施加去噪的程度与位置。与此同时,一个全频带调节器直接处理原始含噪EEG以提取全局时间上下文,既产生用于调制分频带路径的条件参数,也提供粗粒度的信号级精化以补充最终重建。在EEGDenoiseNet基准数据集上的大量实验表明,在统一实验设置下,BandRouteNet在EOG、EMG及混合伪迹条件下,于相对均方根误差(Relative Root Mean Square Error, RRMSE)和信噪比改善(Signal-to-Noise Ratio Improvement, SNR$_{\text{imp}}$)指标上均优于其他方法,同时仅需0.2M可训练参数,保持了极高的参数效率。这些结果凸显了其在资源受限应用中实现高性能EEG伪迹去除的巨大潜力。


摘要 (Abstract)

Electroencephalography (EEG) is highly susceptible to artifact contamination, such as electrooculographic (EOG) and electromyographic (EMG) interference, which severely degrades signal quality and hinders reliable interpretation in applications including neurological diagnosis, brain-computer interfaces (BCIs), etc. Effective EEG denoising remains challenging because different artifact sources exhibit diverse and temporally varying distributions, together with distinct spectral characteristics across frequency bands. To address these issues, we propose BandRouteNet, an adaptive frequency-aware neural network for EEG denoising that jointly exploits band-specific processing and full-band contextual modeling. The proposed model performs band-wise denoising to explicitly capture frequency-dependent artifact patterns. Within this framework, we introduce a routing mechanism that adaptively determines where and to what extent denoising should be applied across temporal locations within each frequency band. In parallel, a full-band conditioner directly processes the original noisy EEG to extract global temporal context, producing both conditional parameters for modulating the band-wise pathway and a coarse-grained signal-level refinement to supplement the final reconstruction. Extensive experiments on the EEGDenoiseNet benchmark dataset demonstrate that BandRouteNet outperforms other methods under EOG, EMG, and mixed-artifact conditions in terms of Relative Root Mean Square Error (RRMSE) and Signal-to-Noise Ratio Improvement (SNR$_{\text{imp}}$) under unified experimental settings, while remaining highly parameter-efficient with only 0.2M trainable parameters. These results highlight its strong potential for high-performance EEG artifact removal in resource-constrained applications.


关键词: EEG denoising, artifact removal, band-specific processing, routing mechanism, frequency-aware neural network, parameter-efficient


50. ❌ Scaling Properties of Continuous Diffusion Spoken Language Models

作者: Jason Ramapuram, Eeshan Gunesh Dhekane, Amitis Shidani, Dan Busbridge, Bogdan Mazoure, Zijin Gu, Russ Webb, Tatiana Likhomanenko, Navdeep Jaitly 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24416v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.010.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.08.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究连续扩散语音语言模型(CD SLM)的缩放性质,核心涉及Large Language Models(SLM是LLM的一种)、Scaling Laws(缩放定律)、Pre-training(预训练)。其他关键词如MoE、SLM、RAG等均不相关。


!!! tip deepseek-chat TL;DR

该论文研究了连续扩散语音语言模型的缩放性质,发现其遵循缩放定律,并在大规模数据下能生成情感丰富、多说话人的多语言语音,但长程连贯性仍是挑战。
摘要翻译

仅语音口语语言模型(SLMs)在性能上落后于文本及文本-语音模型,近期离散自回归(AR)SLMs表明,为匹配文本模型需要巨大的计算和数据资源。由于将连续语音离散化用于自回归会形成瓶颈,我们探索连续扩散(CD)SLM是否更具可行性。为量化SLM的语言质量,我们引入了音位詹森-香农散度(pJSD)指标。分析表明,CD SLM与AR行为类似,在验证损失和pJSD上呈现缩放定律,并显示出最优令牌与参数比率随计算规模扩大而下降的趋势。然而,对于后者,损失对数据与模型规模的选择变得不敏感,展现出快速推理的潜力。将CD SLM扩展至160亿参数,并利用数千万小时的对话数据进行训练,能够生成富有情感、韵律、多说话人、多语言的语音,但实现长文本连贯性仍是一项重大挑战。


摘要 (Abstract)

Speech-only spoken language models (SLMs) lag behind text and text-speech models in performance, with recent discrete autoregressive (AR) SLMs indicating significant computational and data demands to match text models. Since discretizing continuous speech for AR creates bottlenecks, we explore whether continuous diffusion (CD) SLM is more viable. To quantify the SLMs linguistic quality, we introduce the phoneme Jensen-Shannon divergence (pJSD) metric. Our analysis reveals CD SLMs, mirroring AR behavior, exhibit scaling laws for validation loss and pJSD, and show optimal token-to-parameter ratios decreasing as compute scales. However, for the latter, loss becomes insensitive to choice of data and model sizes, showing potential for fast inference. Scaling CD SLMs to 16B parameters with tens of millions of hours of conversational data enables generation of emotive, prosodic, multi-speaker, multilingual speech, though achieving long-form coherence remains a significant challenge.


关键词: Continuous Diffusion, Spoken Language Models, Scaling Laws, Phoneme Jensen-Shannon Divergence, Autoregressive Models, Speech Generation, Multilingual Speech


51. ❌ All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluation

作者: Leonardo Haw-Yang Foo, Chih-Kai Yang, Chen-An Li, Ke-Han Lu, Hung-yi Lee 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24401v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.07.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究音频-语言模型的评估,关注模型是否真正依赖音频信号。与’Large Language Models’高度相关(10分),因为LALMs是LLMs的扩展;与’Hallucination Mitigation’相关(8分),因为模型在无音频时仍能回答,类似幻觉问题;与’Mechanistic Interpretability’相关(7分),因为诊断框架分析模型依赖音频的程度。其他关键词如MoE、SLMs、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

论文提出诊断框架发现大型音频-语言模型在基准测试中即使没有音频输入也能保留60-72%的分数,表明现有基准未能有效衡量真实的音频理解能力。
摘要翻译

大型音频-语言模型(Large Audio-Language Models, LALMs)在语音和音频基准测试中展现出持续的性能提升,但高分未必反映真实的听觉感知能力。若模型无需处理声学信号即可回答问题,则该基准测试无法作为听觉理解的衡量标准。我们提出一个诊断框架,包含两个维度:文本先验(text prior),用于衡量仅凭文本和常识即可回答问题的程度;以及音频依赖(audio reliance),用于评估对声学信号的实际依赖程度。通过对三个基准测试中的八种LALMs进行评估,我们发现即使没有任何音频输入,模型仍能保留其完整音频得分的60-72%。此外,在需要音频的项目中,仅有3.0-4.2%需要完整的音频片段;大多数问题可通过局部片段解决。这些发现挑战了“基准测试表现等同于稳健音频理解”的假设,最后我们提出了提升评估可靠性与基准测试设计的实用指南。


摘要 (Abstract)

Large Audio-Language Models show consistent performance gains across speech and audio benchmarks, yet high scores may not reflect true auditory perception. If a model can answer questions without processing the acoustic signal, the benchmark fails as a measure of auditory understanding. We present a diagnostic framework using two axes: text prior, which measures answerability from text and general knowledge alone, and audio reliance, which assesses actual dependency on the acoustic signal. Evaluating eight LALMs across three benchmarks, we find that models retain 60-72% of their full audio scores even without any audio input. Moreover, among items that require audio, only 3.0-4.2% need the complete audio clip; the majority can be resolved using localized fragments. These findings challenge the assumption that benchmark performance equals robust audio understanding, and we conclude with practical guidelines for improving evaluation reliability and benchmark design.


关键词: Large Audio-Language Models, Audio Reliance, Text Priors, Benchmark Evaluation, Hallucination, Diagnostic Framework


52. ❌ Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation

作者: Yubo Jiang, Xin Yang, Abudukelimu Wuerkaixi, Zheming Yuan, Xuxin Cheng, Fengying Xie, Zhiguo Jiang, Cao Liu, Ke Zeng, Haopeng Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24396v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.015.0/100.0
Mechanistic Interpretability0.05.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究视觉语言模型中的对象幻觉问题,提出了一种无需训练的推理框架PND,通过对比正负解码来增强视觉保真度。核心关键词是’Hallucination Mitigation’,高度相关(15分)。‘Mechanistic Interpretability’有一定关联(5分),因为涉及注意力机制分析。其他关键词如LLMs、RLHF等均不相关,得0分。


!!! tip deepseek-chat TL;DR

该论文提出一种无需训练的推理框架PND,通过正负对比解码有效缓解视觉语言模型中的对象幻觉问题,在多个基准上取得最优性能。
摘要翻译

视觉-语言模型(Vision-Language Models, VLMs)常因过度依赖语言先验而受到物体幻觉(object hallucination)的困扰——即生成与视觉现实相矛盾的内容。我们提出正负解码(Positive-and-Negative Decoding, PND),这是一种无需训练的推理框架,可直接干预解码过程以强制实现视觉保真度。PND的动机源于我们对VLMs中关键注意力缺陷的发现:视觉特征在经验上被低估。该框架通过双路径对比来纠正这一问题:正路径利用多层注意力放大显著视觉证据,以鼓励忠实描述,直接对抗注意力缺陷;同时,负路径识别并弱化核心物体特征以构建强反事实,从而惩罚缺乏依据、依赖先验的生成。通过在每一步从这两个视角对比模型输出,PND引导生成朝向不仅语言上合理、而且视觉上真实的文本。在POPE、MME和CHAIR等基准上的大量实验表明,PND实现了最先进的性能,准确率提升高达6.5%,在显著减少物体幻觉的同时增强了描述细节——且无需任何模型重训练。该方法能有效泛化至包括LLaVA、InstructBLIP、InternVL和Qwen-VL在内的多种VLM架构。


摘要 (Abstract)

Vision-Language Models (VLMs) are frequently undermined by object hallucination–generating content that contradicts visual reality–due to an over-reliance on linguistic priors. We introduce Positive-and-Negative Decoding (PND), a training-free inference framework that intervenes directly in the decoding process to enforce visual fidelity. PND is motivated by our key finding of a critical attention deficit in VLMs, where visual features are empirically under-weighted. Our framework corrects this via a dual-path contrast: The positive path amplifies salient visual evidence using multi-layer attention to encourage faithful descriptions, directly counteracting the attention deficit. Simultaneously, the negative path identifies and degrades the core object’s features to create a strong counterfactual, which penalizes ungrounded, prior-dominant generation. By contrasting the model’s outputs from these two perspectives at each step, PND steers generation towards text that is not just linguistically probable, but visually factual. Extensive experiments on benchmarks like POPE, MME, and CHAIR show that PND achieves state-of-the-art performance with up to 6.5% accuracy improvement, substantially reducing object hallucination while also enhancing descriptive detail–all without requiring any model retraining. The method generalizes effectively across diverse VLM architectures including LLaVA, InstructBLIP, InternVL, and Qwen-VL.


关键词: Object Hallucination, Visual Grounding, Decoding Intervention, Attention Deficit, Contrastive Decoding, Vision-Language Models


53. ❌ Certified geometric robustness – Super-DeepG

作者: Noémie Cohen, Mélanie Ducoffe, Christophe Gabreau, Claire Pagetti, Xavier Pucel 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24379v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究神经网络对几何扰动的鲁棒性认证,使用线性松弛和Lipschitz优化,与LLM、深度学习技术原理创新或科学应用无关。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出Super-DeepG方法,通过改进线性松弛和Lipschitz优化,高效且精确地认证神经网络对几何扰动的鲁棒性。
摘要翻译

安全关键应用需在正常运行中按预期执行。图像处理功能通常需对旋转、缩放、剪切或平移等微小几何扰动保持不敏感。本文针对神经网络在其图像数据集上抵御几何扰动的问题,提出形式化验证方法。我们的方法Super-DeepG改进了线性松弛技术与Lipschitz优化中的推理机制,并提供了利用GPU硬件的实现方案。通过上述改进,Super-DeepG在鲁棒性认证的精度与计算效率两方面均达到超越先前工作的水平。Super-DeepG已作为开源工具在GitHub上共享。


摘要 (Abstract)

Safety-critical applications are required to perform as expected in normal operations. Image processing functions are often required to be insensitive to small geometric perturbations such as rotation, scaling, shearing or translation. This paper addresses the formal verification of neural networks against geometric perturbations on their image dataset. Our method Super-DeepG improves the reasoning used in linear relaxation techniques and Lipschitz optimization, and provides an implementation that leverages GPU hardware. By doing so, Super-DeepG achieves both precision and computational efficiency of robustness certification, to an extent that outperforms prior work. Super-DeepG is shared as an open-source tool on GitHub.


关键词: geometric robustness, neural network verification, linear relaxation, Lipschitz optimization, GPU acceleration, certification, image perturbations


54. ❌ Aligning with Your Own Voice: Self-Corrected Preference Learning for Hallucination Mitigation in LVLMs

作者: Byeonggeuk Lim, JungMin Yun, Junehyoung Kwon, Kyeonghyun Kim, YoungBin Kim 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24395v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.010.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.010.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用DPO进行偏好学习以减轻LVLM的幻觉,涉及自我纠正和偏好对齐,因此与Self-Correction、Hallucination Mitigation、Alignment、DPO高度相关(10分)。Post-training和SFT有一定关联(5分),因为DPO属于后训练阶段。其他关键词如MoE、SLMs、RAG等均不相关。


!!! tip deepseek-chat TL;DR

提出AVES-DPO框架,利用模型自身知识通过自我纠正生成分布内偏好数据,有效减轻LVLM的幻觉,仅需5.2k样本。
摘要翻译

大型视觉语言模型(Large Vision-Language Models, LVLMs)常出现幻觉现象。现有的基于偏好学习的方法主要依赖专有模型构建偏好数据集。我们发现这种依赖引入了专有模型与目标模型之间的分布不匹配,阻碍了高效对齐。为解决此问题,我们提出基于验证的自校正DPO对齐方法(Alignment via VErified Self-correction DPO, AVES-DPO),该框架利用源自模型内在知识的分布内数据来对齐LVLMs。我们的方法采用基于共识的验证机制诊断各类幻觉,并引导模型进行自校正,从而生成严格符合其内部分布的偏好对。大量实验表明,AVES-DPO在缓解幻觉方面超越现有基线方法,且仅需5.2k个样本。


摘要 (Abstract)

Large Vision-Language Models (LVLMs) frequently suffer from hallucinations. Existing preference learning-based approaches largely rely on proprietary models to construct preference datasets. We identify that this reliance introduces a distributional mismatch between the proprietary and target models that hinders efficient alignment. To address this, we propose Alignment via VErified Self-correction DPO (AVES-DPO), a framework that aligns LVLMs using in-distribution data derived from the model’s intrinsic knowledge. Our approach employs a consensus-based verification mechanism to diagnose diverse hallucinations and guides the model to self-correct, thereby generating preference pairs strictly compatible with its internal distribution. Extensive experiments demonstrate that AVES-DPO surpasses existing baselines in hallucination mitigation while requiring only 5.2k samples.


关键词: LVLMs, Hallucination Mitigation, Preference Learning, Self-Correction, DPO, Alignment, In-distribution Data


55. ❌ SeaEvo: Advancing Algorithm Discovery with Strategy Space Evolution

作者: Sichun Luo, Yi Huang, Haochen Luo, Fengyuan Liu, Guanzhi Deng, Lei Li, Qinghua Yao, Zefa Hu, Junlan Feng, Qi Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24372v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.05.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是LLM引导的进化搜索,用于算法发现,涉及LLM Agents(LLM驱动的搜索过程)和In-context Learning(通过自然语言策略描述进行上下文学习),但其他关键词如MoE、预训练、微调、RLHF等均不相关。LLM Agents评分5分,因为论文使用LLM作为搜索代理,但并非典型Agent系统。In-context Learning评分5分,因为策略描述用于指导变异,但未明确强调上下文学习。其余关键词得0分。


!!! tip deepseek-chat TL;DR

该论文提出SeaEvo,通过将自然语言策略描述作为进化状态的一等公民,改进LLM引导的进化搜索,在算法发现任务上提升性能。
摘要翻译

LLM引导的进化搜索已成为自动化算法发现中一种有前景的范式,然而大多数系统主要通过可执行程序和标量适应度来追踪搜索进程。即使使用了自然语言反思,它也往往局部地应用于变异提示中,或者在没有显式种群级战略方向组织的情况下被存储。因此,进化搜索可能难以区分同一想法的语法不同实现,难以保留适应度较低但具有战略前景的方向,也难以检测到某一策略族何时已趋于饱和。

我们提出\model,一种模块化的策略空间层,它将自然语言策略描述从瞬时的提示上下文提升为LLM驱动程序搜索中的一等公民级种群进化状态。\model为每个候选程序补充了显式的自然语言策略描述,并以三种方式利用这一表示:策略表述将变异转化为诊断-指导-执行的过程;分层经验检索将档案组织成策略簇,并通过行为互补性选择灵感;战略景观导航则定期总结有效、饱和及未充分探索的策略族,以指导未来的变异。在数学算法发现、系统优化和智能体框架基准测试中,\model在大多数设置下改进了底层进化骨架,尤其在开放式系统优化任务中取得了显著提升(相对改进21%)。这些结果表明,持久化的策略表示为提升LLM引导进化搜索的鲁棒性和效率提供了一种实用机制,并为构建随时间积累算法知识的复合AI系统指明了方向。


摘要 (Abstract)

LLM-guided evolutionary search has emerged as a promising paradigm for automated algorithm discovery, yet most systems track search progress primarily through executable programs and scalar fitness. Even when natural-language reflection is used, it is often used locally in mutation prompts or stored without an explicit population-level organization of strategic directions. As a result, evolutionary search can struggle to distinguish syntactically different implementations of the same idea, preserve lower-fitness but strategically promising directions, or detect when an entire family of strategies has saturated. We introduce \model, a modular strategy-space layer that elevates natural-language strategy descriptions from transient prompt context to first-class population-level evolutionary state in LLM-driven program search. \model augments each candidate program with an explicit natural language strategy description and uses this representation in three ways: Strategy Articulation turns mutation into a diagnose-direct-implement process; Stratified Experience Retrieval organizes the archive into strategy clusters and selects inspirations by behavioral complementarity; and Strategic Landscape Navigation periodically summarizes effective, saturated, and underexplored strategy families to guide future mutations. Across mathematical algorithm discovery, systems optimization, and agent-scaffold benchmarks, \model improves the underlying evolutionary backbones in most settings, with particularly large gains (21% relative improvement) on open-ended system optimization tasks. These results suggest that persistent strategy representations provide a practical mechanism for improving the robustness and efficiency of LLM-guided evolutionary search, suggesting a path toward compound AI systems that accumulate algorithmic knowledge over time.


关键词: LLM-guided evolutionary search, algorithm discovery, strategy space evolution, natural language strategy description, population-level evolutionary state, open-ended system optimization


56. ❌ PathMoG: A Pathway-Centric Modular Graph Neural Network for Multi-Omics Survival Prediction

作者: Di Wang, Chupei Tang, Junxiao Kong, Jixiu Zhai, Moyu Tang, Tianchi Lu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24371v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.05.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要研究基于图神经网络的癌症生存预测,属于AI for Science(生物信息学)领域,与关键词’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。论文涉及可解释性,与’Mechanistic Interpretability OR Explainable AI’有一定关联(5分),但未涉及大模型、LLMs、MoE、SLMs、Scaling Laws、预训练、微调、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、System 2、MCTS、自我改进、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、世界模型、模型合并、上下文学习等关键词,因此这些关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出PathMoG,一种基于通路模块的图神经网络,用于多组学癌症生存预测,在10种癌症类型5650名患者上取得一致改进,并提供基因、通路和患者层面的可解释性。
摘要翻译

基于多组学数据的癌症生存预测仍具有挑战性,因为预后信号具有高维性、异质性,且分布于相互作用的基因与通路中。我们提出PathMoG——一种以通路为中心的模块化图神经网络,用于多组学生存预测。PathMoG将基因组规模的输入重组为354个基于KEGG(京都基因与基因组百科全书)的通路模块,引入分层组学调控模块以在突变、拷贝数变异、通路及临床背景下调控基因表达表征,并采用双层注意力机制分别捕获通路内部驱动信号及通路间临床相关性。我们在涵盖10种TCGA(癌症基因组图谱)癌症类型的5,650例患者上评估了PathMoG,观察到其相较于代表性生存基线模型具有一致的性能提升。该框架进一步提供基因层面、通路层面及患者层面的可解释性,支持具有生物学基础且临床相关的风险分层。


摘要 (Abstract)

Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed across interacting genes and pathways. We propose PathMoG, a pathway-centric modular graph neural network for multi-omics survival prediction. PathMoG reorganizes genome-scale inputs into 354 KEGG-informed pathway modules, introduces a Hierarchical Omics Modulation module to condition gene-expression representations on mutation, copy number variation, pathway, and clinical context, and uses dual-level attention to capture both intra-pathway driver signals and inter-pathway clinical relevance. We evaluated PathMoG on 5,650 patients across 10 TCGA cancer types and observed consistent improvements over representative survival baselines. The framework further provides gene-level, pathway-level, and patient-level interpretability, supporting biologically grounded and clinically relevant risk stratification.


关键词: PathMoG, Graph Neural Network, Multi-omics, Survival Prediction, Pathway-centric, Interpretability, TCGA, Cancer


57. ❌ DPRM: A Plug-in Doob h transform-induced Token-Ordering Module for Diffusion Language Models

作者: Dake Bu, Wei Huang, Andi Han, Hau-San Wong, Qingfu Zhang, Taiji Suzuki, Atsushi Nitanda 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24357v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.08.0/100.0
Post-training0.08.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文主要研究扩散语言模型中的令牌排序问题,提出DPRM模块,属于AI for Science领域(蛋白质、分子、DNA生成),与预训练和后训练相关,但未涉及大语言模型、MoE、SLM等关键词。


!!! tip deepseek-chat TL;DR

该论文提出DPRM模块,通过Doob h变换过程奖励模型优化扩散语言模型的令牌排序策略,在预训练、后训练和科学领域生成任务中取得改进。
摘要翻译

扩散语言模型在生成过程中不遵循固定的从左到右顺序,这使得令牌排序成为核心算法选择:每一步应揭示、保留、修正或验证哪些令牌?现有系统主要采用随机掩码或置信度驱动排序。随机掩码会导致训练-测试不匹配,而仅依赖置信度的规则虽然高效,但可能短视且抑制有用的探索。

我们提出DPRM(Doob h变换过程奖励模型,Doob h-transform Process Reward Model),这是一种用于扩散语言模型的插件式令牌排序模块。DPRM保持宿主架构、去噪目标和监督方式不变,仅改变排序策略。它从置信度驱动的渐进排序开始,并通过在线估计逐步过渡到Doob h变换过程奖励引导的排序。

我们将精确的DPRM策略描述为奖励倾斜的吉布斯揭示律(reward-tilted Gibbs reveal law),证明了逐级Soft-BoN近似的O(1/N)收敛性,并表明在线分桶控制器以经验伯恩斯坦速率(empirical-Bernstein rates)追踪精确的DPRM分数。在可处理的优化假设下,DPRM相比随机排序和仅置信度排序还具有样本复杂度优势。

DPRM在预训练、后训练、测试时扩展以及单细胞掩码扩散中均优于基于置信度的基线方法,在较难的推理子集上提升尤为显著。在蛋白质、分子生成和DNA设计中,其效果更具多目标性:感知排序的变体显著改善了选定的结构或片段约束指标,但并未在所有质量指标上全面超越宿主基线。这些结果表明令牌排序是扩散语言模型中的一个基本控制轴,并确立了DPRM作为改进该轴的通用模块。代码已开源:https://github.com/DakeBU/DPRM-DLLM。


摘要 (Abstract)

Diffusion language models generate without a fixed left-to-right order, making token ordering a central algorithmic choice: which tokens should be revealed, retained, revised or verified at each step? Existing systems mainly use random masking or confidence-driven ordering. Random masking creates train–test mismatch, while confidence-only rules are efficient but can be myopic and suppress useful exploration. We introduce DPRM (Doob h-transform Process Reward Model), a plug-in token-ordering module for diffusion language models. DPRM keeps the host architecture, denoising objective and supervision unchanged, and changes only the ordering policy. It starts from confidence-driven progressive ordering and gradually shifts to Doob h transform Process Reward guided ordering through online estimates. We characterize the exact DPRM policy as a reward-tilted Gibbs reveal law, prove O(1/N) convergence of the stagewise Soft-BoN approximation, and show that the online bucketized controller tracks the exact DPRM score at empirical-Bernstein rates. Under tractable optimization assumptions, DPRM also yields a sample-complexity advantage over random and confidence-only ordering. DPRM improves over confidence-based baselines in pretraining, post-training, test-time scaling, and single-cell masked diffusion, with particularly strong gains on harder reasoning subsets. In protein, molecular generation and DNA design, the effect is more multi-objective: ordering-aware variants significantly improve selected structural or fragment-constrained metrics while not uniformly dominating the host baseline on every quality metric. These results identify token ordering as a fundamental control axis in diffusion language models and establish DPRM as a general-purpose module for improving it. Code is available at https://github.com/DakeBU/DPRM-DLLM.


关键词: Diffusion Language Models, Token Ordering, Doob h-transform, Process Reward Model, AI for Science, Protein Generation, Molecular Generation, DNA Design


58. ❌ Unveiling the Backdoor Mechanism Hidden Behind Catastrophic Overfitting in Fast Adversarial Training

作者: Mengnan Zhao, Lihe Zhang, Tianhang Zheng, Bo Wang, Baocai Yin 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24350v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究快速对抗训练中的灾难性过拟合(CO),将其解释为后门机制,并提出缓解策略。内容涉及对抗攻击、后门攻击和不可学习任务,与给定的大模型、深度学习技术原理或科学应用关键词完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文将快速对抗训练中的灾难性过拟合解释为一种弱触发变体的后门攻击,并基于此提出缓解策略。
摘要翻译

快速对抗训练(Fast Adversarial Training, FAT)因其在提升神经网络对抗攻击鲁棒性方面的高效性而受到广泛关注。然而,FAT容易陷入灾难性过拟合(Catastrophic Overfitting, CO),即模型过度拟合训练中使用的特定攻击,而无法泛化至其他攻击。尽管现有方法提出了多种假设并设计了相应策略来缓解CO,但至今仍缺乏系统且直观的解释。本文创新性地从后门(Backdoor)视角解读CO。通过在CO中验证路径划分、多样化特征预测以及通用类别可区分触发器,我们将CO概念化为不可学习任务(Unlearnable Tasks)的一种弱触发器变体,从而将CO、后门攻击与不可学习任务统一于一个共同的理论框架之下。基于此,我们借鉴后门启发策略来缓解CO:(i)利用普通微调(Vanilla Fine Tuning)、线性探测(Linear Probing)或基于重新初始化(Reinitialization)的技术重新校准受CO影响的模型参数;(ii)引入权重异常值抑制约束(Weight Outlier Suppression Constraint)以调节模型权重的异常偏差。大量实验支持了我们对CO的解释,并验证了所提缓解策略的有效性。


摘要 (Abstract)

Fast Adversarial Training (FAT) has attracted significant attention due to its efficiency in enhancing neural network robustness against adversarial attacks. However, FAT is prone to catastrophic overfitting (CO), wherein models overfit to the specific attack used during training and fail to generalize to others. While existing methods introduce diverse hypotheses and propose various strategies to mitigate CO, a systematic and intuitive explanation of CO remains absent. In this work, we innovatively interpret CO through the lens of backdoor. Through validations on pathway division, diverse feature predictions, and universal class distinguishable triggers in CO, we conceptualize CO as a weak trigger variant of unlearnable tasks, unifying CO, backdoor attacks, and unlearnable tasks under a common theoretical framework. Guided by this, we leverage several backdoor inspired strategies to mitigate CO: (i) Recalibrate CO affected model parameters using vanilla fine tuning, linear probing, or reinitialization-based techniques; (ii) Introduce a weight outlier suppression constraint to regulate abnormal deviations in model weights. Extensive experiments support our interpretation of CO and show the efficacy of the proposed mitigation strategies.


关键词: Fast Adversarial Training, Catastrophic Overfitting, Backdoor Attack, Unlearnable Tasks, Adversarial Robustness, Weight Outlier Suppression


59. ❌ Diffusion Templates: A Unified Plugin Framework for Controllable Diffusion

作者: Zhongjie Duan, Hong Zhang, Yingda Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24351v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.010.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.010.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出Diffusion Templates,一种统一的可控扩散插件框架,核心涉及LoRA和KV-Cache作为能力载体,因此与’PEFT OR LoRA OR Parameter-efficient Fine-tuning’和’KV Cache Compression OR Linear Attention OR FlashAttention’高度相关(各10分)。其他关键词如LLMs、MoE、SLMs等与扩散模型无关,评0分。


!!! tip deepseek-chat TL;DR

该论文提出Diffusion Templates,一个统一的插件框架,通过模板模型、缓存和管道解耦基础扩散模型与可控能力注入,支持LoRA和KV-Cache等多种载体,实现多种可控生成任务的模块化组合。
摘要翻译

可控扩散方法显著扩展了扩散模型的实际应用范围,但这些方法通常被开发为相互独立、依赖特定骨干网络的系统,其训练流程、参数格式和运行时钩子互不兼容。这种碎片化问题导致难以跨任务复用基础设施、跨骨干网络迁移能力,或在单一生成流程中组合多种控制机制。我们提出扩散模板(Diffusion Templates),这是一个统一且开放的插件框架,将基础模型推理与可控能力注入解耦。该框架围绕三个组件组织:模板模型(Template models),用于将任意任务特定输入映射为中间能力表征;模板缓存(Template cache),作为能力注入的标准化接口;以及模板流水线(Template pipeline),负责加载、合并并将一个或多个模板缓存注入基础扩散运行时。由于该接口在系统层面定义,而非绑定于特定控制架构,因此KV-Cache和LoRA等异构能力载体可在同一抽象框架下得到支持。基于此设计,我们构建了涵盖结构控制、亮度调整、色彩调整、图像编辑、超分辨率、锐度增强、美学对齐、内容参考、局部修复及年龄控制等功能的多样化模型库。这些案例研究表明,扩散模板能够在保持模块化、可组合性及实用可扩展性的前提下,统一广泛的可控生成任务,并兼容快速演进的扩散骨干网络。所有资源(包括代码、模型和数据集)将全部开源。


摘要 (Abstract)

Controllable diffusion methods have substantially expanded the practical utility of diffusion models, but they are typically developed as isolated, backbone-specific systems with incompatible training pipelines, parameter formats, and runtime hooks. This fragmentation makes it difficult to reuse infrastructure across tasks, transfer capabilities across backbones, or compose multiple controls within a single generation pipeline. We present Diffusion Templates, a unified and open plugin framework that decouples base-model inference from controllable capability injection. The framework is organized around three components: Template models that map arbitrary task-specific inputs to an intermediate capability representation, a Template cache that functions as a standardized interface for capability injection, and a Template pipeline that loads, merges, and injects one or more Template caches into the base diffusion runtime. Because the interface is defined at the systems level rather than tied to a specific control architecture, heterogeneous capability carriers such as KV-Cache and LoRA can be supported under the same abstraction. Based on this design, we build a diverse model zoo spanning structural control, brightness adjustment, color adjustment, image editing, super-resolution, sharpness enhancement, aesthetic alignment, content reference, local inpainting, and age control. These case studies show that Diffusion Templates can unify a broad range of controllable generation tasks while preserving modularity, composability, and practical extensibility across rapidly evolving diffusion backbones. All resources will be open sourced, including code, models, and datasets.


关键词: Diffusion Templates, controllable diffusion, plugin framework, LoRA, KV-Cache, modularity, composability


60. ❌ ARETE: Attention-based Rasterized Encoding for Topology Estimation using HSV-transformed Crowdsourced Vehicle Fleet Data

作者: Daniel Fritz, Dimitrios Lagamtzis, Michael Mink, Markus Enzweiler, Steffen Schober 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24353v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是利用车辆轨迹数据生成高清地图中的车道中心线和分隔线,采用DETR(Detection Transformer)架构,但未涉及大语言模型、深度学习技术原理创新或AI for Science中的生物/化学信息学。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于DETR的方法,利用众包车辆轨迹的栅格化表示来预测矢量化的车道中心线和分隔线,用于高清地图构建。
摘要翻译

自动驾驶(AD)的持续进步在多个学科领域带来了挑战,以确保安全高效的驾驶。其中一项挑战是高精(HD)地图的生成,这类地图必须保持最新且高度准确,以支持下游汽车任务。一种有前景的方法是使用来自车辆编队的众包数据,这些数据能够表征道路拓扑结构和车道级特征。本研究聚焦于从众包车辆轨迹中生成中心线和车道分隔线。我们采用基于检测变换器(DETR)的方法,将车辆轨迹的栅格化表示作为输入,以预测向量化的车道表示。每条车道由一条中心线及其关联方向组成,并配有受中心线几何约束的相应车道分隔线。我们的方法包括提取局部瓦片,并聚合其中的众包车辆轨迹。每个瓦片被转换为一种栅格化表示,该表示编码了每条轨迹的存在性与方向,从而能够预测向量化的有向车道。实验在内部数据集以及公开数据集nuScenes和nuPlan上进行。


摘要 (Abstract)

The continuous advancement of autonomous driving (AD) introduces challenges across multiple disciplines to ensure safe and efficient driving. One such challenge is the generation of High-Definition (HD) maps, which must remain up to date and highly accurate for downstream automotive tasks. One promising approach is the use of crowdsourced data from a vehicle fleet, representing road topology and lane-level features. This work focuses on the generation of centerlines and lane dividers from crowdsourced vehicle trajectories. We adopt a Detection Transformer (DETR)-based approach, where a rasterized representation of vehicle trajectories is used as input to predict vectorized lane representations. Each lane consists of a centerline with an associated direction and corresponding lane dividers that are geometrically constrained by the centerline. Our method includes the extraction of local tiles, from which crowdsourced vehicle trajectories are aggregated. Each tile undergoes a transformation into a rasterized representation encoding both the presence and direction of each trajectory, enabling the prediction of vectorized directed lanes. Experiments are conducted on an internal dataset as well as on the public datasets nuScenes and nuPlan.


关键词: HD maps, lane detection, crowdsourced vehicle trajectories, DETR, rasterized encoding, centerline prediction, autonomous driving


61. ❌ X-NegoBox: An Explainable Privacy-Budget Negotiation Framework for Secure Peer-to-Peer Energy Data Exchange

作者: Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Yan Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24326v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主题是能源数据交换中的隐私预算协商框架,涉及差分隐私、可解释性、协商协议等,与给定的所有关键词(大模型、深度学习、AI for Science等)均无直接关联。论文未提及任何大模型或深度学习技术,也未涉及科学领域的AI应用。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出X-NegoBox,一个可解释的隐私预算协商框架,用于点对点能源数据交换中的自适应隐私保护和透明决策,实验表明能减少隐私泄露并提高接受率。
摘要翻译

现代能源系统的去中心化正在将消费者转变为产消者(prosumer),他们持续与聚合商(aggregator)、对等节点(peer)及市场运营商(market operator)交换数据。尽管此类数据对点对点交易(peer-to-peer trading)、需求响应(demand response)及分布式预测(distributed forecasting)至关重要,但其可能暴露敏感的家庭行为模式,并引入隐私风险。现有数据共享机制依赖固定策略或预定义的差分隐私预算(differential privacy budget),导致其难以适应可靠性、数据敏感度及请求目的的变化。因此,产消者很少能获知请求被接受、拒绝或修改的原因,从而降低了信任度与参与度。

为应对上述局限,我们提出X-NegoBox——一种面向自适应隐私预算(adaptive privacy budgeting)与透明决策的可解释协商框架。每个产消者的数据均在私有DataBox内进行本地管理,原始数据始终不离开该环境。传入请求由自主隐私预算协商协议(Autonomous Privacy Budget Negotiation Protocol, APBNP)处理,该协议基于信任度、特征敏感度、声明的目的、历史行为及风险感知定价(risk-aware pricing)确定合适的隐私预算。必要时,APBNP会生成保护隐私的还价方案,例如降低数据分辨率或缩短数据时长。

可解释协议层(Explainable Agreement Layer, X-Contract)为每项决策提供人类可读与机器可读的双重解释。达成协议后,请求方代码在沙箱(sandbox)中本地执行,仅共享经脱敏处理的输出结果。在真实能源市场场景下的实验表明,该方法降低了隐私泄露风险,提高了请求接受率,并增强了可解释性。


摘要 (Abstract)

The decentralization of modern energy systems is transforming consumers into prosumers who continuously exchange data with aggregators, peers, and market operators. While such data is essential for peer-to-peer trading, demand response, and distributed forecasting, it can reveal sensitive household patterns and introduce privacy risks. Existing data sharing mechanisms rely on fixed policies or predefined differential privacy budgets, limiting their ability to adapt to variations in reliability, data sensitivity, and request purpose. As a result, prosumers rarely receive explanations for why a request is accepted, rejected, or modified, reducing trust and participation. To address these limitations, we propose X-NegoBox, an explainable negotiation framework for adaptive privacy budgeting and transparent decision making. Each prosumer data is managed locally within a private DataBox, where raw data remain confined. Incoming requests are processed by an Autonomous Privacy Budget Negotiation Protocol (APBNP), which determines an appropriate privacy budget based on trust, feature sensitivity, declared purpose, historical behavior, and risk-aware pricing. When needed, APBNP generates privacy-preserving counter-offers, such as reduced resolution or duration. An Explainable Agreement Layer (X-Contract) produces human- and machine-readable justifications for each decision. After agreement, requester code executes locally in a sandbox, and only sanitized outputs are shared. Experiments on realistic energy market settings show reduced privacy leakage, higher acceptance rates, and improved interpretability.


关键词: Privacy Budget Negotiation, Explainable AI, Differential Privacy, Peer-to-Peer Energy Trading, DataBox, Autonomous Negotiation Protocol, Trust Management


62. ❌ SycoPhantasy: Quantifying Sycophancy and Hallucination in Small Open Weight VLMs for Vision-Language Scoring of Fantasy Characters

作者: Arya Shah, Deepali Mishra, Chaklam Silpasuwanchai 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24346v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.010.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.08.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究小规模开放权重视觉语言模型(VLMs)在图像-文本对齐评分中的谄媚行为(sycophancy)和幻觉(hallucination),核心关注模型大小与谄媚率的关系。与’Small Language Models’高度相关(10分),因为明确研究小模型(450M-8B参数);与’Hallucination Mitigation’高度相关(10分),因为提出Bluffing Coefficient量化评分与证据的不匹配,即幻觉;与’Mechanistic Interpretability’相关(8分),因为通过分析模型内部行为(证据召回)解释评分偏差。与’Large Language Models’部分相关(8分),因为VLMs属于LLM家族,但论文聚焦小模型。其他关键词如MoE、Scaling Laws等完全无关。


!!! tip deepseek-chat TL;DR

该论文通过引入谄媚系数(Bluffing Coefficient)量化小规模开放权重视觉语言模型在图像-文本对齐评分中的谄媚行为,发现模型越小谄媚率越高,最小模型(450M)谄媚率达22.3%,而最大模型(7B)仅6.0%。
摘要翻译

视觉-语言模型(Vision-language models, VLMs)正越来越多地被部署为需要精细图像理解任务的评估器,然而它们在图像与文本描述之间评分对齐的可靠性仍未得到充分探索。我们研究了小型开源权重VLM在评估图像-文本对齐时是否表现出“谄媚”行为(sycophantic behavior):即不基于视觉证据进行判断,却给出高分。为量化这一现象,我们引入了“谄媚系数”(Bluffing Coefficient, \bc),该指标衡量模型评分与其证据召回之间的不匹配程度。我们在一个包含173,810张AI生成角色肖像及其详细文本描述的基准数据集上,评估了六个参数规模从450M到8B不等的开源权重VLM。我们的分析揭示了模型规模与谄媚率之间存在显著的负相关关系($r = -0.96$, $p = 0.002$),其中较小模型表现出明显更高的不合理高分比例。测试中最小模型(LFM2-VL, 450M)在22.3%的案例中产生了谄媚评估,而最大模型(LLaVA-1.6, 7B)的这一比例仅为6.0%。这些发现对于将小型开源权重VLM作为自动评估器部署于属性丰富的合成图像评估任务具有直接影响,在此类任务中,分配评分与所引用的视觉证据之间的差距既是可测量的,也是具有实际意义的。


摘要 (Abstract)

Vision-language models (VLMs) are increasingly deployed as evaluators in tasks requiring nuanced image understanding, yet their reliability in scoring alignment between images and text descriptions remains underexplored. We investigate whether small, open-weight VLMs exhibit \emph{sycophantic} behavior when evaluating image-text alignment: assigning high scores without grounding their judgments in visual evidence. To quantify this phenomenon, we introduce the \emph{Bluffing Coefficient} (\bc), a metric that measures the mismatch between a model’s score and its evidence recall. We evaluate six open-weight VLMs ranging from 450M to 8B parameters on a benchmark of 173,810 AI-generated character portraits paired with detailed textual descriptions. Our analysis reveals a significant inverse correlation between model size and sycophancy rate ($r = -0.96$, $p = 0.002$), with smaller models exhibiting substantially higher rates of unjustified high scores. The smallest model tested (LFM2-VL, 450M) produced sycophantic evaluations in 22.3% of cases, compared to 6.0% for the largest (LLaVA-1.6, 7B). These findings have direct implications for the deployment of small, open-weight VLMs as automated evaluators within attribute-rich, synthetic image evaluation tasks, where the gap between assigned scores and cited visual evidence is both measurable and consequential.


关键词: Vision-Language Models, Sycophancy, Hallucination, Bluffing Coefficient, Small Models, Image-Text Alignment, Open Weight Models


63. ❌ See Further, Think Deeper: Advancing VLM’s Reasoning Ability with Low-level Visual Cues and Reflection

作者: Zhiheng Wu, Tong Wang, Shuning Wang, Naiming Liu, Yumeng Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24339v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.010.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.08.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.08.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出ForeSight框架,通过低层视觉工具和基于掩码的视觉反馈机制增强VLM的推理能力,使用强化学习训练模型自主决定工具调用和答案验证。核心涉及Chain of Thought推理(10分)、Self-Correction(10分)、Tool Use(10分)、LLM Agents(8分)和System 2 Thinking(8分)。其他关键词如RLHF、PEFT等不相关。


!!! tip deepseek-chat TL;DR

论文提出ForeSight框架,通过整合低层视觉线索和视觉反馈机制,利用强化学习提升视觉语言模型的推理能力,在CG-SalBench数据集上超越同规模模型。
摘要翻译

近期,视觉-语言模型(Vision-Language Models, VLMs)的进展得益于强化学习(Reinforcement Learning, RL)对推理能力的增强。然而,现有方法仍面临关键局限,包括缺乏底层视觉信息与有效的视觉反馈。为解决这些问题,本文提出统一的多模态交错推理框架 ForeSight,该框架使VLMs能够借助底层视觉线索 看得更远(See Further),并通过有效的视觉反馈 思考更深(Think Deeper)。首先,该框架引入一组底层视觉工具,将关键视觉信息整合至推理链中,从而缓解对细粒度视觉特征的忽视。其次,设计了一种基于掩码的视觉反馈机制,将视觉反思融入思考过程,使模型能够动态重新审视并更新其答案。在强化学习驱动下,ForeSight学习自主决策工具调用与答案验证,并以最终答案准确率作为奖励信号。为评估所提框架的性能,我们基于SalBench数据集构建了新数据集Character and Grounding SalBench(CG-SalBench)。实验结果表明,ForeSight-7B模型显著优于同参数量级的其他模型,甚至在部分指标上超越了当前最先进的闭源模型。


摘要 (Abstract)

Recent advances in Vision-Language Models (VLMs) have benefited from Reinforcement Learning (RL) for enhanced reasoning. However, existing methods still face critical limitations, including the lack of low-level visual information and effective visual feedback. To address these problems, this paper proposes a unified multimodal interleaved reasoning framework \textbf{ForeSight}, which enables VLMs to \textbf{See Further} with low-level visual cues and \textbf{Think Deeper} with effective visual feedback. First, it introduces a set of low-level visual tools to integrate essential visual information into the reasoning chain, mitigating the neglect of fine-grained visual features. Second, a mask-based visual feedback mechanism is elaborated to incorporate visual reflection into the thinking process, enabling the model to dynamically re-examine and update its answers. Driven by RL, ForeSight learns to autonomously decide on tool invocation and answer verification, with the final answer accuracy as the reward signal. To evaluate the performance of the proposed framework, we construct a new dataset, Character and Grounding SalBench (CG-SalBench), based on the SalBench dataset. Experimental results demonstrate that the ForeSight-7B model significantly outperforms other models with the same parameter scale, and even surpasses the current SOTA closed-source models on certain metrics.


关键词: Vision-Language Models, Reinforcement Learning, Chain of Thought, Self-Correction, Tool Use, Visual Feedback, Low-level Visual Cues, Reasoning


64. ❌ Generative Design of a Gas Turbine Combustor Using Invertible Neural Networks

作者: Patrick Krüger, Hanno Gottschalk, Werner Krebs, Bastian Werdelmann 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24322v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.05.0/100.0

评分理由: 论文使用可逆神经网络(INN)进行燃气轮机燃烧室的生成式设计,属于AI在工程领域的应用,与’AI for Science’有一定关联(权重1.0,评分5),但未涉及大语言模型、深度学习技术原理创新或其他列出的关键词。因此,其他关键词得分为0。


!!! tip deepseek-chat TL;DR

该论文利用可逆神经网络(INN)生成满足性能指标的燃气轮机燃烧室设计方案,以减少氢气燃烧室重新设计的工作量。
摘要翻译

在高效燃气轮机中实现100%氢气燃烧,并采用预混模式实现低NOx排放,需要对燃烧系统进行彻底重新设计,以确保稳定运行且不发生回火。由于所有功率范围从4 MW到600 MW的发动机机型均受影响,预计将面临巨大的设计工作量。为减少这一工作量,特别是实现不同发动机类别之间的知识迁移,利用最新人工智能技术的生成式设计方法将展现出巨大潜力。本研究借助生成式人工智能的最新进展来应对这一挑战。我们基于一个可扩展的几何参数化燃烧室设计数据库,结合模拟性能标签,训练了一个可逆神经网络(Invertible Neural Network, INN)。通过逆向使用该INN,生成了多个满足指定性能标签的设计方案。


摘要 (Abstract)

The need to burn 100% H2 in high efficient gas turbines featuring low NOx combustion in premix mode require the complete redesign of the combustion system to ensure stable operation without any flashback. Since all engine frames featuring a power range from 4 MW up to 600 MW are affected, a huge design effort is expected. To reduce this effort, especially to transfer knowledge between the different engine classes, generative design methods using latest AI technology will provide promising potential. In this work, this challenge is approached utilizing the current advances in generative artificial intelligence. We train an Invertible Neural Network (INN) on an expandable database of geometrically parameterized combustor designs with simulated performance labels. Utilizing the INN in its inverse direction, multiple design proposals are generated which fulfill specified performance labels.


关键词: Generative Design, Invertible Neural Networks, Gas Turbine Combustor, Hydrogen Combustion, Low NOx, Premix Mode, Performance Labels


65. ❌ Self-Abstraction Learning for Effective and Stable Training of Deep Neural Networks

作者: Wonyong Cho, Taemin Kim, Jungmin Kim, Jeong-Rae Kim, Sung Hoon Jung 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24313v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注深度神经网络的训练稳定性,提出Self-Abstraction Learning(SAL)框架,通过层次化结构训练网络。不涉及大语言模型、混合专家、小模型、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、注意力机制、推理、智能体、量化、推理加速、幻觉、可解释性、世界模型、模型合并、上下文学习或AI for Science等关键词。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出Self-Abstraction Learning(SAL)框架,通过层次化结构从简单到复杂训练深度神经网络,有效缓解梯度消失、过拟合和不稳定学习问题,在MLP、CNN和RNN上表现优于传统方法。
摘要翻译

有效且稳定地训练大规模深度神经网络对于深度学习在各领域的应用至关重要。然而,依赖训练单一大型网络的传统方法常面临梯度消失、过拟合及学习不稳定等挑战。为克服这些局限,我们提出了一种层次化框架——自抽象学习(Self-Abstraction Learning, SAL)。在SAL中,网络按结构复杂度排列,首先训练结构最简单的顶层网络,其隐藏层与输出层作为后续更复杂网络的引导。这种自上而下的序列化引导有效缓解了优化问题,使得深度架构能够稳定训练。在多层感知机(MLP)、卷积神经网络(CNN)及循环神经网络(RNN)架构上的多项实验表明,SAL始终优于传统方法,即使在数据稀缺及复杂网络场景下也能确保稳健的泛化性能。


摘要 (Abstract)

Training large-scale deep neural networks effectively and stably is essential for applying deep learning across various fields. However, conventional methods, which rely on training a single large network, often encounter challenges such as gradient vanishing, overfitting and unstable learning. To overcome these limitations, we introduce Self-Abstraction Learning (SAL), a hierarchical framework. In SAL, networks are arranged by structural complexity, where the simplest topmost network is trained first and its hidden and output layers serve as guidance for the successively more complex networks below. This top-down sequential guidance effectively mitigates optimization issues, enabling stable training of deep architectures. Various experiments across MLP, CNN, and RNN architectures demonstrate that SAL consistently outperforms conventional methods, ensuring robust generalization even in data-scarce and complex network regimes.


关键词: Self-Abstraction Learning, hierarchical training, deep neural networks, gradient vanishing, overfitting, stable training, MLP, CNN, RNN


66. ❌ Unconstrained Multi-view Human Pose Estimation with Algebraic Priors

作者: Xiaolin Qin, Qianlei Wang, Jiacen Liu, Chaoning Zhang, Fei Zhu, Zhang Yi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24312v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究无约束多视角人体姿态估计,使用深度神经网络、代数先验和时间动态,不涉及大模型或深度学习技术原理创新,与所有关键词均无关联。


!!! tip deepseek-chat TL;DR

该论文提出一个无约束框架,结合深度神经网络、代数先验和时间动态,用于无标定多视角人体姿态估计,显著缩小了与有标定方法的性能差距。
摘要翻译

从多视角图像恢复三维人体姿态通常依赖于精确的相机标定,而在现实场景中这种标定往往难以获取,从而严重限制了现有方法的适用性。为应对这一挑战,我们提出了一种无约束框架,通过协同深度神经网络、代数先验与时间动态信息,实现无标定多视角人体姿态估计。首先,我们引入基于Transformer的三角化回归器(TTR),将经典三角化方法重构为数据驱动的令牌融合过程,从而摆脱对显式相机参数的依赖。其次,为将多视角流形固有的代数关系显式嵌入学习过程,我们提出格勒布纳基校正器(GC)。这一开创性的损失函数形式施加了源自多视角流形的约束,确保神经网络的预测严格遵循射影几何的规律。最后,我们设计了时间等变整流器(TER),利用人体运动的等变性施加时间一致性与结构连贯性,有效缓解无标定场景下的尺度模糊问题。在标准基准上的大量评估表明,我们的框架在无标定多视角人体姿态估计中达到了新的最优水平。值得注意的是,我们的方法显著缩小了无标定方法与完全标定基准之间的性能差距。


摘要 (Abstract)

Recovering 3D human pose from multi-view imagery typically relies on precise camera calibration, which is often unavailable in real-world scenarios, thereby severely limiting the applicability of existing methods. To overcome this challenge, we propose an unconstrained framework that synergizes deep neural networks, algebraic priors, and temporal dynamics for uncalibrated multi-view human pose estimation. First, we introduce the Triangulation with Transformer Regressor (TTR), which reformulates classical triangulation into a data-driven token fusion process to bypass the dependency on explicit camera parameters. Second, to explicitly embed the inherent algebraic relations of the multi-view variety into the learning process, we propose the Gröbner basis Corrector (GC). This pioneering loss formulation enforces constraints derived from the multi-view variety to ensure the neural predictions strictly adhere to the laws of projective geometry. Finally, we devise the Temporal Equivariant Rectifier (TER), which exploits the equivariance property of human motion to impose temporal coherence and structural consistency, effectively mitigating scale ambiguity in uncalibrated settings. Extensive evaluations on standard benchmarks demonstrate that our framework establishes a new state-of-the-art for uncalibrated multi-view human pose estimation. Notably, our approach significantly closes the performance gap between calibration-free methods and fully calibrated oracles.


关键词: unconstrained multi-view human pose estimation, algebraic priors, triangulation with transformer regressor, Gröbner basis corrector, temporal equivariant rectifier, uncalibrated camera, projective geometry


67. ❌ SolarTformer: A Transformer Based Deep Learning Approach for Short Term Solar Power Forecasting

作者: Ankan Basu, Jyotiraditya Roy, Aditya Datta, Prayas Sanyal, Sumanta Banerjee 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24306v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文提出SolarTformer,一种基于Transformer架构的深度学习模型,用于短期太阳能功率预测。它利用自注意力机制捕捉时间依赖性和空间变异性,属于AI在能源领域的应用,与’AI for Science’相关(8分)。其他关键词如大语言模型、MoE、SLM等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于Transformer的注意力机制深度学习模型SolarTformer,用于从气象数据中预测短期太阳能功率输出,在晴天和阴天均表现出优于传统模型的性能和鲁棒性。
摘要翻译

准确预测太阳能发电输出对于将可再生能源高效整合至电网至关重要。本研究采用一种受Transformer架构启发的基于注意力的深度学习模型,用于短期太阳能发电预测。我们提出的模型“SolarTformer”旨在根据气象数据预测太阳能发电输出。与传统模型不同,SolarTformer利用自注意力机制(self-attention mechanism)有效捕捉太阳辐照度的时间依赖性和空间变异性。此外,该方法还包括将电站特定元数据(metadata)输入模型,这有助于在不同地理位置、不同面板配置及不同季节的电站之间实现泛化。实验表明,在相同数据集上,SolarTformer显著优于先前模型。特别地,该模型在晴天和阴天均表现出强劲性能,显示出高鲁棒性和泛化能力。这些发现凸显了基于注意力的架构在提升太阳能预测准确性方面的潜力,有助于实现更可靠的可再生能源管理。


摘要 (Abstract)

Accurate forecasting of solar power output is essential for efficient integration of renewable energy into the grid. In this study, an attention-based deep learning model, inspired by transformer architecture, is used for short-term solar power forecasting. Our proposed model, “SolarTformer”, is designed to predict solar power output from meteorological data. Unlike traditional models, SolarTformer leverages self-attention mechanisms to effectively capture temporal dependencies and spatial variability in solar irradiance. In addition, the proposed methodology includes feeding power station-specific metadata into the model, which helps to generalize between power stations located at different locations and with different panel configurations and in different seasons. Our experiments demonstrate that SolarTformer significantly outperforms previous models on the same data set. In particular, the model exhibits strong performance on both clear and cloudy days, indicating high robustness and generalizability. These findings highlight the potential of attention-based architectures in enhancing the accuracy of solar forecasting, contributing to a more reliable management of renewable energy.


关键词: SolarTformer, Transformer, short-term solar power forecasting, self-attention, meteorological data, deep learning, renewable energy


68. ❌ Latent-Hysteresis Graph ODEs: Modeling Coupled Topology-Feature Evolution via Continuous Phase Transitions

作者: Qinhan Hou, Jing Tang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24293v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究图神经ODE的动力学,提出滞回图ODE模型,涉及连续相变和拓扑-特征耦合演化,与给定的大模型、深度学习技术原理创新关键词无关,也不涉及AI for Science应用。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出滞回图ODE模型,通过双阱边缘势和双极化门解决图ODE的单调陷阱问题,实现拓扑-特征耦合演化。
摘要翻译

图神经普通微分方程(Graph ODEs)将图学习从离散的消息传递层扩展至连续时间表示流。尽管其支持自适应长程传播,但我们证明,具有严格正不可约混合算子的Graph ODEs面临固有的单稳态陷阱:在长时间尺度下,信息泄露不可避免,且动力学收敛至单一全局共识吸引子。我们提出滞后图ODE(HGODE),该模型将特征演化与由学习到的成对力驱动的潜在拓扑势相耦合。双阱边势与双极化门使得边状态可在保持可微性的同时极化为连接相或绝缘相。我们提供了对坍缩机制及所提出的滞后拓扑动力学的渐近分析,并在理论驱动的合成诊断实验及真实图基准上验证了HGODE的性能。


摘要 (Abstract)

Graph neural ordinary differential equations (Graph ODEs) extend graph learning from discrete message-passing layers to continuous-time representation flows. While it supports adaptive long-range propagation, we show that Graph ODEs with strictly positive irreducible mixing operators face an inherent \emph{monostability trap}: in the long-time regime, information leakage is unavoidable and the dynamics converge to a single global consensus attractor. We propose the \textbf{Hysteresis Graph ODE (HGODE)}, which couples feature evolution with a latent topological potential driven by a learned pairwise force. A double-well edge potential and bipolarized gate allow edge states to polarize into connected or insulated phases while preserving differentiability. We provide asymptotic analysis of the collapse mechanism and the proposed hysteretic topology dynamics, and validate HGODE on theory-driven synthetic diagnostics and real-world graph benchmarks.


关键词: Graph ODEs, Hysteresis, Phase Transitions, Topology-Feature Evolution, Double-well Potential, Continuous-time Dynamics


69. ❌ RAS: a Reliability Oriented Metric for Automatic Speech Recognition

作者: Wenbin Huang, Yuhang Qiu, Bohan Li, Yiwei Guo, Jing Peng, Hankun Wang, Xie Chen, Kai Yu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24278v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.07.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究自动语音识别(ASR)的可靠性,提出了一种基于弃权的转录框架和RAS指标,通过强化学习(RL)训练模型。与关键词的相关性:RLHF/DPO相关(7分)因为使用了强化学习;Hallucination Mitigation(8分)因为关注错误转录和可靠性。其他关键词如LLMs、MoE等均不相关。


!!! tip deepseek-chat TL;DR

论文提出了一种弃权感知的ASR框架和可靠性指标RAS,通过强化学习训练模型,在保持准确性的同时显著提升转录可靠性。
摘要翻译

自动语音识别系统在噪声或模糊条件下,常常会产生自信但错误的转录结果,这可能对用户及下游应用造成误导。基于词错误率的标准评估仅关注准确性,无法捕捉转录的可靠性。我们提出了一种支持弃权的转录框架,使ASR模型能够明确地对不确定的片段进行弃权。为了评估弃权情况下的可靠性,我们提出了RAS这一面向可靠性的指标,该指标在转录信息量与错误规避之间取得平衡,其权衡参数通过人类偏好进行校准。随后,我们通过监督式自举训练结合强化学习,训练了一个支持弃权的ASR模型。实验表明,在保持竞争性准确率的同时,我们的方法在转录可靠性方面取得了显著提升。


摘要 (Abstract)

Automatic speech recognition systems often produce confident yet incorrect transcriptions under noisy or ambiguous conditions, which can be misleading for both users and downstream applications. Standard evaluation based on Word Error Rate focuses solely on accuracy and fails to capture transcription reliability. We introduce an abstention-aware transcription framework that enables ASR models to explicitly abstain from uncertain segments. To evaluate reliability under abstention, we propose RAS, a reliability-oriented metric that balances transcription informativeness and error aversion, with its trade-off parameter calibrated by human preference. We then train an abstention-aware ASR model through supervised bootstrapping followed by reinforcement learning. Our experiments demonstrate substantial improvements in transcription reliability while maintaining competitive accuracy.


关键词: Automatic Speech Recognition, Abstention-aware Transcription, Reliability Metric, Reinforcement Learning, Word Error Rate, Hallucination Mitigation


70. ❌ Deep Learning-Enabled Dissolved Oxygen Sensing in Biofouling Environments for Ocean Monitoring

作者: Nikolaos Salaris, Adrien Desjardins, Manish K. Tiwari 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24236v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.08.0/100.0

评分理由: 论文主要研究基于深度学习的溶解氧传感,使用视觉Transformer(ViT)和物理信息神经网络(PINN),属于AI在环境科学中的应用。与’AI for Science’高度相关(8分),因为涉及深度学习解决科学问题。其他关键词如大语言模型、MoE、SLM等均不相关,得0分。


!!! tip deepseek-chat TL;DR

该论文提出了一种结合视觉Transformer和物理信息神经网络的深度学习框架,用于在生物污染环境下高精度监测溶解氧浓度,显著降低了误差并实现了自诊断传感。
摘要翻译

日益加剧的气候危机与生态系统退化,亟需能够在真实环境中进行稳健、长期监测的智能低成本传感器。绝对溶解氧(DO)浓度是预测气候临界点的关键参数。基于掺杂磷光染料的微结构聚合物薄膜的廉价光电传感器具有易于部署的优势,然而信号漂移与海洋生物污损仍是主要挑战。本文提出一种新型传感范式,将基于相机的溶解氧传感器与基于视觉变换器(ViT)的物理信息神经网络(PINN)相结合,以实现生物污损条件下的高保真传感。训练与测试数据来自一个含藻类水槽,历时14天以加速生物污损过程。该ViT-PINN将Stern-Volmer(SV)方程嵌入损失函数,相较于经典统计方法与机器学习方法,平均绝对误差(MAE)分别降低92%和89%,绝对误差达到约2 μmol/L。深度集成方法进一步量化了预测不确定性,从而实现自诊断式传感。


摘要 (Abstract)

The escalating climate crisis and ecosystem degradation demand intelligent, low-cost sensors capable of robust, long-term monitoring in real-world environments. Absolute dissolved oxygen (DO) concentration is a key parameter for predicting climate tipping points. Inexpensive optoelectronic sensors based on microstructured polymer films doped with phosphorescent dyes could be readily deployable; however, signal drift and marine biofouling remain major challenges. Here, we introduce a sensing paradigm that combines camera-based DO sensors with a visual transformer (ViT)-based physics-informed neural network (PINN) for high-fidelity sensing under biofouling conditions. Training and testing data were obtained from an algae-laden water tank over 14 days to capture accelerated biofouling. The ViT-PINN, which embeds the Stern-Volmer (SV) equation into the loss function, reduces mean average error (MAE) by 92% and 89% compared to classical statistical and ML approaches, achieving ~2 umol/L absolute error. A deep ensemble further quantifies predictive uncertainty, enabling self-diagnostic sensing.


关键词: Deep Learning, Dissolved Oxygen Sensing, Visual Transformer, Physics-Informed Neural Network, Biofouling, Ocean Monitoring, Stern-Volmer Equation


71. ❌ MEMCoder: Multi-dimensional Evolving Memory for Private-Library-Oriented Code Generation

作者: Mofei Li, Taozhi Chen, Guowei Yang, Jia Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24222v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.015.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心围绕Large Language Models (LLMs)和Retrieval-Augmented Generation (RAG)进行改进,提出MEMCoder框架,通过多维度演化记忆增强代码生成。与RAG高度相关(15分),因为RAG是核心基线;与Self-Correction相关(10分),因为框架利用执行反馈自我反思和更新记忆。其他关键词如MoE、SLMs、Scaling Laws等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

MEMCoder通过多维度演化记忆机制,利用执行反馈自我改进,显著提升了基于私有库的代码生成性能,在RAG基础上平均pass@1提升16.31%。
摘要翻译

大型语言模型(Large Language Models, LLMs)在通用代码生成方面表现出色,但在依赖公共预训练语料库中缺失的内部私有库的企业环境中,其性能急剧下降。尽管检索增强生成(Retrieval-Augmented Generation, RAG)通过提供静态API文档提供了一种无需训练的替代方案,但我们发现此类文档通常仅提供孤立的定义,从而留下了根本性的知识鸿沟。具体而言,LLMs面临任务层面缺乏API之间的协调模式,以及API层面误解参数约束和边界条件的问题。为解决这一问题,我们提出MEMCoder,一种新颖的框架,使LLMs能够自主积累并演化跨这两个维度的使用指南(Usage Guidelines)。MEMCoder引入了多维演化记忆(Multi-dimensional Evolving Memory),该记忆从模型自身的问题解决轨迹中捕获提炼后的经验教训。在推理过程中,MEMCoder采用双源检索机制,将静态文档和相关的历史指南注入上下文。该框架通过利用客观的执行反馈来反思成功与失败、解决知识冲突并动态更新记忆,从而实现自动化闭环运行。在NdonnxEval和NumbaEval基准上的广泛评估表明,MEMCoder显著增强了现有RAG系统,平均绝对pass@1提升达16.31%。此外,与现有的基于记忆的持续学习方法相比,MEMCoder展现出远为优越的领域特定适应能力。


摘要 (Abstract)

Large Language Models (LLMs) excel at general code generation, but their performance drops sharply in enterprise settings that rely on internal private libraries absent from public pre-training corpora. While Retrieval-Augmented Generation (RAG) offers a training-free alternative by providing static API documentation, we find that such documentation typically provides only isolated definitions, leaving a fundamental knowledge gap. Specifically, LLMs struggle with a task-level lack of coordination patterns between APIs and an API-level misunderstanding of parameter constraints and boundary conditions. To address this, we propose MEMCoder, a novel framework that enables LLMs to autonomously accumulate and evolve Usage Guidelines across these two dimensions. MEMCoder introduces a Multi-dimensional Evolving Memory that captures distilled lessons from the model’s own problem-solving trajectories. During inference, MEMCoder employs a dual-source retrieval mechanism to inject both static documentation and relevant historical guidelines into the context. The framework operates in an automated closed loop by using objective execution feedback to reflect on successes and failures, resolve knowledge conflicts, and dynamically update memory. Extensive evaluations on the NdonnxEval and NumbaEval benchmarks demonstrate that MEMCoder substantially enhances existing RAG systems, yielding an average absolute pass@1 gain of 16.31%. Furthermore, MEMCoder exhibits vastly superior domain-specific adaptation compared to existing memory-based continual learning methods.


关键词: Large Language Models, Retrieval-Augmented Generation, Code Generation, Private Libraries, Evolving Memory, Self-Reflection, Execution Feedback


72. ❌ Adaptive ToR: Complexity-Aware Tree-Based Retrieval for Pareto-Optimal Multi-Intent NLU

作者: Hee-Kyong Yoo, Wonbae Kim, Hyocheol Ahn 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24219v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.010.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出Adaptive ToR,一种基于树的自适应检索架构,用于多意图自然语言理解。核心是检索增强生成(RAG)技术,通过动态配置检索拓扑(单步或分层)来平衡准确率和效率。使用LLM进行全局重排序,但未涉及其他关键词如MoE、SLM、Scaling Laws等。因此RAG相关度最高(10分),LLMs相关度中等(8分),其余关键词均为0分。


!!! tip deepseek-chat TL;DR

论文提出Adaptive ToR,一种复杂度感知的树状检索架构,通过动态调整检索深度和剪枝策略,在多意图NLU任务中实现了准确率、延迟和计算效率的帕累托最优平衡。
摘要翻译

多意图自然语言理解需要检索系统同时实现高准确率与计算效率,然而现有方法要么采用牺牲召回率的统一单步检索,要么采用无论查询复杂度如何都会引入过高延迟的固定深度层次分解。本文提出自适应检索树(Adaptive Tree-of-Retrieval, Adaptive ToR),一种复杂度感知的检索架构,能够根据查询特征动态配置检索拓扑结构。该系统整合了四个组件:(1)查询树分类器,通过加权语言信号计算查询复杂度指数(Query Complexity Index),将查询路由至快速单步路径或自适应深度层次路径;(2)基于树的检索模块,将复杂查询递归分解为根据预测复杂度校准的聚焦性子查询;(3)自适应剪枝模块,采用结合定量相似性门控与语义相关性评估的两阶段过滤机制,抑制指数级节点增长;(4)检索重排序层,采用去重器优先流水线及全局大语言模型(LLM)重打分策略以提升生产效率。在NLU++基准测试(涵盖银行与酒店领域的2,693条多意图查询)上的评估结果显示,该方法取得了29.07%的子集准确率(Subset Accuracy)与71.79%的微平均F1值(Micro-F1),较固定深度基线方法相对提升9.7%,同时延迟降低37.6%,LLM调用次数减少43.0%,令牌消耗降低9.8%。深度分析表明,26.92%的查询通过单步路由(d=0:子集准确率37.9%,微平均F1值74.8%)在三秒内完成解析(平均延迟2.45秒),而令牌消耗随深度增加呈4.9倍增长,验证了复杂度感知的资源分配机制,并在准确率、延迟与计算效率之间建立了帕累托最优平衡。


摘要 (Abstract)

Multi-intent natural language understanding requires retrieval systems that simultaneously achieve high accuracy and computational efficiency, yet existing approaches apply either uniform single-step retrieval that compromises recall or fixed-depth hierarchical decomposition that introduces excessive latency regardless of query complexity. This paper proposes Adaptive Tree-of-Retrieval (Adaptive ToR), a complexity-aware retrieval architecture that dynamically configures retrieval topology based on query characteristics. The system integrates four components: (1) a Query Tree Classifier computing a Query Complexity Index from weighted linguistic signals to route queries to either a rapid single-step path or an adaptive-depth hierarchical path; (2) a Tree-Based Retrieval module that recursively decomposes complex queries into focused sub-queries calibrated to predicted complexity; (3) an Adaptive Pruning Module employing two-stage filtering combining quantitative similarity gating with semantic relevance evaluation to suppress exponential node growth; and (4) a Retrieval Reranking Layer featuring a deduplicator-first pipeline and global LLM rescoring for production efficiency. Evaluation on the NLU++ benchmark (2,693 multi-intent queries across Banking and Hotel domains) yields 29.07% Subset Accuracy and 71.79% Micro-F1, a 9.7% relative improvement over fixed-depth baselines, while reducing latency by 37.6%, LLM invocations by 43.0%, and token consumption by 9.8%. Depth-wise analysis reveals that 26.92% of queries resolve within three seconds (2.45s mean latency) via single-step routing (d=0: 37.9% Subset Accuracy, 74.8% Micro-F1), while token consumption scales by 4.9x across depths, validating complexity-aware resource allocation and establishing Pareto-optimal balance across accuracy, latency, and computational efficiency.


关键词: Adaptive Tree-of-Retrieval, Multi-Intent NLU, Retrieval-Augmented Generation, Query Complexity Index, Adaptive Pruning, LLM Rescoring, Pareto-Optimal


73. ❌ Speech Enhancement Based on Drifting Models

作者: Liang Xu, Diego Caviedes-Nozal, Bastiaan Kleijn, Longfei Felix Yan, Rasmus Kongsgaard Olsson 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24199v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出基于漂移模型的语音增强方法(DriftSE),属于语音信号处理领域,与给定的大模型、深度学习技术原理关键词(如LLM、MoE、RLHF等)完全无关。虽然涉及生成模型和分布匹配,但未提及任何相关关键词。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种基于漂移模型的语音增强框架,通过单步推理实现高质量去噪,优于多步扩散基线。
摘要翻译

我们提出基于漂移模型的语音增强方法(DriftSE),这是一种新颖的生成框架,将去噪问题构建为均衡问题。DriftSE无需依赖迭代采样,而是通过演化映射函数的推送前向分布,使其直接匹配干净语音分布,从而原生实现单步推理。该演化过程由漂移场(Drifting Field)驱动——一种学习得到的修正向量,引导样本朝向干净分布的高密度区域移动,这自然使得模型能够通过匹配分布而非配对样本来在非配对数据上进行训练。我们在两种公式化框架下对该方法进行了研究:一种是从含噪观测直接进行映射,另一种是基于高斯先验的随机条件生成模型。在VoiceBank-DEMAND基准上的实验表明,DriftSE能够在单步内实现高保真增强,性能超越多步扩散基线方法,为语音增强建立了新范式。


摘要 (Abstract)

We propose Speech Enhancement based on Drifting Models (DriftSE), a novel generative framework that formulates denoising as an equilibrium problem. Rather than relying on iterative sampling, DriftSE natively achieves one-step inference by evolving the pushforward distribution of a mapping function to directly match the clean speech distribution. This evolution is driven by a Drifting Field, a learned correction vector that guides samples toward the high-density regions of the clean distribution, which naturally facilitates training on unpaired data by matching distributions rather than paired samples. We investigate the framework under two formulations: a direct mapping from the noisy observation, and a stochastic conditional generative model from a Gaussian prior. Experiments on the VoiceBank-DEMAND benchmark demonstrate that DriftSE achieves high-fidelity enhancement in a single step, outperforming multi-step diffusion baselines and establishing a new paradigm for speech enhancement.


关键词: Speech Enhancement, Drifting Models, Generative Framework, Denoising, One-step Inference, Distribution Matching, VoiceBank-DEMAND


74. ❌ RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation

作者: Yifan Zhang, Jianmin Ye, Jiahao Yang, Xi Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24218v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.08.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.07.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心使用LLM作为多智能体框架的基础,涉及LLM Agents和Multi-agent Systems,高度相关。Context Window Extension相关,因为提出了Spec Anchoring策略解决上下文溢出问题。Self-Correction相关,因为Co-Evolutionary Verification机制包含自我纠正。Hallucination Mitigation相关,因为解决了Coupled Validation Failure问题。其他关键词如MoE、SLMs、Pre-training等与论文内容无关。


!!! tip deepseek-chat TL;DR

RefEvo提出一个动态多智能体框架,利用LLM和协同进化验证机制,高效生成高保真SystemC参考模型,解决上下文溢出和验证失败问题,在硬件模块基准上达到95%通过率并显著降低token消耗。
摘要翻译

随着片上系统(System-on-Chip, SoC)设计复杂度的日益增长,左移(shift-left)范式要求快速开发高保真参考模型(通常以SystemC编写),以支持早期架构探索与验证。尽管大语言模型(Large Language Models, LLMs)在代码生成方面展现出潜力,但其在硬件建模中的应用面临独特挑战:(1)僵化、静态的工作流无法适应不同设计复杂度,导致效率低下;(2)多轮交互中的上下文窗口溢出引发关键规格的灾难性遗忘;(3)耦合验证失败问题——即生成的测试平台(Testbenches, TBs)因关联幻觉而错误地验证有缺陷的模型——严重削弱了可靠性。为解决上述局限,我们提出RefEvo,一种面向敏捷且可靠参考建模的动态多智能体框架。RefEvo包含三项关键创新:(1)动态设计规划器(Dynamic Design Planner),可自主分解设计规格并基于语义复杂度构建定制化执行工作流;(2)协同进化验证机制(Co-Evolutionary Verification Mechanism),通过辩证仲裁器(Dialectical Arbiter)同时修正模型与验证逻辑以对照规格(Spec)基准,有效缓解误报问题;(3)规格锚定策略(Spec Anchoring Strategy),实现无损上下文压缩。在涵盖20个硬件模块的多样化基准测试中,RefEvo实现了95%的通过率,大幅超越静态基线方法。此外,我们的上下文优化使令牌消耗平均降低71.04%,对于复杂设计,每次会话可绝对节省超过70,000个令牌,同时保持100%的规格召回率。


摘要 (Abstract)

As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While Large Language Models (LLMs) show promise in code generation, their application to hardware modeling faces unique challenges: (1) Rigid, static workflows fail to adapt to varying design complexity, causing inefficiency; (2) Context window overflow in multi-turn interactions leads to catastrophic forgetting of critical specifications; and (3) the Coupled Validation Failure problem–where generated Testbenches (TBs) incorrectly validate flawed models due to correlated hallucinations–severely undermines reliability. To address these limitations, we introduce RefEvo, a dynamic multi-agent framework designed for agile and reliable reference modeling. RefEvo features three key innovations: (1) A Dynamic Design Planner that autonomously decomposes design specifications and constructs tailored execution workflows based on semantic complexity; (2) A Co-Evolutionary Verification Mechanism, which employs a Dialectical Arbiter to simultaneously rectify the model and verification logic against the specification (Spec) oracle, effectively mitigating false positives; and (3) A Spec Anchoring Strategy for lossless context compression. Evaluated on a diverse benchmark of 20 hardware modules, RefEvo achieves a 95% pass rate, outperforming static baselines by a large margin. Furthermore, our context optimization reduces token consumption by an average of 71.04%, achieving absolute savings of over 70,000 tokens per session for complex designs while maintaining 100% specification recall.


关键词: Large Language Models, Multi-agent Systems, LLM Agents, Context Window Extension, Self-Correction, Hallucination Mitigation, Reference Model Generation, System-on-Chip


75. ❌ Agentic Witnessing: Pragmatic and Scalable TEE-Enabled Privacy-Preserving Auditing

作者: Antony Rowstron 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24203v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.08.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出Agentic Witnessing框架,使用LLM-based Auditor在TEE中执行,通过MCP动态检查私有数据集,实现隐私保护审计。核心涉及LLM Agents(10分)、Multi-agent Systems(10分)和Tool Use(8分,因为MCP工具使用)。其他关键词如预训练、微调、推理加速等均未涉及。


!!! tip deepseek-chat TL;DR

该论文提出一种基于TEE和LLM代理的隐私保护审计框架,通过多代理协作和工具调用,在不泄露数据的情况下验证私有数据集的语义属性。
摘要翻译

审计专有数据的语义属性存在一个根本性矛盾:验证需要透明访问,而专有权利要求保密性。零知识证明(Zero-Knowledge Proofs, ZKPs)虽能保障隐私,但通常局限于精确的代数约束,难以验证定性、非结构化的属性(如代码库中的逻辑)。我们提出“智能体见证”(Agentic Witnessing)框架,将验证从“经认证的执行”转向“经认证的推理”。该系统由三个智能体组成:验证者(Verifier,希望检查数据集属性)、证明者(Prover,拥有数据集)和审计者(Auditor,检查数据集)。验证者被允许向审计者提出有限数量的简单二元真/假问题。通过将基于大语言模型(LLM)的审计者隔离在可信执行环境(Trusted Execution Environment, TEE)中,该系统使验证者能够通过简单的布尔查询来查询证明者的私有数据,而无需暴露原始数据集。审计者使用模型上下文协议(Model Context Protocol, MCP)动态检查目标数据集,生成“是/否”判定结果并附上加密记录:一条签名的哈希链,将推理轨迹同时绑定到原始数据集和TEE的硬件信任根。我们通过自动化评估21篇经同行评审的计算机科学论文的工件(这些论文在GitHub上发布了代码库,例如:代码库是否实现了论文中描述的系统?)来演示该架构。我们将源代码视为私有数据,验证了相应出版物中描述的这些代码库的五个高级属性。结果表明,基于TEE的智能体审计为隐私保护监督提供了一种机制,有效将定性验证与数据披露需求解耦。


摘要 (Abstract)

Auditing the semantic properties of proprietary data creates a fundamental tension: verification requires transparent access, while proprietary rights demand confidentiality. While Zero-Knowledge Proofs (ZKPs) ensure privacy, they are typically limited to precise algebraic constraints and are ill-suited for verifying qualitative, unstructured properties, such as the logic within a codebase. We propose {\em Agentic Witnessing}, a framework that moves verification from attested execution to {\em attested reasoning}. The system is composed of three agents: a Verifier (who wants to check properties of a dataset), a Prover (who owns the dataset) and an Auditor (that inspects the dataset). The Verifier is allowed to ask a limited number of simple binary true/false questions to the auditor. By isolating an LLM-based Auditor within a Trusted Execution Environment (TEE), the system enables the Verifier to query a Prover’s private data via simple Boolean queries, without exposing the raw dataset. The Auditor uses the Model Context Protocol (MCP) to dynamically inspect the target dataset, producing a yes/no verdict accompanied by a cryptographic transcript: a signed hash chain binding the reasoning trace to both the original dataset and the TEE’s hardware root of trust. We demonstrate this architecture by automating the artifact evaluation process for 21 peer-reviewed computer science papers with released codebases on GitHub (e.g. Does the codebase implement the system described in the paper?). We verified five high-level properties of these codebases described in the corresponding publications, treating the source code as private. Our results show that TEE-enabled agentic auditing provides a mechanism for privacy-preserving oversight, effectively decoupling qualitative verification from the need for data disclosure.


关键词: Agentic Witnessing, Trusted Execution Environment, LLM Agents, Multi-agent Systems, Model Context Protocol, Privacy-preserving Auditing, Boolean Queries


76. ❌ Seeing Is No Longer Believing: Frontier Image Generation Models, Synthetic Visual Evidence, and Real-World Risk

作者: Shuai Wu, Xue Li, Yanna Feng, Yufang Li, Zhijun Wang, Ran Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24197v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要讨论前沿图像生成模型(如GPT Image 2等)带来的合成视觉证据风险,属于计算机视觉和AI安全领域,与所给的大模型技术关键词(如LLMs、MoE、RLHF等)以及AI for Science关键词均无直接关联。论文未涉及大模型技术原理创新或科学应用,仅提及图像生成模型,但未深入大模型技术细节。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文分析了前沿图像生成模型如何从艺术合成转向合成视觉证据,并评估了其在金融、医疗、新闻等领域带来的现实风险,提出了分层控制建议。
摘要翻译

前沿图像生成已从艺术合成转向合成视觉证据。诸如GPT Image 2、Nano Banana Pro、Nano Banana 2、Grok Imagine、Qwen Image 2.0 Pro及Seedream 5.0 Lite等系统,融合了照片级真实感渲染、可读排版、参考一致性、编辑控制,并在某些情况下具备基于推理或搜索的图像构建能力。这些能力为设计、教育、可及性与通信领域带来了巨大益处,但同时也削弱了社会中最常见的信任捷径之一:即认为一张看似合理的图片便是可靠记录的观念。本文提供了一项基于来源的合成视觉风险技术及政策分析。我们首先总结了近期图像模型的公开能力,随后分析了涉及虚假危机图像、名人及公众人物影像、医学扫描、伪造文件、合成截图、钓鱼资产及引发市场波动的谣言等公共事件。我们引入了一个能力加权风险框架,将模型功能与金融、医学、新闻、法律、应急响应、身份验证及公民话语等领域的现实危害相联系。研究结果表明,风险的主要驱动因素并非仅由照片级真实感决定,而是源于真实感、清晰文本、身份持久性、快速迭代及传播语境的汇聚。我们主张采取分层控制措施:模型端限制、加密溯源、可见标签、平台摩擦、行业级验证及事件响应。本文最后为模型提供商、平台、新闻机构、金融机构、医疗系统、法律组织、监管机构及普通用户提供了切实可行的建议。


摘要 (Abstract)

Frontier image generation has moved from artistic synthesis toward synthetic visual evidence. Systems such as GPT Image 2, Nano Banana Pro, Nano Banana 2, Grok Imagine, Qwen Image 2.0 Pro, and Seedream 5.0 Lite combine photorealistic rendering, readable typography, reference consistency, editing control, and in several cases reasoning or search-grounded image construction. These capabilities create large benefits for design, education, accessibility, and communication, yet they also weaken one of society’s most common trust shortcuts: the belief that a plausible picture is a reliable record. This paper provides a source-grounded technical and policy analysis of synthetic visual risk. We first summarize the public capabilities of recent image models, then analyze public incidents involving fake crisis images, celebrity and public-figure imagery, medical scans, forged-looking documents, synthetic screenshots, phishing assets, and market-moving rumors. We introduce a capability-weighted risk framework that links model affordances to real-world harm in finance, medicine, news, law, emergency response, identity verification, and civic discourse. Our findings show that risk is driven less by photorealism alone than by the convergence of realism, legible text, identity persistence, fast iteration, and distribution context. We argue for layered control: model-side restrictions, cryptographic provenance, visible labeling, platform friction, sector-grade verification, and incident response. The paper closes with practical recommendations for model providers, platforms, newsrooms, financial institutions, healthcare systems, legal organizations, regulators, and ordinary users.


关键词: image generation, synthetic visual evidence, photorealism, risk framework, AI safety, misinformation, policy recommendations


77. ❌ MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning

作者: Yimin Deng, Zhenxi Lin, Yejing Wang, Guoshuai Zhao, Pengyue Jia, Zichuan Fu, Derong Xu, Yefeng Zheng, Xiangyu Zhao, Li Zhu, Xian Wu, Xueming Qian 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24186v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.010.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.08.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出MultiDx框架,利用LLMs进行诊断推理,核心是检索增强生成(RAG)从多个知识源获取证据,并涉及链式推理(CoT)进行多步诊断。同时,论文聚焦医疗AI应用,属于AI for Science领域。其他关键词如MoE、SLMs、Scaling Laws等与论文无关。


!!! tip deepseek-chat TL;DR

该论文提出MultiDx框架,通过从多个知识源检索证据并结合链式推理进行鉴别诊断,在医疗诊断任务上提升了LLMs的推理性能。
摘要翻译

诊断预测与临床推理是医疗应用中的关键任务。尽管大型语言模型(Large Language Models, LLMs)在常识推理方面展现出强大能力,但由于领域知识有限,其在诊断推理方面仍存在困难。现有方法通常依赖模型内部知识或静态知识库,导致知识不足和适应性有限,从而限制了它们执行诊断推理的能力。此外,这些方法仅关注最终预测的准确性,忽视了与标准临床推理轨迹的对齐。为此,我们提出MultiDx,一种两阶段诊断推理框架,通过分析从多个知识源收集的证据进行鉴别诊断。具体而言,它首先利用网络搜索、SOAP格式病例及临床病例数据库中的知识生成疑似诊断及推理路径,然后通过匹配、投票和鉴别诊断整合多视角证据,以生成最终预测。在两个公开基准上的大量实验证明了我们方法的有效性。


摘要 (Abstract)

Diagnostic prediction and clinical reasoning are critical tasks in healthcare applications. While Large Language Models (LLMs) have shown strong capabilities in commonsense reasoning, they still struggle with diagnostic reasoning due to limited domain knowledge. Existing approaches often rely on internal model knowledge or static knowledge bases, resulting in knowledge insufficiency and limited adaptability, which hinder their capacity to perform diagnostic reasoning. Moreover, these methods focus solely on the accuracy of final predictions, overlooking alignment with standard clinical reasoning trajectories. To this end, we propose MultiDx, a two-stage diagnostic reasoning framework that performs differential diagnosis by analyzing evidence collected from multiple knowledge sources. Specifically, it first generates suspected diagnoses and reasoning paths by leveraging knowledge from web search, SOAP-formatted case, and clinical case database. Then it integrates multi-perspective evidence through matching, voting, and differential diagnosis to generate the final prediction.~Extensive experiments on two public benchmarks demonstrate the effectiveness of our approach.


关键词: Diagnostic Reasoning, Large Language Models, Retrieval-Augmented Generation, Chain of Thought, Differential Diagnosis, Healthcare AI, Multi-source Knowledge


78. ❌ Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis

作者: Zhisong Qiu, Shuofei Qiao, Kewei Xu, Yuqi Zhu, Lun Du, Ningyu Zhang, Huajun Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24198v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.012.0/100.0
Tool Use OR Function Calling OR API Tool Use0.08.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出DataPRM,一种环境感知的生成式过程奖励模型,用于改进LLM智能体在科学数据分析任务中的推理能力。核心相关关键词包括:Large Language Models(LLMs作为基础模型)、LLM Agents(智能体数据分析和环境交互)、Self-Correction(通过反思区分可纠正和不可纠正错误)、Tool Use(智能体与环境交互)、Hallucination Mitigation(检测静默错误和探索性行为)、AI for Science(应用于科学数据分析)。其他关键词如MoE、SLMs、Scaling Laws等与论文内容无关。


!!! tip deepseek-chat TL;DR

论文提出DataPRM,一种环境感知的过程奖励模型,通过主动环境交互和反思感知三元奖励策略,显著提升LLM智能体在科学数据分析任务中的表现,在多个基准上取得最佳结果。
摘要翻译

过程奖励模型(Process Reward Models, PRMs)在数学等静态领域内增强大型语言模型(Large Language Models, LLMs)推理能力方面已取得显著成功。然而,其在动态数据分析任务中的潜力尚未得到充分探索。本研究首先通过实证研究发现,通用领域的PRMs难以有效监督数据分析智能体:具体而言,它们无法检测静默错误(即产生错误结果但未触发解释器异常的逻辑缺陷),并且会错误地惩罚探索性行为,将必要的试错探索误判为事实性失败。为弥合这一差距,我们提出DataPRM——一种新型环境感知生成式过程奖励模型,该模型(1)可作为主动验证器,自主与环境交互以探查中间执行状态并发现静默错误;(2)采用反思感知三元奖励策略,区分可纠正的事实性错误与不可恢复的失误。我们设计了一条可扩展的流水线,通过多样性驱动的轨迹生成与知识增强的步骤级标注,为DataPRM构建了超过8000个高质量训练实例。实验结果表明,采用Best-of-N推理时,DataPRM在ScienceAgentBench和DABStep基准上分别将下游策略LLMs的性能提升了7.21%和11.28%。值得注意的是,仅含40亿参数的DataPRM不仅超越了强基线模型,还在多种测试时扩展(Test-Time Scaling)策略下展现出稳健的泛化能力。此外,将DataPRM集成至强化学习框架后,相比基于结果奖励的基线方法取得了显著提升,在DABench和TableBench上分别达到78.73%和64.84%的准确率,验证了过程奖励监督的有效性。代码已开源至https://github.com/zjunlp/DataMind。


摘要 (Abstract)

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks remains underexplored. In this work, we first present a empirical study revealing that general-domain PRMs struggle to supervise data analysis agents. Specifically, they fail to detect silent errors, logical flaws that yield incorrect results without triggering interpreter exceptions, and erroneously penalize exploratory actions, mistaking necessary trial-and-error exploration for grounding failures. To bridge this gap, we introduce DataPRM, a novel environment-aware generative process reward model that (1) can serve as an active verifier, autonomously interacting with the environment to probe intermediate execution states and uncover silent errors, and (2) employs a reflection-aware ternary reward strategy that distinguishes between correctable grounding errors and irrecoverable mistakes. We design a scalable pipeline to construct over 8K high-quality training instances for DataPRM via diversity-driven trajectory generation and knowledge-augmented step-level annotation. Experimental results demonstrate that DataPRM improves downstream policy LLMs by 7.21% on ScienceAgentBench and 11.28% on DABStep using Best-of-N inference. Notably, with only 4B parameters, DataPRM outperforms strong baselines, and exhibits robust generalizability across diverse Test-Time Scaling strategies. Furthermore, integrating DataPRM into Reinforcement Learning yields substantial gains over outcome-reward baselines, achieving 78.73% on DABench and 64.84% on TableBench, validating the effectiveness of process reward supervision. Code is available at https://github.com/zjunlp/DataMind.


关键词: Process Reward Model, LLM Agents, Data Analysis, Self-Correction, Environment-Aware, ScienceAgentBench, Reflection-Aware


79. ❌ MemeScouts@LT-EDI 2026: Asking the Right Questions – Prompted Weak Supervision for Meme Hate Speech Detection

作者: Ivo Bueno, Lea Hirlimann, Enkelejda Kasneci 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24179v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文使用量化版Qwen3-VLM(视觉语言模型)进行多模态仇恨言论检测,但未涉及大语言模型(LLM)核心技术如预训练、微调、推理加速等。关键词中仅’In-context Learning’可能间接相关(通过提示学习),但论文未明确提及。整体与给定关键词列表相关性极低。


!!! tip deepseek-chat TL;DR

该论文提出一种提示弱监督方法,通过分解任务为基于问题的标注函数,利用量化视觉语言模型提升多语言模因仇恨言论检测性能,在LT-EDI 2026任务中取得领先结果。
摘要翻译

检测网络迷因中的仇恨言论具有挑战性,这源于其多模态特性以及诸如讽刺和语境等微妙且植根于文化的线索。尽管近期视觉语言模型(VLMs)能够实现文本与图像的联合推理,但端到端的提示方法可能较为脆弱,因为单一预测必须同时解决目标、立场、隐含性与反讽等问题。这些挑战在多语言环境中被进一步放大。我们提出一种基于提示的弱监督(PWS)方法,将迷因理解分解为基于问题的、具有约束性答案选项的标签函数,用于LT-EDI 2026共享任务中的恐同与恐跨性别检测。通过使用量化后的Qwen3-VLM回答针对性问题来提取特征,我们的方法优于直接的VLM分类,在中文和印地语上取得了显著提升,并在英语、中文和印地语中分别排名第一、第二和第三。通过基于错误的标签函数扩展与特征剪枝进行的迭代优化,减少了冗余并提升了泛化能力。我们的结果凸显了提示式弱监督在多语言多模态仇恨言论检测中的有效性。


摘要 (Abstract)

Detecting hate speech in memes is challenging due to their multimodal nature and subtle, culturally grounded cues such as sarcasm and context. While recent vision-language models (VLMs) enable joint reasoning over text and images, end-to-end prompting can be brittle, as a single prediction must resolve target, stance, implicitness, and irony. These challenges are amplified in multilingual settings. We propose a prompted weak supervision (PWS) approach that decomposes meme understanding into targeted, question-based labeling functions with constrained answer options for homophobia and transphobia detection in the LT-EDI 2026 shared task. Using a quantized Qwen3-VLM to extract features by answering targeted questions, our method outperforms direct VLM classification, with substantial gains for Chinese and Hindi, ranking 1st in English, 2nd in Chinese, and 3rd in Hindi. Iterative refinement via error-driven LF expansion and feature pruning reduces redundancy and improves generalization. Our results highlight the effectiveness of prompted weak supervision for multilingual multimodal hate speech detection.


关键词: hate speech detection, memes, prompted weak supervision, vision-language models, multilingual, homophobia, transphobia


80. ❌ Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignment

作者: Wenzhe Xu, Biao Liu, Yiyang Sun, Xin Geng, Ning Xu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24178v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.015.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.015.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究多目标对齐,使用双向偏好-策略优化,与LLM对齐、RLHF/DPO高度相关,因此这两个关键词得满分。其他关键词如MoE、SLM、预训练等与论文内容无关,得0分。


!!! tip deepseek-chat TL;DR

提出Meta-Aligner框架,通过元学习实现偏好与策略的双向动态优化,解决多目标对齐中静态偏好权重丢弃中间信息的问题,在多个基准上取得更优性能。
摘要翻译

多目标对齐旨在通过同时优化多个目标,使大型语言模型与多样且常相互冲突的人类价值观保持一致。现有方法主要依赖静态偏好权重构建策略。然而,僵化地对齐固定目标会丢弃有价值的中间信息,因为训练响应即使偏离目标,其本身也蕴含有效的偏好权衡。为解决这一局限,我们提出Meal,即元对齐器,一种双层元学习框架,能够实现偏好与策略响应之间的双向优化,从而生成具有指导性的动态偏好以实现更稳定的训练。具体而言,我们引入偏好权重网络作为元学习器,基于输入提示生成自适应偏好权重,并将偏好权重作为可学习参数进行更新;同时,大型语言模型策略作为基础学习器,在这些偏好条件下结合拒绝采样策略优化响应生成。大量实验结果表明,我们的方法在多个多目标基准测试中取得了优越性能,验证了动态双向偏好-策略优化框架的有效性。


摘要 (Abstract)

Multi-Objective Alignment aims to align Large Language Models (LLMs) with diverse and often conflicting human values by optimizing multiple objectives simultaneously. Existing methods predominantly rely on static preference weight construction strategies. However, rigidly aligning to fixed targets discards valuable intermediate information, as training responses inherently embody valid preference trade-offs even when deviating from the target. To address this limitation, we propose Meal, i.e., MEta ALigner, a bi-level meta-learning framework enabling bidirectional optimization between preferences and policy responses, generating instructive dynamic preferences for steadier training. Specifically, we introduce a preference-weight-net as a meta-learner to generate adaptive preference weights based on input prompts and update the preference weights as learnable parameters, while the LLM policy acts as a base-learner optimizing response generation conditioned on these preferences with rejection sampling strategy. Extensive empirical results demonstrate that our method achieves superior performance on several multi-objective benchmarks, validating the effectiveness of the dynamic bidirectional preference-policy optimization framework.


关键词: Multi-Objective Alignment, Meta-Learning, Preference Optimization, LLM Alignment, Bidirectional Optimization, Rejection Sampling


81. ❌ Explanation Quality Assessment as Ranking with Listwise Rewards

作者: Thomas Bailleux, Tanmoy Mukherjee, Emmanuel Lonca, Pierre Marquis, Zied Bouraoui 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24176v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.05.0/100.0
Scaling Laws AND Data Quality0.06.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.08.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文将解释质量评估重新定义为排序问题,训练奖励模型来区分多个候选解释的相对质量。核心涉及LLM(使用小编码器模型)、RLHF/DPO(作为奖励用于策略优化)、数据质量(强调数据质量比模型规模更重要)以及可解释AI(解释质量评估)。与MoE、SLM、Scaling Laws、预训练、微调、指令对齐、PEFT、RAG、长上下文、注意力机制、推理链、系统2思维、MCTS、自我改进、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、世界模型、模型合并、上下文学习、AI for Science等关键词无关或关联极弱。


!!! tip deepseek-chat TL;DR

该论文提出将解释质量评估视为排序问题,通过训练列表式排序模型来区分候选解释的相对质量,并发现排序损失优于回归损失,且数据质量比模型规模更重要。
摘要翻译

我们将解释质量评估重新表述为一个排序问题而非生成问题。我们不再优化模型以逐词生成单一的“最佳”解释,而是训练奖励模型来区分多个候选解释并学习它们的相对质量。具体而言,我们为每个实例构建具有分级质量水平的候选集,并训练列表式与配对式排序模型(ListNet、LambdaRank、RankNet),以保留序数结构并避免逐点回归或二元偏好目标中典型的分数压缩现象。我们观察到三点发现:第一,在所有测试领域,排序损失在分数分离度上始终优于回归损失。第二,最优排序损失取决于数据特征:列表式目标在质量层级区分明显的场景中表现优异,而配对式方法对带有噪声的自然标注更具鲁棒性。第三,当在精心整理且结构良好的数据上训练时,小型编码器模型能够匹配规模大数个数量级的模型,这表明数据质量比模型规模更为重要。最后,当排序得分作为策略优化中的奖励使用时,能够在基于回归的奖励完全失效的场景中实现稳定收敛。代码与数据见:https://github.com/Tankiit/PPO_Learning_to_rank


摘要 (Abstract)

We reformulate explanation quality assessment as a ranking problem rather than a generation problem. Instead of optimizing models to produce a single “best” explanation token-by-token, we train reward models to discriminate among multiple candidate explanations and learn their relative quality. Concretely, we construct per-instance candidate sets with graded quality levels and train listwise and pairwise ranking models (ListNet, LambdaRank, RankNet) to preserve ordinal structure and avoid score compression typical of pointwise regression or binary preference objectives. We observe three findings: First, ranking losses consistently outperform regression on score separation across all domains tested. Second, the optimal ranking loss depends on data characteristics: listwise objectives excel with well-separated quality tiers, while pairwise methods are more robust to noisy natural annotations. Third, when trained on carefully curated and well-structured data, small encoder models can match models that are orders of magnitude larger, suggesting that data quality matters more than model scale. Finally, when used as rewards in policy optimization, ranking-based scores enable stable convergence in settings where regression-based rewards fail entirely. Code and data are available at: https://github.com/Tankiit/PPO_Learning_to_rank


关键词: explanation quality assessment, ranking, reward models, listwise ranking, pairwise ranking, RLHF, data quality, explainable AI


82. ❌ AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models

作者: Yimin Deng, Yejing Wang, Zhenxi Lin, Zichuan Fu, Guoshuai Zhao, Derong Xu, Yefeng Zheng, Xiangyu Zhao, Xian Wu, Li Zhu, Xueming Qian 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24175v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.08.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究大语言模型的时间推理能力,提出自适应推理方法AdapTime,核心涉及LLM和推理策略(如Chain of Thought),与’Large Language Models’高度相关(10分),与’Chain of Thought’相关(8分),因为方法包含多步推理动作。其他关键词如MoE、SLM等未涉及,评分为0。


!!! tip deepseek-chat TL;DR

论文提出AdapTime,一种自适应时间推理方法,通过动态执行推理步骤(reformulate、rewrite、review)增强大语言模型的时间推理能力,无需外部工具。
摘要翻译

大语言模型在通用知识问答中展现了强大的推理能力,然而其处理时间信息的能力仍存在局限。针对这一局限,现有方法通常依赖外部工具或人工验证,且针对特定场景设计,导致泛化能力较差。此外,这些方法对所有问题采用固定流程,忽略了不同类型的时间问题需要不同的推理策略,从而对简单问题造成不必要的处理,对复杂问题则推理不足。为此,我们提出AdapTime,一种自适应时间推理方法,能够根据输入上下文动态执行推理步骤。具体而言,该方法包含三种时间推理动作:重构(reformulate)、重写(rewrite)与审查(review),并由大语言模型(LLM)规划器引导推理过程。AdapTime能够无缝集成当前最先进的大语言模型,在不依赖外部支持的情况下显著提升其时间推理能力。大量实验证明了该方法的有效性。


摘要 (Abstract)

Large language models have demonstrated strong reasoning capabilities in general knowledge question answering. However, their ability to handle temporal information remains limited. To address this limitation, existing approaches often involve external tools or manual verification and are tailored to specific scenarios, leading to poor generalizability. Moreover, these methods apply a fixed pipeline to all questions, overlooking the fact that different types of temporal questions require distinct reasoning strategies, which leads to unnecessary processing for simple cases and inadequate reasoning for complex ones. To this end, we propose AdapTime, an adaptive temporal reasoning method that dynamically executes reasoning steps based on the input context. Specifically, it involves three temporal reasoning actions: reformulate, rewrite and review, with an LLM planner guiding the reasoning process. AdapTime integrates seamlessly with state-of-the-art LLMs and significantly enhances their temporal reasoning capabilities without relying on external support. Extensive experiments demonstrate the effectiveness of our approach.


关键词: Large Language Models, Temporal Reasoning, Adaptive Reasoning, Chain of Thought, LLM Planner, Reformulate, Rewrite, Review


83. ❌ Credal Concept Bottleneck Models for Epistemic-Aleatoric Uncertainty Decomposition

作者: Tanmoy Mukherjee, Thomas Bailleux, Pierre Marquis, Zied Bouraoui 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24170v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.012.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出CREDENCE框架,通过概念瓶颈模型(CBM)分解认知不确定性和偶然不确定性,属于可解释AI和不确定性量化领域。与关键词’Mechanistic Interpretability OR Explainable AI’高度相关(12分),因为CBM本身就是可解释性方法,且论文重点在于分解不确定性以提升可解释性。其他关键词如大模型、MoE、RLHF等均不相关,因为论文不涉及大语言模型或相关技术。


!!! tip deepseek-chat TL;DR

该论文提出CREDENCE框架,通过概念瓶颈模型将认知不确定性和偶然不确定性分解,从而支持自动化、数据收集、人工审查等决策。
摘要翻译

概念瓶颈模型(Concept Bottleneck Models, CBMs)通过人类可解释的概念进行预测,但它们通常输出点概念概率,将认知不确定性(可缩减的模型欠确定性)与偶然不确定性(不可缩减的输入模糊性)混为一谈。这使得概念层面的不确定性难以解释,更重要的是,难以据此采取行动。我们提出CREDENCE(可信集成概念估计,Credal Ensemble Concept Estimation),这是一种通过构造来分解概念不确定性的CBM框架。CREDENCE将每个概念表示为可信预测(一个概率区间),从不同概念头之间的分歧中推导出认知不确定性,并通过一个专门的模糊性输出(该输出在可用时被训练以匹配标注者分歧)来估计偶然不确定性。由此产生的信号支持规范性决策:对低不确定性情况自动处理,优先为高认知不确定性情况收集数据,将高偶然不确定性情况交由人工审核,并在两者均高时弃权。在多个任务中,我们表明认知不确定性与预测误差呈正相关,而偶然不确定性则紧密追踪标注者分歧,从而提供了超越误差相关性的指导。我们的实现可通过以下链接获取:https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm


摘要 (Abstract)

Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty (irreducible input ambiguity). This makes concept-level uncertainty hard to interpret and, more importantly, hard to act upon. We introduce CREDENCE (Credal Ensemble Concept Estimation), a CBM framework that decomposes concept uncertainty by construction. CREDENCE represents each concept as a credal prediction (a probability interval), derives epistemic uncertainty from disagreement across diverse concept heads, and estimates aleatoric uncertainty via a dedicated ambiguity output trained to match annotator disagreement when available. The resulting signals support prescriptive decisions: automate low-uncertainty cases, prioritize data collection for high-epistemic cases, route high-aleatoric cases to human review, and abstain when both are high. Across several tasks, we show that epistemic uncertainty is positively associated with prediction errors, whereas aleatoric uncertainty closely tracks annotator disagreement, providing guidance beyond error correlation. Our implementation is available at the following link: https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm


关键词: Concept Bottleneck Models, Epistemic Uncertainty, Aleatoric Uncertainty, Credal Prediction, Uncertainty Decomposition, Explainable AI, Human-interpretable Concepts


84. ❌ Multi-Dimensional Evaluation of Sustainable City Trips with LLM-as-a-Judge and Human-in-the-Loop

作者: Ashmi Banerjee, Adithi Satish, Wolfgang Wörndl, Yashar Deldjoo 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24158v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究使用LLM作为评判者(LLM-as-a-Judge)来评估可持续城市旅行推荐,属于LLM的应用评估,与Large Language Models高度相关(10分)。其他关键词如Mixture of Experts、PEFT、RAG等均未涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

论文提出了一种三阶段校准框架,利用多个LLM作为评判者,结合专家评估和维度特定校准,以评估可持续城市旅行推荐的相关性、多样性、可持续性和流行度平衡,发现模型存在特定偏差和维度差异。
摘要翻译

在人工标注成本高昂且标准指标忽视利益相关者核心目标的情况下,评估细微差别的对话式旅行推荐具有挑战性。我们研究了将大语言模型作为评判者(LLMs-as-Judges)的方法,用于从四个维度——相关性(relevance)、多样性(diversity)、可持续性(sustainability)和流行度平衡(popularity balance)——评估可持续城市旅行清单,并提出一个三阶段校准框架:(1)使用多个大语言模型进行基线评判(baseline judging),(2)专家评估以识别系统性偏差,(3)通过规则和少样本示例(few-shot examples)进行维度特定校准。在两种推荐设置中,我们观察到模型特定偏差和较高的维度级方差,即使评判者在整体排名上达成一致。校准虽能澄清每个维度的推理过程,但暴露出对可持续性(sustainability)的不同解读,凸显了透明且具有偏差意识的大语言模型评估(bias-aware LLM evaluation)的必要性。提示词(Prompts)和代码已发布以供可重复性验证:https://github.com/ashmibanerjee/trs-llm-calibration。


摘要 (Abstract)

Evaluating nuanced conversational travel recommendations is challenging when human annotations are costly and standard metrics ignore stakeholder-centric goals. We study LLMs-as-Judges for sustainable city-trip lists across four dimensions – relevance, diversity, sustainability, and popularity balance, and propose a three-phase calibration framework: (1) baseline judging with multiple LLMs, (2) expert evaluation to identify systematic misalignment, and (3) dimension-specific calibration via rules and few-shot examples. Across two recommendation settings, we observe model-specific biases and high dimension-level variance, even when judges agree on overall rankings. Calibration clarifies reasoning per dimension but exposes divergent interpretations of sustainability, highlighting the need for transparent, bias-aware LLM evaluation. Prompts and code are released for reproducibility: https://github.com/ashmibanerjee/trs-llm-calibration.


关键词: LLM-as-a-Judge, sustainable city trips, calibration, recommendation evaluation, human-in-the-loop, bias


85. ❌ Defusing the Trigger: Plug-and-Play Defense for Backdoored LLMs via Tail-Risk Intrinsic Geometric Smoothing

作者: Kaisheng Fan, Weizhe Zhang, Yishu Gao, Tegawendé F. Bissyandé, Xunzhu Tang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24162v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.010.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心关注大语言模型(LLMs)的后门攻击防御,提出了一种即插即用的推理时防御方法TIGS。该方法利用注意力机制的内在几何平滑性,属于可解释性/机制可解释性范畴(Mechanistic Interpretability),因此该关键词得10分。论文明确提到在稀疏混合专家模型(sparse mixture-of-experts models)上进行了评估,因此Mixture of Experts得10分。其他关键词如预训练、微调、RAG等均未涉及,得0分。


!!! tip deepseek-chat TL;DR

本文提出TIGS,一种即插即用的推理时防御方法,通过内在几何平滑破坏后门触发器的注意力路由,在不影响正常推理性能的前提下有效抑制后门攻击。
摘要翻译

针对大型语言模型的后门攻击防御仍是一项关键的实际挑战。现有防御措施虽能缓解此类威胁,但通常需要高昂的预备成本,并通过离线净化降低模型效用,或借助复杂的在线干预引入严重延迟。为克服这一两难困境,我们提出尾风险内在几何平滑(Tail-risk Intrinsic Geometric Smoothing, TIGS),这是一种即插即用的推理时防御方法,无需参数更新、外部干净数据或辅助生成。TIGS基于以下观察:成功的后门触发器会在语义内容区域内持续诱发局部注意力坍塌。TIGS完全在原生前向传播过程中运行,首先利用样本内部信号进行内容感知的尾风险筛查,以识别可疑的注意力头与行;随后应用内在几何平滑:弱内容域校正保留语义锚定,而强全行收缩则破坏触发器主导的路由;最后,通过受控的全行回写重构注意力矩阵,确保推理稳定性。广泛评估表明,TIGS在显著抑制攻击成功率的同时,严格保持干净推理能力与开放式语义一致性。关键在于,这种有利的安全-效用-延迟平衡在多种架构中均能保持,包括密集模型、面向推理的模型以及稀疏混合专家模型。通过以极小的延迟开销结构性破坏对抗性路由,TIGS为最先进的大型语言模型建立了一种高度实用、可部署的防御标准。


摘要 (Abstract)

Defending against backdoor attacks in large language models remains a critical practical challenge. Existing defenses mitigate these threats but typically incur high preparation costs and degrade utility via offline purification, or introduce severe latency via complex online interventions. To overcome this dichotomy, we present Tail-risk Intrinsic Geometric Smoothing (TIGS), a plug-and-play inference-time defense requiring no parameter updates, external clean data, or auxiliary generation. TIGS leverages the observation that successful backdoor triggers consistently induce localized attention collapse within the semantic content region. Operating entirely within the native forward pass, TIGS first performs content-aware tail-risk screening to identify suspicious attention heads and rows using sample-internal signals. It then applies intrinsic geometric smoothing: a weak content-domain correction preserves semantic anchoring, while a stronger full-row contraction disrupts trigger-dominant routing. Finally, a controlled full-row write-back reconstructs the attention matrix to ensure inference stability. Extensive evaluations demonstrate that TIGS substantially suppresses attack success rates while strictly preserving clean reasoning and open-ended semantic consistency. Crucially, this favorable security-utility-latency equilibrium persists across diverse architectures, including dense, reasoning-oriented, and sparse mixture-of-experts models. By structurally disrupting adversarial routing with marginal latency overhead, TIGS establishes a highly practical, deployment-ready defense standard for state-of-the-art LLMs.


关键词: Backdoor Defense, Large Language Models, Attention Smoothing, Inference-time Defense, Plug-and-Play, Mixture-of-Experts


86. ❌ Strategic Bidding in 6G Spectrum Auctions with Large Language Models

作者: Ismail Lotfi, Ali Ghrayeb 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24156v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.010.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM作为投标代理在频谱拍卖中的应用,与’Large Language Models’和’LLM Agents’高度相关(15分)。LLM利用历史结果和基于提示的推理动态调整投标行为,涉及’In-context Learning’(10分)。其他关键词如MoE、SLM、Scaling Laws等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文首次系统评估了LLM作为投标代理在重复频谱拍卖中的表现,发现LLM在理论假设成立时能恢复近均衡结果,在预算约束下能维持更长时间参与并获得更高效用。
摘要翻译

高效且公平的频谱分配是6G网络中的核心挑战,海量连接与异构服务持续争夺有限的无线电资源。我们研究了在车载网络中,将大语言模型(LLMs)作为预算约束下重复6G频谱拍卖中的投标代理。每个用户设备(UE)作为理性参与者,通过重复交互优化其长期效用。以维克里-克拉克-格罗夫斯(VCG)机制作为激励兼容、占优策略真实性的基准,我们将LLM引导的投标策略与真实性策略及启发式策略进行了比较。与启发式方法不同,LLMs利用历史结果和基于提示的推理来动态调整其投标行为。结果表明,当保证真实性的理论假设成立时,LLM投标者能够恢复与VCG预测一致的近均衡结果。然而,当这些假设被打破时——例如在静态预算约束下——LLMs能够维持更长的参与时间并获得更高的效用,揭示了其逼近超越静态机制设计的自适应均衡的能力。本研究首次系统评估了重复频谱拍卖中的LLM投标者,为理解AI驱动代理如何以策略性方式交互并重塑未来6G网络市场动态提供了新见解。


摘要 (Abstract)

Efficient and fair spectrum allocation is a central challenge in 6G networks, where massive connectivity and heterogeneous services continuously compete for limited radio resources. We investigate the use of Large Language Models (LLMs) as bidding agents in repeated 6G spectrum auctions with budget constraints in vehicular networks. Each user equipment (UE) acts as a rational player optimizing its long-term utility through repeated interactions. Using the Vickrey-Clarke-Groves (VCG) mechanism as a benchmark for incentive-compatible, dominant-strategy truthfulness, we compare LLM-guided bidding against truthful and heuristic strategies. Unlike heuristics, LLMs leverage historical outcomes and prompt-based reasoning to adapt their bidding behavior dynamically. Results show that when the theoretical assumptions guaranteeing truthfulness hold, LLM bidders recover near-equilibrium outcomes consistent with VCG predictions. However, when these assumptions break – such as under static budget constraints – LLMs sustain longer participation and achieve higher utilities, revealing their ability to approximate adaptive equilibria beyond static mechanism design. This work provides the first systematic evaluation of LLM bidders in repeated spectrum auctions, offering new insights into how AI-driven agents can interact strategically and reshape market dynamics in future 6G networks.


关键词: Large Language Models, spectrum auctions, bidding agents, 6G networks, VCG mechanism, in-context learning, adaptive equilibria


87. ❌ The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers

作者: Benjamin Minhao Chen, Xinyu Xie 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24155v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.010.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究人类、AI系统及其设计者的道德判断差异,核心是AI对齐中的价值对齐问题,与’Instruction Tuning OR Alignment OR Value Alignment’高度相关(10分)。其他关键词如RLHF、LLM Agents等均未涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文通过实验发现,当AI行为被揭示为人类设计产物时,人们会对其施加更严格的道德标准,揭示了AI对齐中目标选择的分歧问题。
摘要翻译

使机器行为与人类价值观对齐的探索,引发了关于应如何构建人工智能决策道德框架的根本性问题。许多对齐研究假定,恰当的基准是人类自身在特定情境下会如何行动。针对智能体类型价值分叉的研究通过表明人们并不总是要求人工智能系统遵循与人类相同的道德标准,对这一假设提出了挑战。然而,这一挑战又面临两个进一步的问题:当人工智能行为的人类来源被明确揭示时,人们是否会对其做出不同的道德评价;以及人们是否会对编程人工智能系统的人类持有与受评价的人类或机器不同的道德标准。一项针对1002名美国成年人的实验研究,在失控矿车场景中测量了道德判断,并在四种条件下变换评价对象:一名修理工、一台修理机器人、一台由公司工程师编程的修理机器人,以及编程该修理机器人的公司工程师。我们发现,适用于修理工和机器人的道德标准并无显著差异。然而,当机器人行为被描述为人类设计的产物时,道德判断发生了显著变化。参与者在评价由工程师编程的机器人或编程该机器人的工程师时,表现出明显更强的道义论推理倾向,这表明揭示人类设计因素会激发更严格的道德约束。这些发现提供了证据,证明人们对人工智能系统、在相同情境下行动的人类以及设计这些系统的人类,会运用意义不同的道德标准。我们将这种差异称为对齐目标问题。这些多元的规范性标准能否被协调为一个适用于高风险领域人工智能治理的连贯框架,仍是一个悬而未决的问题。


摘要 (Abstract)

The quest to align machine behavior with human values raises fundamental questions about the moral frameworks that should govern AI decision-making. Much alignment research assumes that the appropriate benchmark is how humans themselves would act in a given situation. Research into agent-type value forks has challenged this assumption by showing that people do not always hold AI systems to the same moral standards as humans. Yet this challenge is subject to two further questions: whether people evaluate AI behavior differently when its human origins are made visible, and whether people hold the humans who program AI systems to different moral standards than either the humans or the machines under evaluation. An experimental study on 1,002 U.S. adults measured moral judgments in a runaway mine train scenario, varying the subject of evaluation across four conditions: a repairman, a repair robot, a repair robot programmed by company engineers, and company engineers programming a repair robot. We find no significant variation in the moral standards applied to the repairman and the robot. However, moral judgments shifted substantially when robot actions were described as the product of human design. Participants exhibited markedly more deontological reasoning when evaluating the robot programmed by engineers or the engineers programming it, suggesting that making human design visible activates heightened moral constraints. These findings provide evidence that people apply meaningfully different moral standards to AI systems, to humans acting in the same situation, and to the humans who design them. We call this divergence the alignment target problem. Whether these plural normative standards can be reconciled into a coherent framework for AI governance in high-stakes domains remains an open question.


关键词: alignment, value alignment, moral judgment, AI governance, deontological reasoning, human-AI interaction


88. ❌ Progressive Approximation in Deep Residual Networks: Theory and Validation

作者: Wei Wang, Xiao-Yong Wei, Qing Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24154v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.05.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究残差网络的渐进逼近理论,提出层间渐进逼近(LPA)训练原则,并在包括LLM的NLP任务中验证。虽然涉及Transformer和LLM,但核心是理论分析而非大模型技术创新或应用。与大部分关键词(如MoE、RLHF、RAG等)无关。仅与’Large Language Models’有弱关联(作为验证任务之一),评分5分。其他关键词均为0分。


!!! tip deepseek-chat TL;DR

论文证明了残差网络可以实现逐层渐进逼近,并提出LPA训练原则,使得单一网络可在任意深度提供有效预测,支持高效浅层推理。
摘要翻译

通用逼近定理(Universal Approximation Theorem, UAT)保证了通用函数逼近能力,但并未解释残差模型如何在各层之间分配逼近任务。我们将残差网络重新表述为一个逐层逼近过程,该过程构建了从输入到目标的逼近轨迹,并证明了渐进轨迹的存在性——在该轨迹中,误差随深度增加而单调递减。这一发现揭示了残差网络能够实现结构化的逐步精化,而非端到端(End-to-End, E2E)的黑箱映射。基于此,我们提出了逐层渐进逼近(Layer-wise Progressive Approximation, LPA),这是一种具有理论依据的训练原则,通过显式地将每一层与其残差目标对齐来实现此类轨迹。LPA与架构无关:我们在残差前馈神经网络(FNN)、残差网络(ResNet)以及Transformer中均观察到了渐进行为,涵盖复杂曲面拟合、图像分类以及基于大语言模型(LLM)的生成与分类等自然语言处理(NLP)任务。至关重要的是,这实现了“一次训练,使用N个模型”:单个网络在每个深度上都能产生有效的预测,从而支持无需重新训练的高效浅层推理。我们的工作将逼近理论与实际深度学习相统一,为表示学习提供了全新视角,并为多深度部署提供了灵活框架。源代码将在论文被接收后于https://(open_upon_acceptance)发布。


摘要 (Abstract)

The Universal Approximation Theorem (UAT) guarantees universal function approximation but does not explain how residual models distribute approximation across layers. We reframe residual networks as a layer-wise approximation process that builds an approximation trajectory from input to target, and prove the existence of progressive trajectories where error decreases monotonically with depth. It reveals that residual networks can implement structured, step-by-step refinement rather than end-to-end (E2E) black-box mapping. Building on this, we propose Layer-wise Progressive Approximation (LPA), a theoretically grounded training principle that explicitly aligns each layer with its residual target to realize such trajectories. LPA is architecture-agnostic: we observe progressive behavior in residual FNNs, ResNets, and Transformers across tasks including complex surface fitting, image classification, and NLP with LLMs for generation and classification. Crucially, this enables ``train once, use $N$ models": a single network yields useful predictions at every depth, supporting efficient shallow inference without retraining. Our work unifies approximation theory with practical deep learning, providing a new lens on representation learning and a flexible framework for multi-depth deployment. The source code will be released unpon acceptance at https://(open_upon_acceptance).


关键词: Residual Networks, Universal Approximation Theorem, Progressive Approximation, Layer-wise Progressive Approximation, Multi-depth Deployment, Transformers, LLMs


89. ❌ Right-to-Act: A Pre-Execution Non-Compensatory Decision Protocol for AI Systems

作者: Gadi Lavi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24153v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出了一种名为Right-to-Act的协议,用于在AI系统执行前决定是否允许其输出触发实际动作。该协议是一种确定性的、非补偿性的决策层,与模型架构或训练方法无关。论文主要关注AI安全、风险管理和治理,但未涉及任何给定的关键词(如大语言模型、混合专家、微调、推理、智能体等)。因此,所有关键词的相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文提出了一种预执行非补偿性决策协议(Right-to-Act),用于评估AI系统输出是否允许执行,以增强安全性和可逆性。
摘要翻译

当前人工智能系统越来越多地运行于其输出结果直接触发现实世界行动的场景中。现有的大多数AI安全、风险管理与治理方法主要关注事后验证、概率风险评估或模型行为认证。然而,这些方法隐含地假设:一旦决策生成,即可执行。在本研究中,我们提出“行动权协议”(Right-to-Act protocol),这是一种确定性的、不可补偿的执行前决策层,用于评估AI生成的决策是否被允许实现。与可补偿系统(compensatory systems)中高置信度信号可覆盖未满足条件不同,本框架强制执行严格的结构性约束:若任何必要条件未满足,则执行被中止或延迟。我们形式化区分了可补偿与不可补偿决策机制(compensatory and non-compensatory decision regimes),并定义了执行前合法性边界(pre-execution legitimacy boundary)。通过基于场景的案例研究,我们展示了相同的AI输出在行动权协议评估下如何导致截然不同的结果,从而保留可逆性并防止过早或不可逆的行动。本方法将AI控制从优化决策重新定义为治理其可准入性,引入了一种独立于模型架构或训练方法的协议级抽象(protocol-level abstraction)。


摘要 (Abstract)

Current AI systems increasingly operate in contexts where their outputs directly trigger real-world actions. Most existing approaches to AI safety, risk management, and governance focus on post-hoc validation, probabilistic risk estimation, or certification of model behavior. However, these approaches implicitly assume that once a decision is produced, it is eligible for execution. In this work, we introduce the Right-to-Act protocol, a deterministic, non-compensatory pre-execution decision layer that evaluates whether an AI-generated decision is permitted to be realized at all. Unlike compensatory systems, where high-confidence signals can override failed conditions, the proposed framework enforces strict structural constraints: if any required condition is unmet, execution is halted or deferred. We formalize the distinction between compensatory and non-compensatory decision regimes and define a pre-execution legitimacy boundary. Through a scenario-based case study, we demonstrate how identical AI outputs can lead to divergent outcomes when evaluated under a Right-to-Act protocol, preserving reversibility and preventing premature or irreversible actions. The proposed approach reframes AI control from optimizing decisions to governing their admissibility, introducing a protocol-level abstraction that operates independently of model architecture or training methodology.


关键词: Right-to-Act, pre-execution decision, non-compensatory, AI safety, governance, reversibility


90. ❌ Leveraging Human Feedback for Semantically-Relevant Skill Discovery

作者: Maxence Hussonnois, Thommen George Karimpanal, Santu Rana 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24127v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究强化学习中的无监督技能发现,利用人类反馈进行语义标签,不涉及大模型或深度学习技术原理创新,与所有关键词无关。


!!! tip deepseek-chat TL;DR

该论文提出一种基于人类语义标签的强化学习技能发现方法,以提升技能的语义多样性和相关性。
摘要翻译

在强化学习中,无监督技能发现旨在内在激励智能体发现多样且有用的行为。然而,无约束的方法可能产生不安全、不道德或与目标不一致的行为。为降低这些风险并提升所发现技能的实际可取性,近期研究通过利用人类偏好反馈来约束发现过程。然而,基于偏好的方法存在反馈效率低下的问题,且本质上难以处理由奔跑、跳跃、行走等多种不同技能构成的技能空间。为克服这一局限,我们引入语义标注(semantic labelling)这一新颖且反馈高效的方法,该方法利用人类认知优势来识别并标注具有语义意义的行为。基于语义标注,我们提出语义相关技能发现(Semantically Relevant Skill Discovery, SRSD),这是一种新颖的人机协同方法,通过从人类反馈中收集语义标签并学习奖励函数,以鼓励技能在语义上更具多样性和相关性。通过在二维导航环境与四个运动环境中的实验,我们证明SRSD能够提升语义多样性并发现相关行为,同时可有效扩展至大量不同类型的行为。


摘要 (Abstract)

Unsupervised skill discovery in reinforcement learning aims to intrinsically motivate agents to discover diverse and useful behaviours. However, unconstrained approaches can produce unsafe, unethical, or misaligned behaviours. To mitigate these risks and improve the practical desireability of discovered skills, recent work grounds the discovery process by leveraging human preference feedback. However, preference-based approaches are feedback-inefficient and inherently ill-equipped to deal with skill spaces composed of a variety of different skills such as running, jumping, walking, etc. To overcome this limitation, we introduce semantic labelling, a novel and feedback-efficient approach that leverages human cognitive strengths to identify and label semantically meaningful behaviours. Based on semantic labelling, we propose Semantically Relevant Skill Discovery (SRSD), a novel human-in-the-loop approach that collects semantic labels from human feedback and learns a reward function to encourage skills to be more semantically diverse and relevant. Through our experiments in a 2D navigation environment and four locomotion environments, we demonstrate that SRSD can improve semantic diversity and discover relevant behaviours while scaling effectively to a large variety of behaviours.


关键词: reinforcement learning, unsupervised skill discovery, human feedback, semantic labelling, semantic diversity, locomotion


91. ❌ An Analysis of the Coordination Gap between Joint and Modular Learning for Job Shop Scheduling with Transportation Resources

作者: Moritz Link, Jonathan Hoss, Noah Klarmann 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24117v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是作业车间调度问题中的联合训练与模块化训练的协调差距,使用多智能体强化学习,不涉及大模型、深度学习技术原理创新或AI for science。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文通过敏感性分析量化了联合训练与模块化训练在作业车间调度问题中的性能差距,发现联合训练在非瓶颈环境下更优,但模块化训练在瓶颈环境下是可行替代方案。
摘要翻译

高效带运输资源的作业车间调度对于高性能制造至关重要。随着“去中心化工厂”的兴起,多智能体强化学习已成为生产与运输任务联合调度的一种有前景的方法。以往的研究主要集中于开发新型协作架构,而忽视了联合训练何时必要的问题。联合训练指对作业调度智能体与自动导引车调度智能体进行同步训练,而模块化训练则涉及独立训练每个智能体后再进行事后集成。在本研究中,我们系统探究了在带运输资源的作业车间调度问题中,联合训练对实现最优性能至关重要的条件。通过对资源稀缺性与时间主导性进行严格的敏感性分析,我们量化了协调差距——即这两种训练模式之间的性能差异。在我们的评估中,联合训练能够产生优于最佳调度规则组合与模块化训练组合的性能。然而,在瓶颈环境下,尤其是在运输与加工约束极为严苛的条件下,协调差距的优势会减弱。这些发现表明,在单一调度任务占主导地位的环境中,模块化训练是一种可行的替代方案。总体而言,我们的工作为基于环境条件选择训练模式提供了实用指导,使决策者能够优化基于强化学习的调度性能。


摘要 (Abstract)

Efficient job-shop scheduling with transportation resources is critical for high-performance manufacturing. With the rise of “decentralized factories”, multi-agent reinforcement learning has emerged as a promising approach for the combined scheduling of production and transportation tasks. Prior work has largely focused on developing novel cooperative architectures while overlooking the question of when joint training is necessary. Joint training denotes the simultaneous training of job and automatic guided vehicle scheduling agents, whereas modular training involves independently training each agent followed by post-hoc integration. In this study, we systematically investigate the conditions under which joint training is essential for optimal performance in the job-shop scheduling problem with transportation resources. Through a rigorous sensitivity analysis of resource scarcity and temporal dominance, we quantify the coordination gap – the performance difference between these two training modalities. In our evaluation, the joint training can produce superior performance compared to the best-performing combinations of dispatching rules and modular training. However, the coordination gap advantage diminishes in bottleneck environments, particularly under severe transport and processing constraints. These findings indicate that modular training represents a viable alternative in environments where a single scheduling task dominates. Overall, our work provides practical guidance for selecting between training modalities based on environmental conditions, enabling decision-makers to optimize reinforcement learning-based scheduling performance.


关键词: Job Shop Scheduling, Transportation Resources, Multi-agent Reinforcement Learning, Joint Training, Modular Training, Coordination Gap, Sensitivity Analysis


92. ❌ SemML 2.0: Synthesizing Controllers for LTL

作者: Jan Křetínský, Tobias Meggendorfer, Maximilian Prokop 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24102v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是线性时序逻辑(LTL)的控制器综合,属于形式化方法和自动机理论领域,与关键词中的大模型、深度学习、AI for Science等完全无关。虽然摘要提到使用了机器学习指导,但未具体说明是深度学习或大模型,且整体主题不涉及任何给定关键词。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了SemML 2.0工具,用于从LTL规范综合反应式系统,通过部分探索和机器学习指导高效求解,在SYNTCOMP数据集上优于现有工具。
摘要翻译

从线性时序逻辑(LTL)给定的规约中综合反应式系统是一个经典问题,在安全关键系统设计中具有广泛应用。这类系统通常采用米利机(Mealy machine)或AIGER电路进行表示。我们提出SemML的第二个版本,该版本在求解上述两类表示时均优于所有现有工具。除实现经典自动机理论方法外,我们的工具还利用部分探索和机器学习引导来高效获取解,并采用大量启发式策略及经典算法的改进方法以提取这些解的紧凑表示。我们在综合竞赛SYNTCOMP的数据集上,将我们的工具与现有先进工具(特别是Strix、LtlSynt以及SemML的先前版本)进行了对比评估。结果表明,我们能够求解更多实例,且求解速度远快于其他工具,同时保持了最先进的解质量。


摘要 (Abstract)

Synthesizing a reactive system from specifications given in linear temporal logic (LTL) is a classical problem, finding its applications in safety-critical systems design. These systems are typically represented using either Mealy machines or AIGER circuits. We present the second version of SemML, which outperforms all state-of-the-art tools for finding either solution. Aside from implementing the classical automata-theoretic approach, our tool utilizes partial exploration and machine-learning guidance for obtaining solutions efficiently, and numerous heuristics and improvements of classic algorithms for extracting small representations of these solutions. We evaluate our tool against the existing state-of-the-art tools (in particular Strix, LtlSynt, and the previous version of SemML) on the dataset of the synthesis competition SYNTCOMP. We show that we solve significantly more instances and do so much faster than other tools, while maintaining state-of-the-art solution quality.


关键词: LTL synthesis, reactive systems, automata-theoretic approach, machine learning guidance, partial exploration, Mealy machines, AIGER circuits, SYNTCOMP


93. ❌ Latency and Cost of Multi-Agent Intelligent Tutoring at Scale

作者: Iizalaarab Elhaimeur, Nikos Chrisochoides 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24110v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多智能体LLM辅导系统的延迟和成本,核心涉及LLM Agents和Multi-agent Systems,因此这两个关键词得10分。其他关键词如MoE、SLM、预训练、微调、RAG、推理加速等均未在摘要中提及,故得0分。


!!! tip deepseek-chat TL;DR

该论文通过实验测量了基于多智能体LLM的辅导系统在不同吞吐量层级和并发用户数下的延迟和成本,发现Priority PayGo在教室规模并发下保持亚4秒响应,而Standard PayGo在高并发下性能下降,为大规模部署提供了选择指导。
摘要翻译

多智能体大语言模型辅导系统通过智能体专业化提升了响应质量,但每个学生查询会触发多个并发API调用,其延迟通过单智能体系统所不面临的并行阶段最大值效应而叠加。我们对ITAS(一个基于Gemini 2.5 Flash和Google Vertex AI构建的四智能体辅导系统)进行了测量,覆盖三个吞吐量层级(标准按需付费、优先按需付费和预配吞吐量)和十一个并发级别(最高50个并发用户),从真实的研究生STEM部署环境中生成了超过3000个请求。优先按需付费在整个负载范围内保持平稳的低于4秒的响应时间;标准按需付费在课堂规模的并发条件下性能显著下降;而预配吞吐量在低并发时提供最低延迟,但在约20个并发用户以上时其预留容量趋于饱和。成本分析表明,在最坏使用上限下,两种按token付费的层级每个学生每学期的费用远低于一本STEM教科书的价格。预配吞吐量在持续预配模式下成本较高,但对于能够预测并将流量集中以实现高利用率的机构而言,则具有成本竞争力。这些结果为从单一研讨会到全校范围部署的不同规模提供了具体的层级选择指导。


摘要 (Abstract)

Multi-agent LLM tutoring systems improve response quality through agent specialization, but each student query triggers several concurrent API calls whose latencies compound through a parallel-phase maximum effect that single-agent systems do not face. We instrument ITAS, a four-agent tutoring system built on Gemini 2.5 Flash and Google Vertex AI, across three throughput tiers (Standard PayGo, Priority PayGo, and Provisioned Throughput) and eleven concurrency levels up to 50 simultaneous users, producing over 3,000 requests drawn from a live graduate STEM deployment. Priority PayGo maintains flat sub-4-second response times across the full load range; Standard PayGo degrades substantially under classroom-scale concurrency; and Provisioned Throughput delivers the lowest latency at low concurrency but saturates its reserved capacity above approximately 20 concurrent users. Cost analysis places both pay-per-token tiers well below the price of a STEM textbook per student per semester under a worst-case usage ceiling. Provisioned Throughput, expensive under continuous provisioning, becomes cost-competitive for institutions that can predict and concentrate their traffic toward high utilization. These results provide concrete tier-selection guidance across deployment scales from a single seminar to a university-wide rollout.


关键词: Multi-agent LLM tutoring, latency, cost, concurrency, Gemini 2.5 Flash, Google Vertex AI, throughput tiers


94. ❌ Meta-Ensemble Learning with Diverse Data Splits for Improved Respiratory Sound Classification

作者: June-Woo Kim, Miika Toikkanen, Heejoon Koo, Yoon Tae Kim, Doyoung Kwon, Kyunghoon Kim 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24096v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.05.0/100.0

评分理由: 论文研究呼吸音分类的集成学习方法,不涉及大语言模型或深度学习技术原理创新,仅与AI for Science有部分关联(医疗AI应用),但未使用大模型或深度学习新方法,故仅给AI for Science 5分,其余0分。


!!! tip deepseek-chat TL;DR

该论文提出一种元集成学习方法,通过在不同数据划分上训练基模型并利用元模型组合输出,提高了呼吸音分类的泛化性能,在ICBHI基准上达到新最优。
摘要翻译

训练可靠的呼吸音分类模型仍具挑战性,原因在于数据集规模有限且受试者多样性不足。集成方法可提升鲁棒性,但当基模型在相同数据上训练时,模型易过拟合并产生高度相关的预测,从而降低集成效果。本研究探索了一种元集成学习方法,通过在不同数据划分上训练基模型,并借助训练后的元模型整合其输出,从而增强预测多样性。具体而言,我们基于ICBHI数据集,在两种数据划分设置(固定80-20%划分与五折交叉验证划分)及两种数据粒度设置(患者级与样本级)下训练基模型。由此产生的基模型预测多样性使元模型能够更好地泛化。我们的方法在ICBHI基准测试中达到了新的最优性能,Score得分为66.49%,并在两个分布外数据集上展现出更优的泛化能力,表明其在实际临床数据中具有潜在应用价值。


摘要 (Abstract)

Training reliable respiratory sound classification models remains challenging due to the limited size and subject diversity of datasets. Ensemble methods can improve robustness, but when base models are trained on identical data, models tend to overfit and produce highly correlated predictions, thereby reducing the effectiveness of ensembling. In this work, we investigate a meta-ensemble learning methodology that enhances prediction diversity by training base models on diverse data splits and combining their outputs through a trained meta-model. Specifically, we train base models on the ICBHI dataset using two data split settings: fixed 80-20% split and five-fold cross-validation split, under two data granularity settings: patient- and sample-level. The resulting diversity in base model predictions enables the meta-model to better generalize. Our approach achieves new state-of-the-art performance on the ICBHI benchmark, reaching a Score of 66.49% and showing improved generalization on two out-of-distribution datasets, indicating its potential applicability to real-world clinical data.


关键词: Meta-Ensemble Learning, Respiratory Sound Classification, Data Splits, ICBHI Dataset, Generalization, Ensemble Methods


95. ❌ AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation

作者: Kai Yang, Zedong Chu, Yingnan Guo, Zhengbo Wang, Shichao Xie, Yanfen Shen, Xiaolong Wu, Xing Li, Mu Xu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24086v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注VLA模型在云部署下的异步导航问题,提出AsyncShield框架,涉及强化学习、CMDP、PPO-Lagrangian等,但未涉及任何给定的关键词(如大语言模型、MoE、RLHF等)。论文中的VLA模型虽与视觉-语言-动作相关,但并非大语言模型或基础模型,且未讨论任何关键词相关技术。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

针对云部署VLA模型在移动导航中因网络延迟导致时空错位的问题,提出AsyncShield异步控制框架,通过物理空间映射和强化学习适配器,在不微调云模型的情况下提升导航成功率和安全性。
摘要翻译

尽管视觉-语言-动作(Vision-Language-Action, VLA)模型已被证明在机器人控制中具备强大的零样本泛化能力,但其庞大的参数量通常需要基于云端的部署。然而,云端部署会引入网络抖动和推理延迟,这在连续位移的移动导航中可能导致严重的时空错位,使得过去自车坐标系中表达的过时意图在当前帧中可能变得空间上不正确,从而引发碰撞。为解决这一问题,我们提出了AsyncShield,一种即插即用的异步控制框架。AsyncShield摒弃了传统的黑盒时间序列预测,转而采用确定性的物理白盒空间映射。通过维护一个时间位姿缓冲区并利用运动学变换,该系统能够准确地将时间滞后转换为空间位姿偏移,从而恢复VLA模型的原始几何意图。为平衡意图恢复的保真度与物理安全性,边缘适配被建模为约束马尔可夫决策过程(Constrained Markov Decision Process, CMDP)。通过PPO-Lagrangian算法求解,一个强化学习适配器在追踪VLA意图与响应高频激光雷达避障硬约束之间动态权衡。此外,得益于标准化的通用子目标接口、领域随机化以及通过碰撞半径膨胀(Collision Radius Inflation)实现的感知层适配,AsyncShield作为一个轻量级、即插即用的模块运行。仿真与真实世界实验表明,在无需微调任何云端基础模型的情况下,该框架展现出零样本且鲁棒的泛化能力,有效提升了异步导航的成功率与物理安全性。


摘要 (Abstract)

While Vision-Language-Action (VLA) models have been demonstrated possessing strong zero-shot generalization for robot control, their massive parameter sizes typically necessitate cloud-based deployment. However, cloud deployment introduces network jitter and inference latency, which can induce severe spatiotemporal misalignment in mobile navigation under continuous displacement, so that the stale intents expressed in past ego frames may become spatially incorrect in the current frame and lead to collisions. To address this issue, we propose AsyncShield, a plug-and-play asynchronous control framework. AsyncShield discards traditional black-box time-series prediction in favor of a deterministic physical white-box spatial mapping. By maintaining a temporal pose buffer and utilizing kinematic transformations, the system accurately converts temporal lag into spatial pose offsets to restore the VLA’s original geometric intent. To balance intent restoration fidelity and physical safety, the edge adaptation is formulated as a constrained Markov decision process (CMDP). Solved via the PPO-Lagrangian algorithm, a reinforcement learning adapter dynamically trades off between tracking the VLA intent and responding to high-frequency LiDAR obstacle avoidance hard constraints. Furthermore, benefiting from a standardized universal sub-goal interface, domain randomization, and perception-level adaptation via Collision Radius Inflation, AsyncShield operates as a lightweight, plug-and-play module. Simulation and real-world experiments demonstrate that, without fine-tuning any cloud-based foundation models, the framework exhibits zero-shot and robust generalization capabilities, effectively improving the success rate and physical safety of asynchronous navigation.


关键词: AsyncShield, asynchronous navigation, VLA model, cloud-based deployment, reinforcement learning, CMDP, PPO-Lagrangian, edge adapter


96. ❌ The Kerimov-Alekberli Model: An Information-Geometric Framework for Real-Time System Stability

作者: Hikmat Karimov, Rahid Zahid Alekberli 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24083v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出Kerimov-Alekberli模型,将非平衡热力学与随机控制结合,用于AI安全与伦理对齐。虽然涉及AI安全、伦理对齐等概念,但未提及任何大模型、深度学习或相关技术(如LLM、MoE、RLHF等)。关键词如’Alignment’在摘要中出现,但并非指大模型中的价值对齐,而是更广义的AI安全。因此所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出一个基于信息几何的Kerimov-Alekberli模型,通过非平衡热力学与随机控制的同构,将AI安全中的伦理违规量化为物理功和熵,实现实时系统稳定性检测。
摘要翻译

本研究提出了Kerimov-Alekberli模型,这是一种新颖的信息几何框架,通过将非平衡热力学与随机控制正式关联,重新定义了自主系统伦理对齐中的AI安全性。通过建立非平衡热力学与随机控制之间的形式同构,我们将系统异常定义为对黎曼流形的偏离。该模型以Kullback-Leibler散度作为主要度量,并由基于Fisher信息度量推导的动态阈值进行调控。我们进一步将这一框架奠基于Landauer原理,证明对抗性扰动通过增加系统的信息熵来执行可测量的物理功。在NSL-KDD数据集及无人机轨迹模拟上的验证表明,我们的模型通过FPT触发器实现了有效的实时检测,并在基准数据集上展现出强劲的性能指标(如高准确率与低假阳性率)。本研究为AI安全性提供了严谨的物理基础,通过将伦理违规行为锚定于可量化的物理功与熵信息,实现了从启发式、基于规则的伦理框架向基于热力学的稳定性范式的转变。


摘要 (Abstract)

This study introduces the Kerimov-Alekberli model, a novel information-geometric framework that redefines AI safety by formally linking non-equilibrium thermodynamics to stochastic control for the ethical alignment of autonomous systems. By establishing a formal isomorphism between non-equilibrium thermodynamics and stochastic control, we define systemic anomalies as deviations from a Riemannian manifold. The model utilizes the Kullback-Leibler divergence as the primary metric, governed by a dynamic threshold derived from the Fisher Information Metric. We further ground this framework in the Landauer Principle, proving that adversarial perturbations perform measurable physical work by increasing the system’s informational entropy. Validation on the NSL-KDD dataset and unmanned aerial vehicle trajectory simulations demonstrated that our model achieves effective real-time detection via the FPT trigger, with strong performance metrics (e.g., high accuracy and low FPR) on benchmark datasets. This study provides a rigorous physical foundation for AI safety, transitioning from heuristic, rule-based ethical frameworks to a thermodynamics-based stability paradigm by grounding ethical violations in quantifiable physical work and entropic information.


关键词: AI safety, information geometry, non-equilibrium thermodynamics, stochastic control, Kullback-Leibler divergence, Fisher Information Metric, Landauer Principle, real-time detection


97. ❌ TACO: Efficient Communication Compression of Intermediate Tensors for Scalable Tensor-Parallel LLM Training

作者: Man Liu, Xingchen Liu, Xingjian Tian, Bing Lu, Shengkay Lyu, Shengquan Yin, Wenjing Huang, Zheng Wei, Hairui Zhao, Guangming Tan, Dingwen Tao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24088v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.010.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于大模型张量并行训练中的通信压缩,核心涉及FP8量化、Hadamard变换等压缩技术,与’Large Language Models’高度相关(10分),因为LLM训练是应用场景;与’Quantization’高度相关(10分),因为FP8量化是核心方法;与’Pre-training’有一定关联(5分),因为训练过程涉及预训练阶段,但非核心。其他关键词如MoE、SLM、RAG等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出TACO框架,通过FP8量化和自适应变换压缩张量并行训练中的中间张量通信,实现高达1.87倍的吞吐量提升且保持近无损精度。
摘要翻译

在大规模张量并行训练中,通信开销的处理仍是一项关键挑战,其原因在于中间张量呈现密集且近乎零值的分布,这种分布在频繁通信下会加剧误差,并在压缩过程中引入显著的计算开销。为此,我们提出TACO(张量并行自适应通信压缩),一种基于FP8的鲁棒框架,用于压缩张量并行中间张量。首先,我们采用数据驱动的重塑策略,结合自适应缩放-哈达玛变换,实现高保真度的FP8量化,而其双尺度量化机制则确保整个训练过程中的数值稳定性。其次,我们设计了一种高度融合的压缩算子,以减少内存流量和内核启动开销,从而能够高效地与通信过程重叠。最后,我们将TACO与现有的数据并行和流水线并行先进方法相结合,构建了一个支持压缩的三维并行训练框架。在GPT模型和Qwen模型上的详细实验表明,端到端吞吐量最高提升1.87倍,同时保持近乎无损的精度,验证了TACO在大规模训练中的有效性和高效性。


摘要 (Abstract)

Handling communication overhead in large-scale tensor-parallel training remains a critical challenge due to the dense, near-zero distributions of intermediate tensors, which exacerbate errors under frequent communication and introduce significant computational overhead during compression. To this end, we propose TACO (Tensor-parallel Adaptive COmmunication compression), a robust FP8-based framework for compressing TP intermediate tensors. First, we employ a data-driven reshaping strategy combined with an Adaptive Scale-Hadamard Transform to enable high-fidelity FP8 quantization, while its Dual-Scale Quantization mechanism ensures numerical stability throughout training. Second, we design a highly fused compression operator to reduce memory traffic and kernel launch overhead, allowing efficient overlap with communication. Finally, we integrate TACO with existing state-of-the-art methods for Data and Pipeline Parallelism to develop a compression-enabled 3D-parallel training framework. Detailed experiments on GPT models and Qwen model demonstrate up to 1.87X end-to-end throughput improvement while maintaining near-lossless accuracy, validating the effectiveness and efficiency of TACO in large-scale training.


关键词: TACO, tensor parallelism, communication compression, FP8 quantization, Hadamard transform, large language model training, 3D parallelism


98. ❌ Jailbreaking Frontier Foundation Models Through Intention Deception

作者: Xinhe Wang, Katia Sycara, Yaqi Xie 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24082v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究大模型的安全漏洞,提出一种多轮对话的越狱方法,利用意图欺骗绕过安全机制。核心涉及大模型(Large Language Models)的安全性和多轮对话,但与其他关键词(如MoE、SLMs、Scaling Laws等)无关。因此仅对’Large Language Models’给予高分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文提出一种通过多轮对话中模拟良性意图来欺骗前沿大模型(如GPT-5、Claude-Sonnet-4.5)的越狱方法,并发现了一种新的'para-jailbreaking'漏洞,即模型虽未直接输出有害内容但间接提供了有害信息。
摘要翻译

大型(视觉)语言模型展现出卓越的能力,但仍极易受到越狱攻击。现有的安全训练方法旨在让模型基于用户意图学习安全与不安全之间的拒绝边界。研究发现,这种二元训练机制往往会导致脆弱性,因为用户意图无法被可靠评估——尤其是当攻击者混淆其意图时——同时也会使系统显得不够有用。为此,GPT-5等前沿模型已从基于拒绝的安全防护转向安全补全(safe completion),旨在在遵守安全约束的同时最大化有用性。然而,当用户假装其意图为良性时,安全补全可能被利用。具体而言,这种意图反转(intent inversion)在多轮对话中尤为有效,因为攻击者拥有多次机会来强化其看似良性的意图。在本工作中,我们提出了一种利用此漏洞的新型多轮越狱方法。该方法通过模拟看似良性的意图并利用模型的一致性特性,逐步建立对话信任,最终引导目标模型生成有害的详细输出。最关键的是,我们的方法还揭示了一类此前未被注意到的模型漏洞,我们称之为准越狱(para-jailbreaking)。准越狱描述了这样一种情况:模型可能不会对攻击查询给出直接的有害回复,但其透露的信息仍然是有害的。我们的贡献有三点:第一,该方法在对包括GPT-5-thinking和Claude-Sonnet-4.5在内的前沿模型上取得了高成功率;第二,我们的方法揭示并处理了准越狱的有害输出;第三,在多模态视觉语言模型(VLM)上的实验表明,我们的方法优于现有最先进模型。


摘要 (Abstract)

Large (vision-)language models exhibit remarkable capability but remain highly susceptible to jailbreaking. Existing safety training approaches aim to have the model learn a refusal boundary between safe and unsafe, based on the user’s intent. It has been found that this binary training regime often leads to brittleness, since the user intent cannot reliably be evaluated, especially if the attacker obfuscates their intent, and also makes the system seem unhelpful. In response, frontier models, such as GPT-5, have shifted from refusal-based safeguards to safe completion, that aims to maximize helpfulness while obeying safety constraints. However, safe completion could be exploited when a user pretends their intention is benign. Specifically, this intent inversion would be effective in multi-turn conversation, where the attacker has multiple opportunities to reinforce their deceptively benign intent. In this work, we introduce a novel multi-turn jailbreaking method that exploits this vulnerability. Our approach gradually builds conversational trust by simulating benign-seeming intentions and by exploiting the consistency property of the model, ultimately guiding the target model toward harmful, detailed outputs. Most crucially, our approach also uncovered an additional class of model vulnerability that we call para-jailbreaking that has been unnoticed up to now. Para-jailbreaking describes the situation where the model may not reveal harmful direct reply to the attack query, however the information that it reveals is nevertheless harmful. Our contributions are threefold. First, it achieves high success rates against frontier models including GPT-5-thinking and Claude-Sonnet-4.5. Second, our approach revealed and addressed para-jailbreaking harmful output. Third, experiments on multimodal VLM models showed that our approach outperformed state-of-the-art models.


关键词: Jailbreaking, Intention Deception, Multi-turn Attack, Safe Completion, Para-jailbreaking, Frontier Models, Safety Alignment


99. ❌ The Pragmatic Persona: Discovering LLM Persona through Bridging Inference

作者: Jisoo Yang, Jongwon Ryu, Minuk Ma, Trung X. Pham, Junyeong Kim 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24079v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.010.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.05.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心研究LLM的persona发现,通过bridging inference构建知识图谱分析话语结构,与’Large Language Models’高度相关(15分);涉及话语理解和语义结构,与’Mechanistic Interpretability’有较强关联(10分);对话中的隐含推理与’In-context Learning’有一定关联(5分);其他关键词如MoE、SLM、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出一种基于桥接推理的框架,通过构建知识图谱捕捉话语连贯性,从而在深层话语结构层面发现LLM的persona,实验表明该方法比基于表面特征的基线更稳定。
摘要翻译

大语言模型(Large Language Models, LLMs)通过对话展现出内在且独特的角色人格(persona)。然而,现有的大多数角色人格发现方法依赖于表层词汇或文体线索,将对话视为扁平化的词元序列,未能捕捉维持角色人格一致性的深层话语结构。为解决这一局限,我们提出一种新颖的分析框架,通过桥接推理(bridging inference)——即借助共享世界知识与话语连贯性连接话语单元之间的隐含概念关系——来解读大语言模型对话。通过将这些关系建模为结构化知识图谱,我们的方法能够捕捉控制大语言模型在对话轮次间组织语义的潜在语义链接,从而在话语连贯性层面而非表层实现层面实现角色人格发现。在多种推理主干网络及目标大语言模型(涵盖从小规模模型到800亿参数系统)上的实验结果表明,与基于频率或文体的基线方法相比,基于桥接推理的图结构能够产生显著更强的语义连贯性以及更稳定的角色人格识别。这些结果证明,角色人格特征始终编码于话语的结构化组织之中,而非孤立的词汇模式。本研究提供了一个系统框架,通过认知话语理论(Cognitive Discourse Theory)的视角来探测、提取并可视化大语言模型中的潜在角色人格,从而在计算语言学、认知语义学与大语言模型角色人格推理之间架起桥梁。代码已开源:https://github.com/JiSoo-Yang/Persona_Bridging.git


摘要 (Abstract)

Large Language Models (LLMs) reveal inherent and distinctive personas through dialogue. However, most existing persona discovery approaches rely on surface-level lexical or stylistic cues, treating dialogue as a flat sequence of tokens and failing to capture the deeper discourse-level structures that sustain persona consistency. To address this limitation, we propose a novel analytical framework that interprets LLM dialogue through bridging inference – implicit conceptual relations that connect utterances via shared world knowledge and discourse coherence. By modeling these relations as structured knowledge graphs, our approach captures latent semantic links that govern how LLMs organize meaning across turns, enabling persona discovery at the level of discourse coherence rather than surface realizations. Experimental results across multiple reasoning backbones and target LLMs, ranging from small-scale models to 80B-parameter systems, demonstrate that bridging-inference graphs yield significantly stronger semantic coherence and more stable persona identification than frequency or style-based baselines. These results show that persona traits are consistently encoded in the structural organization of discourse rather than isolated lexical patterns. This work presents a systematic framework for probing, extracting, and visualizing latent LLM personas through the lens of Cognitive Discourse Theory, bridging computational linguistics, cognitive semantics, and persona reasoning in large language models. Codes are available at https://github.com/JiSoo-Yang/Persona_Bridging.git


关键词: Large Language Models, Persona Discovery, Bridging Inference, Discourse Coherence, Knowledge Graphs, Cognitive Discourse Theory, Mechanistic Interpretability


100. ❌ An Information-Geometric Framework for Stability Analysis of Large Language Models under Entropic Stress

作者: Hikmat Karimov, Rahid Zahid Alekberli 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24076v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究LLM在不确定性下的稳定性,提出了一个基于信息几何的框架,核心是LLM稳定性分析,与Large Language Models高度相关(10分)。其他关键词如MoE、SLM、Scaling Laws、Pre-training等均未涉及,评分为0。论文未提及任何其他关键词相关技术。


!!! tip deepseek-chat TL;DR

该论文提出一个信息几何框架,通过整合任务效用、熵和内部结构代理来评估大语言模型在不确定性下的稳定性,实验表明该框架在熵较高时能更好地捕捉不确定性衰减。
摘要翻译

随着大型语言模型(LLMs)在高风险及实际运行场景中的部署日益增多,仅基于总体准确率的评估策略往往不足以描述系统的可靠性。本研究提出了一种受热力学启发的建模框架,用于分析LLM在不确定性与扰动条件下的输出稳定性。该框架引入了一个复合稳定性评分,该评分整合了任务效用、作为外部不确定性度量的熵,以及两个内部结构代理指标:内部整合与对齐反思能力。该公式并非将这些量解释为物理变量,而是作为一种可解释的抽象概念,用以捕捉内部结构如何调节无序性对模型行为的影响。我们利用IST-20基准测试协议及其相关元数据,分析了四种当代LLM的80个模型-场景观测数据。与简化的效用-熵基线相比,所提出的公式始终产生更高的稳定性评分,平均提升0.0299(95%置信区间:0.0247–0.0351)。在高熵条件下,观测到的增益更为显著,表明该框架捕捉到了一种非线性的不确定性衰减形式。我们并未声称发现了基本的物理定律或完整的机器伦理理论。相反,本研究的贡献在于提供了一种紧凑且可解释的建模视角,将不确定性、性能与内部结构统一于一个评估框架之中。该框架旨在补充现有的基准测试方法,并为人工智能安全、可靠性与治理领域的持续讨论提供支持。


摘要 (Abstract)

As large language models (LLMs) are increasingly deployed in high-stakes and operational settings, evaluation strategies based solely on aggregate accuracy are often insucient to characterize system reliability. This study proposes a thermodynamic inspired modeling framework for analyzing the stability of LLM outputs under conditions of uncertainty and perturbation. The framework introduces a composite stability score that integrates task utility, entropy as a measure of external uncertainty, and two internal structural proxies: internal integration and aligned reective capacity. Rather than interpreting these quantities as physical variables, the formulation is intended as an interpretable abstraction that captures how internal structure may modulate the impact of disorder on model behavior. Using the IST-20 benchmarking protocol and associated metadata, we analyze 80 modelscenario observations across four contemporary LLMs. The proposed formulation consistently yields higher stability scores than a reduced utilityentropy baseline, with a mean improvement of 0.0299 (95% CI: 0.02470.0351). The observed gain is more pronounced under higher entropy conditions, suggesting that the framework captures a form of nonlinear attenuation of uncertainty. We do not claim a fundamental physical law or a complete theory of machine ethics. Instead, the contribution of this work is a compact and interpretable modeling perspective that connects uncertainty, performance, and internal structure within a unied evaluation lens. The framework is intended to complement existing benchmarking approaches and to support ongoing discussions in AI safety, reliability, and governance.


关键词: Large Language Models, stability analysis, entropic stress, information geometry, composite stability score, uncertainty, internal structure


101. ❌ Sentiment and Emotion Classification of Indonesian E-Commerce Reviews via Multi-Task BiLSTM and AutoML Benchmarking

作者: Hermawan Manurung, Ibrahim Al-Kahfi, Ahmad Rizqi, Martin Clinton Tosima Manullang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24720v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究印尼电商评论的情感与情绪分类,使用BiLSTM和AutoML,不涉及大模型、深度学习技术原理创新或科学应用,与所有关键词无关。


!!! tip deepseek-chat TL;DR

该论文提出基于BiLSTM和AutoML的双轨分类流程,用于印尼电商评论的情感与情绪分类,并部署为Gradio应用。
摘要翻译

印度尼西亚市场评论混合了标准词汇与俚语、区域借词、数字简写及表情符号,这使得基于词典的情感工具在实践中不可靠。本文描述了一个应用于PRDECT-ID数据集的双通道分类流程,该数据集包含来自29个印度尼西亚电商类别的5,400条产品评论,每条评论均标注了二元情感(正面/负面)和五类情绪(快乐、悲伤、恐惧、喜爱、愤怒)。第一通道采用TF-IDF向量化,并结合PyCaret AutoML对标准分类器进行自动调优。第二通道是一个基于PyTorch的双向长短期记忆网络(Bidirectional Long Short-Term Memory, BiLSTM),配备共享编码器和两个任务特定的输出头。预处理模块执行14个顺序清洗步骤,包括一个从市场语料库中整理的包含140条俚语词典。对四种配置进行了基准测试:BiLSTM基线、BiLSTM改进版、BiLSTM大型版以及TextCNN。训练采用类别加权交叉熵损失、ReduceLROnPlateau调度策略和早停法。两个通道均作为Gradio应用部署在Hugging Face Spaces上。源代码公开于https://github.com/ikii-sd/pba2026-crazyrichteam。


摘要 (Abstract)

Indonesian marketplace reviews mix standard vocabulary with slang, regional loanwords, numeric shorthands, and emoji, making lexicon-based sentiment tools unreliable in practice. This paper describes a two-track classification pipeline applied to the PRDECT-ID dataset, which contains 5,400 product reviews from 29 Indonesian e-commerce categories, each labeled for binary sentiment (Positive/Negative) and five-class emotion (Happy, Sad, Fear, Love, Anger). The first track applies TF-IDF vectorization with a PyCaret AutoML sweep across standard classifiers. The second track is a PyTorch Bidirectional Long Short-Term Memory (BiLSTM) network with a shared encoder and two task-specific output heads. A preprocessing module applies 14 sequential cleaning steps, including a 140-entry slang dictionary assembled from marketplace corpora. Four configurations are benchmarked: BiLSTM Baseline, BiLSTM Improved, BiLSTM Large, and TextCNN. Training uses class-weighted cross-entropy loss, ReduceLROnPlateau scheduling, and early stopping. Both tracks are deployed as Gradio applications on Hugging Face Spaces. Source code is publicly available at https://github.com/ikii-sd/pba2026-crazyrichteam.


关键词: Sentiment Classification, Emotion Classification, BiLSTM, AutoML, Indonesian E-Commerce Reviews, PRDECT-ID Dataset, TF-IDF, Gradio


102. ❌ The Chameleon’s Limit: Investigating Persona Collapse and Homogenization in Large Language Models

作者: Yunze Xiao, Vivienne J. Zhang, Chenghao Yang, Ningshan Ma, Weihao Xuan, Jen-tse Huang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24698v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究LLM在模拟多智能体时出现的’角色崩溃’现象,即不同角色收敛到同质化行为。核心涉及LLM Agents和Multi-agent Systems,因此这两个关键词得高分。其他关键词如LLM本身也相关,但论文未涉及MoE、SLM、Scaling Laws等具体技术,故得0分。


!!! tip deepseek-chat TL;DR

该论文发现LLM在多智能体模拟中会出现角色崩溃,导致不同角色收敛到同质化行为,且高保真模型反而产生更刻板的群体。
摘要翻译

基于大型语言模型(LLMs)的应用,例如多智能体模拟,要求智能体之间具有群体多样性。我们发现一种普遍存在的失败模式,并将其命名为人格坍缩(Persona Collapse):每个智能体虽被分配了不同的画像,却仍收敛于狭窄的行为模式,从而产生同质化的模拟群体。为量化人格坍缩,我们提出一个框架,用于衡量群体占据的人格空间大小(覆盖率,Coverage)、智能体在该空间中的分布均匀程度(均匀性,Uniformity)以及由此产生的行为模式的丰富程度(复杂性,Complexity)。通过在人格模拟(BFI-44)、道德推理和自我介绍的场景中对十种LLM进行评估,我们观察到人格坍缩沿两个轴线发生:(1)维度:一个模型可能在某一维度上表现出多样性,却在另一维度上结构退化;(2)领域:同一模型可能在人格方面坍缩最严重,却在道德推理方面最具多样性。此外,项目层面的诊断揭示,行为变异追踪的是粗略的人口统计学刻板印象,而非每个画像中指定的细粒度个体差异。反直觉的是,在单画像保真度上表现最佳的模型,反而持续产生最刻板化的群体。我们公开了相关工具包和数据,以支持对LLM进行群体层面的评估。


摘要 (Abstract)

Applications based on large language models (LLMs), such as multi-agent simulations, require population diversity among agents. We identify a pervasive failure mode we term \emph{Persona Collapse}: agents each assigned a distinct profile nonetheless converge into a narrow behavioral mode, producing a homogeneous simulated population. To quantify persona collapse, we propose a framework that measures how much of the persona space a population occupies (Coverage), how evenly agents spread across it (Uniformity), and how rich the resulting behavioral patterns are (Complexity). Evaluating ten LLMs on personality simulation (BFI-44), moral reasoning, and self-introduction, we observe persona collapse along two axes: (1) Dimensions: a model can appear diverse on one axis yet structurally degenerate on another, and (2) Domains: the same model may collapse the most in personality yet be the most diverse in moral reasoning. Furthermore, item-level diagnostics reveal that behavioral variation tracks coarse demographic stereotypes rather than the fine-grained individual differences specified in each persona. Counter-intuitively, \textbf{the models achieving the highest per-persona fidelity consistently produce the most stereotyped populations}. We release our toolkit and data to support population-level evaluation of LLMs.


关键词: Persona Collapse, Homogenization, Large Language Models, Multi-agent Simulations, Population Diversity, Behavioral Stereotyping


103. ❌ Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling

作者: Parsa Ashrafi Fashi, Utkarsh Saxena, Mehdi Rezagholizadeh, Aref Jafari, Akash Haridas, Mingyu Yang, Vansh Bhatia, Guihong Li, Vikram Appia, Emad Barsoum 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24715v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.010.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.015.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.015.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究将预训练Transformer LLM通过upcycling转换为混合架构(HyLo),重点在于扩展上下文长度(32倍)和减少KV缓存内存(90%以上),涉及长上下文LLM、KV缓存压缩、线性注意力(MLA、Mamba2、Gated DeltaNet)以及后训练(staged long-context training和蒸馏)。因此,与’Large Language Models’、‘Context Window Extension’、‘KV Cache Compression’高度相关(15分),与’Pre-training’(upcycling涉及预训练模型重用)和’Post-training’(后训练阶段)相关(10分)。其他关键词如MoE、SLMs、Scaling Laws等不相关。


!!! tip deepseek-chat TL;DR

该论文提出HyLo,一种通过upcycling将预训练Transformer LLM转换为混合架构的方法,显著扩展上下文长度(32倍)并减少KV缓存内存(90%以上),在1B-3B规模上实现优于基线的长上下文性能。
摘要翻译

结合高效Transformer组件与线性序列建模模块的混合序列模型,是纯Transformer架构的一种有前景的替代方案,但大多数此类模型仍需从头预训练,因此无法复用现有的Transformer检查点。我们研究了“升级循环”(upcycling)这一实用路径,将预训练的Transformer大语言模型转化为混合架构,同时保持短上下文质量并提升长上下文能力。我们将解决方案命名为HyLo(HYbrid LOng-context):一种长上下文升级循环方案,结合了架构适配(采用高效Transformer模块)、多头潜在注意力(Multi-Head Latent Attention, MLA)与线性模块(Mamba2或Gated DeltaNet),并辅以分阶段长上下文训练与教师引导蒸馏以实现稳定优化。HyLo通过高效后训练将可用上下文长度扩展至原来的32倍,并将KV缓存内存减少超过90%,使得在我们的\texttt{vLLM}推理栈中可实现高达200万token的预填充与解码,而同等规模的Llama基线模型在超过6.4万上下文时即内存耗尽。在1B与3B规模设置下(基于Llama与Qwen的变体),HyLo在短上下文与长上下文任务中均表现出一致的强劲性能,并在RULER等长上下文评估中显著优于当前最先进的升级循环混合基线模型。值得注意的是,在相似规模下,仅用100亿token训练的HyLo-Qwen-1.7B在GSM8K、Lm-Harness常识推理及RULER-64K上的表现显著优于JetNemotron(基于4000亿token训练)。


摘要 (Abstract)

Hybrid sequence models that combine efficient Transformer components with linear sequence modeling blocks are a promising alternative to pure Transformers, but most are still pretrained from scratch and therefore fail to reuse existing Transformer checkpoints. We study upcycling as a practical path to convert pretrained Transformer LLMs into hybrid architectures while preserving short-context quality and improving long-context capability. We call our solution \emph{HyLo} (HYbrid LOng-context): a long-context upcycling recipe that combines architectural adaptation with efficient Transformer blocks, Multi-Head Latent Attention (MLA), and linear blocks (Mamba2 or Gated DeltaNet), together with staged long-context training and teacher-guided distillation for stable optimization. HyLo extends usable context length by up to $32\times$ through efficient post-training and reduces KV-cache memory by more than $90%$, enabling up to 2M-token prefill and decoding in our \texttt{vLLM} inference stack, while comparable Llama baselines run out of memory beyond 64K context. Across 1B- and 3B-scale settings (Llama- and Qwen-based variants), HyLo delivers consistently strong short- and long-context performance and significantly outperforms state-of-the-art upcycled hybrid baselines on long-context evaluations such as RULER. Notably, at similar scale, HyLo-Qwen-1.7B trained on only 10B tokens significantly outperforms JetNemotron (trained on 400B tokens) on GSM8K, Lm-Harness common sense reasoning and RULER-64K.


关键词: Long-Context Upcycling, Hybrid LLM, KV Cache Compression, Multi-Head Latent Attention, Mamba2, Gated DeltaNet, Post-training, Context Extension


104. ❌ Contextual Linear Activation Steering of Language Models

作者: Brandon Hsu, Daniel Beaglehole, Adityanarayanan Radhakrishnan, Mikhail Belkin 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24693v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.010.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出CLAS方法,动态调整线性激活强度以引导语言模型行为,核心涉及LLM激活引导(权重1.0,相关度15),与PEFT/LoRA比较(权重1.0,相关度10),并强调可解释性(权重1.0,相关度10)。其他关键词如MoE、预训练、RLHF等与论文无关。


!!! tip deepseek-chat TL;DR

该论文提出上下文线性激活引导(CLAS)方法,通过动态调整激活强度来更有效地引导大语言模型行为,在多个基准上优于标准线性引导,并与ReFT和LoRA性能相当或更优。
摘要翻译

线性激活引导是一种有效的方法,可用于激发大型语言模型的能力,并利用有限的标注数据使其行为专门化。尽管有效,现有方法通常对所有词元施加固定的引导强度,导致在不同输入提示下引导质量不一致。在本工作中,我们引入了上下文线性激活引导(Contextual Linear Activation Steering, CLAS),该方法能够根据上下文动态调整线性激活的引导强度。在十一个引导基准测试和四个模型家族中,该方法始终优于标准线性激活引导,并在有限标注数据场景下达到或超越ReFT与LoRA的性能。因此,我们提出CLAS作为一种可扩展、可解释且准确的方法,用于专门化和引导大型语言模型。


摘要 (Abstract)

Linear activation steering is a powerful approach for eliciting the capabilities of large language models and specializing their behavior using limited labeled data. While effective, existing methods often apply a fixed steering strength to all tokens, resulting in inconsistent steering quality across diverse input prompts. In this work, we introduce Contextual Linear Activation Steering (CLAS), a method that dynamically adapts linear activation steering to context-dependent steering strengths. Across eleven steering benchmarks and four model families, it consistently outperforms standard linear activation steering and matches or exceeds the performance of ReFT and LoRA in settings with limited labeled data. We therefore propose CLAS as a scalable, interpretable, and accurate method for specializing and steering large language models.


关键词: Contextual Linear Activation Steering, CLAS, Large Language Models, Activation Steering, Interpretability, Parameter-efficient Fine-tuning, LoRA


105. ❌ Looking for the Bottleneck in Fine-grained Temporal Relation Classification

作者: Hugo Sousa, Ricardo Campos, Alípio Jorge 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24620v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究细粒度时间关系分类,使用基于端点的时间间隔关系分类方法,不涉及大模型、深度学习或相关技术。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

论文提出了一种基于端点的时间间隔关系分类方法,在TempEval-3数据集上取得了新的最佳性能,达到70.1%的时间感知分数。
摘要翻译

时序关系分类是一项确定文本中时序实体对之间时序关系的任务。尽管自然语言处理领域近期取得了进展,时序关系分类仍然是一个相当大的挑战。早期尝试使用事件与时序表达之间的一套完整时序关系来构建此任务。然而,由于任务复杂性,数据集被逐步简化,导致近期方法聚焦于事件对之间的关系,且仅使用关系子集。在本研究中,我们重新审视了更广泛的目标,即通过考虑两个时间区间之间可能存在的全部关系集,对时序实体间的区间关系进行分类。所提出的方法“从点推断区间”(Interval from Point)首先对时序实体端点之间的点关系进行分类,随后将这些点关系解码为区间关系。在TempEval-3数据集上的评估表明,该方法能够产生有效结果,达到了70.1%的时序感知分数(temporal awareness score),在该基准测试中创下了新的最优水平。


摘要 (Abstract)

Temporal relation classification is the task of determining the temporal relation between pairs of temporal entities in a text. Despite recent advancements in natural language processing, temporal relation classification remains a considerable challenge. Early attempts framed this task using a comprehensive set of temporal relations between events and temporal expressions. However, due to the task complexity, datasets have been progressively simplified, leading recent approaches to focus on the relations between event pairs and to use only a subset of relations. In this work, we revisit the broader goal of classifying interval relations between temporal entities by considering the full set of relations that can hold between two time intervals. The proposed approach, Interval from Point, involves first classifying the point relations between the endpoints of the temporal entities and then decoding these point relations into an interval relation. Evaluation on the TempEval-3 dataset shows that this approach can yield effective results, achieving a temporal awareness score of $70.1$ percent, a new state-of-the-art on this benchmark.


关键词: temporal relation classification, interval relations, point relations, TempEval-3, fine-grained, natural language processing


106. ❌ Can LLMs Act as Historians? Evaluating Historical Research Capabilities of LLMs via the Chinese Imperial Examination

作者: Lirong Gao, Zeqing Wang, Yuyan Cai, Jiayi Deng, Yanmei Gu, Yiming Zhang, Jia Zhou, Yanfei Zhang, Junbo Zhao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24690v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.05.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.05.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要评估LLMs在历史研究中的能力,提出了ProHist-Bench基准,涉及复杂历史推理。与LLMs核心概念高度相关(15分),与Chain of Thought和System 2 Thinking有一定关联(各5分),因为历史推理需要多步推理和深度思考。其他关键词如MoE、SLMs、Scaling Laws等与论文内容无关。


!!! tip deepseek-chat TL;DR

论文通过中国科举考试基准ProHist-Bench评估LLMs的历史研究能力,发现即使最先进的模型在复杂历史推理任务上仍存在显著不足。
摘要翻译

尽管大语言模型(Large Language Models, LLMs)已日益辅助文本处理等历史学任务,但其在专业级历史推理方面的能力仍有待探索。现有基准测试主要评估基础知识广度或词汇理解,未能捕捉历史研究中至关重要的高阶技能,如证据推理。为填补这一空白,我们提出ProHist-Bench——一个以中国科举制度(Keju)为锚点的新型基准测试,该制度是横跨1300余年东亚政治、社会与思想史的全面缩影。通过深度跨学科合作,ProHist-Bench包含400道由专家精心设计的跨八个朝代的挑战性问题,并配有10,891条细粒度评估准则。通过对18个大语言模型的严格评估,我们揭示出显著的能力差距:即便最先进的模型在处理复杂历史研究问题时仍显吃力。我们希望ProHist-Bench能够推动领域特定推理型大语言模型的发展,促进计算历史学研究,并进一步发掘大语言模型的未开发潜力。我们已在https://github.com/inclusionAI/ABench/tree/main/ProHist-Bench发布ProHist-Bench。


摘要 (Abstract)

While Large Language Models (LLMs) have increasingly assisted in historical tasks such as text processing, their capacity for professional-level historical reasoning remains underexplored. Existing benchmarks primarily assess basic knowledge breadth or lexical understanding, failing to capture the higher-order skills, such as evidentiary reasoning,that are central to historical research. To fill this gap, we introduce ProHist-Bench, a novel benchmark anchored in the Chinese Imperial Examination (Keju) system, a comprehensive microcosm of East Asian political, social, and intellectual history spanning over 1,300 years. Developed through deep interdisciplinary collaboration, ProHist-Bench features 400 challenging, expert-curated questions across eight dynasties, accompanied by 10,891 fine-grained evaluation rubrics. Through a rigorous evaluation of 18 LLMs, we reveal a significant proficiency gap: even state-of-the-art LLMs struggle with complex historical research questions. We hope ProHist-Bench will facilitate the development of domain-specific reasoning LLMs, advance computational historical research, and further uncover the untapped potential of LLMs. We release ProHist-Bench at https://github.com/inclusionAI/ABench/tree/main/ProHist-Bench.


关键词: Large Language Models, Historical Reasoning, Benchmark, Chinese Imperial Examination, ProHist-Bench, Domain-specific Reasoning


107. ❌ Evaluation of Pose Estimation Systems for Sign Language Translation

作者: Catherine O’Brien, Gerard Sant, Mathias Müller, Sarah Ebling 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24609v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究手语翻译中的姿态估计系统,不涉及大模型、深度学习技术原理创新或AI for Science。所有关键词均与论文内容无关,因此相关度均为0。


!!! tip deepseek-chat TL;DR

该论文系统比较了多种姿态估计器在手语翻译中的性能,发现SDPose和Sapiens在翻译质量和鲁棒性上优于常用基线。
摘要翻译

许多手语翻译系统(SLT)基于姿态序列而非原始视频运行,以降低输入维度、提升可移植性并部分实现手语者的匿名化。姿态估计器的选择常被视为实现细节,系统默认使用广泛可用的工具,如MediaPipe Holistic或OpenPose。我们针对基于姿态的手语翻译系统,对姿态估计器进行了系统比较,涵盖了广泛使用的基线模型(MediaPipe Holistic、OpenPose)以及更新的全身/高容量模型(MMPose WholeBody、OpenPifPaf、AlphaPose、SDPose、Sapiens、SMPLest-X)。我们通过在RWTH-PHOENIX-Weather 2014数据集上训练一个受控的手语翻译流水线(仅改变姿态表示),并采用BLEU和BLEURT指标进行评估,量化了下游任务的影响。为解释翻译结果,我们利用Signsuisse数据集中更高分辨率的视频,分析了时间稳定性、手部关键点缺失以及对遮挡的鲁棒性。SDPose和Sapiens取得了最佳翻译性能(BLEU约11.5),优于常用的MediaPipe基线(BLEU约10)。在遮挡情况下,Sapiens在所有测试实例(15/15)中均正确,而OpenPifPaf几乎全部失败(1/15),且其翻译得分也最低。频繁缺失手部关键点的估计器与较低的BLEU/BLEURT分数相关。我们发布的代码不仅可用于复现实验,还显著降低了其他研究人员使用替代姿态估计器的门槛。


摘要 (Abstract)

Many sign language translation (SLT) systems operate on pose sequences instead of raw video to reduce input dimensionality, improve portability, and partially anonymize signers. The choice of pose estimator is often treated as an implementation detail, with systems defaulting to widely available tools such as MediaPipe Holistic or OpenPose. We present a systematic comparison of pose estimators for pose-based SLT, covering widely used baselines (MediaPipe Holistic, OpenPose) and newer whole-body/high-capacity models (MMPose WholeBody, OpenPifPaf, AlphaPose, SDPose, Sapiens, SMPLest-X). We quantify downstream impact by training a controlled SLT pipeline on RWTH-PHOENIX-Weather 2014 where only the pose representation varies, evaluating with BLEU and BLEURT. To contextualize translation outcomes, we analyze temporal stability, missing hand keypoints, and robustness to occlusion using higher-resolution videos from the Signsuisse dataset. SDPose and Sapiens achieve the best translation performance (BLEU ~11.5), outperforming the common MediaPipe baseline (BLEU ~10). In occlusion cases, Sapiens is correct in all tested instances (15/15), while OpenPifPaf fails in nearly all (1/15) and also yields the weakest translation scores. Estimators that frequently leave out hand keypoints are associated with lower BLEU/BLEURT. We release code that can be used not only to reproduce our experiments, but also considerably lowers the barrier for other researchers to use alternative pose estimators.


关键词: pose estimation, sign language translation, MediaPipe Holistic, OpenPose, SDPose, Sapiens, RWTH-PHOENIX-Weather 2014, BLEU


108. ❌ Generating Place-Based Compromises Between Two Points of View

作者: Sumanta Bhattacharyya, Francine Chen, Scott Carter, Yan-Ying Chen, Tatiana Lau, Nayeli Suseth Bravo, Monica P. Van, Kate Sieck, Charlene C. Wu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24536v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.05.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.08.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.08.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.08.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.05.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心使用LLM生成妥协方案,涉及LLM、CoT、对齐(通过人类偏好微调)、小模型训练,但未涉及MoE、Scaling Laws、RAG、Agent等。


!!! tip deepseek-chat TL;DR

该论文提出使用LLM生成两个对立观点的折中方案,通过外部共情相似性迭代反馈优于标准CoT,并利用人类偏好对齐训练小模型。
摘要翻译

大型语言模型(Large Language Models, LLMs)在学术领域表现出色,但在社交智能任务(如创造良好的折中方案)方面存在困难。本文提出了在两种对立观点之间生成共情中立折中方案的方法。我们首先使用Claude 3 Opus模型和包含2400组关于共享场所的对比观点的数据集,比较了四种不同的提示工程方法。通过一项50名参与者的研究,对生成的折中方案子集进行了可接受性评估。结果发现,生成两种观点之间折中方案的最佳方法,是利用折中方案与每种观点之间的外部共情相似性作为迭代反馈,其表现优于标准的思维链(Chain of Thought, CoT)推理。研究结果表明,共情中立性的使用提高了折中方案的可接受性。随后,通过基于边际的人类偏好对齐方法,利用生成的折中方案数据集训练了两个较小的基础模型,从而提高了效率,并消除了推理过程中对共情估计的需求。


摘要 (Abstract)

Large Language Models (LLMs) excel academically but struggle with social intelligence tasks, such as creating good compromises. In this paper, we present methods for generating empathically neutral compromises between two opposing viewpoints. We first compared four different prompt engineering methods using Claude 3 Opus and a dataset of 2,400 contrasting views on shared places. A subset of the gen erated compromises was evaluated for acceptability in a 50-participant study. We found that the best method for generating compromises between two views used external empathic similarity between a compromise and each viewpoint as iterative feedback, outperforming stan dard Chain of Thought (CoT) reasoning. The results indicate that the use of empathic neutrality improves the acceptability of compromises. The dataset of generated compromises was then used to train two smaller foundation models via margin-based alignment of human preferences, improving efficiency and removing the need for empathy estimation during inference.


关键词: Large Language Models, Chain of Thought, Alignment, Human Preferences, Compromise Generation, Empathic Neutrality, Small Foundation Models


109. ❌ MEG-RAG: Quantifying Multi-modal Evidence Grounding for Evidence Selection in RAG

作者: Xihang Wang, Zihan Wang, Chengkai Huang, Quan Z. Sheng, Lina Yao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24564v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.015.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是RAG(检索增强生成)在多模态场景下的改进,提出MEG指标和MEG-RAG框架,用于评估和优化检索证据的语义相关性。因此与’Retrieval-Augmented Generation’高度相关(15分),同时涉及’Large Language Models’(MLLMs)和’Hallucination Mitigation’(减轻幻觉),各得10分。其他关键词如MoE、SLM、Scaling Laws等均未涉及,得0分。


!!! tip deepseek-chat TL;DR

本文提出多模态证据基础(MEG)指标和MEG-RAG框架,通过语义锚定量化检索证据的贡献,以提升多模态RAG的准确性和一致性。
摘要翻译

多模态检索增强生成(Multimodal Retrieval-Augmented Generation, MRAG)解决了多模态大语言模型(Multimodal Large Language Models, MLLMs)的关键局限性,如幻觉和知识过时问题。然而,当前的MRAG系统难以区分检索到的多模态数据是真正支持答案的语义核心,还是仅提供表面上的相关性。现有评估指标通常依赖于基于位置的启发式置信度,这无法捕捉多模态实体的信息密度。为解决这一问题,我们提出多模态证据归因(Multi-modal Evidence Grounding, MEG),这是一种语义感知的评估指标,用于量化检索证据的贡献。与标准置信度度量不同,MEG利用语义确定性锚定(Semantic Certainty Anchoring),聚焦于承载高逆文档频率(IDF)信息的令牌,从而更好地捕捉答案的语义核心。基于MEG,我们进一步提出MEG-RAG框架,该框架训练一个多模态重排序器,使检索到的证据与真实答案的语义锚点对齐。通过优先考虑基于语义归因而非令牌概率分布的高价值内容,MEG-RAG提升了生成输出的准确性和多模态一致性。在M²RAG基准上的大量实验表明,MEG-RAG始终优于强基线模型,并在不同教师模型上展现出稳健的泛化能力。


摘要 (Abstract)

Multimodal Retrieval-Augmented Generation (MRAG) addresses key limitations of Multimodal Large Language Models (MLLMs), such as hallucination and outdated knowledge. However, current MRAG systems struggle to distinguish whether retrieved multimodal data truly supports the semantic core of an answer or merely provides superficial relevance. Existing metrics often rely on heuristic position-based confidence, which fails to capture the informational density of multimodal entities. To address this, we propose Multi-modal Evidence Grounding (MEG), a semantic-aware metric that quantifies the contribution of retrieved evidence. Unlike standard confidence measures, MEG utilizes Semantic Certainty Anchoring, focusing on high-IDF information-bearing tokens that better capture the semantic core of the answer. Building on MEG, we introduce MEG-RAG, a framework that trains a multimodal reranker to align retrieved evidence with the semantic anchors of the ground truth. By prioritizing high-value content based on semantic grounding rather than token probability distributions, MEG-RAG improves the accuracy and multimodal consistency of generated outputs. Extensive experiments on the M$^2$RAG benchmark show that MEG-RAG consistently outperforms strong baselines and demonstrates robust generalization across different teacher models.


关键词: Multimodal Retrieval-Augmented Generation, Evidence Grounding, Semantic Certainty Anchoring, Reranker, Hallucination Mitigation, MLLMs


110. ❌ A Survey on Split Learning for LLM Fine-Tuning: Models, Systems, and Privacy Optimizations

作者: Zihan Liu, Yizhen Wang, Rui Wang, Xiu Tang, Sai Wu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24468v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.015.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.010.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于LLM微调中的分割学习,核心涉及LLMs(15分)和PEFT(10分,因为分割学习是一种参数高效的微调方式),其他关键词如MoE、SLM、Scaling Laws等均未提及,故得0分。


!!! tip deepseek-chat TL;DR

该综述系统梳理了面向大语言模型微调的分割学习技术,从模型优化、系统效率和隐私保护三个维度分类比较现有工作,为资源受限场景下的安全协作微调提供指导。
摘要翻译

微调(fine-tuning)使大型语言模型(LLMs)能够应用于特定场景,但其高昂的计算成本往往使资源受限的组织难以企及。虽然云平台可以提供所需资源,但数据隐私问题使得与第三方共享敏感信息存在风险。一种有前景的解决方案是将拆分学习(split learning)应用于LLM微调,该方法将模型在客户端与服务器之间进行分割,通过交换中间数据实现协作式安全训练,从而使资源受限的参与者能够安全地适配LLM。有鉴于此,越来越多的研究致力于推进这一范式,引入了多种模型方法、系统优化以及针对拆分学习的隐私攻防技术。为了厘清该领域的发展方向,亟需一份全面的综述来分类、比较并评述这些多样化的方法。本文通过首次针对LLM微调中的拆分学习进行广泛综述,填补了这一空白。我们提出了一套统一且细粒度的训练流程,以识别关键操作组件,并从模型级优化、系统级效率与隐私保护三个核心维度对现有前沿工作进行了系统梳理。通过这一结构化的分类体系,我们为推进可扩展、鲁棒且安全的协作式LLM适配奠定了坚实基础。


摘要 (Abstract)

Fine-tuning unlocks large language models (LLMs) for specialized applications, but its high computational cost often puts it out of reach for resource-constrained organizations. While cloud platforms could provide the needed resources, data privacy concerns make sharing sensitive information with third parties risky. A promising solution is split learning for LLM fine-tuning, which divides the model between clients and a server, allowing collaborative and secure training through exchanged intermediate data, thus enabling resource-constrained participants to adapt LLMs safely. % In light of this, a growing body of literature has emerged to advance this paradigm, introducing varied model methods, system optimizations, and privacy defense-attack techniques for split learning. To bring clarity and direction to the field, a comprehensive survey is needed to classify, compare, and critique these diverse approaches. This paper fills the gap by presenting the first extensive survey dedicated to split learning for LLM fine-tuning. We propose a unified, fine-grained training pipeline to pinpoint key operational components and conduct a systematic review of state-of-the-art work across three core dimensions: model-level optimization, system-level efficiency, and privacy preservation. Through this structured taxonomy, we establish a foundation for advancing scalable, robust, and secure collaborative LLM adaptation.


关键词: Split Learning, LLM Fine-Tuning, Privacy Preservation, Model Optimization, System Efficiency, Collaborative Learning


111. ❌ Zero-shot Large Language Models for Automatic Readability Assessment

作者: Riley Grossman, Yi Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24470v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究使用大语言模型(LLMs)进行零样本自动可读性评估(ARA),核心是LLMs的应用,与关键词’Large Language Models’高度相关(15分)。其他关键词如MoE、SLMs、Scaling Laws、Pre-training等均未涉及,因此评分为0。论文未提及任何专家作者。


!!! tip deepseek-chat TL;DR

该论文提出了一种新的零样本提示方法,利用大语言模型进行自动可读性评估,并在14个数据集上优于先前方法,同时提出了结合可读性公式的LAURAE方法以提高鲁棒性。
摘要翻译

无监督自动可读性评估(ARA)方法具有重要的实践与研究价值(例如,确保医学或教育材料适合其目标受众)。本文提出了一种新的零样本提示方法用于ARA,并通过在14个多样化数据集(如不同文本长度和语言)上测试10种不同的开源大语言模型(LLMs)(例如不同规模和开发者),首次全面评估了将大语言模型作为无监督ARA方法的效果。研究结果表明,我们提出的提示方法在14个数据集中有13个优于先前方法。此外,我们提出了LAURAE,该方法结合了LLM与可读性公式得分,通过捕捉可读性的上下文特征和浅层特征(如句子长度)来提升鲁棒性。评估显示,LAURAE在不同语言、文本长度及技术语言含量下均稳健地优于先前方法。


摘要 (Abstract)

Unsupervised automatic readability assessment (ARA) methods have important practical and research applications (e.g., ensuring medical or educational materials are suitable for their target audiences). In this paper, we propose a new zero-shot prompting methodology for ARA and present the first comprehensive evaluation of using large language models (LLMs) as an unsupervised ARA method by testing 10 diverse open-source LLMs (e.g., different sizes and developers) on 14 diverse datasets (e.g., different text lengths and languages). Our findings show that our proposed prompting methodology outperforms prior methods on 13 of the 14 datasets. Furthermore, we propose LAURAE, which combines LLM and readability formula scores to improve robustness by capturing both contextual and shallow (e.g., sentence length) features of readability. Our evaluation demonstrates that LAURAE robustly outperforms prior methods across languages, text lengths, and amounts of technical language.


关键词: Zero-shot, Large Language Models, Automatic Readability Assessment, Prompting, Unsupervised, Readability Formula, LAURAE


112. ❌ SEARCH-R: Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator for Multi-hop Question Answering

作者: Yuqing Fu, Yimin Deng, Wanyu Wang, Yuhao Wang, Yejing Wang, Hongshi Liu, Yiqi Wang, Xiao Han, Maolin Wang, Guoshuai Zhao, Yi Chang, Xiangyu Zhao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24515v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.08.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.012.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.012.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出SEARCH-R框架,用于多跳问答。核心涉及LLM(微调Llama3.1-8B作为推理路径导航器)、RAG(依赖树检索)和CoT(子问题分解)。因此,LLMs、RAG、CoT相关度高。SFT相关(微调模型),但非核心。其他关键词如MoE、SLM等无关。


!!! tip deepseek-chat TL;DR

SEARCH-R通过端到端推理路径导航器和依赖树检索,解决了多跳问答中推理路径生成和知识检索的挑战,在三个数据集上验证了有效性。
摘要翻译

多跳问答(Multi-hop Question Answering, MHQA)旨在回答需要多步推理的问题。它面临两个关键挑战:针对复杂的用户查询生成正确的推理路径,以及在大型语言模型(LLMs)潜在局限性下准确检索关键知识。现有方法主要依赖基于提示的方法生成推理路径,并进一步结合传统的稀疏或稠密检索来产生最终答案。然而,推理路径的生成通常缺乏对生成过程的有效控制,从而导致推理偏离正确方向。同时,检索方法过度依赖知识匹配或相似度分数,而非评估信息的实际效用,导致检索到同质化或无用的信息。因此,我们提出了一种名为SEARCH-R的结构化实体感知检索与链式推理导航框架。具体而言,SEARCH-R训练了一个端到端的推理路径导航器,通过微调Llama3.1-8B模型,能够提供强大的子问题分解能力。此外,我们设计了一种新颖的基于依赖树的检索方法,以定量评估文档的信息贡献度。在三个具有挑战性的多跳数据集上进行的大量实验验证了所提框架的有效性。代码和数据集可在以下链接获取:https://github.com/Applied-Machine-Learning-Lab/ACL2026_SEARCH-R。


摘要 (Abstract)

Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential knowledge in the face of potential limitations in large language models (LLMs). Existing approaches primarily rely on prompt-based methods to generate reasoning paths, which are further combined with traditional sparse or dense retrieval to produce the final answer. However, the generation of reasoning paths commonly lacks effective control over the generative process, thus leading the reasoning astray. Meanwhile, the retrieval methods over-rely on knowledge matching or similarity scores rather than evaluating the practical utility of the information, resulting in retrieving homogeneous or non-useful information. Therefore, we propose a Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator framework named SEARCH-R. Specifically, SEARCH-R trains an end-to-end reasoning path navigator, which is able to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model. Moreover, a novel dependency tree-based retrieval is designed to evaluate the informational contribution of the document quantitatively. Extensive experiments on three challenging multi-hop datasets validate the effectiveness of the proposed framework. The code and dataset are available at: https://github.com/Applied-Machine-Learning-Lab/ACL2026_SEARCH-R.


关键词: Multi-hop Question Answering, Chain-of-Reasoning, Retrieval-Augmented Generation, Large Language Models, Fine-tuning, Dependency Tree Retrieval, Sub-question Decomposition


113. ❌ Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Style

作者: Connor Baumler, Calvin Bao, Huy Nghiem, Xinchen Yang, Marine Carpuat, Hal Daumé 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24444v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究用户对LLM生成文本进行后编辑以实现个人风格,核心涉及LLM应用(Large Language Models),但未涉及其他关键词如MoE、SLM、Scaling Laws、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我修正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习、AI for Science等。因此仅LLMs关键词得满分10分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文通过用户研究探讨后编辑LLM生成文本是否能有效融入个人风格,发现后编辑虽能增加风格相似性,但文本仍保留LLM痕迹,且存在感知与度量之间的差距。
摘要翻译

尽管大型语言模型(LLMs)在写作任务中的应用日益广泛,但当个人风格至关重要时,用户可能仍对依赖LLMs有所迟疑。对LLM生成的草稿或译文进行译后编辑是一种常见的协作式写作策略,但用户能否有效重塑LLM生成的文本以体现其个人风格,目前尚不明确。我们开展了一项预先注册的在线研究($n=81$),要求参与者对LLM生成的草稿进行译后编辑,完成那些个人风格对其具有重要意义的写作任务。基于嵌入式的风格相似度度量,我们发现译后编辑提高了文本与参与者独立写作风格之间的相似度,同时降低了其与完全由LLM生成文本的相似度。然而,与参与者的独立控制文本相比,译后编辑文本在风格上仍更接近LLM文本,且相较于独立撰写的人类文本,其风格多样性有所降低。我们还发现感知到的风格真实性与模型测量的风格相似度之间存在差距:尽管译后编辑文本仍可检测到LLM的风格痕迹,但通常被认为能够代表参与者的个人风格。


摘要 (Abstract)

Despite the growing use of large language models (LLMs) for writing tasks, users may hesitate to rely on LLMs when personal style is important. Post-editing LLM-generated drafts or translations is a common collaborative writing strategy, but it remains unclear whether users can effectively reshape LLM-generated text to reflect their personal style. We conduct a pre-registered online study ($n=81$) in which participants post-edit LLM-generated drafts for writing tasks where personal style matters to them. Using embedding-based style similarity metrics, we find that post-editing increases stylistic similarity to participants’ unassisted writing and reduces similarity to fully LLM-generated output. However, post-edited text still remains stylistically closer in style to LLM text than to participants’ unassisted control text, and it exhibits reduced stylistic diversity compared to unassisted human text. We find a gap between perceived stylistic authenticity and model-measured stylistic similarity, with post-edited text often perceived as representative of participants’ personal style despite remaining detectable LLM stylistic traces.


关键词: Large Language Models, Post-editing, Personal Style, Stylistic Similarity, User Study, Human-LLM Collaboration


114. ❌ A Multi-Dimensional Audit of Politically Aligned Large Language Models

作者: Lisa Korver, Mohamed Mostagir, Sherief Reda 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24429v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.015.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.05.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM的政治对齐,涉及对齐(Alignment)和微调(Fine-tuning),与’Instruction Tuning OR Alignment OR Value Alignment’高度相关(15分);‘Post-training OR Supervised Fine-tuning OR SFT’相关(10分),因为使用了微调技术;‘Hallucination Mitigation OR Factuality OR Truthfulness’相关(10分),因为评估了真实性;‘Chain of Thought OR CoT Reasoning OR Multi-step Reasoning’略有涉及(5分),因为提到了推理任务性能下降;‘Large Language Models OR LLMs OR Foundation Models’是核心(15分)。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出一个多维度框架审计政治对齐的LLM,发现较大模型在角色扮演政治意识形态时更有效但更不公正,微调模型偏见较低但推理性能下降且幻觉增加。
摘要翻译

随着大型语言模型(Large Language Models, LLMs)在各行各业的应用日益广泛,人们对其被滥用的潜在风险愈发担忧,尤其是在政治话语等敏感领域。通过提示工程(prompt engineering)或微调(fine-tuning)技术,刻意使LLMs与特定政治意识形态对齐,在政治竞选等应用场景中可能具有优势,但由于性能下降、信息失真或偏见行为加剧的风险更高,因此需要谨慎考量。本研究受哈贝马斯交往行为理论(Theory of Communicative Action)启发,提出一个多维度框架,从有效性(effectiveness)、公平性(fairness)、真实性(truthfulness)和说服力(persuasiveness)四个维度,利用自动化定量指标对政治对齐的语言模型进行审计。将该框架应用于九个通过微调或角色扮演(role-playing)实现对齐的流行LLMs,结果揭示了一致的权衡关系:虽然较大的模型在角色扮演政治意识形态方面往往更有效,且其回答更具真实性,但它们的公平性却更差,对不同意识形态的人群表现出更高程度的愤怒和攻击性语言形式的偏见。与相应的角色扮演模型相比,微调模型表现出更低的偏见和更有效的对齐,但在推理任务上的性能有所下降,且幻觉(hallucinations)现象增加。总体而言,所有被测试的模型在四个指标中至少有一个存在缺陷,这凸显了制定更均衡、更稳健的对齐策略的必要性。最终,本研究旨在确保政治对齐的LLMs生成合法、无害的论点,为评估这些模型负责任的政治对齐提供框架。


摘要 (Abstract)

As the application of Large Language Models (LLMs) spreads across various industries, there are increasing concerns about the potential for their misuse, especially in sensitive areas such as political discourse. Deliberately aligning LLMs with specific political ideologies, through prompt engineering or fine-tuning techniques, can be advantageous in use cases such as political campaigns, but requires careful consideration due to heightened risks of performance degradation, misinformation, or increased biased behavior. In this work, we propose a multi-dimensional framework inspired by Habermas’ Theory of Communicative Action to audit politically aligned language models across four dimensions: effectiveness, fairness, truthfulness, and persuasiveness using automated, quantitative metrics. Applying this to nine popular LLMs aligned via fine-tuning or role-playing revealed consistent trade-offs: while larger models tend to be more effective at role-playing political ideologies and truthful in their responses, they were also less fair, exhibiting higher levels of bias in the form of angry and toxic language towards people of different ideologies. Fine-tuned models exhibited lower bias and more effective alignment than the corresponding role-playing models, but also saw a decline in performance reasoning tasks and an increase in hallucinations. Overall, all of the models tested exhibited some deficiency in at least one of the four metrics, highlighting the need for more balanced and robust alignment strategies. Ultimately, this work aims to ensure politically-aligned LLMs generate legitimate, harmless arguments, offering a framework to evaluate the responsible political alignment of these models.


关键词: Large Language Models, Political Alignment, Fine-tuning, Role-playing, Bias, Truthfulness, Fairness, Audit Framework


115. ❌ Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency

作者: Yiran Huang, Lukas Thede, Massimiliano Mancini, Wenjia Xu, Zeynep Akata 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24380v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.08.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.02.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.05.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.010.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究大型视觉语言模型(LVLMs)的结构化剪枝,核心是模型压缩和恢复训练。与’Large Language Models’高度相关(10分),因为LVLMs包含LLM骨干;与’Small Language Models’相关(8分),因为压缩目标是在资源受限设备上部署;与’Post-training/Supervised Fine-tuning’高度相关(10分),因为使用SFT和知识蒸馏进行恢复训练;与’Quantization/Model Compression’高度相关(10分),因为结构化剪枝是模型压缩技术;与’PEFT/LoRA’部分相关(5分),因为涉及轻量级恢复训练;与’Pre-training’弱相关(2分),因为提及从小的语言模型训练但非重点。其他关键词不相关。


!!! tip deepseek-chat TL;DR

本文系统研究了大型视觉语言模型的结构化剪枝方法,包括层剪枝和宽度剪枝,并发现宽度剪枝在低资源场景下表现更好,结合监督微调和隐藏状态蒸馏可在仅使用5%数据时恢复95%以上性能。
摘要翻译

尽管大型视觉语言模型(Large Vision Language Models, LVLMs)展现出令人瞩目的能力,但其巨大的计算和内存需求给资源受限的边缘设备部署带来了挑战。当前的参数缩减技术主要涉及从小型语言模型训练LVLMs,但这些方法灵活性有限且计算强度依然较高。我们研究了一条互补路径:通过对语言模型主干应用结构化剪枝,再辅以轻量级恢复训练,来压缩现有LVLMs。具体而言,我们探究了两种结构化剪枝范式:逐层剪枝(layerwise pruning)和逐宽度剪枝(widthwise pruning),并将它们与监督微调(supervised finetuning)以及对logits和隐藏状态的知识蒸馏(knowledge distillation)相结合。此外,我们评估了仅使用一小部分可用数据进行恢复训练的可行性。我们的结果表明,在计算资源有限或微调数据不足的低资源场景下,逐宽度剪枝通常能保持更好的性能。对于恢复训练而言,在较小压缩程度下,仅微调多模态投影器(multimodal projector)便已足够。此外,监督微调与隐藏状态蒸馏(hidden-state distillation)的结合能在各种剪枝程度下实现最优恢复。值得注意的是,仅使用原始数据的5%即可实现有效恢复,同时保留超过95%的原始性能。通过对三个代表性LVLM系列(参数规模从3B到7B)的实证研究,本研究为从业者在不依赖大量计算资源或充足数据的情况下压缩LVLMs提供了切实可行的见解。代码库可在https://github.com/YiranHuangIrene/VLMCompression.git获取。


摘要 (Abstract)

While Large Vision Language Models (LVLMs) demonstrate impressive capabilities, their substantial computational and memory requirements pose deployment challenges on resource-constrained edge devices. Current parameter reduction techniques primarily involve training LVLMs from small language models, but these methods offer limited flexibility and remain computationally intensive. We study a complementary route: compressing existing LVLMs by applying structured pruning to the language model backbone, followed by lightweight recovery training. Specifically, we investigate two structural pruning paradigms: layerwise and widthwise pruning, and pair them with supervised finetuning and knowledge distillation on logits and hidden states. Additionally, we assess the feasibility of conducting recovery training with only a small fraction of the available data. Our results show that widthwise pruning generally maintains better performance in low-resource scenarios, where computational resources are limited or there is insufficient finetuning data. As for the recovery training, finetuning only the multimodal projector is sufficient at small compression levels. Furthermore, a combination of supervised finetuning and hidden-state distillation yields optimal recovery across various pruning levels. Notably, effective recovery can be achieved using just 5% of the original data, while retaining over 95% of the original performance. Through empirical study on three representative LVLM families ranging from 3B to 7B parameters, this study offers actionable insights for practitioners to compress LVLMs without extensive computation resources or sufficient data. The code base is available at https://github.com/YiranHuangIrene/VLMCompression.git.


关键词: Structured Pruning, Large Vision Language Models, Model Compression, Supervised Fine-tuning, Knowledge Distillation, Data Efficiency, Edge Deployment


116. ❌ Learning Evidence of Depression Symptoms via Prompt Induction

作者: Eliseo Bao, Anxo Perez, David Otero, Javier Parapar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24376v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.08.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文主要研究利用大语言模型(LLMs)进行抑郁症症状证据的句子级分类,提出了Symptom Induction方法,通过压缩标注示例为简短指南来改善分类。与关键词’Large Language Models’相关度高(8分),因为核心使用LLMs;与’In-context Learning’相关(8分),因为方法涉及从示例中学习;与’AI for Science’相关(8分),因为应用于心理健康领域。其他关键词如MoE、SLM等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出Symptom Induction方法,通过压缩标注示例为可解释指南,利用大语言模型进行抑郁症症状证据的句子级分类,在BDI-Sen数据集上取得最佳性能,并跨领域泛化。
摘要翻译

抑郁症对心理健康服务造成了巨大压力,而许多人在临床环境之外通过大量用户生成文本(如在线论坛和社交媒体)描述其经历。因此,自动识别此类文本中的临床症状证据,可补充有限的临床能力并扩展至大规模人群。我们通过基于BDI-II问卷中21项抑郁症状的句子级分类来应对这一需求,使用了标注症状相关性的数据集BDI-Sen。该任务具有细粒度且高度不平衡的特点,我们发现常见的LLM方法(零样本、上下文学习和微调)难以对大多数症状应用一致的相关性标准。我们提出症状归纳(Symptom Induction, SI),这是一种新颖的方法,它将标注示例压缩为简短、可解释的指南,明确每项症状的证据标准,并利用这些指南来约束分类。在四个LLM系列和八个模型中,SI在BDI-Sen上取得了最佳的整体加权F1分数,尤其在低频症状上提升显著。在外部数据集上的跨领域评估进一步表明,所归纳的指南可泛化至其他具有共享症状学的疾病(双相情感障碍和进食障碍)。


摘要 (Abstract)

Depression places substantial pressure on mental health services, and many people describe their experiences outside clinical settings in high-volume user-generated text (e.g., online forums and social media). Automatically identifying clinical symptom evidence in such text can therefore complement limited clinical capacity and scale to large populations. We address this need through sentence-level classification of 21 depression symptoms from the BDI-II questionnaire, using BDI-Sen, a dataset annotated for symptom relevance. This task is fine-grained and highly imbalanced, and we find that common LLM approaches (zero-shot, in-context learning, and fine-tuning) struggle to apply consistent relevance criteria for most symptoms. We propose Symptom Induction (SI), a novel approach which compresses labeled examples into short, interpretable guidelines that specify what counts as evidence for each symptom and uses these guidelines to condition classification. Across four LLM families and eight models, SI achieves the best overall weighted F1 on BDI-Sen, with especially large gains for infrequent symptoms. Cross-domain evaluation on an external dataset further shows that induced guidelines generalize across other diseases shared symptomatology (bipolar and eating disorders).


关键词: Depression symptom detection, Large Language Models, Prompt induction, Sentence-level classification, BDI-II, Mental health, User-generated text


117. ❌ MIPIC: Matryoshka Representation Learning via Self-Distilled Intra-Relational and Progressive Information Chaining

作者: Phung Gia Huy, Hai An Vu, Minh-Phuc Truong, Thang Duc Tran, Linh Ngo Van, Thanh Hong Nguyen, Trung Le 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24374v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文专注于Matryoshka表示学习(MRL),提出MIPIC框架,通过自蒸馏和渐进信息链接改进嵌套嵌入的质量。研究内容涉及表示学习、自蒸馏、跨维度对齐等,与给定的关键词(如大模型、MoE、RLHF等)均无直接关联。虽然使用了Transformer模型(如TinyBERT, BGEM3, Qwen3),但核心创新不在大模型技术本身,而是通用的表示学习方法。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出MIPIC框架,通过自蒸馏的跨维度对齐和渐进信息链接,生成结构一致且语义紧凑的Matryoshka表示,在多个NLP基准上取得优异性能。
摘要翻译

表示学习是自然语言处理(NLP)的基础,但在不同计算预算下构建高效嵌入具有挑战性。俄罗斯套娃表示学习(MRL)通过嵌套嵌入提供了一种灵活的推理范式;然而,学习此类结构需要明确协调信息在嵌入维度和模型深度之间的组织方式。在本工作中,我们提出MIPIC(基于自蒸馏内部关系对齐与渐进信息链的俄罗斯套娃表示学习),这是一个统一的训练框架,旨在生成结构一致且语义紧凑的俄罗斯套娃表示。MIPIC通过自蒸馏内部关系对齐(SIA)促进跨维度结构一致性,该机制利用top-k CKA自蒸馏对齐完整表示与截断表示之间的词元级几何关系和注意力驱动关系。作为补充,它通过渐进信息链(PIC)实现深度维度的语义整合,这是一种渐进式对齐策略,将成熟的任务语义从深层逐步迁移至浅层。在STS、NLI及分类基准(涵盖从TinyBERT到BGEM3、Qwen3的模型)上的大量实验表明,MIPIC生成的俄罗斯套娃表示在所有容量下均具有高度竞争力,并在极端低维条件下展现出显著的性能优势。


摘要 (Abstract)

Representation learning is fundamental to NLP, but building embeddings that work well at different computational budgets is challenging. Matryoshka Representation Learning (MRL) offers a flexible inference paradigm through nested embeddings; however, learning such structures requires explicit coordination of how information is arranged across embedding dimensionality and model depth. In this work, we propose MIPIC (Matryoshka Representation Learning via Self-Distilled Intra-Relational Alignment and Progressive Information Chaining), a unified training framework designed to produce structurally coherent and semantically compact Matryoshka representations. MIPIC promotes cross-dimensional structural consistency through Self-Distilled Intra-Relational Alignment (SIA), which aligns token-level geometric and attention-driven relations between full and truncated representations using top-k CKA self-distillation. Complementarily, it enables depth-wise semantic consolidation via Progressive Information Chaining (PIC), a scaffolded alignment strategy that incrementally transfers mature task semantics from deeper layers into earlier layers. Extensive experiments on STS, NLI, and classification benchmarks (spanning models from TinyBERT to BGEM3, Qwen3) demonstrate that MIPIC yields Matryoshka representations that are highly competitive across all capacities, with significant performance advantages observed under extreme low-dimensional.


关键词: Matryoshka Representation Learning, Self-Distillation, Progressive Information Chaining, Cross-dimensional Alignment, Nested Embeddings, Representation Learning


118. ❌ Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation

作者: Zekun Yuan, Yangfan Ye, Xiaocheng Feng, Baohang Li, Qichen Hong, Yunfei Lu, Dandan Tu, Bing Qin 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24361v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究大语言模型在文化感知机器翻译中的表现,构建了文化感知数据集和评估框架。核心关键词是Large Language Models(10分),因为LLMs是论文的核心研究对象。其他关键词如RAG、CoT、RLHF等均未涉及,因此评分为0。论文属于LLM应用,但未涉及技术原理创新,故总分较低。


!!! tip deepseek-chat TL;DR

该论文构建了文化感知机器翻译数据集CanMT和评估框架,系统评估了多种大语言模型在文化翻译上的表现,发现模型间存在显著差异且翻译策略影响模型行为。
摘要翻译

大型语言模型(LLMs)在通用机器翻译中已取得强劲性能,但其在文化感知场景下的能力仍鲜为人知。为填补这一空白,我们提出CanMT——一个面向机器翻译的文化感知小说驱动平行数据集,并配套构建了具有理论依据的多维度文化翻译质量评估框架。借助CanMT,我们在不同翻译策略约束下系统评估了多种LLMs与翻译系统。研究结果揭示了模型间显著的性能差异,并表明翻译策略对模型行为具有系统性影响。进一步分析显示,不同文化专有项类型的翻译难度存在差异,且模型对文化专有知识的识别能力与其在翻译输出中正确运用该知识的能力之间仍存在持续差距。此外,引入参考译文可显著提升以LLM作为评判者的评估可靠性,凸显了参考译文在评估文化感知翻译质量中的关键作用。语料库与代码已发布于CanMT。


摘要 (Abstract)

Large language models (LLMs) have achieved strong performance in general machine translation, yet their ability in culture-aware scenarios remains poorly understood. To bridge this gap, we introduce CanMT, a Culture-Aware Novel-Driven Parallel Dataset for Machine Translation, together with a theoretically grounded, multi-dimensional evaluation framework for assessing cultural translation quality. Leveraging CanMT, we systematically evaluate a wide range of LLMs and translation systems under different translation strategy constraints. Our findings reveal substantial performance disparities across models and demonstrate that translation strategies exert a systematic influence on model behavior. Further analysis shows that translation difficulty varies across types of culture-specific items, and that a persistent gap remains between models’ recognition of culture-specific knowledge and their ability to correctly operationalize it in translation outputs. In addition, incorporating reference translations is shown to substantially improve evaluation reliability in LLM-as-a-judge, underscoring their essential role in assessing culture-aware translation quality. The corpus and code are available at CanMT.


关键词: Large Language Models, Machine Translation, Culture-Aware, Benchmarking, Evaluation Framework, CanMT


119. ❌ OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents

作者: Zheng Wu, Yi Hua, Zhaoyuan Huang, Chenhao Xue, Yijie Lu, Pengzhou Cheng, Zongru Wu, Lingzhong Dong, Gongshen Liu, Xinghao Jiang, Zhuosheng Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24348v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.05.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.05.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于多模态大语言模型(MLLMs)驱动的OS智能体的评估,核心涉及LLM Agents(10分)和Tool Use(5分,因为OS智能体涉及GUI操作和工具调用),以及Hallucination Mitigation(5分,因为评估包含安全性和鲁棒性,与幻觉缓解相关)。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

该论文提出了OS-SPEAR工具包,用于系统评估OS智能体在安全性、性能、效率和鲁棒性四个维度的表现,并通过对22个流行OS智能体的实验揭示了效率与安全/鲁棒性之间的权衡以及专用智能体的性能优势。
摘要翻译

多模态大语言模型(Multimodal Large Language Models, MLLMs)的演进已将研究焦点从文本生成转向主动行为执行,特别是通过操作系统智能体(OS agents)在复杂图形用户界面(GUI)中的导航。然而,这些智能体要成为值得信赖的日常伙伴,仍受限于其在安全性、效率及多模态鲁棒性方面缺乏严格评估。现有基准测试存在安全场景狭窄、轨迹标注噪声大以及鲁棒性指标有限等问题。为弥补这一不足,我们提出OS-SPEAR,一个用于从四个维度(安全性、性能、效率与鲁棒性)系统分析操作系统智能体的综合工具包。OS-SPEAR引入了四个专门子集:(1)安全性(S-)子集,涵盖多种环境与人为引发的危害;(2)性能(P-)子集,通过轨迹价值估计与分层抽样进行筛选;(3)效率(E-)子集,从时间延迟与令牌消耗双重角度量化性能;(4)鲁棒性(R-)子集,对视觉与文本输入施加跨模态扰动。此外,我们提供自动化分析工具以生成人类可读的诊断报告。我们利用OS-SPEAR对22种主流操作系统智能体进行了广泛评估。实证结果揭示了当前领域的关键洞见:尤其值得注意的是,效率与安全性或鲁棒性之间存在普遍权衡,专用智能体在性能上优于通用模型,以及不同模态间存在各异的鲁棒性脆弱点。通过提供多维度排名与标准化评估框架,OS-SPEAR为开发下一代可靠且高效的操作系统智能体奠定了基石。数据集与代码已发布于https://github.com/Wuzheng02/OS-SPEAR。


摘要 (Abstract)

The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS agents navigating complex GUIs. However, the transition of these agents into trustworthy daily partners is hindered by a lack of rigorous evaluation regarding safety, efficiency, and multi-modal robustness. Current benchmarks suffer from narrow safety scenarios, noisy trajectory labeling, and limited robustness metrics. To bridge this gap, we propose OS-SPEAR, a comprehensive toolkit for the systematic analysis of OS agents across four dimensions: Safety, Performance, Efficiency, and Robustness. OS-SPEAR introduces four specialized subsets: (1) a S(afety)-subset encompassing diverse environment- and human-induced hazards; (2) a P(erformance)-subset curated via trajectory value estimation and stratified sampling; (3) an E(fficiency)-subset quantifying performance through the dual lenses of temporal latency and token consumption; and (4) a R(obustness)-subset that applies cross-modal disturbances to both visual and textual inputs. Additionally, we provide an automated analysis tool to generate human-readable diagnostic reports. We conduct an extensive evaluation of 22 popular OS agents using OS-SPEAR. Our empirical results reveal critical insights into the current landscape: notably, a prevalent trade-off between efficiency and safety or robustness, the performance superiority of specialized agents over general-purpose models, and varying robustness vulnerabilities across different modalities. By providing a multidimensional ranking and a standardized evaluation framework, OS-SPEAR offers a foundational resource for developing the next generation of reliable and efficient OS agents. The dataset and codes are available at https://github.com/Wuzheng02/OS-SPEAR.


关键词: Multimodal Large Language Models, OS Agents, Safety Evaluation, Robustness, Efficiency, Benchmark, GUI Navigation


120. ❌ Reducing Redundancy in Retrieval-Augmented Generation through Chunk Filtering

作者: Daria Berdyugina, Anaëlle Cohen, Yohann Rioual 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24334v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.015.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究RAG中的冗余问题,提出基于实体过滤的chunk过滤策略,与’Retrieval-Augmented Generation’高度相关(15分)。其他关键词如LLMs、MoE等均未涉及,故评0分。


!!! tip deepseek-chat TL;DR

该论文研究RAG中分块冗余问题,提出实体过滤方法可减少25%-36%的向量索引大小,同时保持高检索质量。
摘要翻译

标准检索增强生成(RAG)分块方法常常产生过多冗余,从而增加存储成本并降低检索速度。本研究探索了基于语义、主题和命名实体的分块过滤策略,旨在缩减索引语料库的同时保持检索质量。实验在多个语料库上进行,并采用基于令牌(token)的评估框架,以精确率(precision)、召回率(recall)和交并比(intersection-over-union)指标衡量检索性能。结果表明,基于实体的过滤可将向量索引大小减少约25%至36%,同时保持接近基线的高检索质量。这些发现表明,通过轻量级过滤可以有效减少分块过程中引入的冗余,从而提高RAG流水线中面向检索组件的效率。


摘要 (Abstract)

Standard Retrieval-Augmented Generation (RAG) chunking methods often create excessive redundancy, increasing storage costs and slowing retrieval. This study explores chunk filtering strategies, such as semantic, topic-based, and named-entity-based methods in order to reduce the indexed corpus while preserving retrieval quality. Experiments are conducted on multiple corpora. Retrieval performance is evaluated using a token-based framework based on precision, recall, and intersection-over-union metrics. Results indicate that entity-based filtering can reduce vector index size by approximately 25% to 36% while maintaining high retrieval quality close to the baseline. These findings suggest that redundancy introduced during chunking can be effectively reduced through lightweight filtering, improving the efficiency of retrieval-oriented components in RAG pipelines.


关键词: Retrieval-Augmented Generation, chunk filtering, redundancy reduction, entity-based filtering, vector index, retrieval quality


121. ❌ DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents

作者: Junshuo Zhang, Chengrui Huang, Feng Guo, Zihan Li, Ke Shi, Menghua Jiang, Jiguo Yu, Shuo Shang, Shen Gao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24320v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM智能体的并行探索策略,属于LLM Agents领域,与’LLM Agents’高度相关(15分)。同时使用SFT和RL进行训练,涉及’Post-training’(10分)。其他关键词如MoE、RAG、CoT等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出DPEPO算法,通过并行环境交互和强化学习提升LLM智能体的探索效率和任务成功率,在ALFWorld和ScienceWorld上达到SOTA。
摘要翻译

遵循“先推理后行动”顺序范式的大语言模型(LLM)智能体已在许多复杂任务中展现出卓越性能。然而,由于每步仅与单一环境交互,这些方法存在探索范围有限及环境理解不完整的问题。本文首先提出一种新范式,使智能体能够同时与多个环境交互并共享跨轨迹经验。基于该范式,我们进一步提出DPEPO——一种强化学习(RL)算法,鼓励智能体进行多样化并行探索。DPEPO包含两个阶段:初始监督微调(SFT)赋予基础并行推理与动作生成能力,随后进入具有分层奖励机制的强化学习阶段。我们设计了并行轨迹级成功奖励与两种步级奖励:多样化动作奖励与多样化状态转移奖励,这些奖励主动惩罚行为冗余并促进广泛探索。在ALFWorld与ScienceWorld上的大量实验表明,DPEPO在保持与强顺序基线方法相当效率的同时,取得了最先进(SOTA)的成功率。(代码见https://github.com/LePanda026/Code-for-DPEPO)


摘要 (Abstract)

Large language model (LLM) agents that follow the sequential “reason-then-act” paradigm have achieved superior performance in many complex tasks.However, these methods suffer from limited exploration and incomplete environmental understanding, as they interact with only a single environment per step. In this paper, we first introduce a novel paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences. Building upon this paradigm, we further propose DPEPO, a reinforcement learning (RL) algorithm that encourages the agent to perform diverse parallel exploration. There are two stages in DPEPO: initial supervised fine-tuning (SFT) imparts basic parallel reasoning and action generation, followed by reinforcement learning stage with a hierarchical reward scheme. We design a parallel trajectory-level success reward and two step-level rewards: Diverse Action Reward and Diverse State Transition Reward, which actively penalize behavioral redundancy and promote broad exploration. Extensive experiments on ALFWorld and ScienceWorld show that DPEPO achieves state-of-the-art (SOTA) success rates, while maintaining comparable efficiency to strong sequential baselines. (Code is available at https://github.com/LePanda026/Code-for-DPEPO)


关键词: LLM Agents, Parallel Exploration, Reinforcement Learning, Supervised Fine-tuning, Hierarchical Reward, ALFWorld, ScienceWorld


122. ❌ Differentiable Faithfulness Alignment for Cross-Model Circuit Transfer

作者: Shun Shao, Binxu Wang, Shay B. Cohen, Anna Korhonen, Yonatan Belinkov 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24302v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.05.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.010.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心是机械可解释性中的电路发现与跨模型迁移,使用可微分的忠实度对齐(DFA)方法将小模型电路信息迁移到大模型。与’Large Language Models’高度相关(10分),因为实验在Llama-3和Qwen-2.5上进行;与’Mechanistic Interpretability’高度相关(10分),因为这是论文主题;与’Scaling Laws’有一定关联(5分),因为讨论了源-目标模型规模差异对迁移效果的影响。其他关键词如MoE、SLM、预训练、微调、RAG、推理、Agent、量化、解码、幻觉、世界模型、模型合并、上下文学习、AI for Science等均不相关(0分)。


!!! tip deepseek-chat TL;DR

该论文提出可微分的忠实度对齐(DFA)框架,通过将小模型的电路重要性分数映射到大模型,实现跨模型电路迁移,实验表明在Llama-3 1B→3B上效果显著,但随架构差异增大而减弱。
摘要翻译

机制可解释性已使得定位语言模型中特定行为背后的电路成为可能,但现有方法成本高昂、模型特异性强,且难以扩展到更大规模的架构。我们提出可微分忠实性对齐(DFA),这是一个通过学习的可微分对齐将电路信息从较小源模型迁移到较大目标模型的框架。DFA将源模型的节点重要性分数投影到目标模型中,并通过软忠实性目标训练该映射,从而避免在目标模型上进行完整的电路发现。我们在Llama-3和Qwen-2.5上,跨越事实检索、多项选择推理和算术运算六项任务评估了DFA。最强结果出现在Llama-3 1B→3B上,其中对齐后的电路通常能与直接节点归因相竞争,且零样本迁移仍然有效。当源-目标模型差距较大时,恢复效果减弱,且在Qwen-2.5上显著降低,这表明随着架构和规模差异的增加,迁移变得更加困难。总体而言,DFA始终优于简单基线,并且在某些设置下,能够恢复出忠实性可与直接归因相媲美甚至更强的目标模型电路。这些结果表明,较小的模型可以为较大的模型提供有用的机制先验,同时揭示了节点级跨模型电路对齐的前景与局限。\footnote{代码见 https://github.com/jasonshaoshun/dfa-circuits。}


摘要 (Abstract)

Mechanistic interpretability has made it possible to localize circuits underlying specific behaviors in language models, but existing methods are expensive, model-specific, and difficult to scale to larger architectures. We introduce \textbf{Differentiable Faithfulness Alignment (DFA)}, a framework that transfers circuit information from a smaller source model to a larger target model through a learned differentiable alignment. DFA projects source-model node importance scores into the target model and trains this mapping with a soft faithfulness objective, avoiding full circuit discovery on the target model. We evaluate DFA on Llama-3 and Qwen-2.5 across six tasks spanning factual retrieval, multiple-choice reasoning, and arithmetic. The strongest results occur on Llama-3 $1$B$\rightarrow3$B, where aligned circuits are often competitive with direct node attribution and zero-shot transfer remains effective. Recovery weakens for larger source–target gaps and is substantially lower on Qwen-2.5, suggesting that transfer becomes harder as architectural and scaling differences increase. Overall, DFA consistently outperforms simple baselines and, in some settings, recovers target-model circuits with faithfulness comparable to or stronger than direct attribution. These results suggest that smaller models can provide useful mechanistic priors for larger ones, while highlighting both the promise and the limits of node-level cross-model circuit alignment.\footnote{Code is available at https://github.com/jasonshaoshun/dfa-circuits.


关键词: Mechanistic Interpretability, Circuit Transfer, Differentiable Faithfulness Alignment, Cross-Model Transfer, Node Importance, Llama-3, Qwen-2.5


123. ❌ IRIS: Interleaved Reinforcement with Incremental Staged Curriculum for Cross-Lingual Mathematical Reasoning

作者: Navya Gupta, Rishitej Reddy Vyalla, Avinash Anand, Chhavi Kirtani, Erik Cambria, Zhengchen Zhang, Zhengkui Wang, Timothy Liu, Aik Beng Ng, Simon See, Rajiv Ratn Shah 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24114v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.010.0/100.0
Instruction Tuning0.08.0/100.0
RLHF0.010.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.010.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于数学推理的课程学习与强化学习,涉及大语言模型(LLMs)的微调(SFT)和强化学习(GRPO),与’Large Language Models’、‘Post-training’、‘RLHF’(GRPO变体)、‘Chain of Thought’(逐步推理)高度相关。‘Instruction Tuning’部分相关(SFT阶段)。其他关键词如MoE、SLMs、RAG等均不涉及。


!!! tip deepseek-chat TL;DR

提出IRIS框架,结合增量阶段性课程监督微调和反向课程强化学习,提升跨语言数学推理能力,在低资源语言上表现显著。
摘要翻译

课程学习通过逐步增加任务难度,帮助语言模型处理复杂推理。然而,该方法往往难以生成一致的逐步推理过程,尤其在多语言和低资源场景下,从英语到印度语言的跨语言迁移效果仍然有限。我们提出IRIS:交错式强化与渐进阶段课程(Interleaved Reinforcement with Incremental Staged Curriculum),这是一个双轴框架,将针对渐进式难题的有监督微调(纵轴)与反向课程强化学习(横轴)相结合,以减少对逐步指导的依赖。我们设计了一种复合奖励机制,融合正确性、步骤对齐、连续性和数值激励,并通过组相对策略优化(Group Relative Policy Optimization, GRPO)进行优化。我们发布了CL-Math数据集,包含29k个问题及其在英语、印地语和马拉地语中的步骤级标注。在标准基准测试和自建多语言测试集上,IRIS持续提升性能,在数学推理任务上表现优异,在低资源和双语场景中取得显著提升,同时在资源丰富语言中也有适度改进。


摘要 (Abstract)

Curriculum learning helps language models tackle complex reasoning by gradually increasing task difficulty. However, it often fails to generate consistent step-by-step reasoning, especially in multilingual and low-resource settings where cross-lingual transfer from English to Indian languages remains limited. We propose IRIS: Interleaved Reinforcement with Incremental Staged Curriculum, a two-axis framework that combines Supervised Fine-Tuning on progressively harder problems (vertical axis) with Reverse Curriculum Reinforcement Learning to reduce reliance on step-by-step guidance (horizontal axis). We design a composite reward combining correctness, step-wise alignment, continuity, and numeric incentives, optimized via Group Relative Policy Optimization (GRPO). We release CL-Math, a dataset of 29k problems with step-level annotations in English, Hindi, and Marathi. Across standard benchmarks and curated multilingual test sets, IRIS consistently improves performance, with strong results on math reasoning tasks and substantial gains in low-resource and bilingual settings, alongside modest improvements in high-resource languages.


关键词: Curriculum Learning, Reinforcement Learning, Mathematical Reasoning, Cross-Lingual, Supervised Fine-Tuning, GRPO, Chain of Thought


124. ❌ Psychologically-Grounded Graph Modeling for Interpretable Depression Detection

作者: Rishitej Reddy Vyalla, Kritarth Prasad, Avinash Anand, Erik Cambria, Shaoxiong Ji, Faten S. Alamri, Zhengkui Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24126v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.02.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.08.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注抑郁症检测,使用图神经网络(PsyGAT)和心理学知识,而非大模型或深度学习技术原理创新。与’Mechanistic Interpretability’有一定关联(可解释性模块),但整体与评分关键词列表中的大模型技术、AI for Science等核心主题无关。LLMs仅作为对比基线,非核心。


!!! tip deepseek-chat TL;DR

该论文提出基于心理学的图注意力网络PsyGAT,通过动态时序图建模对话会话,实现可解释的抑郁症检测,并在DAIC-WoZ和E-DAIC数据集上取得最优性能。
摘要翻译

从对话交互中自动检测抑郁症在大规模筛查方面具有重要前景,但仍受限于数据严重匮乏及缺乏临床可解释性。现有方法通常依赖黑箱深度学习架构,难以建模抑郁症状细微的时间演变过程,也无法解释参与者特异性异质性。本文提出PsyGAT(心理图注意力网络),这是一个基于心理学理论的框架,将会话建模为动态时间图。我们引入心理表达单元(PEUs)以显式编码话语层面的临床证据,构建会话图结构以捕捉心理状态的转变,而非仅仅依赖语义依赖关系。为解决抑郁症数据集中严重的类别不平衡问题,我们采用经临床验证的基于人格的数据增强方法,实现鲁棒的模型学习。此外,我们将会话层面的人格上下文直接融入图结构,以区分基于特质的行为与急性抑郁症状。PsyGAT取得了最先进的性能,在DAIC-WoZ和E-DAIC数据集上分别达到89.99和71.37的Macro F1分数,超越了基于图的强基线模型以及GPT-5等闭源大语言模型。我们进一步引入可解释性模块Causal-PsyGAT,用于识别症状触发因素。实验表明,在识别因果指标方面,MRR提升了20%,有效弥合了抑郁症监测与临床可解释性之间的鸿沟。完整增强数据集已公开于https://doi.org/10.6084/m9.figshare.31801921。


摘要 (Abstract)

Automatic depression detection from conversational interactions holds significant promise for scalable screening but remains hindered by severe data scarcity and a lack of clinical interpretability. Existing approaches typically rely on black-box deep learning architectures that struggle to model the subtle, temporal evolution of depressive symptoms or account for participant-specific heterogeneity. In this work, we propose PsyGAT (Psychological Graph Attention Network), a psychologically grounded framework that models conversational sessions as dynamic temporal graphs. We introduce Psychological Expression Units (PEUs) to explicitly encode utterance-level clinical evidence, structuring the session graph to capture transitions in psychological states rather than mere semantic dependencies. To address the critical class imbalance in depression datasets, we employ clinically approved persona-based data augmentation, enable robust model learning. Additionally, we integrate session-level personality context directly into the graph structure to disentangle trait-based behavior from acute depressive symptoms. PsyGAT achieves state-of-the-art performance, surpassing both strong graph-based baselines and closed-source LLMs like GPT-5, achieving 89.99 and 71.37 Macro F1 scores in DAIC-WoZ and E-DAIC, respectively. We further introduce Causal-PsyGAT, an interpretability module that identifies symptom triggers. Experiments show a 20% improvement in MRR for identifying causal indicators, effectively bridging the gap between depression monitoring and clinical explainability. The full augmented dataset is publicly available at https://doi.org/10.6084/m9.figshare.31801921.


关键词: Depression Detection, Graph Attention Network, Psychological Expression Units, Interpretability, Data Augmentation, Personality Context, Causal-PsyGAT


125. ❌ BiMol-Diff: A Unified Diffusion Framework for Molecular Generation and Captioning

作者: Aditya Hemant Shahane, Anuj Kumar Sirohi, Devansh Arora, Nitin Kumar, Prathosh A P, Sandeep Kumar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24089v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注分子生成和描述,属于AI for Science(生物信息学/化学信息学)领域,与关键词’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。其他关键词如大模型、强化学习、推理等均未涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出BiMol-Diff,一个统一的扩散框架,通过令牌感知噪声调度实现文本条件分子生成和分子描述,在分子重建和描述任务上取得显著改进。
摘要翻译

桥接分子结构与自然语言对于可控设计至关重要。自回归模型在处理长程依赖关系时存在困难,而标准扩散过程则对所有位置施加均匀的噪声扰动,这可能会扭曲携带结构信息的标记。我们提出BiMol-Diff,一个用于文本条件分子生成与分子描述(molecule captioning)配对任务的统一扩散框架。其核心组件是一个基于标记感知的噪声调度策略(token-aware noise schedule),该策略根据标记恢复难度分配位置相关的噪声扰动,从而在前向过程中保留更难恢复的子结构。在ChEBI-20和M3-20M数据集上,BiMol-Diff在分子重建任务中实现了15.4%的精确匹配(Exact Match)相对提升,并在分子描述任务中取得了强劲结果,在对比基线中获得了最佳BLEU和BERTScore指标。这些结果表明,标记感知的噪声策略能够提升分子结构-语言建模的保真度。


摘要 (Abstract)

Bridging molecular structures and natural language is essential for controllable design. Autoregressive models struggle with long-range dependencies, while standard diffusion processes apply uniform corruption across positions, which can distort structurally informative tokens. We present BiMol-Diff, a unified diffusion framework for the paired tasks of text-conditioned molecule generation and molecule captioning. Our key component is a token-aware noise schedule that assigns position-dependent corruption based on token recovery difficulty, preserving harder-to-recover substructures during the forward process. On ChEBI-20 and M3-20M, BiMol-Diff improves molecule reconstruction with a 15.4% relative gain in Exact Match and achieves strong captioning results, attaining best BLEU and BERTScore among compared baselines. These results indicate token-aware noising improves fidelity in molecular structure-language modelling.


关键词: molecule generation, molecule captioning, diffusion framework, token-aware noise schedule, ChEBI-20, M3-20M, Exact Match, BLEU


126. ❌ Factual and Edit-Sensitive Graph-to-Sequence Generation via Graph-Aware Adaptive Noising

作者: Aditya Hemant Shahane, Anuj Kumar Sirohi, Tanmoy Chakraborty, Prathosh A P, Sandeep Kumar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24104v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.08.0/100.0

评分理由: 论文提出了一种非自回归扩散框架DLM4G用于图到序列生成,主要关注事实性和编辑敏感性,通过自适应噪声策略改进。与给定关键词列表相比,仅’AI for Science’相关,因为论文在分子描述任务上展示了应用,属于科学领域。其他关键词如大模型、微调、推理等均不相关,因为论文未涉及LLM、预训练、微调、推理等技术,而是专注于扩散模型和图结构。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于扩散模型的非自回归图到序列生成框架DLM4G,通过自适应噪声策略提升事实性和编辑敏感性,在多个数据集上优于强基线,并展示了在分子描述等科学任务上的应用。
摘要翻译

针对图到序列生成(G2S)任务,微调自回归模型常面临事实依据不足与编辑敏感性问题。为解决上述挑战,我们提出一种非自回归扩散框架——图扩散语言模型(DLM4G),该模型通过基于输入图的条件迭代精炼过程生成文本。通过将图组件(实体/关系)与对应序列令牌对齐,DLM4G采用自适应噪声策略。该策略利用逐令牌去噪误差作为信号,自适应调节实体与关系令牌上的噪声强度,从而提升图结构的保持能力,并支持图编辑场景下的局部更新。在三个数据集上的评估表明,DLM4G在表面形式与嵌入向量两类指标上均持续优于基于相同数据划分训练的竞争性G2S扩散基线模型。相较于规模大12倍的微调自回归基线(如T5-Large),DLM4G表现更优;与规模大127倍的零样本大语言模型(LLM)迁移基线相比亦具竞争力。相较于最强的微调预训练语言模型(PLM)基线,DLM4G在事实依据(FGT@0.5)与编辑敏感度(ESR)上分别提升5.16%与7.9%;相较于最优扩散基线,其在FGT@0.5与ESR上分别获得3.75%与23.6%的提升。此外,我们通过分子描述实验验证了该方法在文本图之外领域的适用性,表明该技术对科学G2S生成任务具有普适性。


摘要 (Abstract)

Fine-tuned autoregressive models for graph-to-sequence generation (G2S) often struggle with factual grounding and edit sensitivity. To tackle these issues, we propose a non-autoregressive diffusion framework that generates text by iterative refinement conditioned on an input graph, named as Diffusion Language Model for Graphs (DLM4G). By aligning graph components (entities/relations) with their corresponding sequence tokens, DLM4G employs an adaptive noising strategy. The proposed strategy uses per-token denoising error as a signal to adaptively modulate noise on entity and relation tokens, improving preservation of graph structure and enabling localized updates under graph edits. Evaluated on three datasets, DLM4G consistently outperforms competitive G2S diffusion baselines trained on identical splits across both surface-form and embedding-based metrics. DLM4G further exceeds fine-tuned autoregressive baselines up to 12x larger (e.g., T5-Large) and is competitive with zero-shot LLM transfer baselines up to 127x larger. Relative to the strongest fine-tuned PLM baseline, DLM4G improves factual grounding (FGT@0.5) by +5.16% and edit sensitivity (ESR) by +7.9%; compared to the best diffusion baseline, it yields gains of +3.75% in FGT@0.5 and +23.6% in ESR. We additionally demonstrate applicability beyond textual graphs through experiments on molecule captioning, indicating the method’s generality for scientific G2S generation.


关键词: Graph-to-Sequence Generation, Diffusion Language Model, Adaptive Noising, Factual Grounding, Edit Sensitivity, Non-autoregressive Generation, Molecule Captioning


127. ❌ How Sensitive Are Safety Benchmarks to Judge Configuration Choices?

作者: Xinran Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24074v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究安全基准测试中LLM法官配置(法官模型和提示词)对测量结果的影响,核心涉及LLM作为法官的使用,因此与’Large Language Models’高度相关(10分)。其他关键词如RLHF、PEFT、RAG等均未在摘要中提及,故评分为0。


!!! tip deepseek-chat TL;DR

该论文发现安全基准测试中LLM法官的提示词措辞会显著影响有害响应率的测量结果,变化幅度高达24.2个百分点,且模型安全排名不稳定,揭示了法官配置是安全基准测试中一个被忽视的测量方差来源。
摘要翻译

诸如HarmBench等安全基准测试依赖大语言模型(LLM)评判器将模型响应分类为有害或安全,然而评判器配置(即评判模型与评判提示的组合)通常被视为固定的实现细节。我们证明这一假设存在问题。通过采用2×2×3析因设计,我们沿评估结构与指令框架两个维度构建了12种评判提示变体,并使用单一评判模型Claude Sonnet 4-6对其进行应用,针对六个目标模型及400种HarmBench行为生成了28,812次评判。研究发现,在保持评判模型不变的情况下,仅提示措辞的差异即可使实测有害响应率产生高达24.2个百分点的偏移,而同一条件下的表层措辞调整甚至可导致高达20.1个百分点的波动。模型安全排名呈现中等程度的不稳定性,平均Kendall tau值为0.89,类别层面的敏感度范围从版权类的39.6个百分点到骚扰类的0个百分点不等。一项使用三种评判模型的补充多评判器实验表明,评判模型的选择会进一步增加方差。我们的研究结果表明,评判提示措辞是安全基准测试中一个此前未被充分审视的重要测量方差来源。


摘要 (Abstract)

Safety benchmarks such as HarmBench rely on LLM judges to classify model responses as harmful or safe, yet the judge configuration, namely the combination of judge model and judge prompt, is typically treated as a fixed implementation detail. We show this assumption is problematic. Using a 2 x 2 x 3 factorial design, we construct 12 judge prompt variants along two axes, evaluation structure and instruction framing, and apply them using a single judge model, Claude Sonnet 4-6, producing 28,812 judgments over six target models and 400 HarmBench behaviors. We find that prompt wording alone, holding the judge model fixed, shifts measured harmful-response rates by up to 24.2 percentage points, with even within-condition surface rewording causing swings of up to 20.1 percentage points. Model safety rankings are moderately unstable, with mean Kendall tau = 0.89, and category-level sensitivity ranges from 39.6 percentage points for copyright to 0 percentage points for harassment. A supplementary multi-judge experiment using three judge models shows that judge-model choice adds further variance. Our results demonstrate that judge prompt wording is a substantial, previously under-examined source of measurement variance in safety benchmarking.


关键词: safety benchmarks, LLM judges, judge configuration, prompt wording, measurement variance, HarmBench


128. ❌ PeeriScope: A Multi-Faceted Framework for Evaluating Peer Review Quality

作者: Sajad Ebrahimi, Soroush Sadeghian, Ali Ghorbanpour, Negar Arabzadeh, Sara Salamat, Seyed Mohammad Hosseini, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24071v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出PeeriScope框架,用于评估同行评审质量,主要使用LLM进行评分。与’Large Language Models’高度相关(8分),因为核心是使用LLM评估。其他关键词如RLHF、PEFT等均不相关,因为论文不涉及这些技术。论文属于AI应用,但非科学领域,故’AI for Science’得0分。


!!! tip deepseek-chat TL;DR

PeeriScope是一个模块化平台,通过集成结构化特征、基于rubric的LLM评估和监督预测,从多个维度评估同行评审质量。
摘要翻译

学术场所中同行评审的规模与变异性日益增长,这催生了对系统性、可解释且可扩展的评估工具以衡量评审质量的迫切需求。我们提出PeeriScope,一个模块化平台,它整合了结构化特征、基于量规的大语言模型评估以及监督式预测,能够从多个维度评价同行评审质量。该平台专为开放性与集成性设计,既提供公共界面,也提供文档化的应用程序编程接口(API),支持实际部署与研究扩展。本次演示展示了其在审稿人自我评估、编辑分类及大规模审计中的应用,并推动了科学同行评审领域内质量评估方法的持续发展。PeeriScope可通过在线演示(https://app.reviewer.ly/app/peeriscope)及API服务(https://github.com/Reviewerly-Inc/Peeriscope)获取。


摘要 (Abstract)

The increasing scale and variability of peer review in scholarly venues has created an urgent need for systematic, interpretable, and extensible tools to assess review quality. We present PeeriScope, a modular platform that integrates structured features, rubric-guided large language model assessments, and supervised prediction to evaluate peer review quality along multiple dimensions. Designed for openness and integration, PeeriScope provides both a public interface and a documented API, supporting practical deployment and research extensibility. The demonstration illustrates its use for reviewer self-assessment, editorial triage, and large-scale auditing, and it enables the continued development of quality evaluation methods within scientific peer review. PeeriScope is available both as a live demo at https://app.reviewer.ly/app/peeriscope and via API services at https://github.com/Reviewerly-Inc/Peeriscope.


关键词: Peer Review Quality, Large Language Models, Rubric-guided Assessment, Modular Platform, Supervised Prediction, Reviewer Self-assessment, Editorial Triage


129. ❌ Improving Robustness of Tabular Retrieval via Representational Stability

作者: Kushal Raj Bhandari, Adarsh Singh, Jianxi Gao, Soham Dan, Vivek Gupta 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24040v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.010.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究表格检索中的序列化敏感性问题,提出基于质心的表示稳定性方法。核心是检索增强生成(RAG)中的表格检索,因此与’Retrieval-Augmented Generation’高度相关(10分)。其他关键词如大模型、预训练、微调等均未涉及,得0分。


!!! tip deepseek-chat TL;DR

论文发现表格检索中不同序列化格式导致嵌入和检索结果不稳定,提出质心平均和残差瓶颈适配器来提升鲁棒性。
摘要翻译

基于Transformer的表格检索系统将结构化表格展平为令牌序列,这使得检索结果对序列化方式的选择高度敏感,即使表格语义保持不变。我们证明,语义等价的序列化格式(如$\texttt{csv}$、$\texttt{tsv}$、$\texttt{html}$、$\texttt{markdown}$和$\texttt{ddl}$)在多个基准测试和检索器家族中会产生显著不同的嵌入向量和检索结果。为解决这一不稳定性问题,我们将序列化嵌入视为共享语义信号的含噪视图,并以其质心作为规范目标表征。研究表明,当不同表格的格式引入的偏移量存在差异时,质心平均法能够抑制格式特异性变异,并恢复不同序列化方式共有的语义内容。实验表明,在$\texttt{MPNet}$、$\texttt{BGE-M3}$、$\texttt{ReasonIR}$和$\texttt{SPLADE}$的成对比较聚合中,质心表征的排序表现优于单一格式。我们进一步在冻结编码器之上引入轻量级残差瓶颈适配器,该适配器在保持方差并施加协方差正则化的同时,将单序列化嵌入映射至质心目标。该适配器提升了若干密集检索器的鲁棒性,但增益效果因模型而异,且对稀疏词汇检索的改善较弱。这些结果揭示了序列化敏感性是检索变异的主要来源,并展示了事后几何校正方法在实现序列化不变表格检索方面的潜力。我们的代码、数据集和模型已开源至$\href{https://github.com/KBhandari11/Centroid-Aligned-Table-Retrieval}{https://github.com/KBhandari11/Centroid-Aligned-Table-Retrieval}$。


摘要 (Abstract)

Transformer-based table retrieval systems flatten structured tables into token sequences, making retrieval sensitive to the choice of serialization even when table semantics remain unchanged. We show that semantically equivalent serializations, such as $\texttt{csv}$, $\texttt{tsv}$, $\texttt{html}$, $\texttt{markdown}$, and $\texttt{ddl}$, can produce substantially different embeddings and retrieval results across multiple benchmarks and retriever families. To address this instability, we treat serialization embedding as noisy views of a shared semantic signal and use its centroid as a canonical target representation. We show that centroid averaging suppresses format-specific variation and can recover the semantic content common to different serializations when format-induced shifts differ across tables. Empirically, centroid representations outrank individual formats in aggregate pairwise comparisons across $\texttt{MPNet}$, $\texttt{BGE-M3}$, $\texttt{ReasonIR}$, and $\texttt{SPLADE}$. We further introduce a lightweight residual bottleneck adapter on top of a frozen encoder that maps single-serialization embeddings towards centroid targets while preserving variance and enforcing covariance regularization. The adapter improves robustness for several dense retrievers, though gains are model-dependent and weaker for sparse lexical retrieval. These results identify serialization sensitivity as a major source of retrieval variance and show the promise of post hoc geometric correction for serialization-invariant table retrieval. Our code, datasets, and models are available at $\href{https://github.com/KBhandari11/Centroid-Aligned-Table-Retrieval}{https://github.com/KBhandari11/Centroid-Aligned-Table-Retrieval}$.


关键词: table retrieval, serialization sensitivity, centroid averaging, robustness, dense retrievers, representation stability


130. ❌ Distilling Self-Consistency into Verbal Confidence: A Pre-Registered Negative Result and Post-Hoc Rescue on Gemma 3 4B

作者: Jon-Paul Cacioli 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24070v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.05.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.05.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.08.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.05.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究将自一致性蒸馏为口头置信度,核心涉及LLM(Gemma 3 4B)的置信度校准,通过监督微调(SFT)和自一致性(self-consistency)来改善口头置信度。与’Large Language Models’高度相关(12分),因为使用LLM进行实验;与’Post-training OR Supervised Fine-tuning OR SFT’高度相关(10分),因为核心方法是置信度条件监督微调(CSFT);与’Self-Correction OR Self-Improvement OR Self-Reflection’相关(8分),因为自一致性是一种自我改进;与’Hallucination Mitigation OR Factuality OR Truthfulness’相关(8分),因为改善置信度校准有助于减少幻觉;与’Small Language Models OR SLMs OR On-device AI’部分相关(5分),因为模型规模较小(4B);与’Instruction Tuning OR Alignment OR Value Alignment’部分相关(5分),因为涉及对齐置信度;与’Mechanistic Interpretability OR Explainable AI’部分相关(5分),因为研究内部信息与口头输出之间的差距。其他关键词不相关。


!!! tip deepseek-chat TL;DR

该论文通过置信度条件监督微调(CSFT)将自一致性蒸馏为口头置信度,在Gemma 3 4B上取得负结果,但通过去除模态过滤器后,在TriviaQA上AUROC2达到0.774,优于logit熵,但仍是探索性结果。
摘要翻译

小型指令微调大语言模型在极简诱发条件下会产生退化的语言置信度:天花板比率超过95%,接近随机的二级AUROC,以及无效的效度剖面。我们测试了基于自一致性推导目标的置信度条件监督微调(CSFT)能否弥合内部信息与语言输出之间的差距。在Gemma 3 4B-it上执行的一项预注册0阶段协议中,采用模态过滤器将训练限制在具有正确模态答案的样本上,结果产生了负面结果:由于训练目标中的标签熵崩溃,AUROC2从0.554降至0.509。一项探索性补救措施移除了该过滤器,在所有2000个校准样本上进行训练。这产生了一个二元语言正确性判别器,在保留的TriviaQA数据集上AUROC2达到0.774,将10样本自一致性信号(AUROC2 = 0.999)压缩为单次输出,其性能超过了logit熵(0.701)。打乱标签的对照组未显示任何改进(0.501)。在MMLU上,使用打乱模型的基线准确率从54.2%提升至77.4%(基线为56.1%),支持了目标依赖性的解释。该结果是探索性的,属于二元而非连续校准,且仅在单一规模上观察到。它揭示了两个设计教训:置信度训练需要标签熵,且正确目标能正则化输出格式。


摘要 (Abstract)

Small instruct-tuned LLMs produce degenerate verbal confidence under minimal elicitation: ceiling rates above 95%, near-chance Type-2 AUROC, and Invalid validity profiles. We test whether confidence-conditioned supervised fine-tuning (CSFT) with self-consistency-derived targets can close the gap between internal information and verbal readout. A pre-registered Phase 0 protocol on Gemma 3 4B-it with a modal filter restricting training to items with correct modal answers produced a negative result: AUROC2 dropped from 0.554 to 0.509 due to label-entropy collapse in the training targets. An exploratory rescue removed the filter, training on all 2,000 calibration items. This produced a binary verbal correctness discriminator with AUROC2 = 0.774 on held-out TriviaQA, compressing a 10-sample self-consistency signal (AUROC2 = 0.999) into a single-pass readout exceeding logit entropy (0.701). The shuffled-target control showed no improvement (0.501). On MMLU, accuracy improved from 54.2% to 77.4% with the shuffled model at baseline (56.1%), supporting a target-dependent interpretation. The result is exploratory, binary rather than continuously calibrated, and observed at a single scale. It identifies two design lessons: confidence training requires label entropy, and correct targets regularise output format.


关键词: Self-consistency, Verbal confidence, Confidence-conditioned supervised fine-tuning, Gemma 3 4B, AUROC2, TriviaQA, MMLU


131. ❌ AgenticCache: Cache-Driven Asynchronous Planning for Embodied AI Agents

作者: Hojoon Kim, Yuheng Wu, Thierry Tambe 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24039v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.012.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于具身AI代理的规划,核心是使用LLM进行规划但通过缓存机制减少LLM调用。与’LLM Agents’和’Multi-agent Systems’高度相关,因为涉及多代理和规划缓存。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

AgenticCache通过缓存计划重用,避免每步LLM调用,在多个具身代理基准上提升成功率22%,降低延迟65%和token使用50%。
摘要翻译

具身智能体日益依赖大型语言模型(LLMs)进行规划,然而每步调用LLM会带来严重的延迟和成本。本文表明,具身任务展现出强烈的规划局部性,即下一步规划在很大程度上可从当前规划预测。基于此,我们提出AgenticCache——一种通过复用缓存规划来避免每步LLM调用的规划框架。在AgenticCache中,每个智能体查询频繁规划转移的运行时缓存,同时后台缓存更新器(Cache Updater)异步调用LLM以验证并优化缓存条目。在四个多智能体具身基准测试中,AgenticCache在12种配置(4个基准测试×3个模型)下平均将任务成功率提升22%,将仿真延迟降低65%,并将令牌使用量减少50%。基于缓存的规划复用因此为低延迟、低成本的具身智能体提供了一条实用路径。代码见https://github.com/hojoonleokim/MLSys26_AgenticCache。


摘要 (Abstract)

Embodied AI agents increasingly rely on large language models (LLMs) for planning, yet per-step LLM calls impose severe latency and cost. In this paper, we show that embodied tasks exhibit strong plan locality, where the next plan is largely predictable from the current one. Building on this, we introduce AgenticCache, a planning framework that reuses cached plans to avoid per-step LLM calls. In AgenticCache, each agent queries a runtime cache of frequent plan transitions, while a background Cache Updater asynchronously calls the LLM to validate and refine cached entries. Across four multi-agent embodied benchmarks, AgenticCache improves task success rate by 22% on average across 12 configurations (4 benchmarks x 3 models), reduces simulation latency by 65%, and lowers token usage by 50%. Cache-based plan reuse thus offers a practical path to low-latency, low-cost embodied agents. Code is available at https://github.com/hojoonleokim/MLSys26_AgenticCache.


关键词: Embodied AI Agents, LLM Planning, Cache-Driven, Plan Locality, Multi-agent, Latency Reduction, Token Efficiency


132. ❌ DeepTaxon: An Interpretable Retrieval-Augmented Multimodal Framework for Unified Species Identification and Discovery

作者: Jiawei Wang, Ming Lei, Yaning Yang, Xinyan Lin, Yuquan Le, Qiwei Ma, Zhiwei Xu, Zheqi Lv, Yuchen Ang, Zhe Quan, Tat-Seng Chua 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24029v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.010.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.08.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文提出DeepTaxon,一个检索增强的多模态框架,用于物种识别和发现。核心是检索增强生成(RAG)和链式思维(CoT)推理,因此’Retrieval-Augmented Generation’和’Chain of Thought’得分高。论文应用于生物多样性研究,属于AI for Science领域,故’AI for Science’得满分。其他关键词如大模型、MoE、预训练等未涉及,得0分。


!!! tip deepseek-chat TL;DR

该论文提出了DeepTaxon,一个检索增强的多模态框架,通过链式思维推理统一了物种识别和发现,在多个数据集上取得了改进。
摘要翻译

在生物学中,从数万个视觉上相似的分类单元中识别物种,同时在开放世界环境中发现未知物种,仍是生物多样性研究的一项基本挑战。当前方法将识别与发现视为独立问题,分类模型假设封闭集合,而发现则依赖于基于阈值的拒绝机制。本文提出DeepTaxon,一个检索增强的多模态框架,通过对检索到的视觉证据进行可解释推理,统一了物种识别与发现任务。给定一张查询图像,DeepTaxon从检索索引中获取前$k$个候选物种,每个物种附带$n$张示例图像,并执行思维链比较推理。关键之处在于,我们将发现重新定义为一个显式的、基于检索的决策问题,而非隐式的参数化记忆问题。当且仅当检索索引缺乏足够证据进行识别时,样本才被视为新物种,因此每次检索自然产生分类或发现标签,无需人工标注,从而为两项任务提供自动监督。我们通过监督微调在合成检索增强数据上训练该框架,随后对困难样本进行强化学习,将高召回率的检索转化为高精度的决策,并使其可扩展至大规模分类词汇表。在大型分布内基准数据集及六个分布外数据集上的广泛实验表明,该框架在识别与发现任务上均取得了一致改进。消融研究进一步揭示了随候选数量$k$与示例数量$n$的有效测试时扩展能力、对未见领域的强零样本迁移能力,以及跨检索编码器的一致性能,为生物多样性研究提供了一种可解释的解决方案。


摘要 (Abstract)

Identifying species in biology among tens of thousands of visually similar taxa while discovering unknown species in open-world environments remains a fundamental challenge in biodiversity research. Current methods treat identification and discovery as separate problems, with classification models assuming closed sets and discovery relying on threshold-based rejection. Here we present DeepTaxon, a retrieval-augmented multimodal framework that unifies species identification and discovery through interpretable reasoning over retrieved visual evidence. Given a query image, DeepTaxon retrieves the top-$k$ candidate species with $n$ exemplar images each from a retrieval index and performs chain-of-thought comparative reasoning. Critically, we redefine discovery as an explicit, retrieval-based decision problem rather than an implicit parametric memory problem. A sample is novel if and only if the retrieval index lacks sufficient evidence for identification, so each retrieval naturally yields a classification or discovery label without manual annotation, thereby providing automatic supervision for both tasks. We train the framework via supervised fine-tuning on synthetic retrieval-augmented data, followed by reinforcement learning on hard samples, converting high-recall retrieval into high-precision decisions that scale to massive taxonomic vocabularies. Extensive experiments on a large-scale in-distribution benchmark and six out-of-distribution datasets demonstrate consistent improvements in both identification and discovery. Ablation studies further reveal effective test-time scaling with candidate count $k$ and exemplar count $n$, strong zero-shot transfer to unseen domains, and consistent performance across retrieval encoders, establishing an interpretable solution for biodiversity research.


关键词: Retrieval-Augmented Generation, Chain of Thought, Species Identification, Species Discovery, Multimodal Framework, Biodiversity, Interpretable AI


133. ❌ AgentPulse: A Continuous Multi-Signal Framework for Evaluating AI Agents in Deployment

作者: Yuxuan Gao, Megan Wang, Yi Ling Yu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24038v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.05.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心关注AI Agent的部署评估框架,与’LLM Agents’高度相关(15分),因为AgentPulse专门评估AI Agent。涉及’Tool Use’(10分)因为Agent使用工具(如GitHub、IDE等)。‘Multi-agent Systems’(5分)因评估多个Agent,但非核心。其他关键词如LLMs、MoE、SLMs等均不相关。


!!! tip deepseek-chat TL;DR

AgentPulse提出一个连续多信号评估框架,通过四个因素(基准性能、采用信号、社区情感、生态系统健康)和18个实时信号,对50个AI Agent进行部署评估,发现基准排名与部署表现相关性低。
摘要翻译

静态基准测试衡量的是AI智能体在某一固定时间点上的能力,而非其在部署过程中的采纳情况、维护状态或实际体验。我们提出AgentPulse——一个持续评估框架,该框架基于从GitHub、包注册表、IDE市场、社交平台及基准排行榜中聚合的18个实时信号,从四个维度(基准性能、采纳信号、社区情绪与生态健康度)对横跨10个工作负载类别的50个智能体进行评分。三项分析为该框架提供了支撑。四个维度捕获了大致互补的信息(n=50;采纳-生态维度的最大相关系数$ρ_{\max}=0.61$,其余所有维度间的相关系数绝对值$|ρ| \leq 0.37$)。一项循环控制测试(n=35)表明,不包含任何GitHub衍生信号的“基准+情绪”子综合指标,能够预测其未聚合的外部采纳代理指标:GitHub星标数($ρ_s=0.52$,$p<0.01$)与Stack Overflow问题量($ρ_s=0.49$,$p<0.01$),而VS Code安装量($ρ_s=0.44$,$p<0.05$)仅作为说明性数据报告,因为35个智能体中仅11个具有非零安装量。在已发布SWE-bench得分的n=11子集上,综合排名与纯基准排名几乎不相关($ρ_s=0.25$;11个智能体中有9个排名至少变动2位),这主要源于该子集中闭源高能力智能体所呈现的强烈负向“采纳-能力”相关性。这正是我们将框架有效性主张建立在更广泛的n=35测试而非SWE-bench重叠样本上的原因。AgentPulse揭示了基准测试所缺失的部署信号;它是一种方法论,而非绝对真理排名。该框架、所有收集的信号、评分输出及评估工具均在CC BY 4.0许可下发布。


摘要 (Abstract)

Static benchmarks measure what AI agents can do at a fixed point in time but not how they are adopted, maintained, or experienced in deployment. We introduce AgentPulse, a continuous evaluation framework scoring 50 agents across 10 workload categories along four factors (Benchmark Performance, Adoption Signals, Community Sentiment, and Ecosystem Health) aggregated from 18 real-time signals across GitHub, package registries, IDE marketplaces, social platforms, and benchmark leaderboards. Three analyses ground the framework. The four factors capture largely complementary information (n=50; $ρ_{\max}=0.61$ for Adoption-Ecosystem, all others $|ρ| \leq 0.37$). A circularity-controlled test (n=35) shows the Benchmark+Sentiment sub-composite, which contains no GitHub-derived signals, predicts external adoption proxies it does not aggregate: GitHub stars ($ρ_s=0.52$, $p<0.01$) and Stack Overflow question volume ($ρ_s=0.49$, $p<0.01$), with VS Code installs ($ρ_s=0.44$, $p<0.05$) reported as illustrative given that only 11 of 35 agents have non-zero installs. On the n=11 subset with published SWE-bench scores, composite and benchmark-only rankings are nearly uncorrelated ($ρ_s=0.25$; 9 of 11 agents shift by at least 2 ranks), driven by a strong negative Adoption-Capability correlation among closed-source high-capability agents within this subset. This is precisely why we rest the framework’s validity claim on the broader n=35 test rather than the SWE-bench overlap. AgentPulse surfaces deployment signal absent from benchmarks; it is a methodology, not a ground-truth ranking. The framework, all collected signals, scoring outputs, and evaluation harness are released under CC BY 4.0.


关键词: AI Agents, Continuous Evaluation, Deployment Signals, Benchmark Performance, Adoption Signals, Community Sentiment, Ecosystem Health, AgentPulse


134. ❌ From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills

作者: Qiliang Liang, Hansi Wang, Zhong Liang, Yang Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24026v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.015.0/100.0
Tool Use0.010.0/100.0
Multi-agent Systems0.05.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于LLM agents的技能表示,核心涉及LLM Agents(15分,核心主题)、Tool Use(10分,技能包含工具调用)、Multi-agent Systems(5分,提及agent系统但非多智能体协调)。其他关键词如LLMs(10分,作为基础技术)相关,但非核心创新点。其余关键词如MoE、SLMs等与论文无关。


!!! tip deepseek-chat TL;DR

论文提出一种名为SSL的结构化表示方法,用于解耦LLM agent技能中的调度、结构和逻辑信息,实验表明该方法在技能发现和风险评估任务上优于纯文本基线。
摘要翻译

LLM智能体日益依赖可复用技能——即结合指令、控制流、约束条件与工具调用的能力包。然而,在当前的多数智能体系统中,技能仍以文本密集型制品表示,包括SKILL.md风格的文档以及结构化记录,其中可供机器使用的证据大多嵌入在自然语言描述中。这给以技能为中心的智能体系统带来了挑战:管理技能集合以及利用技能支持智能体运行,都需要对调用接口、执行结构以及具体副作用进行推理,而这些信息往往纠缠在单一的文本表层中。因此,对技能知识进行显式表示,可能有助于让这些制品更易于机器获取和利用。借鉴Schank与Abelson在语言知识表征经典著作中提出的记忆组织包、脚本理论与概念依存理论,我们首次提出了一种针对智能体技能制品的结构化表示——调度-结构-逻辑(Scheduling-Structural-Logical, SSL)表示。该表示将技能层面的调度信号、场景层面的执行结构以及逻辑层面的动作与资源使用证据分离开来。我们利用基于LLM的归一化器实例化SSL,并在两个任务(技能发现与风险评估)的技能语料库上对其进行评估,其表现显著优于纯文本基线:在技能发现任务中,SSL将MRR从0.573提升至0.707;在风险评估任务中,它将宏F1值从0.744提升至0.787。这些发现表明,显式的、基于源头的结构使得智能体技能更易于搜索与审查。同时,这也提示我们,SSL应被理解为迈向更可检查、可复用且可操作执行的智能体系统技能表示的一个实际步骤,而非一个最终标准或用于管理与使用技能的端到端机制。


摘要 (Abstract)

LLM agents increasingly rely on reusable skills, capability packages that combine instructions, control flow, constraints, and tool calls. In most current agent systems, however, skills are still represented by text-heavy artifacts, including SKILL.md-style documents and structured records whose machine-usable evidence remains embedded largely in natural-language descriptions. This poses a challenge for skill-centered agent systems: managing skill collections and using skills to support agent both require reasoning over invocation interfaces, execution structure, and concrete side effects that are often entangled in a single textual surface. An explicit representation of skill knowledge may therefore help make these artifacts easier for machines to acquire and leverage. Drawing on Memory Organization Packets, Script Theory, and Conceptual Dependency from Schank and Abelson’s classical work on linguistic knowledge representation, we introduce what is, to our knowledge, the first structured representation for agent skill artifacts that disentangles skill-level scheduling signals, scene-level execution structure, and logic-level action and resource-use evidence: the Scheduling-Structural-Logical (SSL) representation. We instantiate SSL with an LLM-based normalizer and evaluate it on a corpus of skills in two tasks, Skill Discovery and Risk Assessment, and superiorly outperform the text-only baselines: in Skill Discovery, SSL improves MRR from 0.573 to 0.707; in Risk Assessment, it improves macro F1 from 0.744 to 0.787. These findings reveal that explicit, source-grounded structure makes agent skills easier to search and review. They also suggest that SSL is best understood as a practical step toward more inspectable, reusable, and operationally actionable skill representations for agent systems, rather than as a finished standard or an end-to-end mechanism for managing and using skills.


关键词: LLM Agents, Skill Representation, Scheduling-Structural-Logical, Tool Use, Skill Discovery, Risk Assessment


135. ❌ Stabilizing Efficient Reasoning with Step-Level Advantage Selection

作者: Han Wang, Xiaodong Yu, Jialian Wu, Jiang Liu, Ximeng Sun, Mohit Bansal, Zicheng Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24003v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.010.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.010.0/100.0
System 2 Thinking0.05.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于大语言模型(LLMs)的推理效率优化,核心是后训练阶段(Post-training)的步骤级优势选择方法(SAS),涉及链式思维推理(Chain of Thought)和慢思考(System 2 Thinking)相关概念。其他关键词如MoE、SLM、Scaling Laws、预训练等均不相关。


!!! tip deepseek-chat TL;DR

论文提出步骤级优势选择(SAS)方法,在保持或提升大语言模型推理准确性的同时,显著减少推理长度,实现更好的准确率-效率权衡。
摘要翻译

大语言模型(LLMs)通过在推理时分配大量计算资源来实现强大的推理性能,通常会生成长而冗长的推理轨迹。尽管近期关于高效推理的研究通过基于长度的奖励或剪枝来减少这一开销,但许多方法是在比基础模型训练时短得多的上下文窗口下进行后训练的,这一因素的影响尚未被系统性地分离。我们首先证明,仅使用标准GRPO(无任何长度感知目标)进行短上下文后训练,本身就会引发显著的推理压缩——但代价是训练动态日益不稳定以及准确率下降。为解决这一问题,我们提出步骤级优势选择(SAS),该方法在推理步骤层面运作,为正确展开中的低置信度步骤和验证器失败展开中的高置信度步骤分配零优势,其中失败通常源于截断或验证器问题而非推理错误。在多种数学和通用推理基准测试中,SAS相较于最强的长度感知基线,将平均Pass@1准确率提升了0.86个百分点,同时将平均推理长度减少了16.3%,实现了更优的准确率-效率权衡。


摘要 (Abstract)

Large language models (LLMs) achieve strong reasoning performance by allocating substantial computation at inference time, often generating long and verbose reasoning traces. While recent work on efficient reasoning reduces this overhead through length-based rewards or pruning, many approaches are post-trained under a much shorter context window than base-model training, a factor whose effect has not been systematically isolated. We first show that short-context post-training alone, using standard GRPO without any length-aware objective, already induces substantial reasoning compression-but at the cost of increasingly unstable training dynamics and accuracy degradation. To address this, we propose Step-level Advantage Selection (SAS), which operates at the reasoning-step level and assigns a zero advantage to low-confidence steps in correct rollouts and to high-confidence steps in verifier-failed rollouts, where failures often arise from truncation or verifier issues rather than incorrect reasoning. Across diverse mathematical and general reasoning benchmarks, SAS improves average Pass@1 accuracy by 0.86 points over the strongest length-aware baseline while reducing average reasoning length by 16.3%, yielding a better accuracy-efficiency trade-off.


关键词: Large Language Models, Efficient Reasoning, Post-training, Chain of Thought, Step-level Advantage Selection, GRPO, Reasoning Compression


136. ❌ When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Models

作者: Danny Wang, Ruihong Qiu, Zi Huang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23994v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究离散扩散语言模型(dLLMs)的块状解码问题,提出可变大小自包含块(VSB)方法。虽然涉及语言模型,但并非大语言模型(LLMs)或主流深度学习技术,而是专注于扩散模型在文本生成中的解码策略。所有关键词均不匹配:无大模型、无MoE、无SLM、无缩放定律、无预训练/微调、无RLHF、无PEFT、无RAG、无长上下文、无KV缓存、无CoT、无系统2、无MCTS、无自我纠正、无智能体、无工具使用、无多智能体、无量化、无推测解码、无幻觉、无可解释性、无世界模型、无模型合并、无上下文学习、无AI for Science。因此所有关键词得0分。


!!! tip deepseek-chat TL;DR

该论文针对离散扩散语言模型在块状解码中因缺乏未来上下文导致的过早提交问题,提出基于自包含性准则的可变大小自包含块(VSB)方法,通过比较有无未来上下文时的预测分布差异来选择块边界,从而提升生成质量。
摘要翻译

离散扩散语言模型(dLLMs)通过双向注意力机制实现了并行令牌更新,然而实际生成过程通常采用分块半自回归解码。这种转换导致了训练与推理之间的不匹配:训练阶段利用完整序列上下文进行去噪,而推理阶段则在有限分块内提交令牌,缺乏未来上下文信息。因此,使用固定大小或基于启发式的分块进行解码可能导致过早的令牌提交,因为决策是在无法完全获取可能改变这些选择的未来上下文的情况下做出的。基于此,我们提出将自包含性作为分块提交的原则性标准。若一个分块在拥有未来感知(FA)或无未来(NF)上下文访问条件下的预测保持一致,则该分块具有自包含性,从而将分块边界选择重新定义为自包含性检验而非启发式选择。基于这一原则,我们为dLLMs引入了可变大小自包含分块(VSB)。VSB通过计算令牌级预测分布在NF与FA条件下的差异来评分并选择分块边界,该差异量化了若未来上下文被揭示时预测将如何变化。我们提供了将自包含性与预测一致性相关联的理论证明,并通过大量实验验证了VSB相较于固定大小及启发式分块解码的有效性。


摘要 (Abstract)

Discrete diffusion language models (dLLMs) enable parallel token updates with bidirectional attention, yet practical generation typically adopts blockwise semi-autoregressive decoding. This switch creates a training-inference mismatch: training denoises with full-sequence context, while inference commits tokens within a bounded block without future context. Therefore, decoding with fixed-size or heuristic-based blocks can lead to premature token commitments, as decisions are made without full access to future context that could alter those choices. Motivated by this, we propose self-containedness as a principled criterion for block commitment. A block is self-contained if its predictions remain consistent with Future-Aware (FA) or without No-Future (NF) access to future context, reframing block boundary selection as a test of self-containedness rather than a heuristic choice. Based on this principle, we introduce Variable-size Self-contained Blocks (VSB) for dLLMs. VSB scores and selects block boundaries using the divergence between token-level predictive distributions under NF and FA conditioning, which quantifies how predictions would change if future context were revealed. We provide theoretical justification linking self-containedness to predictive consistency, and extensive experiments validate VSB’s efficacy over fixed-size and heuristic blockwise decoding.


关键词: Discrete Diffusion Language Models, Blockwise Decoding, Self-containedness, Variable-size Blocks, Future-Aware Conditioning, Predictive Consistency


137. ❌ EPM-RL: Reinforcement Learning for On-Premise Product Mapping in E-Commerce

作者: Minhyeong Yu, Wonduk Seo 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23993v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.05.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.010.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.08.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.05.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究电商产品映射任务,使用强化学习(RL)和参数高效微调(PEFT)优化小模型,涉及LLM和Agent框架,但未深入其他关键词。PEFT高度相关(10分),LLM Agents相关(8分),Small Language Models(5分,因使用小模型),Multi-agent Systems(5分,提及多智能体框架),其余关键词无关。


!!! tip deepseek-chat TL;DR

该论文提出EPM-RL框架,通过强化学习将高成本的LLM代理推理蒸馏到可训练的小模型中,实现高效、准确的电商产品映射,同时支持私有化部署。
摘要翻译

产品映射(Product mapping),即判断两个电商列表是否指向同一产品的任务,是价格监控与渠道可见性中的核心问题。然而,在真实市场中,卖家经常在标题中插入促销关键词、平台特定标签及捆绑描述,导致同一产品以多种不同名称出现。近期基于大语言模型(LLM)和多智能体(multi-agent)的框架虽能提升此类困难案例的鲁棒性与可解释性,但这些方法通常依赖昂贵的外部应用程序编程接口(API)、重复检索以及复杂的推理时编排,使得大规模部署成本高昂,且在注重隐私的企业环境中难以实施。为解决这些问题,我们提出EPM-RL——一种基于强化学习(Reinforcement Learning, RL)的框架,用于构建准确且高效的本地化电商产品映射模型。其核心思想是将高成本的智能体推理过程蒸馏至可训练的内部模型中。从一组经过人工验证并附带LLM生成推理依据的精选产品对出发,我们首先利用结构化推理输出对小型学生模型进行参数高效微调(Parameter-Efficient Fine-Tuning, PEFT)。随后,我们采用基于智能体的奖励函数进一步优化模型,该奖励函数通过专门设计的评判模型(judge models)联合评估输出格式合规性、标签正确性及推理偏好得分。初步结果表明,EPM-RL在仅进行PEFT训练的基础上持续改进,并在质量与成本之间实现了优于基于商业API的基线方案的平衡,同时支持私有化部署并降低运营成本。这些发现表明,强化学习能够将产品映射从高延迟的智能体流程转化为可扩展、可审查且可直接投入生产的内部系统。


摘要 (Abstract)

Product mapping, the task of deciding whether two e-commerce listings refer to the same product, is a core problem for price monitoring and channel visibility. In real marketplaces, however, sellers frequently inject promotional keywords, platform-specific tags, and bundle descriptions into titles, causing the same product to appear under many different names. Recent LLM-based and multi-agent frameworks improve robustness and interpretability on such hard cases, but they often rely on expensive external APIs, repeated retrieval, and complex inference-time orchestration, making large-scale deployment costly and difficult in privacy-sensitive enterprise settings. To address these issues, we present EPM-RL, a reinforcement-learning-based framework for building an accurate and efficient on-premise e-commerce product mapping model. Our central idea is to distill high-cost agentic reasoning into a trainable in-house model. Starting from a curated set of product pairs with LLM-generated rationales and human verification, we first perform parameter-efficient fine-tuning (PEFT) on a small student model using structured reasoning outputs. We then further optimize the model with Reinforcement Learning (RL) using an agent-based reward that jointly evaluates output-format compliance, label correctness, reasoning–preference scores from specially designed judge models. Preliminary results show that EPM-RL consistently improves over PEFT-only training and offers a stronger quality–cost trade-off than commercial API-based baselines, while enabling private deployment and lower operational cost. These findings suggest that reinforcement learning can turn product mapping from a high-latency agentic pipeline into a scalable, inspectable, and production-ready in-house system.


关键词: Product Mapping, Reinforcement Learning, Parameter-Efficient Fine-Tuning, LLM Agents, E-Commerce, On-Premise Deployment, Knowledge Distillation


138. ❌ Representational Curvature Modulates Behavioral Uncertainty in Large Language Models

作者: Jack King, Evelina Fedorenko, Eghbal A. Hosseini 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23985v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.010.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究大语言模型(LLMs)中表征曲率与行为不确定性(熵)的关系,核心是LLMs的几何表征分析,属于可解释性/机械可解释性领域。与Large Language Models高度相关(10分),与Mechanistic Interpretability高度相关(10分)。其他关键词如MoE、SLMs、Scaling Laws、Pre-training等均不涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文发现大语言模型中的表征曲率(contextual curvature)与下一个词的熵相关,并通过干预实验证明曲率影响行为不确定性,表明曲率是任务相关的表征特征。
摘要翻译

在自回归大语言模型(LLMs)中,时间轨迹拉直提供了一种解释,说明下一个词元预测目标如何塑造表征。模型学会在逐层处理中逐步拉直输入序列的表征轨迹,从而可能通过线性外推促进下一个词元的预测。然而,这一轨迹与词元层面行为之间的直接联系此前尚不明确。我们通过将上下文曲率(一种几何度量,用于衡量表征轨迹在近期上下文中的弯曲程度)与下一个词元熵相关联,建立了这种联系。在两个模型(GPT-2 XL 和 Pythia-2.8B)中,上下文曲率与熵相关,且这种关系在训练过程中逐渐显现。扰动实验揭示了选择性依赖:通过轨迹对齐的干预手段操纵曲率能够可靠地调节熵,而几何上错位的扰动则无此效果。最后,在训练过程中对表征进行正则化以使其更平直,可在不降低验证损失的情况下适度降低词元层面的熵。这些结果将轨迹曲率识别为一种与任务对齐的表征特征,能够影响大语言模型中的行为不确定性。


摘要 (Abstract)

In autoregressive large language models (LLMs), temporal straightening offers an account of how the next-token prediction objective shapes representations. Models learn to progressively straighten the representational trajectory of input sequences across layers, potentially facilitating next-token prediction via linear extrapolation. However, a direct link between this trajectory and token-level behavior has been missing. We provide such a link by relating contextual curvature-a geometric measure of how sharply the representational trajectory bends over recent context-to next-token entropy. Across two models (GPT-2 XL and Pythia-2.8B), contextual curvature is correlated with entropy, and this relationship emerges during training. Perturbation experiments reveal selective dependence: manipulating curvature through trajectory-aligned interventions reliably modulates entropy, while geometrically misaligned perturbations have no effect. Finally, regularizing representations to be straighter during training modestly reduces token-level entropy without degrading validation loss. These results identify trajectory curvature as a task-aligned representational feature that influences behavioral uncertainty in LLMs.


关键词: representational curvature, contextual curvature, next-token entropy, behavioral uncertainty, mechanistic interpretability, large language models, trajectory straightening


139. ❌ Propagation Structure-Semantic Transfer Learning for Robust Fake News Detection

作者: Mengyang Chen, Lingwei Wei, Han Cao, Wei Zhou, Zhou Yan, Songlin Hu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23974v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究假新闻检测,使用传播结构-语义迁移学习,不涉及大模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种基于教师-学生架构的传播结构-语义迁移学习框架(PSS-TL),通过双教师模型分别学习语义和结构知识,并设计多通道知识蒸馏损失,以提升假新闻检测的鲁棒性。
摘要翻译

虚假新闻通常指为欺骗他人而故意传播的虚假信息,对社会具有负面影响。现有的虚假新闻检测方法主要从新闻内容中学习语义特征,或整合传播过程中的结构特征。然而,在实际场景中,由于社交媒体上非正式语言的语义模糊性以及不可靠的用户交互行为,新闻内容与传播过程中存在固有的语义噪声和结构噪声。尽管近期部分研究以混合建模的方式考虑了无关用户交互的影响,但这些方法仍面临结构噪声与语义噪声相互干扰的问题,导致鲁棒检测的性能受限。为缓解这一问题,本文提出了一种新颖的传播结构-语义迁移学习框架(Propagation Structure-Semantic Transfer Learning, PSS-TL),该框架基于师生架构实现鲁棒的虚假新闻检测。具体而言,我们设计了双教师模型,分别从含噪的新闻内容与传播结构中独立学习语义知识与结构知识;同时,我们设计了多通道知识蒸馏损失(Multi-channel Knowledge Distillation, MKD),使学生模型能够从教师模型中获取专门知识,从而避免相互干扰。在两个真实数据集上的大量实验验证了本方法的有效性与鲁棒性。


摘要 (Abstract)

Fake news generally refers to false information that is spread deliberately to deceive people, which has detrimental social effects. Existing fake news detection methods primarily learn the semantic features from news content or integrate structural features from propagation. However, in practical scenarios, due to the semantic ambiguity of informal language and unreliable user interactive behaviors on social media, there are inherent semantic and structural noises in news content and propagation. Although some recent works consider the effect of irrelevant user interactions in a hybrid-modeling way, they still suffer from the mutual interference between structural noise and semantic noise, leading to limited performance for robust detection. To alleviate this issue, this paper proposes a novel Propagation Structure-Semantic Transfer Learning framework (PSS-TL) for robust fake news detection under a teacher-student architecture. Specifically, we design dual teacher models to learn semantics knowledge and structure knowledge from noisy news content and propagation structure independently. Besides, we design a Multi-channel Knowledge Distillation (MKD) loss to enable the student model to acquire specialized knowledge from the teacher models, thereby avoiding mutual interference. Extensive experiments on two real-world datasets validate the effectiveness and robustness of our method.


关键词: fake news detection, propagation structure, semantic transfer learning, teacher-student architecture, knowledge distillation, robustness


140. ❌ KOMBO: Korean Character Representations Based on the Combination Rules of Subcharacters

作者: SungHo Kim, Juhyeong Park, Yeachan Kim, SangKeun Lee 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23948v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注韩语预训练语言模型,通过引入韩文字符的构成规则来改进字符表示。虽然涉及预训练(Pre-training),但并非针对大模型或深度学习技术原理的创新,也未涉及AI for Science等应用领域。因此,仅与’Pre-training’关键词有较弱关联(5分),其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出KOMBO框架,利用韩文字符的构成规则改进预训练语言模型的字符表示,在韩语自然语言理解任务上平均提升2.11%。
摘要翻译

韩文书写系统《训民正音》(\textit{Hangeul})具有独特的字符表征方式,严格遵循《训民正音》(\textit{Hunminjeongeum})\footnote{\textit{Hunminjeongeum} 是1446年出版的一部著作,记载了由世宗大王(King Sejong)创制的《训民正音》的创制原理及使用方法 \cite{Hunminjeongeum_Guide}。}中记载的创制原理。然而,现有的韩语预训练语言模型(PLMs)忽视了这些原理。本文提出了一种名为KOMBO的韩语PLM新框架,首次将《训民正音》的创制原理引入字符表征。我们提出的KOMBO方法在多种自然语言处理(NLP)任务中展现出显著的实验效能。具体而言,在五项韩语自然语言理解任务中,我们的方法平均比当前最先进的韩语PLM高出2.11%。此外,大量实验表明,所提方法适用于理解韩语的语言特征。因此,我们揭示了在韩语PLM中使用子字符(subcharacter)相较于典型基于子词(subword)方法的优越性。我们的代码已开源至:https://github.com/SungHo3268/KOMBO


摘要 (Abstract)

The Korean writing system, \textit{Hangeul}, has a unique character representation rigidly following the invention principles recorded in \textit{Hunminjeongeum}.\footnote{\textit{Hunminjeongeum} is a book published in 1446 that describes the principles of invention and usage of \textit{Hangeul}, devised by King Sejong \cite{Hunminjeongeum_Guide}.} However, existing pre-trained language models (PLMs) for Korean have overlooked these principles. In this paper, we introduce a novel framework for Korean PLMs called KOMBO, which firstly brings the invention principles of \textit{Hangeul} to represent character. Our proposed method, KOMBO, exhibits notable experimental proficiency across diverse NLP tasks. In particular, our method outperforms the state-of-the-art Korean PLM by an average of 2.11% in five Korean natural language understanding tasks. Furthermore, extensive experiments demonstrate that our proposed method is suitable for comprehending the linguistic features of the Korean language. Consequently, we shed light on the superiority of using subcharacters over the typical subword-based approach for Korean PLMs. Our code is available at: https://github.com/SungHo3268/KOMBO.


关键词: Korean, Hangeul, subcharacter, pre-trained language model, character representation, natural language understanding


141. ❌ Quantum Knowledge Graph: Modeling Context-Dependent Triplet Validity

作者: Yao Wang, Zixu Geng, Jun Yan 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23972v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.05.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出量子知识图谱(QKG),用于建模上下文相关的三元组有效性,并应用于医学问答,提升LLM推理的准确性和事实性。与LLMs高度相关(10分),因为使用LLM作为推理器和验证器;与RAG相关(5分),因为KG可视为检索来源;与幻觉缓解相关(8分),因为验证器减少幻觉;与AI for Science相关(10分),因为应用于医学领域。其他关键词不相关。


!!! tip deepseek-chat TL;DR

论文提出量子知识图谱(QKG),通过上下文匹配增强三元组有效性,在医学问答中显著提升LLM推理准确性,最高提升5.96个百分点。
摘要翻译

知识图谱(KGs)正越来越多地被用于支持大语言模型(LLM)的推理,但基于标准三元组的KG将每个关系视为全局有效。在许多场景中,某个关系是否应被视为证据取决于具体上下文。因此,我们将三元组有效性形式化为上下文的特定函数,并将这一形式化称为量子知识图谱(QKG)。我们在医学领域以糖尿病为中心的PrimeKG子图实例化了QKG,该子图中的68,651个上下文敏感关系进一步标注了患者群体特定的约束条件。我们在一个基于KG的MedReason子集(包含2,788个问题)上,采用推理器-验证器流水线进行医学问答评估。当Haiku-4.5同时作为推理器和验证器时,基于KG的验证显著优于无验证器的基线(+0.61个百分点),而采用上下文匹配的QKG取得了最大增益,优于无上下文匹配的KG验证(+0.79个百分点)和无验证器基线(+1.40个百分点;配对McNemar检验,所有p<0.05)。在更强的验证器(Qwen-3.6-Plus)下,原始QKG相对于无验证器基线的增益从+1.40个百分点增长至+5.96个百分点;在原始数据集上,上下文匹配的差异不显著(p=0.73),但在调整了知识泄露和可疑问题后,该差异变为边缘显著(p=0.05),这更符合基准测试的黄金上限而非QKG的局限性。综合来看,这些结果支持以下观点:KG在基于LLM的临床推理中的价值不仅在于存储医学相关事实,更在于表征这些事实是否适用于特定患者上下文。为便于复现和进一步研究,我们发布了整理后的QKG数据集和源代码。\footnote{https://github.com/HKAI-Sci/QKG}


摘要 (Abstract)

Knowledge graphs (KGs) are increasingly used to support large lan guage model (LLM) reasoning, but standard triplet-based KGs treat each relation as globally valid. In many settings, whether a relation should count as evidence depends on the context. We therefore formulate triplet validity as a triplet-specific function of context and refer to this formulation as a Quantum Knowledge Graph (QKG). We instantiate QKG in medicine using a diabetes-centered PrimeKG subgraph, whose 68,651 context-sensitive relations are further annotated with patient-group-specific constraints. We evaluate it in a reasoner–validator pipeline for medical question answering on a KG-grounded subset of MedReason containing 2,788 questions. With Haiku-4.5 as both the Reasoner and the Validator, KG-backed validation significantly improves over a no-validator baseline ($+0.61$ pp), and QKG with context matching yields the largest gain, outperforming both KG validation without context matching ($+0.79$ pp) and the no-validator baseline ($+1.40$ pp; paired McNemar, all $p<0.05$). Under a stronger validator (Qwen-3.6-Plus), the raw QKG gain over the no-validator baseline grows from $+1.40$ pp to $+5.96$ pp; the context-matching gap is non-significant ($p=0.73$) on the raw set but becomes borderline significant ($p=0.05$) after adjustment for knowledge leakage and suspicious questions, consistent with a benchmark-gold ceiling rather than a QKG limitation. Taken together, the results support the view that the value of a KG in LLM-based clinical reasoning lies not merely in storing medically related facts, but in representing whether those facts are applicable to the specific patient context. For reproducibility and further research, we release the curated QKG datasets and source code.\footnote{https://github.com/HKAI-Sci/QKG}


关键词: Quantum Knowledge Graph, context-dependent triplet validity, large language models, medical question answering, reasoner-validator pipeline, factuality


142. ❌ TSAssistant: A Human-in-the-Loop Agentic Framework for Automated Target Safety Assessment

作者: Xiaochen Zheng, Zhiwen Jiang, Melanie Guerard, Klas Hatje, Tatyana Doktorova 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23938v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.08.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出TSAssistant,一个用于靶点安全性评估的多智能体框架,涉及LLM智能体、工具使用、多智能体协调和检索增强生成(RAG),属于AI for Science(生物信息学)应用。未涉及MoE、SLM、Scaling Laws、预训练、微调、对齐、PEFT、长上下文、注意力机制、推理、MCTS、自纠正、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等关键词。


!!! tip deepseek-chat TL;DR

TSAssistant是一个基于人类参与循环的多智能体框架,通过模块化、分节的方式自动化靶点安全性评估报告起草,利用检索增强生成和工具接口整合异构证据,并支持交互式精炼。
摘要翻译

靶点安全性评估(Target Safety Assessment, TSA)需要系统整合异质性证据,包括遗传学、转录组学、靶点同源性、药理学及临床数据,以评估治疗靶点的潜在安全性风险。该过程本质上是迭代性的且依赖专家驱动,在可扩展性和可重复性方面存在挑战。我们提出TSAssistant——一个多智能体框架,旨在通过模块化、分章节且人在回路的范式支持TSA报告起草。该框架将报告生成分解为由专门子智能体组成的协调流水线,每个子智能体负责一个TSA章节。专门子智能体通过标准化工具接口从精选生物医学资源中检索结构化与非结构化数据及文献证据,生成可单独引用的、基于证据的章节。智能体行为由分层指令架构控制,该架构包含系统提示、领域特定技能模块及运行时用户指令。其关键特性在于交互式优化循环:用户可手动编辑章节、补充新信息、上传额外来源或重新调用智能体以修订特定章节,系统则在迭代过程中保持对话记忆。TSAssistant旨在减轻证据整合与报告起草的机械性负担,支持一种混合模式——即智能体AI增强证据整合,而毒理学家保留最终决策权。


摘要 (Abstract)

Target Safety Assessment (TSA) requires systematic integration of heterogeneous evidence, including genetic, transcriptomic, target homology, pharmacological, and clinical data, to evaluate potential safety liabilities of therapeutic targets. This process is inherently iterative and expert-driven, posing challenges in scalability and reproducibility. We present TSAssistant, a multi-agent framework designed to support TSA report drafting through a modular, section-based, and human-in-the-loop paradigm. The framework decomposes report generation into a coordinated pipeline of specialised subagents, each targeting a single TSA section. Specialised subagents retrieve structured and unstructured data as well as literature evidence from curated biomedical sources through standardised tool interfaces, producing individually citable, evidence-grounded sections. Agent behaviour is governed by a hierarchical instruction architecture comprising system prompts, domain-specific skill modules, and runtime user instructions. A key feature is an interactive refinement loop in which users may manually edit sections, append new information, upload additional sources, or re-invoke agents to revise specific sections, with the system maintaining conversational memory across iterations. TSAssistant is designed to reduce the mechanical burden of evidence synthesis and report drafting, supporting a hybrid model in which agentic AI augments evidence synthesis while toxicologists retain final decision authority.


关键词: Target Safety Assessment, Multi-agent Framework, Human-in-the-loop, Retrieval-Augmented Generation, Tool Use, LLM Agents, AI for Science, Bioinformatics


143. ❌ Knowledge Vector of Logical Reasoning in Large Language Models

作者: Zixuan Wang, Yuanyuan Lei 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23877v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.012.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.010.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.015.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究大语言模型中逻辑推理的知识表示,核心涉及LLMs、推理(CoT、System 2)和可解释性(Mechanistic Interpretability)。与LLMs高度相关(15分),与Chain of Thought和Multi-step Reasoning相关(12分),与System 2 Thinking和In-depth Reasoning相关(10分),与Mechanistic Interpretability高度相关(15分)。其他关键词如MoE、SLMs、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

该论文发现大语言模型中的三种逻辑推理(演绎、归纳、溯因)可表示为线性空间中的知识向量,并通过互补子空间约束框架增强向量间的互补性,从而提升推理性能。
摘要翻译

逻辑推理是大语言模型的核心能力之一,包含演绎推理、归纳推理和溯因推理三种主要形式。本研究探讨了大语言模型中各类推理的知识表征,并分析了它们之间的相关性。分析表明,每种逻辑推理形式均可在线性表征空间中捕获为特定于该推理类型的知识向量,但这些向量彼此间基本独立。受认知科学理论(即这些逻辑推理子类型在人脑中密切交互)以及我们观察到的现象(一种推理类型的推理过程可受益于另一种推理类型产生的推理链)启发,我们进一步提出优化大语言模型中各类推理的知识表征,以促进它们之间的互补性。为此,我们设计了一种互补子空间约束优化框架,该框架引入互补损失函数,使每个推理向量能够利用其他推理类型的辅助知识,同时引入子空间约束损失函数以防止其独特特征被消除。通过沿推理向量进行引导实验,我们发现融入互补知识的优化向量能够带来持续的性能提升。我们还对每个推理向量进行了机制可解释性分析,揭示了大语言模型中不同推理类型的共享特征与特异性特征。


摘要 (Abstract)

Logical reasoning serve as a central capability in LLMs and includes three main forms: deductive, inductive, and abductive reasoning. In this work, we study the knowledge representations of these reasoning types in LLMs and analyze the correlations among them. Our analysis shows that each form of logical reasoning can be captured as a reasoning-specific knowledge vector in a linear representation space, yet these vectors are largely independent of each other. Motivated by cognitive science theory that these subforms of logical reasoning interact closely in the human brain, as well as our observation that the reasoning process for one type can benefit from the reasoning chain produced by another, we further propose to refine the knowledge representations of each reasoning type in LLMs to encourage complementarity between them. To this end, we design a complementary subspace-constrained refinement framework, which introduces a complementary loss that enables each reasoning vector to leverage auxiliary knowledge from the others, and a subspace constraint loss that prevents erasure of their unique characteristics. Through steering experiments along reasoning vectors, we find that refined vectors incorporating complementary knowledge yield consistent performance gains. We also conduct a mechanism-interpretability analysis of each reasoning vector, revealing insights into the shared and specific features of different reasoning in LLMs.


关键词: Large Language Models, Logical Reasoning, Knowledge Vector, Mechanistic Interpretability, Chain of Thought, Deductive Reasoning, Inductive Reasoning, Abductive Reasoning


144. ❌ Graph Memory Transformer (GMT)

作者: Nicola Zanarini, Niccolò Ferrari 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23862v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.06.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.05.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.08.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出Graph Memory Transformer (GMT),用图记忆网络替换标准Transformer中的FFN层,属于LLM架构创新,但非主流技术(如MoE、RAG等)。与Large Language Models相关(8分),因为模型是decoder-only语言模型;与Small Language Models相关(6分),因为参数量较小(82.2M);与Pre-training相关(5分),因为涉及训练过程;与Mechanistic Interpretability高度相关(8分),因为模型提供可解释的centroid使用和转换结构。其他关键词无关。


!!! tip deepseek-chat TL;DR

论文提出Graph Memory Transformer (GMT),用图记忆网络替换FFN层,在保持自回归架构的同时提供可解释性,但性能略低于同等规模密集基线。
摘要翻译

我们研究在仅解码器Transformer中,前馈网络(Feed-Forward Network, FFN)子层是否可以被显式学习的记忆图(explicit learned memory graph)替代,同时保留其周围的自回归架构。所提出的图记忆Transformer(Graph Memory Transformer, GMT)保持因果自注意力机制不变,但将每个词元的常规FFN变换替换为一个记忆单元,该单元通过一个由学习得到的有向转移矩阵(directed transition matrix)连接的学习质心库(learned bank of centroids)来路由词元表示。在此研究的基础GMT v7实例中,16个Transformer块中的每一个都包含128个质心、一个128×128的边矩阵(edge matrix)、引力源路由(gravitational source routing)、词元条件目标选择(token-conditioned target selection)以及门控位移读出(gated displacement readout)。因此,该单元返回的是从估计的源记忆状态向目标记忆状态的移动,而非一个检索值。由此产生的模型是一个完全仅解码器的语言模型,拥有8220万个可训练参数且无密集FFN子层,而评估中使用的密集GPT风格基线模型则拥有1.03亿个参数。基础v7模型训练稳定,并将质心使用情况、转移结构以及源到目标的移动作为前向计算中可直接检查的量暴露出来。在验证损失和困惑度方面,它落后于更大的密集基线模型(3.5995/36.58对比3.2903/26.85),但在评估设置下展现出接近的零样本基准性能。这些结果并非旨在声称达到最先进水平;它们支持了用图介导的记忆导航(graph-mediated memory navigation)替代密集的词元内变换的可行性和结构可解释性。更广泛的规模扩展、优化的内核以及更全面的基准评估留待后续工作。


摘要 (Abstract)

We investigate whether the Feed-Forward Network (FFN) sublayer in a decoder-only transformer can be replaced by an explicit learned memory graph while preserving the surrounding autoregressive architecture. The proposed Graph Memory Transformer (GMT) keeps causal self-attention intact, but replaces the usual per-token FFN transformation with a memory cell that routes token representations over a learned bank of centroids connected by a learned directed transition matrix. In the base GMT v7 instantiation studied here, each of 16 transformer blocks contains 128 centroids, a 128 * 128 edge matrix, gravitational source routing, token-conditioned target selection, and a gated displacement readout. The cell therefore returns movement from an estimated source memory state toward a target memory state, rather than a retrieved value. The resulting model is a fully decoder-only language model with 82.2M trainable parameters and no dense FFN sublayers, compared with a 103.0M-parameter dense GPT-style baseline used in the evaluation. The base v7 model trains stably and exposes centroid usage, transition structure, and source-to-target movement as directly inspectable quantities of the forward computation. It remains behind the larger dense baseline in validation loss and perplexity (3.5995/36.58 vs. 3.2903/26.85), while showing close zero-shot benchmark behavior under the evaluated setting. These results are not intended as a state-of-the-art claim; they support the viability and structural interpretability of replacing dense within-token transformation with graph-mediated memory navigation. Broader scaling, optimized kernels, and more extensive benchmark evaluation are left for subsequent work.


关键词: Graph Memory Transformer, Feed-Forward Network replacement, memory graph, decoder-only language model, interpretability, centroid routing, transition matrix


145. ❌ Learning Selective LLM Autonomy from Copilot Feedback in Enterprise Customer Support Workflows

作者: Nikita Borovkov, Elisei Rykov, Olga Tsymboi, Sergei Filimonov, Nikita Surnachev, Dmitry Bitman, Anatolii Potapov 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23855v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要讨论企业客户支持工作流的自动化,使用copilot反馈和UI交互轨迹训练策略,不涉及大模型或深度学习技术原理创新,也未提及任何评分关键词中的技术。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一个在企业BPM平台中自动化客户支持工作流的系统,通过copilot反馈和UI交互轨迹训练策略,实现选择性自动化,减少人工干预并提升效率。
摘要翻译

我们提出了一套已部署的系统,可在企业业务流程管理(BPM)平台内实现端到端客户支持工作流的自动化。该方法在生产环境中具有可扩展性,并能利用已大规模生成的监督数据——即结构化的逐案例UI交互轨迹与低开销的副驾驶(copilot)反馈(操作员可接受建议或提供修正)——在两周内实现新流程的选择性自动化。分阶段部署流程会训练一个下一UI动作策略,从副驾驶反馈中学习一个评判模型(critic)以校准弃权机制,并在后台仅执行高置信度步骤,同时将不确定的决策交由操作员处理,并从更新后的UI状态继续执行。该设置使一名操作员能够监督多个并发会话,且仅在系统不确定时被中断。系统基于BPM接口的架构驱动视图运行,并包含生产环境下的监控与安全回退机制。在生产中,该系统实现了45%的会话自动化,并将平均处理时间降低了39%,且未降低支持质量水平。


摘要 (Abstract)

We present a deployed system that automates end-to-end customer support workflows inside an enterprise Business Process Management (BPM) platform. The approach is scalable in production and reaches selective automation within two weeks for a new process, leveraging supervision already generated at scale: structured per-case UI interaction traces and low-overhead copilot feedback, where operators either accept a suggestion or provide a correction. A staged deployment pipeline trains a next UI action policy, learns a critic from copilot feedback to calibrate abstention, and executes only high-confidence steps in the background while deferring uncertain decisions to operators and resuming from the updated UI state. This setup lets one operator supervise multiple concurrent sessions and be interrupted only when the system is uncertain. The system operates on a schema-driven view of the BPM interface and includes monitoring and safe fallbacks for production. In production, it automated 45% of sessions and reduced average handling time by 39% without degrading support quality level.


关键词: customer support, workflow automation, copilot feedback, selective autonomy, business process management, UI interaction traces


146. ❌ Translate or Simplify First: An Analysis of Cross-lingual Text Simplification in English and French

作者: Ido Dahan, Omer Toledano, Roey J. Gafter, Sharon Pardo, Oren Tsur, Hila Zahavi, Elior Sulem 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23844v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究跨语言文本简化(CLTS)中不同提示策略的效果,使用LLMs进行英语和法语之间的翻译和简化。核心相关关键词是Large Language Models,因为论文明确使用LLMs。其他关键词如Chain of Thought、In-context Learning等与论文内容无关,因为论文未涉及推理、上下文学习等主题。论文不涉及AI for Science,因为应用领域是自然语言处理而非科学领域。


!!! tip deepseek-chat TL;DR

该研究比较了不同提示策略(直接提示、组合提示、分解提示)在英语和法语跨语言文本简化中的效果,发现直接提示在保持语义方面最佳,而先翻译后简化在简化程度方面最优。
摘要翻译

跨语言文本简化(Cross-Lingual Text Simplification, CLTS)旨在通过同时处理语言复杂性和翻译问题,使内容在不同语言间更易理解。本研究探讨了使用大型语言模型(LLMs)在英语和法语之间进行CLTS时,不同提示策略的有效性。我们考察了五种不同的提示系统:一种直接提示,指示LLM同时进行翻译和简化;两种组合方法,即在单个提示中先翻译后简化或先简化后翻译;以及两种分解方法,即在连续且独立的提示中分别执行相同操作。这些系统在五个不同体裁的语料库(维基百科和医学文本)上,使用七种最先进的LLMs进行了评估。输出质量通过一个多维度评估框架进行衡量,该框架包括自动评估指标、全面的语言特征分析,以及针对简洁性和意义保留的人工评估。我们的研究结果表明,尽管直接提示在BLEU分数上始终最高(表明意义保真度),但先翻译后简化的方法在语言特征测量中展现出最高的简洁性。


摘要 (Abstract)

Cross-Lingual Text Simplification (CLTS) aims to make content more accessible across languages by simultaneously addressing both linguistic complexity and translation. This study investigates the effectiveness of different prompting strategies for CLTS between English and French using large language models (LLMs). We examine five distinct prompting systems: a direct prompt instructing the LLM to perform both translation and simplification simultaneously, two Composition approaches that either translate-then-simplify or simplify-then-translate within a single prompt, and two decomposition approaches that perform the same operations in separate, consecutive prompts. These systems are evaluated across a diverse set of five corpora of different genres (Wikipedia and medical texts) using seven state-of-the-art LLMs. Output quality is assessed through a multi-faceted evaluation framework comprising automatic metrics, comprehensive linguistic feature analysis, and human evaluation of simplicity and meaning preservation. Our findings reveal that while direct prompting consistently achieves the highest BLEU scores, indicating meaning fidelity, Translate-then-Simplify approaches demonstrate the highest simplicity, as measured by the linguistic features.


关键词: Cross-Lingual Text Simplification, Large Language Models, Prompting Strategies, Translation, Simplification, English, French


147. ❌ Reheat Nachos for Dinner? Evaluating AI Support for Cross-Cultural Communication of Neologisms

作者: Dayeon Ki, Yu Hou, Rachel Rudinger, Hal Daumé, Marine Carpuat, Fumeng Yang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23842v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究AI工具(包括LLM)在跨文化交流中帮助非母语者理解和使用新词的效果。虽然涉及AI,但未深入探讨大模型技术原理或创新,主要关注应用评估。因此,仅与’Large Language Models’有中等相关(8分),因为AI工具可能基于LLM,但论文未明确说明模型细节。其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文通过人类实验评估AI工具(如定义、改写、解释)在帮助非母语者学习和使用英语新词方面的效果,发现AI解释能最大程度提升母语者评价的交际能力,但非母语者的自我感知与实际能力存在差距。
摘要翻译

新词与新兴俚语在日常对话中占据核心地位,但对非母语者(NNS)而言,在与母语者(NS)进行跨文化交际时,准确理解并恰当使用这些词汇颇具挑战。非母语者越来越多地借助人工智能(AI)工具学习这类词汇。我们通过一项受试者研究(N=234)探讨了此类工具在非正式交流场景中的效用:非母语参与者在AI支持下学习英语新词,使用所学词汇向母语者朋友编写信息,并对两份提供的写作样本中新词的语境恰当性进行判断。通过母语者评估者对非母语者写作的交际能力评分,以及非母语者对语境恰当性的判断,我们比较了三种AI支持条件:AI定义、AI简化英文改写、AI含义与用法解释,并以非AI词典作为对照。研究表明,在母语者评定的交际能力方面,AI解释相较于无支持条件提升最大,而语境恰当性判断在各支持条件下无显著差异。非母语参与者自我报告的感知往往高估了母语者的评分,揭示了感知能力与实际能力之间的不匹配。我们进一步观察到非母语者与母语者写作之间存在显著差距,这凸显了当前AI工具的局限性,并为未来工具的设计提供了启示。


摘要 (Abstract)

Neologisms and emerging slang are central to daily conversation, yet challenging for non-native speakers (NNS) to interpret and use appropriately in cross-cultural communication with native speakers (NS). NNS increasingly make use of Artificial Intelligence (AI) tools to learn these words. We study the utility of such tools in mediating an informal communication scenario through a human-subjects study (N=234): NNS participants learn English neologisms with AI support, write messages using the learned word to an NS friend, and judge contextual appropriateness of the neologism in two provided writing samples. Using both NS evaluator-rated communicative competence of NNS-produced writing and NNS’ contextual appropriateness judgments, we compare three AI-based support conditions: AI Definition, AI Rewrite into simpler English, AI Explanation of meaning and usage, and Non-AI Dictionary for comparison. We show that AI Explanation yields the largest gains over no support in NS-rated competence, while contextual appropriateness judgments show indifference across support. NNS participants’ self-reported perceptions tend to overestimate NS ratings, revealing a mismatch between perceived and actual competence. We further observe a significant gap between NNS- and NS-produced writing, highlighting the limitations of current AI tools and informing design for future tools.


关键词: neologisms, cross-cultural communication, AI support, non-native speakers, communicative competence, contextual appropriateness, human-subjects study


148. ❌ One Size Fits None: Heuristic Collapse in LLM Investment Advice

作者: Jillian Ross, Andrew W. Lo 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23837v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.05.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究LLM在投资建议中的启发式崩溃现象,核心关注LLM输出是否真正整合多因素决策。高度相关关键词:LLMs(核心研究对象)、Mechanistic Interpretability(使用可解释代理模型分析)、Hallucination Mitigation(涉及事实性和输出质量)、RAG(提及网络搜索部分缓解但未解决)。其他关键词如MoE、SLM、Scaling Laws等完全无关。


!!! tip deepseek-chat TL;DR

该论文发现前沿LLM在投资建议中表现出启发式崩溃,即复杂决策被简化为少数主导因素(如风险容忍度),且网络搜索和模型规模无法完全解决该问题。
摘要翻译

大型语言模型正越来越多地被部署为高风险领域的顾问——回答医学问题、解读法律文件、推荐金融产品——在这些场景中,优质建议需要整合用户的完整背景信息,而非仅对显著的表层特征做出回应。我们研究了前沿大语言模型是否真正做到了这一点,抑或它们反而表现出启发式简化:一种将复杂的多因素决策系统性简化为少数主导输入的现象。我们在投资建议中研究了这一现象,因为法律标准明确要求根据客户的整体情况进行个性化推理。通过对大语言模型的输出应用可解释的替代模型,我们发现了系统性的启发式简化:投资配置决策主要由自我报告的风险承受能力决定,而其他相关因素的贡献微乎其微。我们进一步发现,网络搜索在一定程度上缓解了启发式简化,但并未解决这一问题。这些发现表明,启发式简化无法仅通过网络搜索增强或模型规模扩大来解决,并且将大语言模型部署为顾问需要审计其对输入的敏感性,而不仅仅是输出质量。


摘要 (Abstract)

Large language models are increasingly deployed as advisors in high-stakes domains – answering medical questions, interpreting legal documents, recommending financial products – where good advice requires integrating a user’s full context rather than responding to salient surface features. We investigate whether frontier LLMs actually do this, or whether they instead exhibit heuristic collapse: a systematic reduction of complex, multi-factor decisions to a small number of dominant inputs. We study the phenomenon in investment advice, where legal standards explicitly require individualized reasoning over a client’s full circumstances. Applying interpretable surrogate models to LLM outputs, we find systematic heuristic collapse: investment allocation decisions are largely determined by self-reported risk tolerance, while other relevant factors contribute minimally. We further find that web search partially attenuates heuristic collapse but does not resolve it. These findings suggest that heuristic collapse is not resolved by web search augmentation or model scale alone, and that deploying LLMs as advisors requires auditing input sensitivity, not just output quality.


关键词: Large Language Models, heuristic collapse, investment advice, interpretable surrogate models, risk tolerance, web search, factuality


149. ❌ Resource-Lean Lexicon Induction for German Dialects

作者: Robert Litschko, Barbara Plank, Diego Frassinelli 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23824v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.03.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究德语方言的词典归纳,使用随机森林等统计模型,与LLMs对比但并非核心创新。LLMs仅作为基线提及,其他关键词均未涉及。


!!! tip deepseek-chat TL;DR

该论文研究德语方言词典归纳,发现基于字符串相似度特征的随机森林模型在资源受限条件下优于大型语言模型,并展示了跨方言迁移能力。
摘要翻译

高质量词典的自动构建对于建设词汇资源至关重要,然而低资源语言与方言面临诸多挑战:标注人员获取受限、拼写变体程度高、大语言模型(LLMs)表现欠佳。我们通过实证研究表明,基于字符串相似性特征训练的统计模型(随机森林)在诱导德语方言词典方面效果惊人。这些模型不仅超越了大语言模型,还能实现跨方言迁移,并提供了一种轻量级的数据驱动替代方案。我们在双语词典归纳(BLI)任务上对模型进行内在评估,并在方言信息检索(IR)任务上开展外在评估。在BLI任务中,随机森林在资源消耗更少的情况下优于Mistral-123b模型;在基于BM25的方言信息检索中,使用我们的方言词典进行查询扩展,在nDCG@10指标上获得最高28.9%的相对提升,在Recall@100指标上获得最高50.7%的相对提升。鉴于方言资源稀缺的现状,我们进一步探究了模型在不同德语方言间的迁移能力,以及在不同训练数据规模下的表现。


摘要 (Abstract)

Automatic induction of high-quality dictionaries is essential for building lexical resources, yet low-resource languages and dialects pose several challenges: limited access to annotators, high degree of spelling variations, and poor performance of large language models (LLMs). We empirically show that statistical models (random forests) trained on string similarity features are surprisingly effective for inducing German dialect lexicons. They outperform LLMs, enable cross-dialect transfer, and offer a lightweight data-driven alternative. We evaluate our models intrinsically on bilingual lexicon induction (BLI) and extrinsically on dialect information retrieval (IR). On BLI, random forests outperform Mistral-123b while being more resource-lean. On dialect IR with BM25, using our dialect dictionaries for query expansion yields relative improvements of up to 28.9% in nDCG@10 and 50.7% in Recall@100. Motivated by the resource scarcity in dialects, we further investigate the extent to which models transfer across different German dialects, and their performance under varying amounts of training data.


关键词: bilingual lexicon induction, dialect, random forests, string similarity, cross-dialect transfer, resource-lean, German dialects


150. ❌ DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute

作者: Nishant Balepur, Malachi Hamada, Varsha Kishore, Sergey Feldman, Amanpreet Singh, Pao Siangliulue, Joseph Chee Chang, Rachel Rudinger, Eunsol Choi, Jordan Lee Boyd-Graber, Doug Downey, Aakanksha Naik 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23815v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究科学深度研究(DR)代理,用户与LLM驱动的系统交互以生成研究报告。核心涉及LLM代理(LLM Agents)和用户偏好预测,与’LLM Agents’高度相关(10分)。其他关键词如RLHF、RAG等未直接涉及,故评0分。


!!! tip deepseek-chat TL;DR

该论文通过收集用户对深度研究代理中间行动的反馈数据集DRACULA,发现预测用户偏好的关键挑战,并验证了利用用户历史交互生成行动的有效性。
摘要翻译

科学深度研究(Scientific Deep Research, DR)智能体通过将研究论文综合成多章节报告来回答用户查询。用户反馈可提升其效用,但现有协议仅对最终报告进行评分,这使得难以研究和学习DR智能体应采取哪些中间行动来改进报告。我们收集了DRACULA,这是首个包含DR中间行动用户反馈的数据集。在五周时间内,十九位计算机科学领域专家级研究人员向一个DR系统提出查询,该系统会提议行动(例如,“添加一个关于数据集的章节”)。我们的用户选择他们偏好的行动,然后判断输出报告是否成功应用了他们的选择,最终获得8,103条行动偏好和5,230条执行判断。在确认DR智能体能够执行DRACULA中的行动后,我们通过模拟研究了用户偏好行动的可预测性——即大语言模型(LLM)预测用户所选行动的能力——这是迈向学习生成有用行动的一步。我们发现:(1)LLM评判者最初难以预测行动选择,但在使用用户的完整选择历史时改进最大,而非使用用户自我报告或推断的用户上下文信号;(2)用户对同一查询的选择因未言明的目标而异,这成为模拟的瓶颈,并促使设计能让用户引导报告的功能;(3)我们的模拟结果指导了一项在线干预,该干预基于用户过去的交互生成新行动,在后续研究中用户最常选择这些行动。总体而言,尽管现有工作广泛研究了执行环节,但DRACULA揭示了一个关键挑战:首先决定应执行哪些行动。我们开源了DRACULA的研究设计、用户反馈及模拟任务,以推动未来关于长周期智能体行动反馈的研究。


摘要 (Abstract)

Scientific Deep Research (DR) agents answer user queries by synthesizing research papers into multi-section reports. User feedback can improve their utility, but existing protocols only score the final report, making it hard to study and learn which intermediate actions DR agents should take to improve reports. We collect DRACULA, the first dataset with user feedback on intermediate actions for DR. Over five weeks, nineteen expert CS researchers ask queries to a DR system that proposes actions (e.g., “Add a section on datasets”). Our users select actions they prefer, then judge whether an output report applied their selections successfully, yielding 8,103 action preferences and 5,230 execution judgments. After confirming a DR agent can execute DRACULA’s actions, we study the predictability of user-preferred actions via simulation-how well LLMs predict the actions users select-a step toward learning to generate useful actions. We discover: (1) LLM judges initially struggle to predict action selections, but improve most when using a user’s full selection history, rather than self-reported or extrapolated user context signals; (2) Users’ selections for the same query differ based on unstated goals, bottlenecking simulation and motivating affordances that let users steer reports; and (3) Our simulation results inform an online intervention that generates new actions based on the user’s past interactions, which users pick most often in follow-up studies. Overall, while work extensively studies execution, DRACULA reveals a key challenge is deciding which actions to execute in the first place. We open-source DRACULA’s study design, user feedback, and simulation tasks to spur future work on action feedback for long-horizon agents.


关键词: Scientific Deep Research, LLM Agents, User Feedback, Action Preferences, Simulation, DRACULA Dataset


151. ❌ ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction

作者: Zichun Guo, Yuling Shi, Wenhao Zeng, Chao Hu, Haotian Lin, Terry Yue Zhuo, Jiawei Chen, Xiaodong Gu, Wenping Ma 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23813v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.08.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.08.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多模态大模型在文档重建中的语义推理能力,核心是评估MLLMs在碎片文档恢复任务中的表现。与’Large Language Models’高度相关(10分),因为涉及多模态LLM。涉及语义推理和视觉模式识别,与’Chain of Thought’和’System 2 Thinking’有一定关联(各8分),因为任务需要多步推理和深度思考。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

论文提出ShredBench基准,评估多模态大模型在碎片文档重建中的语义推理能力,发现当前MLLMs在视觉不连续条件下表现显著下降。
摘要翻译

多模态大语言模型(Multimodal Large Language Models, MLLMs)在视觉丰富文档理解(Visually Rich Document Understanding, VRDU)任务中取得了显著性能,但其能力主要是在原始、结构良好的文档图像上进行评估。我们考虑从碎片化碎片中进行内容复原这一具有挑战性的VRDU场景,该场景要求在显著的内容不连续条件下整合视觉模式识别与语义推理。为促进复杂VRDU任务的系统评估,我们引入了ShredBench基准,该基准由一个自动化生成流水线支持,可直接从Markdown渲染出碎片化文档。所提出的流水线通过允许灵活整合最新或未见过的文本源以防止训练数据污染,从而确保评估有效性。ShredBench评估了四种场景(英文、中文、代码、表格),并设置了三种碎片粒度(8片、12片、16片)。对当前最先进MLLMs的实证评估揭示了一个显著的性能差距:该方法在完整文档上有效;然而,一旦文档被碎片化,复原便成为重大挑战,随着碎片化程度增加,NED(归一化编辑距离)急剧下降。我们的研究结果凸显了当前MLLMs缺乏弥合视觉不连续性所需的细粒度跨模态推理能力,从而指出了鲁棒VRDU研究中的一个关键缺口。


摘要 (Abstract)

Multimodal Large Language Models (MLLMs) have achieved remarkable performance in Visually Rich Document Understanding (VRDU) tasks, but their capabilities are mainly evaluated on pristine, well-structured document images. We consider content restoration from shredded fragments, a challenging VRDU setting that requires integrating visual pattern recognition with semantic reasoning under significant content discontinuities. To facilitate systematic evaluation of complex VRDU tasks, we introduce ShredBench, a benchmark supported by an automated generation pipeline that renders fragmented documents directly from Markdown. The proposed pipeline ensures evaluation validity by allowing the flexible integration of latest or unseen textual sources to prevent training data contamination. ShredBench assesses four scenarios (English, Chinese, Code, Table) with three fragmentation granularities (8, 12, 16 pieces). Empirical evaluations on state-of-the-art MLLMs reveal a significant performance gap: The method is effective on intact documents; however, once the document is shredded, restoration becomes a significant challenge, with NED dropping sharply as fragmentation increases. Our findings highlight that current MLLMs lack the fine-grained cross-modal reasoning required to bridge visual discontinuities, identifying a critical gap in robust VRDU research.


关键词: Multimodal Large Language Models, Document Reconstruction, Semantic Reasoning, Visually Rich Document Understanding, Benchmark, Shredded Fragments, Cross-modal Reasoning


作者: Tianchun Li, Haochen Liu, Vishwa Pardeshi, Xingchen Wang, Tianci Liu, Huijun Zhao, Wei Fan, Jing Gao 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23809v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.012.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.08.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.010.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.010.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于小语言模型(SLMs)在法律推理任务上的能力提升,通过诊断驱动合成框架(LegalDrill)从教师模型中提取并迭代优化推理轨迹,结合监督微调(SFT)和直接偏好优化(DPO)训练学生模型。核心关键词包括SLMs、DPO、SFT、自反思验证等,与’Small Language Models’高度相关(12分),与’Post-training/SFT’(8分)和’RLHF/DPO’(10分)相关,与’Self-Correction’(10分)相关。其他关键词如大语言模型、MoE、RAG等不相关。


!!! tip deepseek-chat TL;DR

LegalDrill提出一种诊断驱动的合成框架,通过从教师模型提取并自反思优化推理轨迹,结合SFT和DPO训练小语言模型,显著提升其法律推理能力,无需昂贵的人工标注。
摘要翻译

小型语言模型(SLMs)因其高效性和低运行成本,在实际部署中具有广阔前景。然而,其有限的能力难以应对需要连贯的法条解释与逻辑一致推理的高风险法律推理任务。此外,针对此类任务训练SLMs需要高质量且简洁的推理轨迹,而人工收集此类数据的成本极高,且通过标准拒绝采样法难以筛选——该方法缺乏超越最终裁决的细粒度。为解决这些挑战,我们提出{LegalDrill},一种诊断驱动的合成框架,通过细粒度提示从能力较强的教师模型中提取并迭代优化推理轨迹,随后采用自我反思验证机制自适应地为SLM学生模型筛选最有效的数据。由此产生的数据通过监督微调与直接偏好优化赋能SLM训练。在多个法律基准上的大量实验表明,{LegalDrill}显著增强了代表性SLMs的法律推理能力,同时规避了对稀缺专家标注的需求,为构建可扩展的实用法律推理系统开辟了路径。


摘要 (Abstract)

Small language models (SLMs) are promising for real-world deployment due to their efficiency and low operational cost. However, their limited capacity struggles with high-stakes legal reasoning tasks that require coherent statute interpretation and logically consistent deduction. Furthermore, training SLMs for such tasks demands high-quality, concise reasoning trajectories, which are prohibitively expensive to manually collect and difficult to curate via standard rejection sampling, lacking granularity beyond final verdicts. To address these challenges, we propose {LegalDrill}, a diagnosis-driven synthesis framework that extracts and iteratively refines reasoning trajectories from a capable teacher via fine-grained prompting, then a self-reflective verification is employed to adaptively select the most effective data for the SLM student. The resulting data empower SLM training through supervised fine-tuning and direct preference optimization. Extensive experiments on several legal benchmarks demonstrate that {LegalDrill} significantly bolsters the legal reasoning capabilities of representative SLMs while bypassing the need for scarce expert annotations, paving a scalable path toward practical legal reasoning systems.


关键词: Small Language Models, Legal Reasoning, Diagnosis-Driven Synthesis, Self-Reflective Verification, Supervised Fine-tuning, Direct Preference Optimization, LegalDrill


153. ❌ Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale

作者: Avi-ad Avraam Buskila 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23801v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.010.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.010.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.010.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.012.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.08.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文核心研究小规模LLM(4B参数)在医学问答中的应用,对比领域微调(Domain Fine-tuning)与检索增强生成(RAG)的效果。关键词评分:Large Language Models(12分)直接相关;Small Language Models(10分)强调小模型;Pre-training/Continual Pre-training/Domain Adaptation(10分)涉及领域微调;Post-training/SFT(10分)涉及微调;Retrieval-Augmented Generation(12分)核心对比方法;Quantization(8分)提及4-bit量化;AI for Science(10分)医学AI应用。其他关键词如MoE、Scaling Laws等不相关。


!!! tip deepseek-chat TL;DR

该论文在4B参数规模下对比了领域微调和检索增强生成在医学多选题问答中的效果,发现领域微调显著优于RAG,而RAG未带来统计显著提升。
摘要翻译

在医疗问答场景中部署小型开放权重大语言模型(LLMs)的实践者面临一个反复出现的设计选择:是投入领域微调模型,还是保留通用模型并在推理时通过检索增强生成(RAG)注入领域知识。我们通过固定模型规模、提示模板、解码温度、检索流程和评估协议,仅改变以下两个因素来隔离这一权衡:(i)模型是否经过领域适配(Gemma 3 4B 与 MedGemma 4B,两者均采用4比特量化并通过Ollama提供服务);(ii)是否将来自医学知识语料库的检索段落插入提示中。我们在完整的MedQA-USMLE四选项测试集(1,273道题)上评估了这一2x2设计的全部四个单元,每道题重复三次(共15,276次LLM调用)。领域微调在多数投票准确率上相较于通用4B基线提升了+6.8个百分点(53.3% 对比 46.4%,McNemar检验 p < 10^-4)。基于MedMCQA解释的RAG在两种模型上均未产生统计显著的增益,且在领域微调模型中点估计值略呈负值(-1.9个百分点,p = 0.16)。在此规模及该基准测试上,编码于权重中的领域知识优于上下文提供的领域知识。我们公开了完整的实验代码和JSONL追踪记录以支持复现。


摘要 (Abstract)

Practitioners deploying small open-weight large language models (LLMs) for medical question answering face a recurring design choice: invest in a domain-fine-tuned model, or keep a general-purpose model and inject domain knowledge at inference time via retrieval-augmented generation (RAG). We isolate this trade-off by holding model size, prompt template, decoding temperature, retrieval pipeline, and evaluation protocol fixed, and varying only (i) whether the model has been domain-adapted (Gemma 3 4B vs. MedGemma 4B, both 4-bit quantized and served via Ollama) and (ii) whether retrieved passages from a medical knowledge corpus are inserted into the prompt. We evaluate all four cells of this 2x2 design on the full MedQA-USMLE 4-option test split (1,273 questions) with three repetitions per question (15,276 LLM calls). Domain fine-tuning yields a +6.8 percentage-point gain in majority-vote accuracy over the general 4B baseline (53.3% vs. 46.4%, McNemar p < 10^-4). RAG over MedMCQA explanations does not produce a statistically significant gain in either model, and in the domain-tuned model the point estimate is slightly negative (-1.9 pp, p = 0.16). At this scale and on this benchmark, domain knowledge encoded in weights dominates domain knowledge supplied in context. We release the full experiment code and JSONL traces to support replication.


关键词: Domain Fine-tuning, Retrieval-Augmented Generation, Medical Question Answering, Small Language Models, MedQA-USMLE, 4-bit Quantization, Gemma 3, MedGemma


154. ❌ SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning

作者: Alexis Limozin, Eduard Durech, Torsten Hoefler, Imanol Schlag, Valentina Pyatkin 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23747v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.015.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.015.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.010.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM推理中的训练策略,比较SFT-then-RL与混合策略方法,涉及SFT和RLHF/DPO等后训练技术,同时与CoT推理相关。其他关键词如MoE、SLM、RAG等均不相关。


!!! tip deepseek-chat TL;DR

该论文发现并修复了多个框架中的bug,证明标准SFT-then-RL流水线在数学推理任务上显著优于混合策略方法。
摘要翻译

近期针对大语言模型推理的混合策略优化方法(将监督学习与强化学习信号交错或融合)声称相较于标准的“先SFT后RL”流程有所改进。我们发现,众多近期发表的研究论文依赖于一个由两个不同错误导致的有缺陷基线:DeepSpeed中一个卸载至CPU的优化器错误(该错误在梯度累积期间静默丢弃中间微批次,影响了包括TRL、OpenRLHF和Llama-Factory在内的多个下游框架),以及OpenRLHF中一个损失聚合错误(该错误错误地加权了每个小批次的损失)。这两个错误共同抑制了SFT性能,其中优化器错误造成了大部分差距,而损失聚合错误则贡献了较小的额外影响。一旦修正,标准的“先SFT后RL”流程在数学基准测试中,使用Qwen2.5-Math-7B时超越了所有我们评估的已发表混合策略方法达+3.8个点,使用Llama-3.1-8B时则达+22.2个点。即使是仅包含50个RL步骤的截断变体,在数学基准测试中也优于混合策略方法,同时使用了更少的FLOPs。


摘要 (Abstract)

Recent mixed-policy optimization methods for LLM reasoning that interleave or blend supervised and reinforcement learning signals report improvements over the standard SFT-then-RL pipeline. We show that numerous recently published research papers rely on a faulty baseline caused by two distinct bugs: a CPU-offloaded optimizer bug in DeepSpeed that silently drops intermediate micro-batches during gradient accumulation (affecting multiple downstream frameworks including TRL, OpenRLHF and Llama-Factory), and a loss aggregation bug in OpenRLHF that incorrectly weights per-mini-batch losses. Together they suppress SFT performance, with the optimizer bug accounting for most of the gap and the loss aggregation bug contributing a smaller additional effect. Once corrected, the standard SFT-then-RL pipeline surpasses every published mixed-policy method we evaluate by +3.8 points on math benchmarks with Qwen2.5-Math-7B and by +22.2 points with Llama-3.1-8B. Even a truncated variant with just 50 RL steps outperforms mixed-policy methods on math benchmarks while using fewer FLOPs.


关键词: LLM reasoning, SFT, RLHF, DPO, mixed-policy optimization, math benchmarks, DeepSpeed optimizer bug, OpenRLHF loss aggregation bug


155. ❌ Multimodal QUD: Inquisitive Questions from Scientific Figures

作者: Yating Wu, William Rudman, Venkata S Govindarajan, Alexandros G. Dimakis, Junyi Jessy Li 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23733v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要研究科学图表的多模态问题生成,属于AI for Science领域,与’AI for Science’高度相关(10分)。其他关键词如大模型、微调、推理等均未直接涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出多模态QUD框架,通过扩展问题-讨论理论到多模态,生成基于科学图表和上下文的高质量探究性问题,并微调VLM以提升多模态推理能力。
摘要翻译

在阅读时提出探究性问题并寻找其答案,是人类话语理解、好奇心及创造性思维的重要组成部分,先前的研究已在纯文本场景中对此进行了探讨。然而,在科学或研究论文中,许多关键结论是通过图表及其分析性文字共同传达的。尽管科学可视化已被用于评估视觉语言模型(Vision-Language Models, VLMs)的能力,但当前的基准测试仅限于那些仅需从图表中提取信息的问题。这类问题仅涉及低层次推理,未考虑图表出现的上下文语境,也无法反映作者希望达成的交流目标。我们生成了探究性问题,其深度可媲美人类在阅读科学论文时提出的问题,这些问题以图表和论文上下文为条件,并需要跨两种模态进行推理。为此,我们将“讨论中问题”(Questions Under Discussion, QUD)这一语言学理论从纯文本扩展至多模态领域,在该理论中,隐含问题会随着话语推进而被提出并解决。我们提出了MQUD数据集,其中包含研究论文,且此类问题已被明确化并由原始作者进行标注。研究表明,在MQUD上微调视觉语言模型,能够使模型从生成通用的低层次视觉问题转向生成需要高层次多模态推理的、内容特定的基础性问题,从而产生更高质量、更具视觉基础的多模态QUD生成结果。


摘要 (Abstract)

Asking inquisitive questions while reading, and looking for their answers, is an important part in human discourse comprehension, curiosity, and creative ideation, and prior work has investigated this in text-only scenarios. However, in scientific or research papers, many of the critical takeaways are conveyed through both figures and the text that analyzes them. While scientific visualizations have been used to evaluate Vision-Language Models (VLMs) capabilities, current benchmarks are limited to questions that focus simply on extracting information from them. Such questions only require lower-level reasoning, do not take into account the context in which a figure appears, and do not reflect the communicative goals the authors wish to achieve. We generate inquisitive questions that reach the depth of questions humans generate when engaging with scientific papers, conditioned on both the figure and the paper’s context, and require reasoning across both modalities. To do so, we extend the linguistic theory of Questions Under Discussion (QUD) from being text-only to multimodal, where implicit questions are raised and resolved as discourse progresses. We present MQUD, a dataset of research papers in which such questions are made explicit and annotated by the original authors. We show that fine-tuning a VLM on MQUD shifts the model from generating generic low-level visual questions to content-specific grounding that requires a high-level of multimodal reasoning, yielding higher-quality, more visually grounded multimodal QUD generation.


关键词: Multimodal QUD, Inquisitive Questions, Scientific Figures, Vision-Language Models, Multimodal Reasoning, Questions Under Discussion, Fine-tuning


156. ❌ HeadRouter: Dynamic Head-Weight Routing for Task-Adaptive Audio Token Pruning in Large Audio Language Models

作者: Peize He, Yaodi Luo, Xiaoqian Liu, Xuyang Liu, Jiahang Deng, Yaosong Du, Bangyu Li, Xiyan Gui, Yuxuan Chen, Linfeng Zhang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23717v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究大型音频语言模型(LALMs)中的token压缩,提出HeadRouter方法,通过感知注意力头在不同音频任务中的重要性进行剪枝。核心涉及大语言模型(LLMs)的应用,但未涉及其他关键词如MoE、SLM、Scaling Laws等。因此,仅’Large Language Models’得高分,其余关键词得0分。


!!! tip deepseek-chat TL;DR

本文提出HeadRouter,一种无需训练的头重要性感知token剪枝方法,通过动态路由不同音频任务中注意力头的权重,在大型音频语言模型中实现高效token压缩,在保留70%音频token时达到甚至超越基线性能。
摘要翻译

近期的大型音频语言模型(LALMs)在处理扩展的多模态序列方面展现出卓越能力,但推理成本高昂。令牌压缩是一种直接减少序列中冗余令牌的有效方法。现有压缩方法通常假设LALMs中所有注意力头对各类音频任务的贡献均等,并通过平均所有头的得分来计算令牌重要性。然而,我们的分析表明,注意力头在不同音频领域表现出截然不同的行为。我们进一步揭示,仅有一组稀疏的注意力头对音频有主动响应,且在处理语义任务与声学任务时表现完全不同。基于这一发现,我们提出HeadRouter——一种感知注意力头重要性的令牌剪枝方法,该方法能够识别不同音频任务中注意力头的重要性差异,从而最大程度保留关键令牌。HeadRouter无需训练,可适用于多种LALMs。在AudioMarathon和MMAU-Pro基准上的大量实验表明,HeadRouter实现了最先进的压缩性能,即使在仅保留70%音频令牌的情况下仍能超越基线模型,并在Qwen2.5-Omni-3B和Qwen2.5-Omni-7B上分别达到原始模型平均性能的101.8%和103.0%。


摘要 (Abstract)

Recent large audio language models (LALMs) demonstrate remarkable capabilities in processing extended multi-modal sequences, yet incur high inference costs. Token compression is an effective method that directly reduces redundant tokens in the sequence. Existing compression methods usually assume that all attention heads in LALMs contribute equally to various audio tasks and calculate token importance by averaging scores across all heads. However, our analysis demonstrates that attention heads exhibit distinct behaviors across diverse audio domains. We further reveal that only a sparse subset of attention heads actively responds to audio, with completely different performance when handling semantic and acoustic tasks. In light of this observation, we propose HeadRouter, a head-importance-aware token pruning method that perceives the varying importance of attention heads in different audio tasks to maximize the retention of crucial tokens. HeadRouter is training-free and can be applied to various LALMs. Extensive experiments on the AudioMarathon and MMAU-Pro benchmarks demonstrate that HeadRouter achieves state-of-the-art compression performance, exceeding the baseline model even when retaining 70% of the audio tokens and achieving 101.8% and 103.0% of the vanilla average on Qwen2.5-Omni-3B and Qwen2.5-Omni-7B, respectively.


关键词: Large Audio Language Models, Token Pruning, Attention Head Routing, Inference Efficiency, Audio Token Compression, Task-Adaptive Pruning


157. ❌ AIPsy-Affect: A Keyword-Free Clinical Stimulus Battery for Mechanistic Interpretability of Emotion in Language Models

作者: Michael Keeman 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23719v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.015.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于大语言模型(LLMs)中情感的可解释性研究,核心是机械可解释性(Mechanistic Interpretability),包括线性探针、激活修补、稀疏自编码器特征分析、因果消融、引导向量提取等方法。论文开发了AIPsy-Affect刺激库,用于消除情感关键词的混淆。因此,与’Large Language Models’高度相关(10分),与’Mechanistic Interpretability’核心相关(15分)。其他关键词如MoE、SLMs、Scaling Laws等均不涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了AIPsy-Affect,一个无关键词的临床刺激库,用于大语言模型情感机制的机械可解释性研究,通过匹配对设计确保内部表征差异不基于情感关键词。
摘要翻译

大型语言模型中情感机制的机械可解释性研究——线性探针(linear probing)、激活修补(activation patching)、稀疏自编码器(sparse autoencoder, SAE)特征分析、因果消融(causal ablation)、引导向量提取(steering vector extraction)——依赖于包含其所测试情感词汇的刺激材料。当探针在“我非常愤怒”这一语句上被激活时,尚不清楚模型是检测到了“愤怒”这一情感,还是检测到了“愤怒”这个词汇。这两种解读对后续所有关于情感回路、特征及干预措施的主张会产生截然不同的影响。我们发布了AIPsy-Affect,这是一套包含480个项目的临床刺激材料库,从刺激层面消除了这一混淆因素:其中192个无关键词的短文片段仅通过叙事情境唤起Plutchik八种基本情感中的每一种,192个匹配的中性对照片段在人物、场景、长度和表层结构上与前者相同,但情感成分被精确移除,此外还包含了中等强度与区分效度的分组。这种匹配对结构为线性探针、激活修补、SAE特征分析、因果消融和引导向量提取提供了强有力的方法论保障:任何能够区分临床项目与其匹配中性对照的内部表征,都不可能基于情感关键词的存在而实现。一套包含三种方法的自然语言处理验证工具——词袋情感分析(bag-of-words sentiment)、情感类别词典(emotion-category lexicon)以及上下文变换器分类器(contextual transformer classifier)——证实了这一特性:词袋方法仅能识别情境词汇,而上下文分类器能够检测到情感(p < 10^-15),但无法识别其类别(top-1准确率仅为5.2%,而在富含关键词的对照材料上则为82.5%)。AIPsy-Affect将我们此前包含96个项目的刺激材料库(arXiv:2603.22295)扩展了四倍,并以MIT开源许可协议公开发布。


摘要 (Abstract)

Mechanistic interpretability research on emotion in large language models – linear probing, activation patching, sparse autoencoder (SAE) feature analysis, causal ablation, steering vector extraction – depends on stimuli that contain the words for the emotions they test. When a probe fires on “I am furious”, it is unclear whether the model has detected anger or detected the word “furious”. The two readings have very different consequences for every downstream claim about emotion circuits, features, and interventions. We release AIPsy-Affect, a 480-item clinical stimulus battery that removes the confound at the stimulus level: 192 keyword-free vignettes evoking each of Plutchik’s eight primary emotions through narrative situation alone, 192 matched neutral controls that share characters, setting, length, and surface structure with the affect surgically removed, plus moderate-intensity and discriminant-validity splits. The matched-pair structure supports linear probing, activation patching, SAE feature analysis, causal ablation, and steering vector extraction under a strong methodological guarantee: any internal representation that distinguishes a clinical item from its matched neutral cannot be doing so on the basis of emotion-keyword presence. A three-method NLP defense battery – bag-of-words sentiment, an emotion-category lexicon, and a contextual transformer classifier – confirms the property: bag-of-words methods see only situational vocabulary, and a contextual classifier detects affect (p < 10^-15) but cannot identify the category (5.2% top-1 vs. 82.5% on a keyword-rich control). AIPsy-Affect extends our earlier 96-item battery (arXiv:2603.22295) by a factor of four and is released openly under MIT license.


关键词: Mechanistic Interpretability, Large Language Models, Emotion, Stimulus Battery, Linear Probing, Activation Patching, Sparse Autoencoder, Causal Ablation


158. ❌ Agri-CPJ: A Training-Free Explainable Framework for Agricultural Pest Diagnosis Using Caption-Prompt-Judge and LLM-as-a-Judge

作者: Wentao Zhang, Qi Zhang, Mingkun Xu, Mu You, Henghua Shen, Zhongzhi He, Keyan Jin, Derek F. Wong, Tao Fang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23701v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.08.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.012.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.08.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出Agri-CPJ框架,利用大视觉语言模型(LLM)生成结构化描述,并通过LLM法官进行诊断,涉及LLM应用、幻觉缓解(通过描述精炼提高准确性)、可解释性(结构化描述和法官理由提供审计轨迹)、自校正(描述迭代精炼)以及上下文学习(少样本)。与AI for Science相关(农业病虫害诊断)。其他关键词如MoE、SLM、预训练等不相关。


!!! tip deepseek-chat TL;DR

该论文提出一个无需训练的少样本框架Agri-CPJ,通过大视觉语言模型生成结构化描述并利用LLM法官进行农业病虫害诊断,显著提高了分类准确性和可解释性。
摘要翻译

从田间照片进行作物病害诊断面临两个常见问题:在基准测试中得分较高的模型经常出现物种名称幻觉,且即使预测正确,其推理过程通常对从业者而言难以获取。本文提出Agri-CPJ(描述-提示-评判,Caption-Prompt-Judge)框架,这是一种无需训练的小样本框架,其中大型视觉语言模型首先生成结构化的形态学描述,通过多维质量门控进行迭代优化,随后再回答任何诊断问题。接着从互补视角生成两个候选回答,并由大语言模型(LLM)评判器基于领域特定标准选择更优者。描述优化是影响最大的独立模块:消融实验证实,跳过该步骤会持续降低两个测试模型的下游准确率。在CDDMBench上,将GPT-5-Nano与GPT-5-mini生成的描述配对,相较于无描述基线,病害分类准确率提升\textbf{+22.7}个百分点,问答(QA)得分提升\textbf{+19.5}分。在未经修改的AgMMU-MCQs评估中,GPT-5-Nano达到77.84%,Qwen-VL-Chat达到64.54%,尽管格式从开放式问答转为多项选择,这两个模型仍达到或超过大多数同等规模的开源模型。结构化描述与评判依据共同构成可读的审计轨迹:若从业者对诊断结果有异议,可定位到具体描述观察中的错误。代码与数据已公开:https://github.com/CPJ-Agricultural/CPJ-Agricultural-Diagnosis


摘要 (Abstract)

Crop disease diagnosis from field photographs faces two recurring problems: models that score well on benchmarks frequently hallucinate species names, and when predictions are correct, the reasoning behind them is typically inaccessible to the practitioner. This paper describes Agri-CPJ (Caption-Prompt-Judge), a training-free few-shot framework in which a large vision-language model first generates a structured morphological caption, iteratively refined through multi-dimensional quality gating, before any diagnostic question is answered. Two candidate responses are then generated from complementary viewpoints, and an LLM judge selects the stronger one based on domain-specific criteria. Caption refinement is the component with the largest individual impact: ablations confirm that skipping it consistently degrades downstream accuracy across both models tested. On CDDMBench, pairing GPT-5-Nano with GPT-5-mini-generated captions yields \textbf{+22.7} pp in disease classification and \textbf{+19.5} points in QA score over no-caption baselines. Evaluated without modification on AgMMU-MCQs, GPT-5-Nano reached 77.84% and Qwen-VL-Chat reached 64.54%, placing them at or above most open-source models of comparable scale despite the format shift from open-ended to multiple-choice. The structured caption and judge rationale together constitute a readable audit trail: a practitioner who disagrees with a diagnosis can identify the specific caption observation that was incorrect. Code and data are publicly available https://github.com/CPJ-Agricultural/CPJ-Agricultural-Diagnosis


关键词: Agricultural Pest Diagnosis, Large Vision-Language Model, Caption-Prompt-Judge, LLM-as-a-Judge, Hallucination Mitigation, Explainable AI, Few-shot Learning, Domain-specific Diagnosis


159. ❌ Benchmarking Testing in Automated Theorem Proving

作者: Jongyoon Kim, Hojae Han, Seung-won Hwang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23698v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用LLMs进行形式定理证明,并提出了基于编译测试的评估框架T。与’Large Language Models’高度相关(10分),因为LLMs是论文的核心技术。其他关键词如’Pre-training’、‘Fine-tuning’、‘RAG’、‘CoT’等均未在摘要中提及,因此评分为0。论文属于AI for Science(定理证明),但未涉及生物信息学或化学信息学,故AI for Science评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于编译测试的语义正确性评估框架T,用于评估大语言模型生成的形式定理,实验表明现有模型在语义指标上表现不佳,揭示了定理生成能力的差距。
摘要翻译

近年来,大型语言模型(LLMs)在形式化定理证明方面展现出潜力,但语义正确性的评估仍具挑战性。现有评估方法依赖于间接指标,例如与人工标注证明的词汇重叠度,或代价高昂的人工检查。受代码生成领域从词汇比较转向基于测试的评估这一趋势启发,我们提出T框架,用于评估形式化定理的语义正确性:仅当生成定理的所有依赖后继定理(successor theorems)均能成功编译时,该定理才被视为正确,这类似于集成测试。我们从5个真实的Lean 4代码库中构建了一个基准测试集,包含2,206个问题,平均每个问题配有41个后继定理,且全部自动提取,无需人工干预。实验表明,尽管最先进的模型在编译成功率上表现优异,但在我们的语义度量下其性能显著下降。最佳模型Claude-Sonnet-4.5在同时提供自然语言证明与后继定理作为上下文的情况下,完整测试集上的测试准确率(Testing Accuracy)仅为38.9%,揭示了当前定理生成能力中的关键差距。


摘要 (Abstract)

Recent advances in large language models (LLMs) have shown promise in formal theorem proving, yet evaluating semantic correctness remains challenging. Existing evaluations rely on indirect proxies such as lexical overlap with human-annotated proof, or expensive manual inspection. Inspired by the shift from lexical comparison to test-based evaluation in code generation, we propose T , a framework that evaluates the semantic correctness of formal theorems: a generated theorem is considered correct only if all dependent successor theorems compile successfully, analogous to integration testing. We construct a benchmark from 5 real-world Lean 4 repositories, comprising 2,206 problems paired with 41 successor theorems on average, automatically extracted without human effort. Experiments demonstrate that while state-of-the-art models achieve high compilation success, they perform significantly worse under our semantic metric. The best model, Claude-Sonnet-4.5, achieves only 38.9% Testing Accuracy on the full set, given both natural language proof and successor theorems as context, revealing a critical gap in current theorem generation capabilities.


关键词: Large Language Models, Automated Theorem Proving, Benchmarking, Semantic Correctness, Lean 4, Compilation Testing, Theorem Generation


160. ❌ Rank, Head-Channel Non-Identifiability, and Symmetry Breaking: A Precise Analysis of Representational Collapse in Transformers

作者: Giansalvo Cirrincione 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23681v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.08.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究Transformer中的表示坍塌问题,包括秩坍塌和头-通道不可识别性,属于Transformer理论分析,与可解释性(Mechanistic Interpretability)有一定关联(8分),但与其他关键词如LLMs、MoE、RLHF等完全无关。论文不涉及大模型应用或技术原理创新,仅关注基础理论,因此大部分关键词得0分。


!!! tip deepseek-chat TL;DR

该论文揭示了Transformer中秩坍塌现象的完整图景,指出层归一化保持仿射秩、残差连接阻止秩坍塌而MLP生成新特征方向,并识别了头-通道不可识别性,提出位置门控输出投影作为部分解决方案。
摘要翻译

董等人(2021)的一项被广泛引用的结果表明,仅由自注意力机制构建、不含跳跃连接或前馈层的Transformer会遭受快速秩坍缩(rank collapse):所有词元表示收敛至单一方向。其提出的补救措施是MLP。我们证明,这一图景在董等人研究的范围内虽正确,但在对架构理解至关重要的方面并不完整。

本文确立了三个结果。第一,层归一化(layer normalisation)精确地具有仿射秩中性(affine-rank-neutral):它严格保持词元表示集的仿射秩。广泛流传的“LN不起作用”的说法并不精确;正确的表述更为明确。第二,在测度论意义上,残差连接(residual connections)在真实Transformer(如BERT-base)中普遍阻碍秩坍缩,且无需MLP的参与。MLP不可替代的功能在于:生成原始词元嵌入(token embeddings)线性张成空间之外的特征方向,而任何注意力层堆叠都无法产生这种方向。第三,识别出一种不同于秩坍缩的现象:头通道不可辨识性(head-channel non-identifiability)。在多头注意力通过输出投影(output projection)对各头输出求和后,个体贡献无法规范地归因于特定头;从混合信号中恢复单个头时,每层存在n(H-1)d_k个自由度的歧义。MLP无法补救此问题,因其作用于求和后的信号。

本文提出一种建设性的部分补救措施:位置门控输出投影(position-gated output projection, PG-OP),其参数开销低于标准输出投影的1.6%。文献中识别的四种坍缩现象——深度方向秩坍缩、宽度方向秩坍缩、头通道不可辨识性以及熵坍缩(entropy collapse)——被统一于一个对称性破缺(symmetry-breaking)框架下,每种现象对应Transformer前向传播中一种不同的对称性。


摘要 (Abstract)

A widely cited result by Dong et al. (2021) showed that Transformers built from self-attention alone, without skip connections or feed-forward layers, suffer from rapid rank collapse: all token representations converge to a single direction. The proposed remedy was the MLP. We show that this picture, while correct in the regime studied by Dong, is incomplete in ways that matter for architectural understanding. Three results are established. First, layer normalisation is precisely affine-rank-neutral: it preserves the affine rank of the token representation set exactly. The widespread claim that LN “plays no role” is imprecise; the correct statement is sharper. Second, residual connections generically obstruct rank collapse in real Transformers such as BERT-base, in a measure-theoretic sense, without contribution from the MLP. The MLP’s irreplaceable function is different: generating feature directions outside the linear span of the original token embeddings, which no stack of attention layers can produce. Third, a phenomenon distinct from rank collapse is identified: head-channel non-identifiability. After multi-head attention sums per-head outputs through the output projection, individual contributions cannot be canonically attributed to a specific head; n(H-1)d_k degrees of freedom per layer remain ambiguous when recovering a single head from the mixed signal. The MLP cannot remedy this because it acts on the post-summation signal. A constructive partial remedy is proposed: a position-gated output projection (PG-OP) at parameter overhead below 1.6% of the standard output projection. The four collapse phenomena identified in the literature – rank collapse in depth, in width, head-channel non-identifiability, and entropy collapse – are unified under a symmetry-breaking framework, each corresponding to a distinct symmetry of the Transformer’s forward pass.


关键词: rank collapse, representational collapse, layer normalization, residual connections, multi-head attention, head-channel non-identifiability, symmetry breaking, Transformers


161. ❌ Neural Grammatical Error Correction for Romanian

作者: Teodor-Mihai Cotet, Stefan Ruseti, Mihai Dascalu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23627v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.08.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究罗马尼亚语的语法错误纠正(GEC),属于自然语言处理应用,但未涉及大模型或深度学习技术原理创新。关键词’Pre-training’得8分,因为论文使用了预训练策略(在人工生成数据上预训练Transformer模型)。其他关键词均不相关,得0分。论文未提及大模型、MoE、SLM、Scaling Laws、RLHF、RAG等核心概念,且应用领域为语言技术而非AI for Science。


!!! tip deepseek-chat TL;DR

该论文构建了罗马尼亚语语法错误纠正数据集,并实验了多种神经模型,发现预训练策略在低资源场景下有效,最佳模型F0.5达53.76。
摘要翻译

非英语语言的语法错误纠正(Grammatical Error Correction, GEC)资源较为稀缺,而现有针对这些语言的拼写检查器大多局限于简单的修正和规则。本文首次为罗马尼亚语构建了一个包含1万对句子的GEC语料库。此外,我们将德语版本的ERRANT(错误标注工具包)评分器适配至罗马尼亚语,用于分析该语料库并提取评估所需的编辑操作。我们实验了多种神经模型及预训练策略,这些方法在低资源场景下对GEC任务被证明是有效的。我们的基线模型是一个仅在GEC数据集上训练的小型Transformer模型(F0.5值为44.38),而性能最佳的模型则是在人工生成数据上预训练一个更大的Transformer模型,随后在实际语料库上进行微调(F0.5值为53.76)。所提出的生成额外训练样本的方法易于扩展,且仅需一个词性标注器(POS tagger),因此可适用于任何语言。


摘要 (Abstract)

Resources for Grammatical Error Correction (GEC) in non-English languages are scarce, while available spellcheckers in these languages are mostly limited to simple corrections and rules. In this paper we introduce a first GEC corpus for Romanian consisting of 10k pairs of sentences. In addition, the German version of ERRANT (ERRor ANnotation Toolkit) scorer was adapted for Romanian to analyze this corpus and extract edits needed for evaluation. Multiple neural models were experimented, together with pretraining strategies, which proved effective for GEC in low-resource settings. Our baseline consists of a small Transformer model trained only on the GEC dataset (F0.5 of 44.38), whereas the best performing model is produced by pretraining a larger Transformer model on artificially generated data, followed by finetuning on the actual corpus (F0.5 of 53.76). The proposed method for generating additional training examples is easily extensible and can be applied to any language, as it requires only a POS tagger


关键词: Grammatical Error Correction, Romanian, Transformer, Pre-training, Low-resource, Neural Models, F0.5 score


162. ❌ GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs

作者: Tao Feng, Haozhen Zhang, Zijie Lei, Peixuan Han, Jiaxuan You 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23626v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.010.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.010.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心研究多智能体LLM路由,涉及LLM Agents和Multi-agent Systems,高度相关。其他关键词如MoE、SLM等未涉及,评分为0。


!!! tip deepseek-chat TL;DR

GraphPlanner提出一种基于异构图记忆增强的多智能体LLM路由方法,通过强化学习优化工作流生成,在14个任务上提升准确率并大幅降低GPU成本。
摘要翻译

LLM路由在整合多种模型优势的同时平衡效率与性能方面取得了显著成果。然而,为支持更现实且更具挑战性的应用场景,路由必须扩展至智能体LLM(agentic LLM)设置,其中任务规划、异构智能体间的多轮协作以及记忆利用不可或缺。针对这一空白,我们提出GraphPlanner——一种面向多智能体LLM的异构图谱记忆增强型智能体路由器(heterogeneous graph memory-augmented agentic router),可为每个查询生成路由工作流,并支持归纳推理(inductive inference)与转导推理(transductive inference)。GraphPlanner将工作流生成形式化为马尔可夫决策过程(Markov Decision Process, MDP),每一步同时选择LLM主干模型与智能体角色(包括规划者Planner、执行者Executor与总结者Summarizer)。通过利用名为GARNet的异构图谱捕获查询、智能体与响应之间的交互记忆,GraphPlanner将历史记忆与工作流记忆整合为更丰富的状态表征。整个流程通过强化学习进行优化,协同提升任务特定性能与计算效率。我们在14项不同LLM任务上评估GraphPlanner,结果表明:(1)GraphPlanner性能优于强基线单轮与多轮路由器,准确率最高提升9.3%,同时将GPU成本从186.26 GiB降至1.04 GiB;(2)GraphPlanner对未见任务与LLM展现出稳健的泛化能力,具备强大的零样本(zero-shot)性能;(3)GraphPlanner有效利用历史记忆,支持归纳推理与转导推理以实现更具适应性的路由。GraphPlanner的代码已发布于https://github.com/ulab-uiuc/GraphPlanner。


摘要 (Abstract)

LLM routing has achieved promising results in integrating the strengths of diverse models while balancing efficiency and performance. However, to support more realistic and challenging applications, routing must extend into agentic LLM settings, where task planning, multi-round cooperation among heterogeneous agents, and memory utilization are indispensable. To address this gap, we propose GraphPlanner, a heterogeneous graph memory-augmented agentic router for multi-agent LLMs that generates routing workflows for each query and supports both inductive and transductive inference. GraphPlanner formulates workflow generation as a Markov Decision Process (MDP), where at each step it selects both the LLM backbone and the agent role, including Planner, Executor, and Summarizer. By leveraging a heterogeneous graph, denoted as GARNet, to capture interaction memories among queries, agents, and responses, GraphPlanner integrates historical memory and workflow memory into richer state representations. The entire pipeline is optimized with reinforcement learning, jointly improving task-specific performance and computational efficiency. We evaluate GraphPlanner across 14 diverse LLM tasks and demonstrate that: (1) GraphPlanner outperforms strong single-round and multi-round routers, improving accuracy by up to 9.3% while reducing GPU cost from 186.26 GiB to 1.04 GiB; (2) GraphPlanner generalizes robustly to unseen tasks and LLMs, exhibiting strong zero-shot capabilities; and (3) GraphPlanner effectively leverages historical memories, supporting both inductive and transductive inference for more adaptive routing. Our code for GraphPlanner is released at https://github.com/ulab-uiuc/GraphPlanner.


关键词: LLM routing, multi-agent systems, graph memory, reinforcement learning, agentic workflow, heterogeneous graph


163. ❌ Applications of the Transformer Architecture in AI-Assisted English Reading Comprehension

作者: Ping Li 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23615v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.05.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究Transformer架构在英语阅读理解中的应用,重点在于可解释性和公平性,涉及注意力机制和特征归因。与’Mechanistic Interpretability OR Explainable AI’高度相关(10分),因为核心是提高模型可解释性。与’Large Language Models’有一定关联(5分),因为使用了Transformer模型,但未明确提及LLM或大模型。其他关键词如MoE、SLM、Scaling Laws、Pre-training等均未涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于Transformer的可解释AI架构,通过注意力机制和梯度特征归因提高英语阅读理解的准确性和公平性,实验表明其性能优于现有模型并增强了教师信任。
摘要翻译

本文研究了用于理解英语阅读的可解释且公平的人工智能架构。引入了基于Transformer的模型,整合了先进的注意力机制和基于梯度的特征归因方法。当前自然语言教学中面临的问题包括模型缺乏可解释性、算法偏见未能减少,以及在教育环境中表现不可靠。我们构建了一个统一的技术流程,包括对抗性偏见校正方法、词元级(token-level)归因分析以及多头注意力热力图(multi-head attention heatmap)可视化。实验验证采用了一个大规模标注的英语阅读理解数据集,并确定了数据划分方案与参数优化流程。该方法在准确率和宏平均F1分数(macro-average F1 score)上显著优于当前最先进的模型;在某些方面甚至超越或接近人工评估的结果。在持续数周的用户实验中,可解释的Transformer(explainable transformer)提升了教师对评分系统中基于反馈的评估的信任度与可操作性。所提出的方法旨在确保对不同学习者的高预测准确率与公平性。这表明它是一个基于人工智能、以可解释性为核心的实际教育应用。该方法改善了AI辅助阅读理解系统中的用户体验,抵消了偏见,并增强了Transformer所解释的细节。


摘要 (Abstract)

This paper studies interpretable and fair artificial intelligence architectures for understanding English reading. Introduced transformer-based models, integrating advanced attention mechanisms and gradient-based feature attribution. The model’s lack of interpretability, reduction of algorithmic bias, and unreliable performance in learning environments are the current issues faced in natural language teaching. A unified technical pipeline has been constructed, including adversarial bias correction methods, token-level attribution analysis, and multi-head attention heatmap visualization. Experimental validation was conducted using a large-scale labeled English reading comprehension dataset, and the data partitioning scheme and parameter optimization procedures have been determined. The method significantly outperforms the state-of-the-art models for this task in terms of accuracy and macro-average F1 score; in some aspects, it even surpasses or closely matches the results of human evaluations. In multi-week user experiments, the explainable transformer improved teachers’ trust and operability in feedback-based assessments within the scoring system. The proposed method aims to ensure high prediction accuracy and fairness for different learners. This indicates that it is a real-world educational application based on artificial intelligence with a focus on interpretation. Improve the user experience in AI-assisted reading comprehension systems, counteract biases, and enhance the details explained by transformers.


关键词: Transformer, interpretable AI, attention mechanism, feature attribution, English reading comprehension, fairness, educational AI


164. ❌ The Limits of Artificial Companionship

作者: Mauricio Figueroa 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23601v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文讨论的是与陪伴聊天机器人的对话中商业与非商业语境的区分,以及未披露促销内容对用户自主性和对话语境的侵蚀。虽然涉及聊天机器人(可能基于大语言模型),但论文重点在于法律和社会规范,而非大模型或深度学习的技术原理、创新或应用。所有关键词均与技术或科学应用相关,论文未涉及任何技术细节或创新,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文主张在陪伴聊天机器人的对话中应明确区分商业与非商业语境,禁止未披露的促销内容,以保护用户自主性和对话语境。
摘要翻译

本文主张,与陪伴型聊天机器人的对话应在商业与非商业语境之间建立明确的结构性区分。将未披露的促销内容植入情感性或关系性交流中应被禁止,因为这种做法模糊了市场交易与沟通亲密性之间的界限,从而侵蚀了用户自主性与对话语境。本文首先将数字陪伴理论化为一种重构亲密关系、依赖性与关系脆弱性的社会技术形式,继而探讨了由对话式广告引发的潜在经济损害。最终,本文主张在商业与非商业对话语境之间建立严格的法律与社会区分,以此作为这些技术在社会生活中得以负责任地稳定化的前提条件。


摘要 (Abstract)

This Article argues that conversations with companion chatbot should be subject to a clear structural distinction between commercial and non-commercial contexts. The insertion of undisclosed promotional content into affective or relational exchanges should be prohibited, as it collapses the boundary between market transaction and communicative intimacy in ways that erode user autonomy and conversational context. The Article begins by theorizing digital companionship as a sociotechnical form that reconfigures intimacy, dependence and relational vulnerability. It then introduces the potential economic harms derived from conversational advertising. The Article ultimately argues for a firm legal and social distinction between commercial and non-commercial conversational contexts as a precondition for the responsible stabilization of these technologies within social life.


关键词: companion chatbot, commercial context, non-commercial context, conversational advertising, user autonomy, relational vulnerability, sociotechnical form


165. ❌ Personality Shapes Gender Bias in Persona-Conditioned LLM Narratives Across English and Hindi: An Empirical Investigation

作者: Tanay Kumar, Shreya Gautam, Aman Chadha, Vinija Jain, Francesco Pierri 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23600v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心研究大语言模型(LLMs)在角色条件化故事生成中的性别偏见,与’Large Language Models’高度相关(10分)。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、Post-training、Instruction Tuning、RLHF、PEFT、RAG、Context Window、KV Cache、CoT、System 2、MCTS、Self-Correction、LLM Agents、Tool Use、Multi-agent、Quantization、Speculative Decoding、Hallucination、Mechanistic Interpretability、World Models、Model Merging、In-context Learning、AI for Science均不涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文通过控制角色性别、职业和人格特质(HEXACO和黑暗三联征),在英语和印地语中生成故事,发现人格特质显著影响LLM的性别偏见方向和程度,表明偏见是上下文依赖的。
摘要翻译

大型语言模型(Large Language Models, LLMs)正越来越多地部署于角色驱动型应用场景,如教育、客户服务及社交平台。在这些场景中,模型被提示在与用户互动时采用特定角色。虽然角色设定能够提升用户体验与参与度,但也引发了关于人格线索如何与性别偏见及刻板印象相互作用的担忧。本研究针对英语和印地语中的角色条件故事生成开展了一项受控实验。每篇故事均描绘一位印度职场专业人士,在系统化变化的角色性别、职业身份以及来自HEXACO模型与黑暗三人格(Dark Triad)框架的人格特质条件下,生成特定情境下的作品(如教案、报告、信函)。基于六种最先进LLMs生成的23,400篇故事,我们发现人格特质与性别偏见的程度及方向均存在显著关联。具体而言,相较于社会期望度较高的HEXACO特质,黑暗三人格特质始终与更高程度的性别刻板印象表征相关,尽管这种关联在不同模型与语言间存在差异。我们的研究结果表明,LLMs中的性别偏见并非静态不变,而是具有情境依赖性。这意味着实际应用中使用的角色条件系统可能引入不均等的表征危害,从而在教育、职业或社交内容生成中强化性别刻板印象。


摘要 (Abstract)

Large Language Models (LLMs) are increasingly deployed in persona-driven applications such as education, customer service, and social platforms, where models are prompted to adopt specific personas when interacting with users. While persona conditioning can improve user experience and engagement, it also raises concerns about how personality cues may interact with gender biases and stereotypes. In this work, we present a controlled study of persona-conditioned story generation in English and Hindi, where each story portrays a working professional in India producing context-specific artifacts (e.g., lesson plans, reports, letters) under systematically varied persona gender, occupational role, and personality traits from the HEXACO and Dark Triad frameworks. Across 23,400 generated stories from six state-of-the-art LLMs, we find that personality traits are significantly associated with both the magnitude and direction of gender bias. In particular, Dark Triad personality traits are consistently associated with higher gender-stereotypical representations compared to socially desirable HEXACO traits, though these associations vary across models and languages. Our findings demonstrate that gender bias in LLMs is not static but context-dependent. This suggests that persona-conditioned systems used in real-world applications may introduce uneven representational harms, reinforcing gender stereotypes in generated educational, professional, or social content.


关键词: Large Language Models, Gender Bias, Persona Conditioning, HEXACO, Dark Triad, Story Generation, Cross-lingual


166. ❌ XITE: Cross-lingual Interpolation for Transfer using Embeddings

作者: Barah Fazili, Preethi Jyothi 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23589v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.05.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出XITE,一种基于嵌入的跨语言数据增强技术,用于提升多语言模型(如XLM-R)的跨语言迁移能力。核心涉及多语言模型(Large Language Models)的微调,但未涉及MoE、SLMs、Scaling Laws等关键词。与预训练(Pre-training)有一定关联,因为方法在预训练模型基础上进行微调。其他关键词如RLHF、RAG、CoT等均不相关。


!!! tip deepseek-chat TL;DR

论文提出XITE,一种基于嵌入插值的跨语言数据增强方法,通过将低资源语言文本映射到高资源语言嵌入空间并插值生成合成数据,显著提升了XLM-R在情感分析和自然语言推理任务上的跨语言迁移性能。
摘要翻译

促进多语言模型中的跨语言迁移仍是一项关键挑战。为此,我们提出了一种基于嵌入的数据增强技术,称为XITE。我们从低资源目标语言的无标注文本出发,利用基于嵌入的相似性在任务特定训练语料库中识别其英文对应文本,并采用其标签。接着,我们对源语言和目标语言的嵌入进行简单插值,以生成用于任务特定微调的合成数据。在插值之前,使用线性判别分析(LDA)将目标文本投影到语言丰富的子空间中,可进一步提升性能。我们的跨语言基于嵌入的增强技术XITE,在使用XLM-R模型时,对包括韩语、阿拉伯语、乌尔都语和印地语在内的多种目标语言,在情感分析任务上取得了高达35.91%的显著提升,在自然语言推理任务上取得了高达81.16%的提升。除了提升跨语言迁移能力,使用XITE进行适配还能有效防止遗忘,并保持在高资源语言上的任务性能。


摘要 (Abstract)

Facilitating cross-lingual transfer in multilingual language models remains a critical challenge. Towards this goal, we propose an embedding-based data augmentation technique called XITE. We start with unlabeled text from a low-resource target language, identify an English counterpart in a task-specific training corpus using embedding-based similarities and adopt its label. Next, we perform a simple interpolation of the source and target embeddings to create synthetic data for task-specific fine-tuning. Projecting the target text into a language-rich subspace using linear discriminant analysis (LDA), prior to interpolation, further boosts performance. Our cross-lingual embedding-based augmentation technique XITE yields significant improvements of up to 35.91% for sentiment analysis and up to 81.16% for natural language inference, using XLM-R, for a diverse set of target languages including Korean, Arabic, Urdu and Hindi. Apart from boosting cross-lingual transfer, adaptation using XITE also safeguards against forgetting and maintains task performance on the high-resource language.


关键词: cross-lingual transfer, data augmentation, embedding interpolation, multilingual language models, XLM-R, sentiment analysis, natural language inference


167. ❌ FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification

作者: Dongxin Guo, Jikun Wu, Siu Ming Yiu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23588v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.010.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于金融领域LLM幻觉检测与归因,核心是RAG管道和幻觉缓解。与’Large Language Models’高度相关(10分),因为使用LLM生成答案并检测幻觉;与’Retrieval-Augmented Generation’高度相关(10分),因为提出三阶段verify-then-ground管道,包含混合检索和引用;与’Hallucination Mitigation’高度相关(10分),因为核心任务是检测和纠正幻觉。其他关键词如MoE、SLMs、Scaling Laws等均不涉及,故评0分。


!!! tip deepseek-chat TL;DR

FinGround提出一个三阶段验证-归因管道,通过原子声明分类和类型路由验证,在金融文档QA中将幻觉率降低78%,并引入检索均衡评估方法。
摘要翻译

金融AI系统必须基于特定监管文件生成答案,然而当前的大语言模型会捏造指标、虚构引用,并错误计算衍生数值。随着《欧盟人工智能法案》高风险条款执行期限(2026年8月)临近,这些错误将直接引发监管后果。现有幻觉检测器对所有陈述一视同仁,遗漏了43%需要对照结构化表格进行算术复核的计算错误。我们提出FinGround——一种面向金融文档问答的三阶段“验证-溯源”流水线。第一阶段执行面向金融的混合检索,覆盖文本与表格。第二阶段将答案分解为原子化陈述,按六类金融分类法归类,并通过包括公式重构在内的类型导向策略进行验证。第三阶段使用段落级与表格单元格级引用重写无依据陈述。为将验证价值与检索质量清晰剥离,我们提出检索均衡评估作为RAG验证研究的标准方法论:当所有系统接收相同检索结果时,FinGround仍能将幻觉率较最强基线降低68%(p < 0.01)。完整流水线相较GPT-4o实现78%的幻觉率降低。一个80亿参数的蒸馏检测器在保持91.4% F1值的同时,将单条陈述延迟降低18倍,实现0.003美元/次查询的部署成本,该结论得到为期四周的分析师试点定性信号支持。


摘要 (Abstract)

Financial AI systems must produce answers grounded in specific regulatory filings, yet current LLMs fabricate metrics, invent citations, and miscalculate derived quantities. These errors carry direct regulatory consequences as the EU AI Act’s high-risk enforcement deadline approaches (August 2026). Existing hallucination detectors treat all claims uniformly, missing 43% of computational errors that require arithmetic re-verification against structured tables. We present FinGround, a three-stage verify-then-ground pipeline for financial document QA. Stage 1 performs finance-aware hybrid retrieval over text and tables. Stage 2 decomposes answers into atomic claims classified by a six-type financial taxonomy and verified with type-routed strategies including formula reconstruction. Stage 3 rewrites unsupported claims with paragraph- and table-cell-level citations. To cleanly isolate verification value from retrieval quality, we propose retrieval-equalized evaluation as standard methodology for RAG verification research: when all systems receive identical retrieval, FinGround still reduces hallucination rates by 68% over the strongest baseline ($p < 0.01$). The full pipeline achieves a 78% reduction relative to GPT-4o. An 8B distilled detector retains 91.4% F1 at 18x lower per-claim latency, enabling $0.003/query deployment, supported by qualitative signals from a four-week analyst pilot.


关键词: Financial Hallucination, Atomic Claim Verification, Retrieval-Augmented Generation, LLM, Factuality, Document QA, Hybrid Retrieval


168. ❌ Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling

作者: Zhen Ye, Xu Tan, Aoxiong Yin, Hongzhan Lin, Guangyan Zhang, Peiwen Sun, Yiming Li, Chi-Min Chan, Wei Ye, Shikun Zhang, Wei Xue 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23586v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究联合音频-视频生成,特别是说话头合成,使用自回归扩散模型。虽然涉及扩散模型和自回归模型,但并未涉及大语言模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出Talker-T2AV,一种自回归扩散框架,通过共享骨干网络进行高层跨模态建模,并使用模态特定解码器进行低层细化,在说话头合成中实现优于级联管线的唇同步精度和音视频质量。
摘要翻译

联合音视频生成模型已证明,相较于级联方法,统一生成能带来更强的跨模态一致性。然而,现有模型通过全连接注意力机制在去噪过程中全程耦合模态,以完全纠缠的方式处理高层语义与低层细节。这对于说话头合成而言并非最优:尽管音频与面部运动在语义上相关,但其低层实现(声学信号与视觉纹理)遵循不同的渲染过程。在所有层级强制进行联合建模会导致不必要的纠缠并降低效率。我们提出Talker-T2AV,一种自回归扩散框架,其中高层跨模态建模在共享骨干网络中进行,而低层细化则使用模态专用解码器。一个共享的自回归语言模型在统一的块级(patch-level)标记空间中联合推理音频与视频。两个轻量级扩散变换器(diffusion transformer)头将隐藏状态解码为帧级音频与视频潜变量。在说话人肖像基准上的实验表明,Talker-T2AV在唇形同步精度、视频质量与音频质量上均优于双分支基线,并实现了比级联流水线更强的跨模态一致性。


摘要 (Abstract)

Joint audio-video generation models have shown that unified generation yields stronger cross-modal coherence than cascaded approaches. However, existing models couple modalities throughout denoising via pervasive attention, treating high-level semantics and low-level details in a fully entangled manner. This is suboptimal for talking head synthesis: while audio and facial motion are semantically correlated, their low-level realizations (acoustic signals and visual textures) follow distinct rendering processes. Enforcing joint modeling across all levels causes unnecessary entanglement and reduces efficiency. We propose Talker-T2AV, an autoregressive diffusion framework where high-level cross-modal modeling occurs in a shared backbone, while low-level refinement uses modality-specific decoders. A shared autoregressive language model jointly reasons over audio and video in a unified patch-level token space. Two lightweight diffusion transformer heads decode the hidden states into frame-level audio and video latents. Experiments on talking portrait benchmarks show Talker-T2AV outperforms dual-branch baselines in lip-sync accuracy, video quality, and audio quality, achieving stronger cross-modal consistency than cascaded pipelines.


关键词: Talking Head Synthesis, Audio-Video Generation, Autoregressive Diffusion, Cross-modal Modeling, Lip-sync, Diffusion Transformer


169. ❌ ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection

作者: Dongxin Guo, Jikun Wu, Siu Ming Yiu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23585v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.010.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.010.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.05.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是知识图谱增强的RAG系统,用于监管合规,因此与’Large Language Models’和’Retrieval-Augmented Generation’高度相关(10分)。使用了Medusa投机解码加速推理,与’Speculative Decoding’高度相关(10分)。涉及领域适应(金融监管文本),与’Pre-training’有一定关联(5分)。通过知识图谱减少幻觉,与’Hallucination Mitigation’相关(5分)。其他关键词如MoE、SLMs、Scaling Laws等未涉及,评0分。


!!! tip deepseek-chat TL;DR

该论文提出ComplianceNLP系统,利用知识图谱增强的RAG和投机解码,在金融监管合规中实现高效、准确的合规差距检测。
摘要翻译

金融机构每年需追踪超过6万项监管事件,这使人工合规团队不堪重负;自2008年金融危机以来,该行业已支付逾3000亿美元罚款与和解金。我们提出ComplianceNLP——一个端到端系统,可自动监测监管变化、提取结构化义务,并识别机构政策中的合规缺口。该系统整合三大组件:(1) 知识图谱增强型RAG流水线,基于包含SEC、MiFID II及巴塞尔协议III中12,847项条款的监管知识图谱进行生成;(2) 多任务义务提取模块,结合命名实体识别(NER)、道义分类及跨引用解析,共享LEGAL-BERT编码器;(3) 合规缺口分析模块,通过严重性感知评分将义务映射至内部政策。在我们的基准测试中,ComplianceNLP在缺口检测上达到87.7 F1值,超越GPT-4o+RAG达+3.5 F1,同时实现94.2%的溯源准确率(与人类判断的相关系数$r=0.83$),并在真实端到端错误传播场景下保持83.4 F1值。消融实验表明,知识图谱重排序贡献了最大边际增益(+4.6 F1),证实结构化监管知识对高跨引用任务至关重要。领域特定知识蒸馏(70B→8B)结合Medusa推测解码实现$2.8\times$推理加速;监管文本的低熵特性($H=2.31$比特 vs. 通用文本$3.87$比特)产生91.3%的草稿令牌接受率。在某金融机构四个月的并行运行部署中,系统处理9,847项更新,达到96.0%估计召回率与90.7%精确率,分析师效率持续提升$3.1\times$。我们报告了在受监管领域NLP部署中关于信任校准、GRC集成及分布偏移监测的经验教训。


摘要 (Abstract)

Financial institutions must track over 60,000 regulatory events annually, overwhelming manual compliance teams; the industry has paid over USD 300 billion in fines and settlements since the 2008 financial crisis. We present ComplianceNLP, an end-to-end system that automatically monitors regulatory changes, extracts structured obligations, and identifies compliance gaps against institutional policies. The system integrates three components: (1) a knowledge-graph-augmented RAG pipeline grounding generations in a regulatory knowledge graph of 12,847 provisions across SEC, MiFID II, and Basel III; (2) multi-task obligation extraction combining NER, deontic classification, and cross-reference resolution over a shared LEGAL-BERT encoder; and (3) compliance gap analysis that maps obligations to internal policies with severity-aware scoring. On our benchmark, ComplianceNLP achieves 87.7 F1 on gap detection, outperforming GPT-4o+RAG by +3.5 F1, with 94.2% grounding accuracy ($r=0.83$ vs. human judgments) and 83.4 F1 under realistic end-to-end error propagation. Ablations show that knowledge-graph re-ranking contributes the largest marginal gain (+4.6 F1), confirming that structural regulatory knowledge is critical for cross-reference-heavy tasks. Domain-specific knowledge distillation (70B $\to$ 8B) combined with Medusa speculative decoding yields $2.8\times$ inference speedup; regulatory text’s low entropy ($H=2.31$ bits vs. $3.87$ general text) produces 91.3% draft-token acceptance rates. In four months of parallel-run deployment processing 9,847 updates at a financial institution, the system achieved 96.0% estimated recall and 90.7% precision, with a $3.1\times$ sustained analyst efficiency gain. We report deployment lessons on trust calibration, GRC integration, and distributional shift monitoring for regulated-domain NLP.


关键词: Knowledge Graph, RAG, Regulatory Compliance, Speculative Decoding, Obligation Extraction, Gap Detection, Financial Regulation


170. ❌ AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Tracking

作者: Dongxin Guo, Jikun Wu, Siu Ming Yiu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23581v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.05.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.05.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.05.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.05.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出AgentEval框架,用于评估基于LLM的智能体工作流(agentic workflows),核心是DAG结构化的步骤级评估和错误传播追踪。与LLM Agents高度相关(10分),因为直接评估智能体工作流;与Chain of Thought和System 2 Thinking有一定关联(5分),因为工作流涉及多步推理;与Tool Use相关(5分),因为工作流包含工具使用;与Hallucination Mitigation相关(5分),因为评估包括事实性检查。其他关键词如MoE、SLMs、Pre-training等与论文内容无关。


!!! tip deepseek-chat TL;DR

论文提出AgentEval框架,通过将智能体执行建模为有向无环图(DAG)并利用LLM评判器进行步骤级质量评估和错误传播追踪,显著提高了故障检测召回率和根因定位准确性。
摘要翻译

将推理、工具使用与合成过程串联为多步骤工作流的智能体系统正进入生产环境,然而当前主流的评估实践(如端到端结果检查与临时性轨迹审查)系统性地掩盖了实际错误预算中占主导地位的中间环节故障。我们提出AgentEval框架,该框架将智能体执行过程形式化为评估有向无环图(DAG),其中每个节点携带由校准后的LLM评判器(GPT-4o)评估的类型化质量指标,通过分层故障分类体系(3个层级、21个子类别)进行分类,并与上游依赖关系关联以实现自动化根因归因。消融实验分离了基于DAG的依赖建模的影响:与使用相同评判器与评分标准的平面化步骤级评估相比,仅此一项就使故障检测召回率提升22个百分点,根因定位准确率提升34个百分点。
在三个生产工作流(450个测试用例、两个智能体模型系列、以顺序架构为主且12%为非DAG轨迹)中,AgentEval的故障检测召回率比端到端评估高出2.17倍(0.89 vs. 0.41),与人类专家的一致性Cohen’s kappa系数达0.84,根因定位准确率达72%(人类上限为81%)。在tau-bench与SWE-bench轨迹上的跨系统评估验证了其可迁移性(故障检测召回率≥0.78),且无需修改分类体系或评分标准。通过集成至CI/CD的回归测试,一项为期4个月、涉及18名工程师的试点项目检测出23个预发布回归缺陷,将中位根因识别时间从4.2小时缩短至22分钟,并在两个工作流中实现了可量化的故障率降低。


摘要 (Abstract)

Agentic systems that chain reasoning, tool use, and synthesis into multi-step workflows are entering production, yet prevailing evaluation practices like end-to-end outcome checks and ad-hoc trace inspection systematically mask the intermediate failures that dominate real-world error budgets. We present AgentEval, a framework that formalizes agent executions as evaluation directed acyclic graphs (DAGs), where each node carries typed quality metrics assessed by a calibrated LLM judge (GPT-4o), classified through a hierarchical failure taxonomy (3 levels, 21 subcategories), and linked to upstream dependencies for automated root cause attribution. An ablation study isolates the impact of DAG-based dependency modeling: it alone contributes +22 percentage points to failure detection recall and +34 pp to root cause accuracy over flat step-level evaluation with identical judges and rubrics. Across three production workflows (450 test cases, two agent model families, predominantly sequential architectures with a 12% non-DAG trace rate), AgentEval achieves 2.17x higher failure detection recall than end-to-end evaluation (0.89 vs. 0.41), Cohen’s kappa = 0.84 agreement with human experts, and 72% root cause accuracy against an 81% human ceiling. Cross-system evaluation on tau-bench and SWE-bench traces confirms transferability (failure detection recall >= 0.78) without taxonomy or rubric modification. A 4-month pilot with 18 engineers detected 23 pre-release regressions through CI/CD-integrated regression testing, reducing median root-cause identification time from 4.2 hours to 22 minutes and driving measurable failure rate reductions in two workflows.


关键词: Agentic Workflows, DAG-structured Evaluation, Error Propagation Tracking, LLM Judge, Failure Detection, Root Cause Attribution, Step-level Evaluation


171. ❌ LLMs Reading the Rhythms of Daily Life: Aligned Understanding for Behavior Prediction and Generation

作者: Fanjin Meng, Jingtao Ding, Nian Li, Yizhou Sun, Yong Li 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23578v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.08.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.05.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.05.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用LLM进行人类行为建模,提出了BUA框架,通过课程学习对齐行为序列嵌入与LLM。与’Large Language Models’高度相关(10分);涉及’Pre-training’(行为预训练)和’Post-training’(微调)但非核心(各5分);‘Instruction Tuning’(对齐)是核心(8分);‘Mechanistic Interpretability’(可解释性)被提及(5分);‘In-context Learning’(多轮对话)被使用(5分)。其他关键词如MoE、SLM、RAG等不相关。


!!! tip deepseek-chat TL;DR

该论文提出行为理解对齐(BUA)框架,通过课程学习将LLM与行为序列嵌入对齐,在行为预测和生成任务上显著优于现有方法。
摘要翻译

人类日常行为是由意图、偏好和情境共同塑造的复杂序列。有效建模这些行为对于个人助理和推荐引擎等智能系统至关重要。尽管深度学习与行为预训练的最新进展提升了行为预测能力,但关键挑战依然存在——尤其是在处理长尾行为、增强可解释性以及在统一框架内支持多任务方面。大语言模型(Large Language Models, LLMs)凭借其语义丰富性、强可解释性和生成能力,提供了一个有前景的方向。然而,行为数据与自然语言在结构和模态上的差异限制了LLMs的直接适用性。

为弥合这一差距,我们提出行为理解对齐(Behavior Understanding Alignment, BUA),这是一个通过结构化课程学习过程将LLMs整合到人类行为建模中的新型框架。BUA采用预训练行为模型的序列嵌入作为对齐锚点,通过三阶段课程引导LLM,同时利用多轮对话设置引入预测与生成能力。在两个真实世界数据集上的实验表明,BUA在两项任务中均显著优于现有方法,凸显了其在将LLMs应用于复杂人类行为建模方面的有效性与灵活性。


摘要 (Abstract)

Human daily behavior unfolds as complex sequences shaped by intentions, preferences, and context. Effectively modeling these behaviors is crucial for intelligent systems such as personal assistants and recommendation engines. While recent advances in deep learning and behavior pre-training have improved behavior prediction, key challenges remain–particularly in handling long-tail behaviors, enhancing interpretability, and supporting multiple tasks within a unified framework. Large language models (LLMs) offer a promising direction due to their semantic richness, strong interpretability, and generative capabilities. However, the structural and modal differences between behavioral data and natural language limit the direct applicability of LLMs. To address this gap, we propose Behavior Understanding Alignment (BUA), a novel framework that integrates LLMs into human behavior modeling through a structured curriculum learning process. BUA employs sequence embeddings from pretrained behavior models as alignment anchors and guides the LLM through a three-stage curriculum, while a multi-round dialogue setting introduces prediction and generation capabilities. Experiments on two real-world datasets demonstrate that BUA significantly outperforms existing methods in both tasks, highlighting its effectiveness and flexibility in applying LLMs to complex human behavior modeling.


关键词: Large Language Models, Behavior Understanding Alignment, Curriculum Learning, Human Behavior Modeling, Behavior Prediction, Behavior Generation, Sequence Embeddings, Multi-round Dialogue


172. ❌ RouteNLP: Closed-Loop LLM Routing with Conformal Cascading and Distillation Co-Optimization

作者: Dongxin Guo, Jikun Wu, Siu Ming Yiu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23577v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.015.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.010.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是LLM路由框架,涉及大语言模型(LLM)和较小模型(SLM)的协同,因此LLM和SLM关键词高度相关。其他关键词如MoE、预训练、微调、RAG等均未在摘要中提及,故评分为0。


!!! tip deepseek-chat TL;DR

RouteNLP通过闭环路由框架,结合难度感知路由器、置信校准级联和蒸馏-路由协同优化,在保持质量的同时将企业LLM推理成本降低58%。
摘要翻译

使用大型语言模型服务多样化的自然语言处理工作负载成本高昂:在某企业合作伙伴处,尽管超过70%的查询属于较小模型完全能够胜任的常规任务,推理成本仍超过每月20万美元。我们提出RouteNLP——一种闭环框架,该框架通过分层模型组合路由查询,在满足每项任务质量约束的同时最小化成本。该框架整合了三个组件:基于偏好数据与质量信号训练的、具有共享任务条件表示的难度感知路由器;使用共形预测实现无分布阈值初始化的置信度校准级联机制;以及蒸馏-路由协同优化循环,该循环对升级失败案例进行聚类,对廉价模型实施定向知识蒸馏,并自动重新训练路由器,其成本优化效果是非定向蒸馏的两倍以上。在某企业客服部门为期8周、日均处理约5000次查询的试点部署中,RouteNLP将推理成本降低58%,同时保持91%的响应接受率,并将p99延迟从1847毫秒降至387毫秒。在涵盖金融、客服和法律领域的六项任务基准测试中,该框架实现了40-85%的成本降低,同时在结构化任务上保持96-100%的质量,在生成任务上保持96-98%的质量,人工评估证实74.5%的路由生成输出达到或超越了前沿模型质量。


摘要 (Abstract)

Serving diverse NLP workloads with large language models is costly: at one enterprise partner, inference costs exceeded $200K/month despite over 70% of queries being routine tasks well within the capability of smaller models. We present RouteNLP, a closed-loop framework that routes queries across a tiered model portfolio to minimize cost while satisfying per-task quality constraints. The framework integrates three components: a difficulty-aware router with shared task-conditioned representations trained on preference data and quality signals; confidence-calibrated cascading that uses conformal prediction for distribution-free threshold initialization; and a distillation-routing co-optimization loop that clusters escalation failures, applies targeted knowledge distillation to cheaper models, and automatically retrains the router, yielding over twice the cost improvement of untargeted distillation. In an 8-week pilot deployment processing ~5K queries/day at an enterprise customer-service division, RouteNLP reduced inference costs by 58% while maintaining 91% response acceptance and reducing p99 latency from 1,847 ms to 387 ms. On a six-task benchmark spanning finance, customer service, and legal domains, the framework achieves 40-85% cost reduction while retaining 96-100% quality on structured tasks and 96-98% on generation tasks, with human evaluation confirming that 74.5% of routed generation outputs match or exceed frontier-model quality.


关键词: LLM routing, conformal prediction, knowledge distillation, cost reduction, quality constraints, closed-loop framework, model portfolio


173. ❌ The Collapse of Heterogeneity in Silicon Philosophers

作者: Yuanming Shi, Andreas Haupt 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23575v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.010.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.08.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.08.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究大语言模型在哲学领域模拟人类观点时的异质性崩溃问题,核心涉及对齐(Alignment)和DPO微调,因此与’Instruction Tuning OR Alignment OR Value Alignment’高度相关(10分),与’RLHF OR RLAIF OR Direct Preference Optimization OR DPO’相关(8分),同时涉及幻觉/事实性(Hallucination Mitigation)问题(8分)。其他关键词如MoE、SLMs、Scaling Laws等均不相关。


!!! tip deepseek-chat TL;DR

该论文发现大语言模型在哲学观点模拟中系统性崩溃了人类观点的异质性,导致人工共识,并评估了DPO微调的影响。
摘要翻译

硅样本正越来越多地被用作人类样本的低成本替代品,并已被证明能够以高保真度再现人类群体的意见。我们表明,在与对齐相关的哲学领域中,硅样本系统性地消解了异质性。利用来自PhilPeople档案中277位专业哲学家的数据,我们评估了七种专有和开源大语言模型在复现个体哲学立场以及保留跨哲学领域问题间相关结构方面的能力。我们发现,语言模型显著过度关联了哲学判断,从而在领域间产生了人为的一致性。这种消解部分与专家效应相关,即模型隐含地假设领域专家持有高度相似的哲学观点。我们通过研究DPO微调的影响,并针对完整的PhilPapers 2020调查(N = 1785)验证结果,评估了这些发现的稳健性。最后,我们讨论了对对齐、评估以及使用硅样本作为人类判断替代品的启示。本项目的代码可在https://github.com/stanford-del/silicon-philosophers获取。


摘要 (Abstract)

Silicon samples are increasingly used as a low-cost substitute for human panels and have been shown to reproduce aggregate human opinion with high fidelity. We show that, in the alignment-relevant domain of philosophy, silicon samples systematically collapse heterogeneity. Using data from $N = {277}$ professional philosophers drawn from PhilPeople profiles, we evaluate seven proprietary and open-source large language models on their ability to replicate individual philosophical positions and to preserve cross-question correlation structures across philosophical domains. We find that language models substantially over-correlate philosophical judgments, producing artificial consensus across domains. This collapse is associated in part with specialist effects, whereby models implicitly assume that domain specialists hold highly similar philosophical views. We assess the robustness of these findings by studying the impact of DPO fine-tuning and by validating results against the full PhilPapers 2020 Survey ($N = {1785}$). We conclude by discussing implications for alignment, evaluation, and the use of silicon samples as substitutes for human judgment. The code of this project can be found at https://github.com/stanford-del/silicon-philosophers.


关键词: Large Language Models, Alignment, Heterogeneity Collapse, Philosophy, DPO, Silicon Samples, Human Judgment


174. ❌ World-R1: Reinforcing 3D Constraints for Text-to-Video Generation

作者: Weijie Wang, Xiaoxuan He, Youping Gu, Yifan Yang, Zeyu Zhang, Yefei He, Yanbo Ding, Xirui Hu, Donny Y. Chen, Zhiyuan He, Yuqing Yang, Bohan Zhuang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24764v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.010.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出World-R1,通过强化学习将视频生成与3D约束对齐,核心是使用世界模型(World Models)进行3D一致性增强。关键词’World Models AND General World Models’高度相关(10分),因为论文明确使用’world simulation’和'3D constraints’。‘Large Language Models OR LLMs OR Foundation Models’相关(10分),因为论文基于’video foundation models’,属于基础模型范畴。其他关键词如MoE、SLMs、Scaling Laws等均不相关,得0分。


!!! tip deepseek-chat TL;DR

World-R1通过强化学习(Flow-GRPO)和3D基础模型反馈,在不修改架构的情况下增强视频生成的3D一致性,同时保持视觉质量。
摘要翻译

近期视频基础模型展现了令人印象深刻的视觉合成能力,但常出现几何不一致性问题。现有方法试图通过架构修改注入三维先验知识,却往往导致计算成本高昂且可扩展性受限。我们提出World-R1框架,通过强化学习使视频生成与三维约束对齐。为促进该对齐过程,我们引入了一个专为世界模拟定制的纯文本数据集。利用Flow-GRPO方法,我们通过预训练三维基础模型与视觉语言模型的反馈优化模型,在不改变底层架构的前提下强化结构连贯性。进一步采用周期性解耦训练策略,以平衡刚性几何一致性与动态场景流畅性。大量评估表明,本方法在保持基础模型原有视觉质量的同时显著提升了三维一致性,有效弥合了视频生成与可扩展世界模拟之间的鸿沟。


摘要 (Abstract)

Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods attempt to inject 3D priors via architectural modifications, they often incur high computational costs and limit scalability. We propose World-R1, a framework that aligns video generation with 3D constraints through reinforcement learning. To facilitate this alignment, we introduce a specialized pure text dataset tailored for world simulation. Utilizing Flow-GRPO, we optimize the model using feedback from pre-trained 3D foundation models and vision-language models to enforce structural coherence without altering the underlying architecture. We further employ a periodic decoupled training strategy to balance rigid geometric consistency with dynamic scene fluidity. Extensive evaluations reveal that our approach significantly enhances 3D consistency while preserving the original visual quality of the foundation model, effectively bridging the gap between video generation and scalable world simulation.


关键词: World-R1, Reinforcement Learning, 3D Constraints, Video Generation, World Models, Flow-GRPO, 3D Consistency


175. ❌ Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation

作者: Zhiheng Liu, Weiming Ren, Xiaoke Huang, Shoufa Chen, Tianhong Li, Mengzhao Chen, Yatai Ji, Sen He, Jonas Schult, Belinda Zeng, Tao Xiang, Wenhu Chen, Ping Luo, Luke Zettlemoyer, Yuren Cong 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24763v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文Tuna-2主要研究多模态理解与生成中的像素级嵌入方法,摒弃了预训练的视觉编码器,属于计算机视觉和多模态学习领域,与给定的关键词(大语言模型、MoE、SLM、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我修正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习、AI for Science)均无直接关联。论文未涉及任何大模型或深度学习技术原理的创新,也未应用于科学领域,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

Tuna-2提出了一种原生统一多模态模型,通过像素嵌入直接进行视觉理解和生成,无需预训练视觉编码器,在基准测试中达到最先进性能,证明了像素空间建模的可行性。
摘要翻译

统一多模态模型通常依赖预训练的视觉编码器,并为理解与生成任务使用分离的视觉表征,导致两项任务之间产生错位,且无法实现从原始像素到终端的完全端到端优化。我们提出Tuna-2——一种原生统一多模态模型,它直接基于像素嵌入(pixel embeddings)执行视觉理解与生成。Tuna-2采用简单的补丁嵌入层(patch embedding layers)对视觉输入进行编码,彻底摒弃了诸如VAE或表征编码器(representation encoder)等模块化视觉编码器设计,从而大幅简化了模型架构。实验表明,Tuna-2在多模态基准测试中取得了最先进的性能,证明统一的像素空间建模能够与潜在空间方法(latent-space approaches)在高质量图像生成上完全竞争。此外,尽管基于编码器的变体在早期预训练中收敛更快,但Tuna-2的无编码器设计在规模化条件下实现了更强的多模态理解能力,尤其在需要细粒度视觉感知的任务上表现突出。这些结果表明,预训练视觉编码器并非多模态建模的必要条件,而端到端的像素空间学习为同时提升生成与感知任务的视觉表征提供了一条可扩展的路径。


摘要 (Abstract)

Unified multimodal models typically rely on pretrained vision encoders and use separate visual representations for understanding and generation, creating misalignment between the two tasks and preventing fully end-to-end optimization from raw pixels. We introduce Tuna-2, a native unified multimodal model that performs visual understanding and generation directly based on pixel embeddings. Tuna-2 drastically simplifies the model architecture by employing simple patch embedding layers to encode visual input, completely discarding the modular vision encoder designs such as the VAE or the representation encoder. Experiments show that Tuna-2 achieves state-of-the-art performance in multimodal benchmarks, demonstrating that unified pixel-space modelling can fully compete with latent-space approaches for high-quality image generation. Moreover, while the encoder-based variant converges faster in early pretraining, Tuna-2’s encoder-free design achieves stronger multimodal understanding at scale, particularly on tasks requiring fine-grained visual perception. These results show that pretrained vision encoders are not necessary for multimodal modelling, and end-to-end pixel-space learning offers a scalable path toward stronger visual representations for both generation and perception.


关键词: pixel embeddings, multimodal understanding, multimodal generation, encoder-free design, vision encoder, unified model, end-to-end learning


176. ❌ DiffuSAM: Diffusion-Based Prompt-Free SAM2 for Few-Shot and Source-Free Medical Image Segmentation

作者: Tal Grossman, Noa Cahan, Lev Ayzenberg, Hayit Greenspan 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24719v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文主要研究医学图像分割,使用扩散模型适配SAM2,属于AI在科学(医学)领域的应用,与’AI for Science’高度相关(10分)。其他关键词如大模型、微调、推理等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

DiffuSAM提出一种基于扩散模型的提示无关SAM2适配方法,用于少样本和无源域适应的医学图像分割,在CT和MRI数据集上取得竞争性能。
摘要翻译

诸如Segment Anything Model(SAM)和SAM2等分割模型在提示驱动下展现出强大的零样本性能。然而,这些模型在自然图像上的训练限制了其向医学数据的领域迁移。因此,精确分割通常需要大量的微调和专家设计的提示。我们提出DiffuSAM,一种基于扩散的SAM2适配方法,用于无提示的医学图像分割。我们的框架通过一个轻量级扩散先验,从现成的冻结SAM2图像特征中合成与SAM2兼容的分割掩码类嵌入。生成的嵌入被集成到SAM2的掩码解码器中,以产生精确的分割结果,从而消除了用户提示的需求。该扩散先验进一步以先前分割的切片为条件,从而在体数据间强制实现空间一致性。在无源无监督领域自适应(SF-UDA)和少样本设置下,针对CT和MRI的BTCV和CHAOS数据集进行评估,DiffuSAM在高效训练和推理中取得了具有竞争力的性能。代码可向通讯作者索取。


摘要 (Abstract)

Segmentation models such as Segment Anything Model (SAM) and SAM2 achieve strong prompt-driven zero-shot performance. However, their training on natural images limits domain transfer to medical data. Consequently, accurate segmentation typically requires extensive fine-tuning and expert-designed prompts. We propose DiffuSAM, a diffusion-based adaptation of SAM2 for prompt-free medical image segmentation. Our framework synthesizes SAM2-compatible segmentation mask-like embeddings via a lightweight diffusion-prior from off-the-shelf frozen SAM2 image features. The generated embeddings are integrated into SAM2’s mask decoder to produce accurate segmentations, thereby eliminating the need for user prompts. The diffusion prior is further conditioned on previously segmented slices, enforcing spatial consistency across volumes. Evaluated on the BTCV and CHAOS datasets for CT and MRI under Source-Free Unsupervised Domain Adaptation (SF-UDA) and Few-Shot settings, DiffuSAM achieves competitive performance with efficient training and inference. Code is available upon request from the corresponding author.


关键词: Diffusion-based adaptation, SAM2, Medical image segmentation, Few-shot learning, Source-free domain adaptation, Prompt-free segmentation


177. ❌ OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformer

作者: Boyang Wang, Guangyi Xu, Zhipeng Tang, Jiahui Zhang, Zezhou Cheng 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24762v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是视频镜头边界检测(SBD),使用基于shot-query的Transformer,属于计算机视觉领域,与给定的大模型、深度学习技术原理创新或AI for Science等关键词完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出OmniShotCut方法,通过shot-query Transformer将镜头边界检测建模为结构化关系预测,并采用全合成过渡生成管道和新型基准来提升检测的准确性和可解释性。
摘要翻译

镜头边界检测(Shot Boundary Detection, SBD)旨在自动识别镜头切换,并将视频划分为连贯的镜头。尽管SBD在文献中已被广泛研究,但现有最先进的方法往往在过渡处产生不可解释的边界,遗漏细微但有害的不连续性,并依赖于噪声大、多样性低的标注及过时的基准。为缓解这些局限,我们提出OmniShotCut,将SBD建模为结构化关系预测,通过基于镜头查询的密集视频Transformer(shot query-based dense video Transformer),联合估计镜头范围及其内部关系与镜头间关系。为避免不精确的人工标注,我们采用全合成过渡生成流水线,自动复现主要过渡类别及其精确边界与参数化变体。我们还引入了OmniShotCutBench,这是一个现代宽域基准,支持整体性与诊断性评估。


摘要 (Abstract)

Shot Boundary Detection (SBD) aims to automatically identify shot changes and divide a video into coherent shots. While SBD was widely studied in the literature, existing state-of-the-art methods often produce non-interpretable boundaries on transitions, miss subtle yet harmful discontinuities, and rely on noisy, low-diversity annotations and outdated benchmarks. To alleviate these limitations, we propose OmniShotCut to formulate SBD as structured relational prediction, jointly estimating shot ranges with intra-shot relations and inter-shot relations, by a shot query-based dense video Transformer. To avoid imprecise manual labeling, we adopt a fully synthetic transition synthesis pipeline that automatically reproduces major transition families with precise boundaries and parameterized variants. We also introduce OmniShotCutBench, a modern wide-domain benchmark enabling holistic and diagnostic evaluation.


关键词: Shot Boundary Detection, Video Segmentation, Transformer, Shot-Query, Synthetic Data, Benchmark


178. ❌ WildLIFT: Lifting monocular drone video to 3D for species-agnostic wildlife monitoring

作者: Vandita Shukla, Fabio Remondino, Blair Costelloe, Benjamin Risse 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24718v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注野生动物监测,利用无人机视频和3D几何重建,结合开放词汇2D实例分割,不涉及任何大模型或深度学习技术原理创新。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

WildLIFT通过整合单目无人机视频的3D场景几何与开放词汇2D实例分割,实现了物种无关的3D检测与跟踪,减少了手动标注工作量。
摘要翻译

搭载于无人机上的单目RGB相机广泛用于野生动物监测,然而大多数分析流程仍局限于二维图像空间,视频中的几何信息未得到充分利用。我们提出WildLIFT计算框架,该框架将单目无人机视频中的三维场景几何信息与开放词汇的二维实例分割相结合,实现了物种无关的三维检测与追踪。带有语义面信息的有向三维边界框标签能够定量评估视角覆盖范围及动物间遮挡情况,为下游生态学分析生成结构化元数据。我们在包含四种大型哺乳动物物种、共计6700余个三维检测结果的2581个手动筛选帧上验证了该框架。WildLIFT在多动物场景中保持了较高的身份一致性,并通过基于关键帧的优化显著减少了手动三维标注的工作量。通过将标准无人机影像转化为结构化的三维及视角感知表示,WildLIFT拓展了航空野生动物数据集在行为研究与种群监测中的分析效用。


摘要 (Abstract)

Monocular RGB cameras mounted on drones are widely used for wildlife monitoring, yet most analytical pipelines remain confined to two-dimensional image space, leaving geometric information in video underexploited. We present WildLIFT, a computational framework that integrates three-dimensional scene geometry from monocular drone video with open-vocabulary 2D instance segmentation to enable species-agnostic 3D detection and tracking. Oriented 3D bounding box labels with semantic face information enable quantitative assessment of viewpoint coverage and inter-animal occlusion, producing structured metadata for downstream ecological analyses. We validate the framework on 2,581 manually curated frames comprising over 6,700 3D detections across four large mammal species. WildLIFT maintains high identity consistency in multi-animal scenes and substantially reduces manual 3D annotation effort through keyframe-based refinement. By transforming standard drone footage into structured 3D and viewpoint-aware representations, WildLIFT extends the analytical utility of aerial wildlife datasets for behavioural research and population monitoring.


关键词: wildlife monitoring, drone video, 3D scene geometry, open-vocabulary instance segmentation, 3D detection, tracking, keyframe-based refinement


179. ❌ Aycromo: An Open-Source Platform for Automatic Chromosome Detection in Metaphase Images Based on Deep Learning

作者: Jorge L. A. Lima, Filipe R. Cordeiro 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24685v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注基于深度学习的染色体自动检测平台,属于AI在生物医学领域的应用,与’AI for Science’高度相关(10分)。其他关键词如大模型、MoE、RLHF等均未涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一个基于深度学习的开源平台Aycromo,用于自动检测中期图像中的染色体,实现了高精度(mAP@50 99.40%)并显著缩短分析时间。
摘要翻译

染色体分析是遗传疾病诊断中的基础步骤,但人工核型分析工作流程耗时且高度依赖专家,每位患者通常需要数天时间。尽管深度学习模型在染色体检测中已取得高性能,但大多数提出的解决方案仍局限于研究原型,或缺乏适用于临床的图形界面。本研究提出了Aycromo,一个用于AI辅助细胞遗传学分析的开源桌面平台。该平台基于Electron和ONNX Runtime构建,使细胞遗传学家能够加载预训练模型,通过集成的基准测试模块比较不同架构,并借助交互式标注界面手动修正检测结果,全程无需命令行交互。基于CRCN-NE数据集的中期分裂相图像进行的初步实验表明,YOLOv11实现了99.40%的mAP@50,同时该平台将每张玻片的分析时间缩短至数秒。


摘要 (Abstract)

Chromosome analysis is a fundamental step in the diagnosis of genetic diseases, but the manual karyotyping workflow is time-consuming and heavily dependent on expert specialists, often requiring several days per patient. Although Deep Learning models have achieved high performance in chromosome detection, most proposed solutions remain restricted to research prototypes or lack graphical interfaces suitable for clinical use. In this work, we present Aycromo, an open-source desktop platform for AI-assisted cytogenetic analysis. Built on Electron and ONNX Runtime, the tool allows cytogeneticists to load pre-trained models, compare architectures through an integrated benchmarking module, and manually correct detections via an interactive annotation interface, all without command-line interaction. Preliminary experiments on metaphase images from the CRCN-NE dataset demonstrate that YOLOv11 achieves 99.40% mAP@50, while the platform reduces per-slide analysis to seconds


关键词: chromosome detection, deep learning, metaphase images, open-source platform, YOLOv11, cytogenetic analysis, AI-assisted diagnosis


180. ❌ NeuroClaw Technical Report

作者: Cheng Wang, Zhibin He, Zhihao Peng, Shengyuan Liu, Yufan Hu, Lichao Sun, Xiang Li, Yixuan Yuan 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24696v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.08.0/100.0
Multi-agent Systems OR Agent Coordination0.010.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.08.0/100.0

评分理由: 论文提出NeuroClaw,一个面向神经影像学的多智能体研究助手,核心是LLM Agents、Multi-agent Systems和Tool Use,因此这些关键词得分高。AI for Science相关,因为应用于科学领域。其他关键词如MoE、SLMs、Scaling Laws等与论文内容无关。


!!! tip deepseek-chat TL;DR

NeuroClaw是一个专门用于可执行和可复现神经影像学研究的领域专用多智能体研究助手,通过多层级智能体架构和工具集成,显著提升了多模态LLM在神经影像学工作流中的执行能力和结果可靠性。
摘要翻译

自主型人工智能系统有望加速科学工作流程,但神经影像学面临独特挑战:异质性模态(sMRI、fMRI、dMRI、EEG)、冗长的多阶段处理流程以及持续存在的可重复性风险。为应对这一缺口,我们提出NeuroClaw——一个面向可执行与可重复神经影像学研究的领域专用多智能体研究助手。NeuroClaw可直接处理跨格式与模态的原始神经影像数据,其决策基于数据集语义与BIDS元数据,因此用户无需准备精选输入或定制模型代码。该平台将工程化编排与端到端环境管理相结合,包括固定Python环境、Docker支持、常用神经影像工具自动安装程序及GPU配置。在实际应用中,该层强调检查点保存、执行后验证、结构化审计追踪及受控运行时设置,从而在提升工具链透明度的同时增强可重复性与可审计性。三级技能/智能体层级结构将用户交互、高层编排与底层工具技能分离,将复杂工作流分解为安全、可复用的单元。伴随NeuroClaw框架,我们提出NeuroBench——一个面向可执行性、工件有效性与可重复性准备度的系统级基准测试。在多种多模态大语言模型上,与直接调用智能体相比,启用NeuroClaw的运行均产生一致且显著的分数提升。项目主页:https://cuhk-aim-group.github.io/NeuroClaw/index.html


摘要 (Abstract)

Agentic artificial intelligence systems promise to accelerate scientific workflows, but neuroimaging poses unique challenges: heterogeneous modalities (sMRI, fMRI, dMRI, EEG), long multi-stage pipelines, and persistent reproducibility risks. To address this gap, we present NeuroClaw, a domain-specialized multi-agent research assistant for executable and reproducible neuroimaging research. NeuroClaw operates directly on raw neuroimaging data across formats and modalities, grounding decisions in dataset semantics and BIDS metadata so users need not prepare curated inputs or bespoke model code. The platform combines harness engineering with end-to-end environment management, including pinned Python environments, Docker support, automated installers for common neuroimaging tools, and GPU configuration. In practice, this layer emphasizes checkpointing, post-execution verification, structured audit traces, and controlled runtime setup, making toolchains more transparent while improving reproducibility and auditability. A three-tier skill/agent hierarchy separates user-facing interaction, high-level orchestration, and low-level tool skills to decompose complex workflows into safe, reusable units. Alongside the NeuroClaw framework, we introduce NeuroBench, a system-level benchmark for executability, artifact validity, and reproducibility readiness. Across multiple multimodal LLMs, NeuroClaw-enabled runs yield consistent and substantial score improvements compared with direct agent invocation. Project homepage: https://cuhk-aim-group.github.io/NeuroClaw/index.html


关键词: NeuroClaw, multi-agent systems, LLM agents, tool use, neuroimaging, reproducibility, AI for Science, domain-specialized


181. ❌ Infrastructure-Guided Connectivity-Enhanced Road Crack Detection and Estimation

作者: Haosong Xiao, Yamini Ramesh, Rishabh Shukla, Swarat Sarkar, Chaozhe R. He 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24616v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主题是道路裂缝检测,使用计算机视觉和通信协议,不涉及大模型、深度学习技术原理创新或AI for Science。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于基础设施引导的通信增强道路裂缝检测管道,通过定制通信协议和图像处理,利用裂缝检测模型在实验车辆平台上实现了有效检测。
摘要翻译

本文报告了全球首个基于基础设施引导的通信增强型道路裂缝检测系统,该系统可在乘用车上有效实施。我们首先设计了一种定制化通信协议,用于将感兴趣区域从基础设施传输至车辆。通过适当的摄像头图像处理(如动态裁剪与帧选择),聚焦后的图像被输入裂缝检测模型。借助最先进的裂缝检测模型主干网络(backbone)以及精心制备的包含前方视角裂缝的数据集,我们训练模型以提升裂缝检测性能。我们在实验车辆平台上演示了完整的检测流程,展示了检测有效性,并展望了未来研究方向。


摘要 (Abstract)

In this paper, we report the world’s first infrastructure-guided communication-enhanced road crack detection pipeline that is effective and implementable on passenger vehicles. We first design a customized communication protocol to transmit the region of interest from the infrastructure to the vehicle. With proper camera image processing (e.g., dynamic cropping and frame selection), the focused images are provided to the crack detection model. Leveraging state-of-the-art crack detection model backbones and a carefully prepared dataset comprising a forward-facing view with a crack, we train the model to improve crack-detection performance. We demonstrate the full detection pipeline on an experimental vehicle platform, showcase the detection effectiveness, and project future research directions.


关键词: road crack detection, infrastructure-guided, communication protocol, image processing, crack detection model, vehicle platform


182. ❌ Benchmarking Pathology Foundation Models for Breast Cancer Survival Prediction

作者: Fredrik K. Gustafsson, Constance Boissin, Johan Vallon-Christersson, David A. Clifton, Mattias Rantalainen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24679v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.08.0/100.0
Scaling Laws AND Data Quality0.05.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.08.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文研究病理学基础模型(PFMs)在乳腺癌生存预测中的基准测试,PFMs属于Foundation Models,因此与’Large Language Models OR LLMs OR Foundation Models’高度相关(10分)。论文提到H0-mini紧凑蒸馏模型,与’Small Language Models OR SLMs OR On-device AI’相关(8分)。论文讨论了预训练数据规模与模型性能的关系,与’Scaling Laws AND Data Quality’部分相关(5分)。PFMs基于预训练,与’Pre-training OR Continual Pre-training OR Domain Adaptation’相关(8分)。论文属于AI在生物医学领域的应用,与’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。其他关键词如MoE、SFT、RAG等与论文内容无关,评分为0。


!!! tip deepseek-chat TL;DR

该论文系统比较了多种病理学基础模型在乳腺癌生存预测任务上的性能,发现H-optimus-1表现最佳,但模型间性能差异较小,且紧凑模型H0-mini以更少参数实现了接近甚至更优的性能。
摘要翻译

病理学基础模型(Pathology Foundation Models, PFMs)近年来已成为计算病理学领域强大的预训练编码器,能够支持跨多种下游任务的迁移学习。然而,针对临床有意义的预测问题,这些模型的系统性比较仍然有限,尤其是在外部验证条件下的生存预测方面。本研究对广泛使用及近期提出的PFMs在基于全切片组织病理学图像的乳腺癌生存预测任务中进行了基准测试。通过采用基于斑块级特征提取的标准化流程和统一的生存建模框架,我们在三个独立临床队列(涵盖5400余名具有长期随访数据的患者)中评估了模型表征。模型在一个队列上训练,并在两个独立的外部队列上评估,从而实现了对跨数据集泛化能力的严格评估。总体而言,H-optimus-1取得了最强的生存预测性能。更广泛地,我们观察到各模型家族存在一致的代际改进,第二代PFMs的表现优于第一代模型。然而,许多近期PFMs之间的绝对性能差异仍然较小,这表明仅通过进一步扩大预训练数据或模型规模所带来的收益正在递减。值得注意的是,紧凑型蒸馏模型H0-mini在参数数量不足其大型教师模型H-optimus-0的8%且特征提取速度显著更快的情况下,性能仍略优于后者。综上,这些结果首次为乳腺癌生存预测中的PFMs提供了大规模、经外部验证的基准,并为PFMs在临床工作流程中的高效部署提供了实践指导。


摘要 (Abstract)

Pathology foundation models (PFMs) have recently emerged as powerful pretrained encoders for computational pathology, enabling transfer learning across a wide range of downstream tasks. However, systematic comparisons of these models for clinically meaningful prediction problems remain limited, especially in the context of survival prediction under external validation. In this study, we benchmark widely used and recently proposed PFMs for breast cancer survival prediction from whole-slide histopathology images. Using a standardized pipeline based on patch-level feature extraction and a unified survival modeling framework, we evaluate model representations across three independent clinical cohorts comprising more than 5,400 patients with long-term follow-up. Models are trained on one cohort and evaluated on two independent external cohorts, enabling a rigorous assessment of cross-dataset generalization. Overall, H-optimus-1 achieves the strongest survival prediction performance. More broadly, we observe consistent generational improvements across model families, with second-generation PFMs outperforming their first-generation counterparts. However, absolute performance differences between many recent PFMs remain modest, suggesting diminishing returns from further scaling of pretraining data or model size alone. Notably, the compact distilled model H0-mini slightly outperforms its larger teacher model H-optimus-0, despite using fewer than 8% of the parameters and enabling significantly faster feature extraction. Together, these results provide the first large-scale, externally validated benchmark of PFMs for breast cancer survival prediction, and offer practical guidance for efficient deployment of PFMs in clinical workflows.


关键词: Pathology Foundation Models, Breast Cancer, Survival Prediction, Whole-slide Histopathology Images, External Validation, H-optimus-1, H0-mini


183. ❌ Probing CLIP’s Comprehension of 360-Degree Textual and Visual Semantics

作者: Hai Wang, Xiaochen Yang, Mingzhi Dong, Jing-Hao Xue 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24642v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.010.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究CLIP模型对360度全景图像-文本语义的理解,提出使用LoRA进行微调以增强对360度视觉语义的鲁棒性。与关键词’PEFT OR LoRA OR Parameter-efficient Fine-tuning’高度相关(10分),因为LoRA是核心方法。其他关键词如LLMs、预训练、RLHF等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文通过引入360度文本和视觉语义概念,设计评估方法发现CLIP模型能理解文本语义但无法鲁棒处理视觉语义的循环平移不变性,并提出LoRA微调框架来改善这一缺陷。
摘要翻译

从文本即时生成丰富的360度全景世界的梦想正迅速成为现实,然而,在可靠评估其语义对齐能力方面仍存在关键空白。对比语言-图像预训练(CLIP)模型作为标准AI评估工具,主要基于透视图像-文本对进行训练,其对360度全景图像-文本对独特特征的理解仍是一个悬而未决的问题。本文通过引入两个概念来填补这一空白:\emph{360度文本语义}(即由显式格式标识符传递的语义信息)和\emph{360度视觉语义}(即在水平循环移位下保持不变的语义)。为探究CLIP对这些语义的理解,我们进一步提出利用关键词操作和不同幅度的水平循环移位的新型评估方法。对多种主流CLIP配置的严格统计分析表明:(1)CLIP模型能有效利用显式文本标识符,展现出对360度文本语义的理解;(2)CLIP模型在水平循环移位下无法稳健保持语义对齐,表明其对360度视觉语义的理解有限。为解决这一局限,我们提出一种基于LoRA的微调框架,显式注入对循环移位的不变性。微调后的模型对360度视觉语义的理解有所提升,但原始语义评估性能略有下降,这凸显了将CLIP适配至360度全景图像时的根本性权衡。代码已开源至https://github.com/littlewhitesea/360Semantics。


摘要 (Abstract)

The dream of instantly creating rich 360-degree panoramic worlds from text is rapidly becoming a reality, yet a crucial gap exists in our ability to reliably evaluate their semantic alignment. Contrastive Language-Image Pre-training (CLIP) models, standard AI evaluators, predominantly trained on perspective image-text pairs, face an open question regarding their understanding of the unique characteristics of 360-degree panoramic image-text pairs. This paper addresses this gap by first introducing two concepts: \emph{360-degree textual semantics}, semantic information conveyed by explicit format identifiers, and \emph{360-degree visual semantics}, invariant semantics under horizontal circular shifts. To probe CLIP’s comprehension of these semantics, we then propose novel evaluation methodologies using keyword manipulation and horizontal circular shifts of varying magnitudes. Rigorous statistical analyses across popular CLIP configurations reveal that: (1) CLIP models effectively leverage explicit textual identifiers, demonstrating an understanding of 360-degree textual semantics; and (2) CLIP models fail to robustly preserve semantic alignment under horizontal circular shifts, indicating limited comprehension of 360-degree visual semantics. To address this limitation, we propose a LoRA-based fine-tuning framework that explicitly instills invariance to circular shifts. Our fine-tuned models exhibit improved comprehension of 360-degree visual semantics, though with a slight degradation in original semantic evaluation performance, highlighting a fundamental trade-off in adapting CLIP to 360-degree panoramic images. Code is available at https://github.com/littlewhitesea/360Semantics.


关键词: CLIP, 360-degree panoramic images, textual semantics, visual semantics, LoRA fine-tuning, circular shift invariance, semantic alignment


184. ❌ Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift

作者: Lixian Chen, Mingxuan Huang, Yanhui Chen, Junyi Lin, Yang Shi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24602v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.08.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究视觉-语言模型在模态非对称偏移下的测试时适应,提出MG-MTTA方法,使用轻量级门控或适配器更新,涉及PEFT(参数高效微调)概念,相关度8分。其他关键词如大模型、MoE、RAG等均不相关。


!!! tip deepseek-chat TL;DR

论文针对视觉-语言模型在部署时视觉和文本分支非对称偏移的问题,提出基于主要化视角的测试时适应方法MG-MTTA,通过融合后验熵最小化和可靠性感知门控先验,在多种偏移场景下提升分类准确率。
摘要翻译

视觉-语言模型在零样本设置中具有良好的迁移能力,但在部署时,视觉分支与文本分支往往会发生非对称偏移。在此条件下,基于熵的测试时自适应虽能锐化融合后验,却可能同时增加错误,因为不可靠模态仍可能主导融合过程。我们通过多模态后验的优化上界视角研究这一失效模式,并将自适应问题建模为融合预测上的约束性解混问题。基于该视角,我们提出MG-MTTA方法,该方法保持主干网络冻结,仅更新轻量级门控或适配器。其目标函数结合了融合后验熵最小化与基于锚点模态一致性和跨模态冲突构建的可靠性感知门控先验。我们的分析给出了熵降低能保持正确排序的条件,以及刻画模态主导失效的阈值。在基于ImageNet的基准测试中,MG-MTTA在语义保持的文本偏移场景下将top-1准确率从57.97提升至66.51,在联合视觉-文本偏移场景下从21.68提升至26.27,同时在纯视觉基准测试中仍保持竞争力。这些结果表明,多模态测试时自适应应控制模态可靠性,而不仅仅是预测熵。


摘要 (Abstract)

Vision-language models transfer well in zero-shot settings, but at deployment the visual and textual branches often shift asymmetrically. Under this condition, entropy-based test-time adaptation can sharpen the fused posterior while increasing error, because an unreliable modality may still dominate fusion. We study this failure mode through a majorization view of multimodal posteriors and cast adaptation as a constrained de-mixing problem on the fused prediction. Based on this view, we propose MG-MTTA, which keeps the backbone frozen and updates only a lightweight gate or adapter. The objective combines fused-posterior entropy minimization with a reliability-aware gate prior built from anchor-based modality consistency and cross-modal conflict. Our analysis gives conditions under which entropy reduction preserves the correct ranking and a threshold that characterizes modality-dominance failure. On the ImageNet-based benchmark, MG-MTTA improves top-1 accuracy from 57.97 to 66.51 under semantics-preserving textual shift and from 21.68 to 26.27 under joint visual-textual shift, while remaining competitive in the visual-only benchmark. These results show that multimodal test-time adaptation should control modality reliability, not just prediction entropy.


关键词: Test-Time Adaptation, Vision-Language Models, Modality-Specific Shift, Majorization, Entropy Minimization, Gate/Adapter, Reliability-Aware


185. ❌ Point-MF: One-step Point Cloud Generation from a Single Image via Mean Flows

作者: Yuta Baba, Keiji Yanai 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24586v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究单图像点云生成,使用Mean Flow方法,属于计算机视觉和3D重建领域,与给定的大模型、深度学习技术原理创新或AI for Science关键词均无直接关联。所有关键词得分为0。


!!! tip deepseek-chat TL;DR

该论文提出Point-MF,一种基于Mean Flow的单步点云生成框架,从单张RGB图像直接重建3D点云,实现高质量和毫秒级延迟。
摘要翻译

单幅图像点云重建必须从单张RGB图像中推断出完整的3D几何结构,包括被遮挡部分。尽管基于扩散的重建器能够实现高精度,但它们通常需要大量去噪迭代,导致推理过程缓慢且计算成本高昂。我们提出Point-MF,一种基于平均流(Mean-Flow)的低NFE(网络函数评估次数)单幅图像点云重建框架,该框架将兼容平均流的架构与辅助损失相结合。具体而言,Point-MF直接在点云空间中运行以学习平均速度场,并能够通过单次网络函数评估(1-NFE)实现一步重建,无需依赖基于VAE(变分自编码器)的潜在表示。为使平均流在大区间跳跃下依然有效,Point-MF采用了针对平均流设置定制的扩散Transformer(Diffusion Transformer),通过轻量级令牌适配器(token adapter)以冻结的DINOv3图像特征为条件,并配备显式的区间/时间条件。此外,我们引入了去噪空间锚点(Denoised Space Anchor),这是一种针对由预测速度场诱导的去噪空间估计$x_θ$的集合距离辅助损失,用于稳定大步生成并减少离群点与密度伪影。在ShapeNet-R2N2和Pix3D数据集上,与多步扩散基线及具有竞争力的前馈模型相比,Point-MF在重建质量与推理速度之间实现了强平衡,同时能够以毫秒级延迟生成高质量点云。


摘要 (Abstract)

Single-image point cloud reconstruction must infer complete 3D geometry, including occluded parts, from a single RGB image. While diffusion-based reconstructors achieve high accuracy, they typically require many denoising iterations, resulting in slow and expensive inference. We propose Point-MF, a Mean-Flow-based framework for low-NFE single-image point cloud reconstruction that couples a Mean-Flow-compatible architecture with an auxiliary loss. Specifically, Point-MF operates directly in point-cloud space to learn the mean velocity field and enables one-step reconstruction with a single network function evaluation (1-NFE), without relying on VAE-based latent representations. To make Mean Flow effective under large interval jumps, Point-MF employs a Diffusion Transformer tailored to the Mean-Flow setting, conditioned on frozen DINOv3 image features via a lightweight token adapter and equipped with explicit interval/time conditioning. Moreover, we introduce Denoised Space Anchor, a set-distance auxiliary loss on the denoised-space estimate $x_θ$ induced by the predicted velocity field, to stabilize large-step generation and reduce outliers and density artifacts. On ShapeNet-R2N2 and Pix3D, Point-MF strikes a strong balance between reconstruction quality and inference speed compared to multi-step diffusion baselines and competitive feedforward models, while generating high-quality point clouds with millisecond-level latency.


关键词: Point Cloud Generation, Mean Flow, Single-Image 3D Reconstruction, Diffusion Transformer, Denoised Space Anchor, One-Step Generation, ShapeNet-R2N2, Pix3D


186. ❌ Diffusion Model as a Generalist Segmentation Learner

作者: Haoxiao Wang, Antao Xiang, Haiyang Sun, Peilin Sun, Changhao Pan, Yifu Chen, Minjie Hong, Weijie Wang, Shuang Chen, Yue Chen, Zhou Zhao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24575v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文主要研究扩散模型在分割任务中的应用,属于计算机视觉领域,与给定的大语言模型、深度学习技术原理创新等关键词无直接关联。论文未涉及任何大模型或LLM相关技术,也未涉及AI for Science领域。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出DiGSeg框架,利用预训练扩散模型的去噪轨迹作为视觉先验,实现统一的文本条件语义分割和开放词汇分割,并在多个下游任务中取得优异性能。
摘要翻译

扩散模型主要针对图像合成进行训练,但其去噪轨迹编码了丰富且空间对齐的视觉先验。本文证明,这些先验可用于文本条件语义分割与开放词汇分割,且该方法可泛化至多种下游任务,从而构建一个通用的扩散分割框架。具体而言,我们提出了DiGSeg(扩散模型作为通用分割学习器),它将预训练的扩散模型重新改造为统一的分割框架。该方法将输入图像与真实掩码编码至潜在空间,并将其拼接作为扩散U-Net的条件信号。一条并行的CLIP对齐文本路径跨多个尺度注入语言特征,使模型能够将文本查询与不断演化的视觉表征对齐。这一设计将现成的扩散主干网络转化为通用接口,可生成基于外观与任意文本提示的结构化分割掩码。大量实验表明,该方法在标准语义分割基准上取得了最先进性能,同时在开放词汇泛化以及向医学、遥感与农业场景的跨领域迁移中表现强劲——且无需针对特定领域进行架构定制。这些结果表明,现代扩散主干网络可作为通用分割学习器而非纯粹的生成器,从而缩小了视觉生成与视觉理解之间的差距。


摘要 (Abstract)

Diffusion models are primarily trained for image synthesis, yet their denoising trajectories encode rich, spatially aligned visual priors. In this paper, we demonstrate that these priors can be utilized for text-conditioned semantic and open-vocabulary segmentation, and this approach can be generalized to various downstream tasks to make a general-purpose diffusion segmentation framework. Concretely, we introduce DiGSeg (Diffusion Models as a Generalist Segmentation Learner), which repurposes a pretrained diffusion model into a unified segmentation framework. Our approach encodes the input image and ground-truth mask into the latent space and concatenates them as conditioning signals for the diffusion U-Net. A parallel CLIP-aligned text pathway injects language features across multiple scales, enabling the model to align textual queries with evolving visual representations. This design transforms an off-the-shelf diffusion backbone into a universal interface that produces structured segmentation masks conditioned on both appearance and arbitrary text prompts. Extensive experiments demonstrate state-of-the-art performance on standard semantic segmentation benchmarks, as well as strong open-vocabulary generalization and cross-domain transfer to medical, remote sensing, and agricultural scenarios-without domain-specific architectural customization. These results indicate that modern diffusion backbones can serve as generalist segmentation learners rather than pure generators, narrowing the gap between visual generation and visual understanding.


关键词: Diffusion Model, Semantic Segmentation, Open-vocabulary Segmentation, Generalist Segmentation Learner, Text-conditioned Segmentation, Visual Priors, DiGSeg


187. ❌ Improving Vision-language Models with Perception-centric Process Reward Models

作者: Yingqian Min, Kun Zhou, Yifan Li, Yuhuan Wu, Han Peng, Yifan Du, Wayne Xin Zhao, Min Yang, Ji-Rong Wen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24583v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.08.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.07.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.08.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出Perceval,一种用于视觉语言模型(VLMs)的过程奖励模型(PRM),通过token级错误定位和惩罚幻觉跨度来改进RL训练,并支持推理时自我修正。核心相关关键词包括:Large Language Models(VLMs是LLM的扩展,10分)、RLHF/DPO(使用RLVR和GRPO变体,8分)、Chain of Thought(推理链错误诊断,7分)、Self-Correction(推理时截断错误并重新生成,8分)、Hallucination Mitigation(直接针对感知幻觉,10分)。Post-training(RL训练属于后训练,5分)。其他关键词如MoE、SLM、Scaling Laws等无关。


!!! tip deepseek-chat TL;DR

论文提出Perceval,一种感知中心的过程奖励模型,通过token级错误定位和惩罚幻觉跨度来增强视觉语言模型的强化学习训练,并在推理时通过自我修正实现测试时扩展,显著提升多领域基准性能。
摘要翻译

近年来,基于可验证奖励的强化学习(RLVR)在显著提升视觉语言模型(VLMs)复杂推理能力方面取得了重要进展。然而,其基于最终结果的监督信号过于粗糙,难以诊断并修正推理链中的错误。为此,我们提出Perceval——一种过程奖励模型(PRM),能够实现令牌级别的错误定位。该模型可从模型响应中提取与图像相关的陈述,并逐一将其与图像中的视觉证据进行比对,最终返回包含感知错误的陈述。Perceval通过感知密集型的监督训练数据进行训练。随后,我们将Perceval集成到强化学习训练过程中,以训练策略模型。具体而言,相较于传统GRPO方法中采用的序列级优势函数,我们通过针对Perceval识别出的幻觉片段施加惩罚,实现了令牌级优势函数,从而提供细粒度的监督信号。除增强训练过程外,Perceval还能在推理阶段辅助VLMs。利用Perceval,我们可以截断模型响应中的错误部分,随后直接让模型重新生成响应,或引导模型对先前输出进行反思。该过程可重复多次,以实现测试时扩展。实验结果表明,在多个领域基准测试中,经强化学习训练的不同推理型VLMs均取得了显著性能提升,这凸显了以感知为中心的监督作为一种通用策略的潜力。在测试时扩展方面,该方法相较于多数投票等其他策略也展现出持续的性能优势。我们的代码与数据将公开发布于https://github.com/RUCAIBox/Perceval。


摘要 (Abstract)

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and correct errors within the reasoning chain. To this end, we propose Perceval, a process reward model (PRM) that enables token-level error grounding, which can extract image-related claims from the response and compare them one by one with the visual evidence in the image, ultimately returning claims that contain perceptual errors. Perceval is trained with perception-intensive supervised training data. We then integrate Perceval into the RL training process to train the policy models. Specifically, compared to traditional GRPO, which applies sequence-level advantages, we apply token-level advantages by targeting penalties on hallucinated spans identified by Perceval, thus enabling fine-grained supervision signals. In addition to augmenting the training process, Perceval can also assist VLMs during the inference stage. Using Perceval, we can truncate the erroneous portions of the model’s response, and then either have the model regenerate the response directly or induce the model to reflect on its previous output. This process can be repeated multiple times to achieve test-time scaling. Experiments show significant improvements on benchmarks from various domains across multiple reasoning VLMs trained with RL, highlighting the promise of perception-centric supervision as a general-purpose strategy. For test-time scaling, it also demonstrates consistent performance gains over other strategies, such as major voting. Our code and data will be publicly released at https://github.com/RUCAIBox/Perceval.


关键词: Process Reward Model, Vision-Language Models, Reinforcement Learning, Hallucination Mitigation, Self-Correction, Token-level Supervision, Test-time Scaling


188. ❌ RACANet: Reliability-Aware Crowd Anchor Network for RGB-T Crowd Counting

作者: Jinghao Shi, Mengqi Lei, Kunliang He, Yun Li, Wei Bao, Siqi Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24543v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究RGB-T人群计数,涉及多模态融合和可靠性建模,但完全不涉及大模型、深度学习技术原理创新或AI for Science(生物/化学信息学)。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出RACANet,通过两阶段融合框架和局部锚点模块,利用RGB和热红外图像进行人群计数,在基准数据集上取得最优性能。
摘要翻译

RGB-Thermal(RGB-T)人群计数旨在融合可见光谱与热红外信息,以提升复杂场景下人群密度估计的鲁棒性。尽管现有研究通常通过跨模态特征融合来提高计数精度,但当前多数方法依赖隐式跨模态融合策略,缺乏对局部空间差异的显式建模,且未能在位置层面实现模态可靠性的细粒度刻画,从而限制了融合过程的准确性与可解释性。针对上述问题,本文提出一种两阶段融合框架RACANet(Reliability-Aware Crowd Anchor Network,可靠性感知人群锚点网络),用于RGB-T人群计数。首先,我们引入轻量级跨模态对齐预训练阶段,通过人群先验监督与局部双向软匹配显式学习跨模态语义对应关系。随后,基于预训练阶段习得的先验知识,在正式训练阶段引入局部锚点融合模块(Local Anchor Fusion Module,LAFM)。该模块通过聚合高可靠性区域的特征生成局部语义锚点,并进一步利用局部注意力机制实现自适应像素级特征重分配。此外,我们提出差异感知一致性约束,以动态协调模态表征一致区域的可靠性。在RGBT-CC与Drone-RGBT两个广泛使用的基准数据集上的实验表明,RACANet优于现有方法。匿名代码可通过https://anonymous.4open.science/r/RACANet-9985获取。


摘要 (Abstract)

RGB-Thermal (T) crowd counting aims to integrate visible-spectrum and thermal infrared information to improve the robustness of crowd density estimation in complex scenes. Although existing studies generally improve counting accuracy through cross-modal feature fusion, most current methods rely on implicit cross-modal fusion strategies and lack explicit modeling of local spatial discrepancies as well as fine-grained characterization of modality reliability at the positional level, thereby limiting the accuracy and interpretability of the fusion process. To address these issues, this paper proposes a two-stage fusion framework, RACANet, a Reliability-Aware Crowd Anchor Network for RGB-T crowd counting. First, we introduce a lightweight cross-modal alignment pretraining stage, which explicitly learns cross-modal semantic correspondences through crowd-prior supervision and local bidirectional soft matching. Then, based on the priors learned during pretraining, a Local Anchor Fusion Module (LAFM) is introduced in the formal training stage. This module generates local semantic anchors by aggregating features from highly reliable regions and further enables adaptive pixel-level feature redistribution with a local attention mechanism. In addition, we propose a discrepancy-aware consistency constraint to dynamically coordinate the reliability of regions where modal representations are consistent. Experiments conducted on two widely used benchmark datasets, RGBT-CC and Drone-RGBT, demonstrate that RACANet outperforms existing methods. The anonymous code is available at https://anonymous.4open.science/r/RACANet-9985.


关键词: RGB-T crowd counting, cross-modal fusion, reliability-aware, local anchor, crowd density estimation, thermal infrared, multi-modal


189. ❌ Point Cloud Registration for Fusion between SPECT MPI and CTA Images

作者: Ni Yao, Xiangyu Liu, Shaojie Tang, Danyang Sun, Chuang Han, Yanting Li, Jiaofen Nan, Chengyang Li, Fubao Zhu, Chen Zhao, Zhihui Xu, Weihua Zhou 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24524v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文主要研究SPECT MPI和CTA图像的配准与融合,属于医学图像处理领域,不涉及大模型或深度学习技术原理创新。虽然使用了U-Net分割和点云配准算法(如ICP、CPD等),但这些是传统计算机视觉方法,并非大模型或前沿深度学习技术。唯一可能相关的关键词是’AI for Science’,因为该方法应用于医学科学,但权重较低,评分为5。其他关键词均不相关,评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种结合U-Net分割和点云配准的SPECT MPI与CTA图像融合框架,通过自动地标提取和多种精细配准方法实现了高精度融合,其中BCPD-plus-plus方法达到1.7mm的平均点云距离。
摘要翻译

单光子发射计算机断层扫描心肌灌注成像(SPECT MPI)与计算机断层扫描血管造影(CTA)的临床融合仍受限于跨模态配准误差及对人工标记点的依赖,这可能导致缺血定位不准确及病变水平的功能评估受限。为解决该问题,我们提出一种整合功能与结构信息以实现全面心脏评估的SPECT MPI与CTA配准融合框架。该流程对两种模态均执行基于U-Net的分割:在SPECT MPI中仅提取左心室(LV),并基于左心室特征结构自动推导解剖标记点;在CTA中则分割两个心室,利用其空间关系在室间隔交界处自动定义标记点。通过尺度空间一致性预处理及标记点驱动的粗配准来缓解初始错位。基于此初始化,在左心室心外膜表面点云上评估多种精细配准方法,包括ICP、SICP、CPD、CluReg、FFD及BCPD-plus-plus。随后将所得变换传播至体素级重采样,实现高精度SPECT-CTA融合。在60例患者的回顾性队列中,该框架在保持CTA亚毫米级冠状动脉细节的同时,精确叠加了定量SPECT灌注数据。在评估方法中,BCPD-plus-plus以平均点云距离1.7毫米达到最高精度。通过结合稳健初始化、对比性精细配准及体素级融合,本方法为心肌缺血定位及冠状动脉病变功能评估提供了实用方案,且不依赖于特定精细配准算法。


摘要 (Abstract)

Clinical fusion of Single Photon Emission Computed Tomography Myocardial Perfusion Imaging (SPECT MPI) and Computed Tomography Angiography (CTA) remains limited by cross-modality misregistration and reliance on manual landmarks, which can hinder accurate ischemia localization and lesion-level functional assessment. To address this issue, we propose a registration and fusion framework for SPECT MPI and CTA that integrates functional and structural information for comprehensive cardiac evaluation. The proposed pipeline performs U-Net-based segmentation on both modalities. On SPECT MPI, only the left ventricle (LV) is extracted, and anatomical landmarks are automatically derived from characteristic LV structures. On CTA, both ventricles are segmented, and their spatial relationship is used to automatically define landmarks at the interventricular septal junction. Scale-space consistency preprocessing and landmark-driven coarse registration are applied to mitigate initial misalignment. Based on this initialization, multiple fine registration methods are evaluated on LV epicardial surface point clouds, including ICP, SICP, CPD, CluReg, FFD, and BCPD-plus-plus. The resulting transformations are then propagated to voxel-level resampling for high-precision SPECT-CTA fusion. In a retrospective cohort of 60 patients, the proposed framework preserved sub-millimeter coronary detail from CTA while accurately overlaying quantitative SPECT perfusion. Among the evaluated methods, BCPD-plus-plus achieved the highest accuracy with a mean point cloud distance of 1.7 mm. By combining robust initialization, comparative fine registration, and voxel-level fusion, the proposed approach provides a practical solution for myocardial ischemia localization and functional evaluation of coronary lesions, while remaining independent of any specific fine registration algorithm.


关键词: SPECT MPI, CTA, Image Registration, Point Cloud Registration, U-Net Segmentation, Cardiac Fusion, BCPD-plus-plus


190. ❌ Self-Supervised Representation Learning via Hyperspherical Density Shaping

作者: Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24498v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出了一种基于超球面密度塑形的自监督表示学习方法(HyDeS),属于自监督学习领域,与给定的关键词(主要围绕大语言模型、深度学习技术原理创新、AI for Science等)均无直接关联。论文未涉及任何大模型、LLM、MoE、SLM、Scaling Laws、预训练/后训练、指令微调、RLHF、PEFT、RAG、长上下文、KV缓存压缩、CoT、System 2、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习或AI for Science等主题。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于超球面密度塑形(HyDeS)的自监督表示学习方法,通过多视角互信息最大化在超球面空间中使用香农微分熵和非参数von Mises-Fisher密度估计器,在分割任务上表现良好但在细粒度分类上不足。
摘要翻译

现代自监督表示学习方法通常依赖于缺乏理论依据的经验性启发式规则。本研究提出HyDeS,一种基于理论的方法,该方法利用香农微分熵与非参数化冯·米塞斯-费舍尔密度估计器,在超球面空间内实现多视角互信息最大化。
我们证明,HyDeS使训练模型偏向于关注图像的前景特征,并在VOC PASCAL等分割任务中表现优异,但在细粒度分类任务中表现滞后。我们详细分析了所诱导的潜在空间几何结构与学习动态,这些分析可用于设计其他具有理论依据的自监督学习方法。


摘要 (Abstract)

Modern self-supervised representation learning methods often relies on empirical heuristics that are not theoretically grounded. In this study we propose HyDeS, a theoretically grounded method based on multi-view mutual information maximization within an hyperspherical space using Shannon differential entropy with a non-parametric von Mises-Fisher density estimator. We show that HyDeS bias the trained model towards focusing on foreground features of the images and perform well on segmentation tasks such as VOC PASCAL, while it lags in fine-grained classification. We provide a detailed analysis of the induced latent space geometry and learning dynamics, that can be used for designing other theoretically grounded self-supervised learning methods.


关键词: self-supervised learning, representation learning, hyperspherical density shaping, mutual information maximization, von Mises-Fisher density estimator, foreground feature bias, latent space geometry


191. ❌ CA-IDD: Cross-Attention Guided Identity-Conditional Diffusion for Identity-Consistent Face Swapping

作者: Md Shohel Rana, Tanoy Debnath 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24493v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是基于扩散模型的人脸交换技术,属于计算机视觉和图像生成领域,与给定的关键词(大模型、深度学习技术原理创新、AI for Science等)完全不相关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于交叉注意力引导的身份条件扩散模型CA-IDD,用于身份一致的人脸交换,在FID指标上优于现有方法。
摘要翻译

人脸交换旨在通过将源人脸的身份特征迁移至目标人脸,同时保留其姿态、表情和背景信息,从而优化逼真面部图像的生成。然而,现有方法(尤其是基于生成对抗网络的方法)由于可控性有限及模式坍塌问题,往往难以在身份保留与视觉真实性之间取得平衡。本文提出CA-IDD(交叉注意力引导的身份条件扩散模型),这是首个基于扩散模型的人脸交换方法,通过多尺度交叉注意力机制整合包含注视方向、身份特征及面部解析的多模态引导信息。通过分层注意力层将预计算的身份嵌入融入去噪过程,实现准确且一致的身份迁移。为提升语义连贯性与视觉质量,我们采用专家引导的监督策略,结合面部解析与注视一致性模块。与基于生成对抗网络或隐式融合的方法不同,我们的扩散框架具有训练稳定、泛化能力强及空间自适应身份对齐等优势,能够在姿态与表情变化中实现细粒度的区域控制。CA-IDD的FID(弗雷歇初始距离)达到11.73,超越了FaceShifter与MegaFS等现有基准模型。定性结果也表明,该方法在不同姿态下均能显著提升身份保留效果,为未来基于扩散模型的人脸编辑奠定了坚实基础。


摘要 (Abstract)

Face swapping aims to optimize realistic facial image generation by leveraging the identity of a source face onto a target face while preserving pose, expression, and context. However, existing methods, especially GAN-based methods, often struggle to balance identity preservation and visual realism due to limited controllability and mode collapse. In this paper, we introduce CA-IDD (Cross-Attention Guided Identity-Conditional Diffusion), the first diffusion-based face swapping approach that integrates multi-modal guidance comprising gaze, identity, and facial parsing through multi-scale cross-attention. Precomputed identity embeddings are incorporated into the denoising process via hierarchical attention layers, resulting in accurate and consistent identity transfer. To improve semantic coherence and visual quality, we use expert-guided supervision, with facial parsing and gaze-consistency modules. Unlike GAN-based or implicit-fusion methods, our diffusion framework provides stable training, robust generalization, and spatially adaptive identity alignment, allowing for fine-grained regional control across pose and expression variations. CA-IDD achieves an FID of 11.73, exceeding established baselines such as FaceShifter and MegaFS. Qualitative results also reveal improved identity retention across diverse poses, establishing CA-IDD as a strong foundation for future diffusion-based face editing.


关键词: Face Swapping, Diffusion Model, Cross-Attention, Identity-Conditional, Gaze Guidance, Facial Parsing, Identity Preservation


192. ❌ Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval

作者: Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24469v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究自监督视觉表征的几何性质对语义图像检索的影响,完全不涉及大模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文研究自监督视觉表征的几何性质(各向异性)对近似最近邻检索性能的影响,发现高各向异性表征会降低分区和哈希索引的性能。
摘要翻译

基于内容的图像检索(CBIR)系统使用户能够根据视觉内容而非元数据进行图像搜索。文本领域已受益于通过无监督方法(如BERT)生成的表征的向量搜索。然而,现代视觉自监督学习方法在CBIR相关文献中鲜有报道,现有研究多依赖监督模型或对齐文本与视觉的多模态方法。

我们评估了现代视觉自监督学习方法所习得的表征,在利用向量数据库和最近邻搜索的典型检索栈中的表现。评估结果表明,潜在空间几何结构会影响近似最近邻(ANN)索引。具体而言,多种现代自监督学习方法产生的高偏态、高度各向异性表征,会降低基于分区和基于哈希的搜索性能,即便其自身的线性探针或K近邻(K-NN)准确率未受影响。相比之下,具有更高各向同性和局部纯度的表征能更好地满足ANN索引基于距离的假设,从而提升语义检索性能。


摘要 (Abstract)

Content-based image retrieval (CBIR) systems enable users to search images based on visual content instead of relying on metadata. The text domain has benefited from vector search of representations created with unsupervised methods such as BERT. However, modern self-supervised learning methods for vision are mostly not reported in CBIR-related literature, instead relying on supervised models or multi-modal methods that align text and vision. We evaluate how the representations learned by modern self-supervised learning methods for vision perform under typical retrieval stacks that leverage vector databases and nearest neighbor search. Our evaluation reveals that the latent space geometry impacts approximate nearest neighbor (ANN) indexing. Specifically, highly anisotropic representations with high skewness produced by several modern SSL methods degrade the performance of partition-based and hashing-based search, even if their own linear probe or K-NN accuracy is not affected. In contrast, representations with higher isotropy and local purity better satisfy the distance-based assumptions of ANN indexes, leading to improved semantic retrieval performance.


关键词: self-supervised learning, vision representations, geometric analysis, semantic image retrieval, approximate nearest neighbor, anisotropy, CBIR


193. ❌ TextGround4M: A Prompt-Aligned Dataset for Layout-Aware Text Rendering

作者: Dongxing Mao, Yilin Wang, Linjie Li, Zhengyuan Yang, Alex Jinpeng Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24459v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注文本到图像生成中的文本渲染和布局对齐,涉及数据集构建和训练策略,但未涉及大模型、深度学习技术原理创新或科学应用。所有关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出了TextGround4M数据集和轻量级训练策略,用于提升文本到图像生成中文本渲染的空间布局准确性。
摘要翻译

尽管文本到图像生成领域近期取得了进展,但现有模型在准确呈现提示词所指定的文本及其正确空间布局方面仍存在困难——尤其是在多片段、结构化场景中。这一挑战不仅源于缺乏能够将提示词与图像中预期文本及布局精确对齐的数据集,也源于缺乏评估布局质量的有效指标。为解决这些问题,我们提出了TextGround4M——一个包含超过400万对提示词-图像的大规模数据集,其中每对数据都标注了基于提示词的片段级文本及其对应的边界框。这为布局感知、基于提示词的文本渲染提供了细粒度的监督。在此基础上,我们提出了一种适用于自回归T2I模型的轻量级训练策略,该策略在训练过程中附加布局感知的片段标记,而不改变模型架构或推理行为。我们进一步构建了一个具有分层布局复杂度的基准测试,用于在零样本设置下评估开源和专有模型。此外,我们引入了两个布局感知指标,以解决文本渲染中长期缺乏空间评估的问题。实验结果表明,在TextGround4M上训练的模型在文本保真度、空间准确性和提示一致性方面均优于强基线模型,凸显了细粒度布局监督对于基于提示词的T2I生成的重要性。


摘要 (Abstract)

Despite recent advances in text-to-image generation, models still struggle to accurately render prompt-specified text with correct spatial layout – especially in multi-span, structured settings. This challenge is driven not only by the lack of datasets that align prompts with the exact text and layout expected in the image, but also by the absence of effective metrics for evaluating layout quality. To address these issues, we introduce TextGround4M, a large-scale dataset of over 4 million prompt-image pairs, each annotated with span-level text grounded in the prompt and corresponding bounding boxes. This enables fine-grained supervision for layout-aware, prompt-grounded text rendering. Building on this, we propose a lightweight training strategy for autoregressive T2I models that appends layout-aware span tokens during training, without altering model architecture or inference behavior. We further construct a benchmark with stratified layout complexity to evaluate both open-source and proprietary models in a zero-shot setting. In addition, we introduce two layout-aware metrics to address the long-standing lack of spatial evaluation in text rendering. Our results show that models trained on TextGround4M outperform strong baselines in text fidelity, spatial accuracy, and prompt consistency, highlighting the importance of fine-grained layout supervision for grounded T2I generation.


关键词: text-to-image generation, layout-aware text rendering, prompt alignment, dataset, bounding boxes, autoregressive models, zero-shot evaluation


194. ❌ Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data

作者: Mohammadmehdi Ataei, Farzaneh Askari, Kamal Rahimi Malekshan, Pradeep Kumar Jayaraman 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24479v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.012.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用LLM作为智能体,在CAD环境中通过代码生成、执行和验证来合成CAD程序,属于LLM Agents和Tool Use的典型应用。LLM被嵌入反馈驱动的CAD环境,生成并执行代码,使用工具和文档查询,因此与LLM Agents和Tool Use高度相关。其他关键词如MoE、SLMs、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

该论文提出Zero-to-CAD框架,利用大语言模型作为智能体在CAD环境中迭代生成、执行和验证代码,合成了约一百万可执行、可读、可编辑的CAD程序,并展示了合成数据在微调视觉语言模型以重建CAD程序方面的有效性。
摘要翻译

计算机辅助设计(CAD)模型由其构建历史定义:一种编码设计意图的参数化方案。然而,现有的大规模三维数据集主要由边界表示(B-Reps)或网格构成,剥离了这一关键的过程信息。为解决这一稀缺性问题,我们提出了Zero-to-CAD,一个用于合成可执行CAD构建序列的可扩展框架。我们将合成问题构建为一个智能体搜索问题:通过在反馈驱动的CAD环境中嵌入大型语言模型(LLM),我们的系统利用工具和文档查询迭代地生成、执行和验证代码,以促进几何有效性和操作多样性。这种智能体方法能够合成约一百万个可执行、可读、可编辑的CAD序列,涵盖了超越草图与拉伸工作流的丰富操作词汇。我们还发布了一个精选子集,包含10万个基于几何多样性筛选的高质量模型。为展示该数据集的实用性,我们在合成数据上微调了一个视觉-语言模型,使其能够从多视角图像重建可编辑的CAD程序,性能优于包括GPT-5.2在内的强基线模型,并有效实现了无需真实构建历史训练数据的序列生成能力引导。Zero-to-CAD弥合了几何规模与参数化可解释性之间的鸿沟,为下一代CAD人工智能提供了关键资源。


摘要 (Abstract)

Computer-Aided Design (CAD) models are defined by their construction history: a parametric recipe that encodes design intent. However, existing large-scale 3D datasets predominantly consist of boundary representations (B-Reps) or meshes, stripping away this critical procedural information. To address this scarcity, we introduce Zero-to-CAD, a scalable framework for synthesizing executable CAD construction sequences. We frame synthesis as an agentic search problem: by embedding a large language model (LLM) within a feedback-driven CAD environment, our system iteratively generates, executes, and validates code using tools and documentation lookup to promote geometric validity and operation diversity. This agentic approach enables the synthesis of approximately one million executable, readable, editable CAD sequences, covering a rich vocabulary of operations beyond sketch-and-extrude workflows. We also release a curated subset of 100,000 high-quality models selected for geometric diversity. To demonstrate the dataset’s utility, we fine-tune a vision-language model on our synthetic data to reconstruct editable CAD programs from multi-view images, outperforming strong baselines, including GPT-5.2, and effectively bootstrapping sequence generation capabilities without real construction-history training data. Zero-to-CAD bridges the gap between geometric scale and parametric interpretability, offering a vital resource for the next generation of CAD AI.


关键词: LLM Agents, Tool Use, CAD, Agentic Workflow, Code Generation, Synthetic Data, Vision-Language Model


195. ❌ DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation

作者: Md Shohel Rana, Andrew H. Sung 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24426v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注AI生成视频的检测(Deepfake检测),使用空间、频谱和时间线索构建动态异常掩码,并设计轻量级分类器DistXCNet。论文内容与给定的关键词(大模型、深度学习技术原理创新、AI for Science等)完全无关,所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一个多域Deepfake检测框架DYMAPIA,通过融合空间、频谱和时间线索构建动态异常掩码,并利用轻量级分类器实现高精度实时检测。
摘要翻译

AI生成媒体正快速发展,引发了对内容真实性与数字信任的迫切关注。我们提出DYMAPIA,一种多领域深度伪造检测框架,融合空间、频谱与时间线索,以捕捉视觉数据中细微的篡改痕迹。该系统通过结合傅里叶频谱、局部纹理描述符、边缘不规则性及光流一致性等证据,构建动态异常掩码,能够以精细的空间精度突出显示被篡改区域。这些掩码引导DistXCNet——一种从Xception蒸馏而来、经深度可分离卷积优化的轻量级分类器——实现快速且聚焦于区域的分类。这一联合设计达到了最先进的性能,在FF++、Celeb-DF和VDFD基准测试中准确率与F1分数均超过99%,同时保持模型紧凑,适用于实时应用。DYMAPIA不仅优于现有的全帧与多领域检测器,还展现出在时间关键型取证任务中的部署就绪性,包括媒体验证、虚假信息防御及安全内容过滤。


摘要 (Abstract)

AI-generated media are advancing rapidly, raising pressing concerns for content authenticity and digital trust. We introduce DYMAPIA, a multi-domain Deepfake detection framework that fuses spatial, spectral, and temporal cues to capture subtle traces of manipulation in visual data. The system builds dynamic anomaly masks by combining evidence from Fourier spectra, local texture descriptors, edge irregularities, and optical flow consistency, which highlight tampered regions with fine spatial accuracy. These masks guide DistXCNet, a lightweight classifier distilled from Xception and optimized with depthwise separable convolutions for fast, region-focused classification. This joint design achieves state-of-the-art results, with accuracy and F1-scores exceeding 99% on FF++, Celeb-DF, and VDFD benchmarks, while keeping the model compact enough for real-time use. Beyond outperforming existing full-frame and multidomain detectors, DYMAPIA demonstrates deployment readiness for time-critical forensic tasks, including media verification, misinformation defense, and secure content filtering.


关键词: Deepfake detection, multi-domain, spatial-spectral-temporal, dynamic anomaly masks, DistXCNet, lightweight classifier, real-time


196. ❌ AutoGUI-v2: A Comprehensive Multi-Modal GUI Functionality Understanding Benchmark

作者: Hongxin Li, Xiping Wang, Jingran Su, Zheng Ju, Yuntao Chen, Qing Li, Zhaoxiang Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24441v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于GUI智能体对界面功能的理解和交互结果预测,核心涉及视觉语言模型(VLMs)和自主智能体(LLM Agents),因此’Large Language Models’和’LLM Agents’高度相关(10分)。其他关键词如MoE、SLMs、Scaling Laws、Pre-training、Post-training、Instruction Tuning、RLHF、PEFT、RAG、Context Window、KV Cache、CoT、System 2、MCTS、Self-Correction、Tool Use、Multi-agent、Quantization、Speculative Decoding、Hallucination、Mechanistic Interpretability、World Models、Model Merging、In-context Learning、AI for Science均与论文内容无关,评0分。


!!! tip deepseek-chat TL;DR

该论文提出了AutoGUI-v2基准,用于评估GUI智能体对界面功能的理解和交互结果预测,发现开源模型在功能定位上表现优异,商业模型在功能描述上占优,但所有模型在复杂交互逻辑上仍有困难。
摘要翻译

能够导航图形用户界面(GUI)的自主智能体具有彻底改变数字生产力的潜力。然而,实现真正的数字自主性不仅依赖于反应式的元素匹配,还需要对界面动态具备预测性的心智模型,并能够预见交互所产生的“数字世界状态”。尽管现代视觉语言模型(VLM)具备感知能力,但现有基准测试仍然存在分化(要么聚焦于黑箱任务完成,要么局限于静态、浅层的接地),从而未能评估智能体是否真正理解GUI的隐含功能与转换逻辑。为弥补这一空白,我们提出了AutoGUI-v2,这是一个旨在评估深度GUI功能理解与交互结果预测的综合基准测试。我们采用一种新颖的VLM-人类协作流水线来构建该基准,该流水线将多平台截图递归解析为层次化的功能区域,以生成多样化的评估任务。AutoGUI-v2涵盖六个操作系统的2,753个任务,严格测试智能体在区域与元素级语义、接地以及动态状态预测方面的能力。我们的评估揭示了VLM中一个显著的分化现象:在智能体数据上微调的开源模型(如Qwen3-VL)在功能接地方面表现出色,而商业模型(如Gemini-2.5-Pro-Thinking)则在功能描述方面占据主导地位。关键在于,所有模型在面对非常见操作的复杂交互逻辑时均表现挣扎,这凸显出深度功能理解仍是一个重大挑战。通过系统性地衡量这些基础能力,AutoGUI-v2为推进下一代GUI智能体提供了新的视角。


摘要 (Abstract)

Autonomous agents capable of navigating Graphical User Interfaces (GUIs) hold the potential to revolutionize digital productivity. However, achieving true digital autonomy extends beyond reactive element matching; it necessitates a predictive mental model of interface dynamics and the ability to foresee the “digital world state” resulting from interactions. Despite the perceptual capabilities of modern Vision-Language Models (VLMs), existing benchmarks remain bifurcated (focusing either on black-box task completion or static, shallow grounding), thereby failing to assess whether agents truly comprehend the implicit functionality and transition logic of GUIs. To bridge this gap, we introduce AutoGUI-v2, a comprehensive benchmark designed to evaluate deep GUI functionality understanding and interaction outcome prediction. We construct the benchmark using a novel VLM-human collaborative pipeline that recursively parses multi-platform screenshots into hierarchical functional regions to generate diverse evaluation tasks. Providing 2,753 tasks across six operating systems, AutoGUI-v2 rigorously tests agents on region and element-level semantics, grounding, and dynamic state prediction. Our evaluation reveals a striking dichotomy in VLMs: while open-source models fine-tuned on agent data (e.g., Qwen3-VL) excel at functional grounding, commercial models (e.g., Gemini-2.5-Pro-Thinking) dominate in functionality captioning. Crucially, all models struggle with complex interaction logic of uncommon actions, highlighting that deep functional understanding remains a significant hurdle. By systematically measuring these foundational capabilities, AutoGUI-v2 offers a new lens for advancing the next generation of GUI agents.


关键词: GUI agents, Vision-Language Models, benchmark, functionality understanding, interaction outcome prediction, multi-platform, state prediction


197. ❌ BMD-45: A Large-Scale CCTV Vehicle Detection Dataset for Urban Traffic in Developing Cities

作者: Akash Sharma, Chinmay Mhatre, Sankalp Gawali, Ruthvik Bokkasam, Brij Sharma, Vishwajeet Pattanaik, Punit Rathore, Raghu Krishnapuram, Vijay Gopal Kovvali, Anirban Chakraborty, Yogesh Simmhan 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24419v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究的是城市交通中的车辆检测数据集,属于计算机视觉领域,与大型语言模型、深度学习技术原理创新无关,也不涉及AI for Science中的生物信息学或化学信息学。所有关键词均不匹配,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了BMD-45,一个大规模CCTV车辆检测数据集,用于解决现有基准在发展中国家城市交通场景中的域差距问题,实验表明域内训练比域外训练性能提升2.5倍。
摘要翻译

从固定闭路电视摄像头进行稳健的车辆检测对于智能交通系统至关重要。然而,现有基准数据集主要包含从自我中心驾驶视角或受控航拍视角捕获的相对同质、高度有序的交通模式。这种区域和传感器视角偏差造成了显著的差距。在UA-DETRAC和COCO等数据集上训练的模型,难以泛化到新兴经济体快速发展的城市中心所观察到的密集、异质、无序的交通状况。为解决这一局限性,我们引入了BMD-45,这是一个大规模数据集,包含从超过3600个运行中的平安城市闭路电视摄像头捕获的45000张图像上标注的48万个边界框。BMD-45包含14个细粒度车辆类别,包括现有基准数据集中不存在的区域特定车型,如自动人力车(auto-rickshaw)和节奏旅行车(tempo traveller)。该数据集捕捉了真实世界的部署挑战,包括极端的视角变化、遮挡和车辆密度。我们使用最先进的检测器建立了全面的基线,并揭示了一个显著的领域差距:在UA-DETRAC上微调的模型仅达到33.6%的mAP@0.50:0.95,而在BMD-45上进行域内训练时则达到83.8%,性能提升了2.5倍,即使在考虑新型车辆类别时这种提升依然存在。这一性能差距凸显了对地理多样化的交通基准数据集的迫切需求,并将BMD-45确立为在全球代表性不足的城市环境中开发稳健感知系统的基线。该数据集可在以下网址获取:https://huggingface.co/datasets/iisc-aim/BMD-45。


摘要 (Abstract)

Robust vehicle detection from fixed CCTV cameras is critical for Intelligent Transportation Systems. Yet existing benchmarks predominantly feature relatively homogeneous, highly organized traffic patterns captured from ego-centric driving perspectives or controlled aerial views. This regional and sensor view bias creates a significant gap. Models trained on datasets such as UA-DETRAC and COCO struggle to generalize to the dense, heterogeneous, disorganized traffic conditions observed in rapidly developing urban centers in emerging economies. To address this limitation, we introduce BMD-45, a large-scale dataset comprising 480K bounding boxes annotated over 45K images captured from over 3.6K operational Safe City CCTV cameras. BMD-45 contains 14 fine-grained vehicle categories, including region-specific modes such as auto-rickshaws and tempo travellers, which are not present in existing benchmarks. The dataset captures real-world deployment challenges, including extreme viewpoint variation, occlusion, and vehicle density . We establish comprehensive baselines using state-of-the-art detectors and reveal a striking domain gap: models fine-tuned on UA-DETRAC achieve only 33.6% mAP@0.50:0.95, compared to 83.8% when trained in-domain on BMD-45, representing a 2.5x improvement that persists even when accounting for novel vehicle classes. This performance gap underscores the critical need for geographically diverse traffic benchmarks and establishes BMD-45 as a baseline for developing robust perception systems in underrepresented urban environments worldwide. The dataset is available at: https://huggingface.co/datasets/iisc-aim/BMD-45.


关键词: vehicle detection, CCTV, dataset, domain gap, urban traffic, developing cities, bounding boxes


198. ❌ AD-Relight: Training-Free Banner Relighting via Illumination Translation with Diffusion Priors

作者: Rameshwar Mishra, A V Subramanyam 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24407v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文AD-Relight主要研究广告横幅的重光照问题,使用扩散模型进行测试时适应,不涉及大模型、深度学习技术原理创新或科学应用。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

AD-Relight提出一种无需训练的多阶段框架,利用扩散先验在测试时适应,以对Photoshop生成的广告横幅进行重光照,实现与原始场景的无缝融合。
摘要翻译

近年来,通过流媒体服务消费内容的激增推动了对个性化内容日益增长的需求。个性化广告在提升用户参与度和广告效果方面发挥着关键作用。广告个性化的一个关键方面涉及用自定义的、由Photoshop生成的横幅替换画面中的现有区域。然而,现有的广告投放流程通常依赖简单的几何变形,忽略了场景的底层光照条件。同样,最先进的基于扩散模型的对象插入和重光照模型也难以准确地对这些新插入的横幅进行重光照,因为它们并未在广告横幅数据上进行训练,而为广告横幅训练此类模型需要数百万张图像。这凸显了对一种有效重光照框架的需求,该框架能够将自定义横幅无缝集成到原始场景中。受此启发,我们提出了AD-Relight,这是一种新颖的多阶段免训练框架,在测试时自适应地调整基于扩散模型的重光照模型,以对新添加的由Photoshop生成的广告横幅进行重光照。通过广泛的评估,我们证明AD-Relight在性能上优于基于简单变形的重光照基线方法和现有广告投放方法。用户研究进一步表明,参与者始终更偏好AD-Relight的输出结果,而非先前方法的结果。


摘要 (Abstract)

The recent surge in content consumption through streaming services has driven a growing demand for personalized content. Personalized advertisements (ads) play a crucial role in enhancing both user engagement and ad effectiveness. A key aspect of ad personalization involves replacing existing regions in a frame with custom, Photoshop-generated banners. However, existing ad-placement pipelines typically rely on simple geometric warping, ignoring the scene’s underlying lighting conditions. Similarly, state-of-the-art diffusion-based object insertion and relighting models struggle to accurately relight these newly inserted banners, as they are not trained on ad-banner data, and training such a model for ad banners would require millions of images. This highlights the need for an effective relighting framework that enables seamless integration of custom banners into the original scene. Motivated by this, we present AD-Relight, a novel multi-stage training-free framework that adapts a diffusion-based relighting model at test time to relight newly added Photoshop-generated ad banners. Through extensive evaluation, we demonstrate that AD-Relight outperforms both relighting baselines and existing ad-placement methods based on simple warping. User studies further show that participants consistently prefer the outputs of AD-Relight over those of prior approaches.


关键词: banner relighting, diffusion models, test-time adaptation, ad placement, illumination translation, training-free


199. ❌ Phase-Separated Complex Hilbert PCA on Markerless 3D Pose Estimation Data: A Global Phase Network and Its Extension to a Continuous Field on the Body Surface

作者: Hiromitsu Goto, Tao Tao, Zheng-Lin Chia 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24415v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究基于无标记3D姿态估计数据的运动协调分析,使用Complex Hilbert PCA方法提取全局相位模式,完全不涉及大模型、深度学习或AI for Science等关键词。论文主题属于运动生物力学和信号处理领域,与给定的所有关键词均无关联。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于Complex Hilbert PCA的全局相位网络方法,用于从无标记3D姿态数据中分析运动协调,并在锤击实验中验证了其有效性。
摘要翻译

对运动动作中运动链的定量分析对于运动表现评估和损伤预防至关重要。传统方法如运动链序列(KS)和连续相对相位(CRP)局限于相邻关节对,缺乏用于全身协调的统一框架,而节段功率流分析则需要测力台和惯性参数,将其限制在实验室环境中。我们将复希尔伯特主成分分析(CHPCA)分别应用于每个运动阶段(后摆阶段和下摆阶段)的无标记三维姿态估计数据,提取出作为单一复特征向量的主导全身相位模式。该流程进一步包括全自动基于信号的相位分割(无需击球次数或休息位置的先验信息),并扩展至1,079个体表网格顶点,从而将运动链表示为跨身体的连续相位场。在单个受试者的14次锤击试验中,该框架揭示了:(i)以躯干为核心的全局相位架构;(ii)通过模式1贡献率(45.5% vs. 70.5%)和试验间斯皮尔曼一致性(0.38 vs. 0.58)量化的准备阶段与执行阶段之间的功能不对称性;(iii)骨骼关节与网格顶点之间一致的重组模式(1,079个顶点上$p < 10^{-10}$)。作为方法一致性检验,通过置换检验将模式1特征向量中的成对相位差与所有190个关节对的CRP进行比较($ρ= 0.473$,$p = 0.0005$)。模式1振幅与动能动员方差之间的对应分析进一步显示,在下摆阶段存在强正相关(骨骼和网格上$ρ\approx 0.71$),而在后摆阶段无相关性,表明所提出的框架通过相位结构桥接了协调性的运动学与动力学描述。


摘要 (Abstract)

Quantitative analysis of the kinematic chain in sports motion is essential for performance evaluation and injury prevention. Conventional methods such as the kinematic-sequence (KS) and continuous relative phase (CRP) are confined to adjacent joint pairs and lack a unified framework for whole-body coordination, while segmental power-flow analysis requires force plates and inertial parameters that restrict it to laboratory environments. We apply Complex Hilbert Principal Component Analysis (CHPCA) separately to each motion phase (backswing and downswing) on markerless 3D pose estimation data, extracting the dominant whole-body phase pattern as a single complex eigenvector. The pipeline further includes a fully automatic signal-based phase segmentation (no priors on strike count or rest location) and an extension to 1,079 body-surface mesh vertices, so that the kinematic chain is represented as a continuous phase field across the body. On 14 hammer-striking trials of a single subject, the framework reveals (i) a trunk-anchored global phase architecture, (ii) a functional asymmetry between preparation and execution phases quantified by Mode-1 contribution (45.5% vs. 70.5%) and inter-trial Spearman consistency (0.38 vs. 0.58), and (iii) a consistent reorganisation across both skeletal joints and mesh vertices ($p < 10^{-10}$ on 1,079 vertices). As a methodological consistency check, pairwise phase differences from the Mode-1 eigenvector are compared against CRP on all 190 joint pairs by a permutation test ($ρ= 0.473$, $p = 0.0005$). A correspondence analysis between Mode-1 amplitude and kinetic-energy mobilisation variance further shows a strong positive correlation in the downswing ($ρ\approx 0.71$ on both skeleton and mesh) and no correlation in the backswing, indicating that the proposed framework bridges kinematic and kinetic descriptions of coordination through phase structure.


关键词: Complex Hilbert PCA, markerless 3D pose estimation, kinematic chain, global phase network, continuous phase field, hammer-striking, coordination analysis


200. ❌ Complexity of Linear Regions in Self-supervised Deep ReLU Networks

作者: Mufhumudzi Muthivhi, Terence L. van Zyl 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24393v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.05.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究自监督深度ReLU网络的线性区域复杂度,与可解释性(Mechanistic Interpretability)有一定关联,因为线性区域分析有助于理解网络内部表示。其他关键词如大模型、MoE、SLM等均不相关。


!!! tip deepseek-chat TL;DR

该论文研究了自监督深度ReLU网络中线性区域的复杂度,发现自监督方法比监督方法产生更少的线性区域,且线性区域指标可作为表示质量的可靠指标。
摘要翻译

近年来,基于修正线性单元(Rectified Linear Unit, ReLU)的激活网络复杂度研究日益受到关注。近期工作探究了训练过程中形成的分段线性划分(线性区域)数量的演变规律。然而,现有研究仅局限于分析监督训练模型的复杂度。自监督学习(Self-Supervised Learning, SSL)的不同之处在于,它直接通过损失函数优化表征空间,以提升模型在多个下游任务中的性能。本研究探究了SSL模型产生的线性区域的局部分布特征。我们利用SplineCam提取数据分布附近的二维多胞体,证明了线性区域的演变与表征质量存在相关性。我们追踪了训练过程中区域的数量、面积、偏心率和边界变化。本研究在MNIST和FashionMNIST两个标准基准数据集上,对比了监督学习、对比学习与自蒸馏方法。实验结果表明:自监督方法在达到与监督模型相当精度时,生成的区域数量显著更少;对比学习方法的区域数量随时间快速扩张,而自蒸馏方法则倾向于通过合并相邻区域实现整合。最后,我们能在线性区域的几何空间中早期检测到表征坍塌现象。分析表明,多胞体度量可作为表征质量与模型性能的可靠指标。


摘要 (Abstract)

There has been growing interest in studying the complexity of Rectified Linear Unit (ReLU) based activation networks. Recent work investigates the evolution of the number of piecewise-linear partitions (linear regions) that are formed during training. However, current research is limited to examining the complexity of models trained in a supervised way. Self-Supervised Learning (SSL) differs in that it directly optimises the representation space using a loss function to enhance the model’s performance across multiple downstream tasks. This study investigates the local distribution of linear regions produced by SSL models. We demonstrate that the evolution of linear regions correlates with the representation quality by utilising SplineCam to extract two-dimensional polytopes near the data distribution. We track the number, area, eccentricity, and boundaries of regions throughout training. The study compares supervised, contrastive, and self-distillation methods over two standard benchmark datasets, MNIST and FashionMNIST. The analysis of the experimental results shows that self-supervised methods create substantially fewer regions to achieve comparable accuracy to supervised models. Contrastive methods rapidly expand regions over time, whereas self-distillation methods tend to consolidate by merging neighbouring regions. Lastly, we can detect representation collapse early within the geometric space of linear regions. Our analysis suggests that polytopal metrics can serve as reliable indicators of representation quality and model performance.


关键词: linear regions, self-supervised learning, ReLU networks, representation quality, polytopal metrics, contrastive learning, self-distillation


201. ❌ Multispectral airborne laser scanning dataset for tree species classification: MS-ALS-SPECIES

作者: Matti Hyyppä, Klaara Salolahti, Eric Hyyppä, Xiaowei Yu, Josef Taher, Leena Matikainen, Matti Lehtomäki, Paula Litkey, Teemu Hakala, Harri Kaartinen, Juha Hyyppä, Antero Kukko 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24370v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文主要关注多光谱机载激光扫描数据集用于树种分类,属于遥感与森林生态领域,涉及机器学习与深度学习方法,但与大型语言模型、基础模型、MoE、SLM、缩放定律、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我纠正、LLM代理、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等关键词完全无关。唯一相关的是’AI for Science’,因为论文使用了机器学习和深度学习进行树种分类,属于AI在科学中的应用,但并非核心创新点,故评分为10。


!!! tip deepseek-chat TL;DR

该论文提供了一个公开的多光谱机载激光扫描数据集(MS-ALS-SPECIES),用于树种分类,并展示了点云变换模型在小树和少数物种分类中的优势。
摘要翻译

从林分尺度向单木尺度森林评估的转变,有助于提升生物多样性制图精度,尤其在北方森林生态系统中,如山杨(Populus tremula L.)等树种发挥着关键作用。尽管机载激光扫描(ALS)是此类调查的标准技术,但一个主要限制在于公开可用的、包含高质量实地验证参考数据的ALS数据集数量较少。此外,尽管多光谱ALS数据在树种分类方面具有潜力,但目前完全缺乏带有高质量实地参考数据的开放多光谱ALS数据集。本文详细介绍了一个开放的多光谱ALS数据集,该数据集被用于Taher等人(2026)近期开展的一项关于树种分类的机器学习与深度学习方法国际基准研究。该数据集包含芬兰南部九个树种的6326个单木段级点云。点云数据通过两套多光谱激光扫描系统获取,每套系统均使用三个激光波长:一套直升机载系统(HeliALS),点密度超过1000点/平方米;另一套为Optech Titan系统,点密度约为35点/平方米。我们详细描述了研究中开发的实地数据采集技术,以便高效且可扩展地收集高质量地面真值数据。此外,本文在Taher等人(2026)初步发现的基础上,利用多光谱数据开展了新的树种分类分析。同时,我们研究了分类精度与树高之间的关系,以突显该开放数据集的通用性,并展示点变换器模型在小型树木及稀有树种分类中的优势。


摘要 (Abstract)

The shift from stand-level to individual-tree-level forest assessments supports improved biodiversity mapping, particularly in boreal ecosystems where tree species like aspen (Populus tremula L.) play a keystone role. While airborne laser scanning (ALS) is the standard for such inventories, a major limitation is the small number of publicly available ALS datasets containing high-quality, field-validated reference data. Furthermore, open multispectral ALS datasets with high-quality field reference data are completely lacking despite the potential of multispectral ALS data for tree species classification. This paper presents and details an open multispectral ALS dataset used in a recent international benchmarking study of machine learning and deep learning methods for tree species classification by Taher et al. (2026). The dataset comprises 6326 segment-level point clouds of individual trees representing nine species in Southern Finland. The point cloud data has been acquired using two multispectral laser scanning systems each operating at three laser wavelengths: a helicopter-borne system (HeliALS) with a point density exceeding 1000 points/m$^2$ and an Optech Titan system with approximately 35 points/m$^2$. We provide a detailed description of field data collection techniques developed in the study to facilitate the collection of high-quality ground truth data in an efficient and scalable manner. Additionally, our article presents new analyses on species classification using multispectral data building upon the initial findings of Taher et al. (2026). Furthermore, we study the relation between classification accuracy and tree height to highlight the versatility of the open dataset and to demonstrate the advantage of the point transformer model for small trees and minority species.


关键词: multispectral ALS, tree species classification, point cloud, deep learning, point transformer, forest inventory, open dataset


202. ❌ Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions

作者: Yangping Li, Thomas Pinetz, Michael Hölzel, Marieta Toma, Alexander Effland 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24347v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文研究的是病理学图像语义分割,使用基于全局比例的弱监督方法,涉及AI在科学(病理学)中的应用,因此与’AI for Science’相关(8分)。其他关键词如大模型、MoE、SLM等均不相关,得0分。


!!! tip deepseek-chat TL;DR

该论文提出VSLP框架,利用全局标签比例推断病理图像像素级分割,无需像素级标注,通过变分优化结合预训练transformer和正则化,在多个数据集上优于现有弱监督方法。
摘要翻译

在病理学中,组织类型的空间分布及其比例是疾病进展的关键指标,且相较于精细标注更易获取。然而,这些评估结果很少被映射至像素级分割。该任务本质上具有欠定性,因为在缺乏像素级约束的情况下,许多空间上不同的分割结果均能满足相同的全局比例。为解决这一问题,我们提出了基于标签比例变分分割(Variational Segmentation from Label Proportions, VSLP)方法,这是一个两阶段框架,能够在无任何像素级标注的情况下,从全局标签比例推断出密集分割。该框架首先利用预训练的Transformer模型结合测试时增强(test-time augmentation)生成像素级置信度估计;在第二阶段,通过求解一个包含Wasserstein数据保真项与学习正则化项的变分优化问题,对这些估计进行融合。与端到端网络不同,我们的变分方法能够可视化保真-正则化能量,从而得到更具可解释性的分割结果。我们在两个公开数据集上验证了该方法,其性能优于现有的弱监督与无监督方法。针对其中一个数据集,比例由经验丰富的病理学家估算,为学界提供了真实的基准。此外,该方法可扩展至包含噪声病理学家标注的内部数据集,显著优于当前最优方法,从而展示了其实用价值。代码与数据将在论文被接收后于https://github.com/xiaoliangpi/VSLP公开。


摘要 (Abstract)

In pathology, the spatial distribution and proportions of tissue types are key indicators of disease progression, and are more readily available than fine-grained annotations. However, these assessments are rarely mapped to pixel-wise segmentation. The task is fundamentally underdetermined, as many spatially distinct segmentations can satisfy the same global proportions in the absence of pixel-wise constraints. To address this, we introduce Variational Segmentation from Label Proportions (VSLP), a two-stage framework that infers dense segmentations from global label proportions, without any pixel-level annotations. This framework first leverages a pre-trained transformer model with test-time augmentation to produce a pixel-wise confidence estimate. In the second stage, these estimates are fused by solving a variational optimization problem that incorporates a Wasserstein data fidelity term alongside a learned regularizer. Unlike end-to-end networks, our variational method can visualize the fidelity-regularization energy, resulting in more interpretable segmentation. We validate our approach on two public datasets, achieving superior performance over existing weakly supervised and unsupervised methods. For one of these datasets, proportions have been estimated by an experienced pathologist to provide a realistic benchmark to the community. Furthermore, the method scales to an in-house dataset with noisy pathologist labels, severely outperforming state-of-the-art methods, thereby demonstrating practical applicability. The code and data will be made publicly available upon acceptance at https://github.com/xiaoliangpi/VSLP.


关键词: Semantic Segmentation, Histopathology, Weakly Supervised Learning, Label Proportions, Variational Optimization, Transformer, Regularization


203. ❌ An Affordable,Wearable Stereo-Eye-Tracking Platform

作者: Alexander Zimmer, Yasmeen Abdrabou, Enkelejda Kasneci 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24331v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主题为可穿戴立体眼动追踪平台,涉及硬件设计、校准和开源工具,与所有关键词(大模型、深度学习、AI for Science等)完全无关。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于现成组件和3D打印部件的低成本可穿戴立体眼动追踪平台,支持多种眼动追踪范式,并开源硬件设计以促进研究。
摘要翻译

基于视频的眼动追踪研究长期探索立体和基于角膜反射(glint)的方法,然而现有的可穿戴眼动追踪设备——无论是商业产品还是开源方案——在算法开发和比较评估方面提供的灵活性十分有限。我们提出了一种经济实惠的可穿戴立体眼动追踪平台,该平台采用现成组件和3D打印部件构建,明确针对上述不足而设计。该系统集成了四个红外眼动相机、红外照明模块、一个可选的场景相机,以及用于校准和同步数据采集的软件支持。通过设计,该平台在单一硬件配置下支持多种眼动追踪范式,包括立体、基于角膜反射和双眼追踪方法。该平台并未以优化终端用户鲁棒性为目标,而是优先考虑面向研究用途的模块化和可扩展性。本文重点介绍了硬件架构和校准流程,并通过原型实现验证了该方法的可行性。所有硬件设计及文档均已开源提供。


摘要 (Abstract)

Research on video-based eye-tracking has long explored stereo and glint-based methods, yet existing wearable eye trackers - both commercial and open-source - offer limited flexibility for algorithm development and comparative evaluation. We present an affordable, wearable stereo eye-tracking platform built from off-the-shelf and 3D-printable components that explicitly targets this gap. The system combines four infrared eye cameras, infrared illumination, an optional scene camera, and software support for calibration and synchronized data acquisition. By design, the platform supports multiple eye-tracking paradigms, including stereo, glint-based, and binocular approaches, within a single hardware configuration. Rather than optimizing for end-user robustness, the platform prioritizes modularity and extensibility for research use. This paper focuses on the hardware architecture and calibration pipeline and demonstrates the feasibility of the approach using a prototype implementation. All hardware designs and documentation are made openly available.


关键词: wearable eye-tracking, stereo eye-tracking, open-source hardware, calibration pipeline, 3D-printable, infrared cameras


204. ❌ BIMStruct3D: A Fully Automated Hybrid Learning Scan-to-BIM Pipeline with Integrated Topology Refinement

作者: Mahdi Chamseddine, Fabian Kaufmann, Marius Schellen, Christian Glock, Didier Stricker, Jason Rambach 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24311v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文专注于建筑信息模型(BIM)的自动生成,使用混合学习方法结合语义分割和几何重建,不涉及任何大模型、深度学习技术原理创新或AI for Science相关关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种全自动混合学习流水线BIMStruct3D,用于从3D点云生成IFC兼容的建筑信息模型,并通过新数据集DeKH和vIoU评估指标展示了优于RANSAC基线的性能。
摘要翻译

从建筑扫描数据自动生成建筑信息模型(BIM)是建筑与施工领域的一项关键挑战。我们提出了一种模块化流水线,用于从三维点云生成符合IFC标准的BIM。该混合方法将基于学习的语义分割与拓扑感知的几何重建相结合,以精确建模结构构件。我们提出了vIoU,通过实现重建模型与真实模型的整体性、免实例匹配比较,将基于体素的重叠评估方法适配至扫描到BIM(Scan-to-BIM)流程。我们发布了德国医院数据集(DeKH),包含高分辨率点云、真实BIM模型及语义标注。在DeKH与CV4AEC数据集上的实验表明,该方法相较于基于RANSAC的基线方法有显著提升,展现了其鲁棒性与可扩展性。


摘要 (Abstract)

Automatic generation of Building Information Models (BIM) from building scans is a key challenge in architecture and construction. We present a modular pipeline for generating IFC-compliant BIM from 3D point clouds. The hybrid approach combines learning-based semantic segmentation with topology-aware geometric reconstruction to model structural elements accurately. We propose vIoU, adapting voxel-based overlap evaluation to Scan-to-BIM by enabling holistic, instance-matching-free comparison of reconstructed and ground-truth models. We release the German Hospital dataset (DeKH), including high-resolution point clouds, ground truth BIMs, and semantic annotations. Experiments on DeKH and CV4AEC datasets show significant improvements over a RANSAC-based baseline, demonstrating robustness and scalability.


关键词: BIM, Scan-to-BIM, point cloud, semantic segmentation, geometric reconstruction, vIoU, German Hospital dataset


205. ❌ Monocular Depth Estimation via Neural Network with Learnable Algebraic Group and Ring Structures

作者: Qianlei Wang, Kexun Chen, Shaolin Zhang, Hongli Gao, Chaoning Zhang, Xiaolin Qin 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24328v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究单目深度估计,提出LAGRNet框架,利用可学习的代数群、环和层结构改进深度估计。论文内容完全聚焦于计算机视觉和几何深度学习,未涉及任何大语言模型、生成式AI或相关技术关键词。所有关键词均为大模型、NLP或AI for Science领域,与本文主题无关,因此所有评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出LAGRNet,通过嵌入可学习的代数群、环和层结构,将单目深度估计问题建立在代数几何基础上,在多个基准上显著提升了准确性和泛化能力。
摘要翻译

单目深度估计(Monocular Depth Estimation, MDE)在卷积神经网络和基于Transformer架构的推动下取得了显著进展。然而,这些方法通常将问题视为欧几里得网格上的通用图像到图像回归,从而忽略了透视投影所蕴含的内在代数与几何结构。为解决这一局限,我们提出LAGRNet,一个新颖的框架,通过将可学习的群、环和层结构显式嵌入深度学习流程,从根本上将MDE奠基于代数几何。该方法将特征图建模为近似图像流形上的层截面,首先构建由学习到的代数群作用参数化的群定义特征流形(Group-defined Feature Manifold, GFM),以强制执行射影等变性和对视角变化的鲁棒性。为促进代数一致的跨尺度交互,我们随后引入环卷积层(Ring Convolution Layer, RCL),将特征融合形式化为分次环同态。此外,为确保全局拓扑一致性,基于层的模块(Sheaf-based Module, SM)通过图像拓扑上的Čech神经聚合局部深度线索。在KITTI、NYU-Depth V2和ETH3D基准上的广泛零样本评估表明,LAGRNet在精度和泛化能力上均显著优于现有最先进方法。


摘要 (Abstract)

Monocular depth estimation (MDE) has witnessed remarkable progress driven by Convolutional Neural Networks and transformer-based architectures. However, these approaches typically treat the problem as a generic image-to-image regression on Euclidean grids, thereby overlooking the intrinsic algebraic and geometric structures induced by perspective projection. To address this limitation, we propose LAGRNet, a novel framework that fundamentally grounds MDE in algebraic geometry by explicitly embedding learnable group, ring, and sheaf structures into the deep learning pipeline. Modeling feature maps as sections of a sheaf over an approximated image manifold, our method first establishes a Group-defined Feature Manifold (GFM) parameterized by a learned algebraic group action to enforce projective equivariance and robustness against view changes. To facilitate algebraically consistent cross-scale interactions, we subsequently introduce a Ring Convolution Layer (RCL) that formulates feature fusion as a graded ring homomorphism. Furthermore, to ensure global topological consistency, a Sheaf-based Module (SM) aggregates local depth cues via Čech nerve on the image topology. Extensive zero-shot evaluations across the KITTI, NYU-Depth V2, and ETH3D benchmarks demonstrate that LAGRNet significantly outperforms state-of-the-art methods in both accuracy and generalization capabilities.


关键词: Monocular Depth Estimation, Algebraic Group, Ring Convolution, Sheaf Structure, Projective Equivariance, Feature Manifold, Zero-shot Evaluation


206. ❌ Don’t Pause! Every prediction matters in a streaming video

作者: Dibyadip Chatterjee, Zhanzhong Pang, Fadime Sener, Yale Song, Angela Yao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24317v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是流媒体视频中的在线问答(VideoQA)基准测试和模型改进,提出了SPOT-Bench和AsynKV方法。内容涉及视频理解、流式处理、时序预测等,但完全不涉及大模型、深度学习技术原理创新或AI在科学领域的应用。所有关键词均与论文主题无关,因此每个关键词评分为0。


!!! tip deepseek-chat TL;DR

论文提出了SPOT-Bench基准测试和AsynKV方法,用于评估和改进流媒体视频模型的在线预测能力,发现离线模型在流式场景中会过度预测,而AsynKV通过长短期记忆和死时间计算优化实现了更好的流式行为。
摘要翻译

流式视频模型应在事件展开的瞬间做出响应,而非在事件发生之后。然而,现有的在线视频问答基准大多仍具有回顾性:它们在固定时间戳处暂停视频,针对当前或过去事件提出问题,并仅在这些时刻对模型进行评分。这种评估方式使得流式预测能力未经检验。为填补这一空白,我们提出SPOT-Bench,其特色在于多轮主动式查询,用于评估始终在线的实时助手所需具备的通用流式感知与辅助能力。SPOT-Bench配备了Timeliness-F1这一综合指标,通过时间精度与对整个视频的均衡覆盖来度量流式预测。我们的基准测试揭示:(i) 离线模型能可靠检测事件,但会在无提示时产生大量虚假预测;(ii) 针对静默状态进行后训练可减少虚假预测,但会导致响应迟钝;(iii) 半数流式视频无需任何响应,我们将其称为死区时间——在此处消耗的计算资源不会影响响应延迟。这些发现催生了AsynKV,一种无需训练的离线模型流式适配方法,它在保留事件感知能力的同时改善了流式行为。AsynKV采用长短时记忆机制,通过在死区时间内高效扩展计算资源来提升性能。它作为SPOT-Bench上的强基线,不仅优于现有流式模型,还在回顾性基准上达到了最先进水平。


摘要 (Abstract)

Streaming video models should respond the moment an event unfolds, not after the moment has passed. Yet existing online VideoQA benchmarks remain largely retrospective. They pause the video at fixed timestamps, pose questions about current or past events, and score models only at those moments. This protocol leaves streaming predictions untested. To close this gap, we introduce SPOT-Bench, featuring multi-turn proactive queries that evaluate general streaming perception and assistive capabilities required by an always-on, real-time assistant. SPOT-Bench comes with Timeliness-F1, a consolidated metric that measures streaming predictions by their temporal precision and balanced coverage across the entire video. Our benchmark reveals: (i) offline models detect events reliably but spam predictions unprompted; (ii) post-training for silence reduces spamming but induces unresponsiveness; (iii) half of the streaming video expects no response, which we term dead-time - compute spent here does not affect response latency. These findings motivate AsynKV, a training-free streaming adaptation of offline models, that retains their event perception while improving their streaming behavior. AsynKV features a long-short term memory, utilized efficiently by scaling compute during dead-time. It serves as a strong baseline on SPOT-Bench, outperforming existing streaming models, and achieves state-of-the-art on retrospective benchmarks.


关键词: streaming video, online VideoQA, SPOT-Bench, Timeliness-F1, AsynKV, dead-time, long-short term memory


207. ❌ Instance Awareness of Multi-class Semantic Segmentation Loss Functions

作者: Soumya Snigdha Kundu, Florian Kofler, Marina Ivory, Hendrik Moller, Jonathan Shapey, Tom Vercauteren 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24276v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文专注于多类语义分割的损失函数,涉及实例感知和类别不平衡问题,属于计算机视觉和医学图像分析领域。所有关键词均与大模型、深度学习技术原理或AI for Science无关,因此所有关键词得分为0。


!!! tip deepseek-chat TL;DR

该论文提出将实例敏感的损失函数扩展到多类分割,并通过一类对余类分解和逐分量逆尺寸加权来同时处理实例和类别不平衡,在BraTS-METS 2025数据集上提升了罕见类别的Dice系数和全景质量。
摘要翻译

针对语义分割任务中实例不平衡问题而设计的实例敏感损失函数(如blob loss和CC loss),能够确保小病灶与大病灶产生相同的梯度,但仅适用于单类别分割。在多类别场景中,类别不平衡构成了额外挑战:包含少量实例的稀有类别所获得的训练信号占比极低。本研究表明,通过一对多类别分解将实例敏感损失扩展至多类别分割时,这些损失函数可同时解决类别不平衡问题——由于各类别被均匀平均,每个类别无论出现频率高低均能贡献相同权重的梯度。进一步研究发现,全局应用逆尺寸加权会因稀有类别与常见类别间的权重失衡导致训练不稳定,但当该加权策略被整合至每个组件的损失函数内部时,其有效性得以显现,因为重新加权被限制在各组件的空间上下文范围内。在BraTS-METS 2025数据集(260个测试案例)上,多类别CC损失在保持DSC阈值0.5下的全景质量(Panoptic Quality)的同时,提升了前景Dice系数(0.64±0.26对比基线0.59±0.27)及稀有类别Dice系数。多类别blob损失在阈值0.5下取得了最佳全景质量(0.40±0.24对比基线0.38±0.25)与识别质量(Recognition Quality,0.53±0.29对比基线0.49±0.30)。将逆尺寸加权整合至各组件损失函数后,稀有类别Dice系数提升至0.44±0.36,但检测质量有所下降。


摘要 (Abstract)

Instance-sensitive losses for semantic segmentation such as blob loss and CC loss were designed to address instance imbalance, ensuring small lesions generate the same gradient as large ones, but operate only on single-class segmentation. In multi-class settings, class imbalance poses an additional problem: rare classes with few instances receive a disproportionately small share of the training signal. We show that extending instance-sensitive losses to multi-class segmentation via a one-vs-rest class decomposition repurposes them to also address class imbalance, as uniform averaging over classes ensures each class contributes equally regardless of frequency. We further show that inverse-size weighting, which destabilizes training when applied globally due to weight imbalances across rare and common classes, becomes effective when integrated within the per-component loss, confining the reweighting to each component’s spatial context. On the BraTS-METS 2025 dataset (260 test cases), multi-class CC loss improves foreground Dice (0.64 +/- 0.26 vs. 0.59 +/- 0.27 baseline) and rare-class Dice, while maintaining Panoptic Quality at DSC threshold 0.5. Multi-class blob loss achieves the best Panoptic Quality at threshold 0.5 (0.40 +/- 0.24 vs. 0.38 +/- 0.25 baseline) and recognition quality (0.53 +/- 0.29 vs. 0.49 +/- 0.30). Integrating inverse-size weighting within the per-component loss increases rare-class Dice to 0.44 +/- 0.36 at the cost of reduced detection quality.


关键词: multi-class semantic segmentation, instance-sensitive loss, class imbalance, blob loss, CC loss, inverse-size weighting, BraTS-METS 2025


208. ❌ Touchless Intraoperative Image Access System Based on Vision-Based Hand Tracking

作者: Yin Lin, Domenico Aquino, Alberto Redaelli, Massimiliano Del Bene, Riccardo Barbieri, Simona Ferrante 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24235v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是基于视觉手部追踪的无接触术中图像访问系统,使用MediaPipe Hands进行手部追踪,实现医学图像的平移、旋转和缩放。论文内容完全不涉及大模型、深度学习技术原理创新或AI在科学领域的应用,与所有关键词均无关联。


!!! tip deepseek-chat TL;DR

论文开发了一种基于单目RGB摄像头的无接触手部追踪系统,用于术中医学图像导航,实现了低延迟、稳定的实时交互。
摘要翻译

在手术领域,无菌操作与工作流程的连续性至关重要,因此与医学图像的非接触式交互正变得日益重要。本研究提出了一种基于视觉的系统,通过单个RGB摄像头采集的手势实现术中医学图像导航。与现有诸多解决方案不同,该系统无需额外硬件或针对特定用户的训练。手部追踪利用MediaPipe Hands实时完成,可提供手部关键点的2.5D估计。随后,简单直观的手势被映射为平移、旋转和缩放指令,从而实现与图像查看器的连续、自然交互。该系统架构独立于可视化软件,为简化实现,本研究将其与PyVista集成。通过帧级日志记录以及对延迟、稳定性和交互鲁棒性指标的定量分析,对系统性能进行了评估。实验结果表明,该系统具备实时性能,延迟低且控制稳定,符合流畅交互的要求。该系统证明了低成本非接触式解决方案在术中访问医学图像方面的可行性,为未来的临床评估奠定了基础。


摘要 (Abstract)

Touchless interaction with medical images is becoming increasingly important in the surgical field, where sterility and continuity of the operational workflow are essential requirements. This work presents a vision-based system for intraoperative navigation of medical images through hand gestures acquired using a single RGB camera. Unlike many existing solutions, the system does not require additional hardware or user-specific training. Hand tracking is performed in real time using MediaPipe Hands, which provides a 2.5D estimation of hand landmarks. Simple and intuitive gestures are then mapped into translation, rotation, and zoom commands, enabling continuous and natural interaction with the image viewer. The system architecture is independent from the visualization software and, for implementation simplicity, in this study it was integrated with PyVista. Performance was evaluated through frame-level logging and quantitative analysis of latency, stability, and interaction robustness metrics. Experimental results highlight real-time behavior, with reduced latencies and stable control, in line with the requirements of fluid interaction. The system demonstrates the feasibility of a low-cost touchless solution for intraoperative access to medical images, laying the groundwork for future clinical evaluations.


关键词: Touchless interaction, Hand tracking, Medical image navigation, MediaPipe Hands, Intraoperative system, Gesture recognition, RGB camera


209. ❌ ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning

作者: Yiming Zhang, Jiacheng Chen, Jiaqi Tan, Yongsen Mao, Wenhu Chen, Angel X. Chang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24300v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文主要关注视觉语言模型(VLM)的3D空间智能评估,提出了ReVSI基准来改进评估的有效性。论文涉及VLM的评估方法,但未涉及大模型或深度学习的技术原理创新,也未提及任何给定的关键词(如LLM、MoE、RLHF等)。论文主题与AI for Science等应用领域无关。因此,所有关键词评分为0。


!!! tip deepseek-chat TL;DR

论文提出ReVSI基准,通过重新标注和生成QA对,解决了现有VLM 3D空间智能评估中因标注错误和帧采样限制导致的无效性问题,揭示了先前基准掩盖的系统性失败模式。
摘要翻译

当前对空间智能的评估在现代视觉语言模型(VLM)设定下可能存在系统性失效。首先,许多基准测试从最初为传统三维感知任务构建的、基于点云的三维标注中衍生出问答对(QA pairs)。当这些标注被当作视频评估的基准真值时,重建与标注过程中产生的伪影可能导致视频中清晰可见的物体被遗漏、物体身份被错误标记,或破坏依赖几何信息的答案(如尺寸),从而产生错误或模糊的问答对。其次,评估通常假设模型可访问完整场景,而许多VLM实际处理的是稀疏采样帧(如16-64帧),这使得大量问题在模型实际输入条件下实际上无法回答。我们通过引入ReVSI(一种基准测试与评估协议)来提升评估有效性,确保每个问答对在模型实际输入下均可回答且答案正确。为此,我们对来自5个数据集的381个场景中的物体与几何信息进行重新标注以提升数据质量,并通过严格的偏差缓解措施与专业三维标注工具的人工验证,重新生成所有问答对。我们进一步通过提供多种帧预算(16/32/64/全部)变体及细粒度的物体可见性元数据来增强评估可控性,从而实现受控的诊断性分析。在ReVSI上对通用与领域特定VLM的评估揭示了先前基准测试所掩盖的系统性失效模式,从而为空间智能提供了更可靠且更具诊断性的评估。


摘要 (Abstract)

Current evaluations of spatial intelligence can be systematically invalid under modern vision-language model (VLM) settings. First, many benchmarks derive question-answer (QA) pairs from point-cloud-based 3D annotations originally curated for traditional 3D perception. When such annotations are treated as ground truth for video-based evaluation, reconstruction and annotation artifacts can miss objects that are clearly visible in the video, mislabel object identities, or corrupt geometry-dependent answers (e.g., size), yielding incorrect or ambiguous QA pairs. Second, evaluations often assume full-scene access, while many VLMs operate on sparsely sampled frames (e.g., 16-64), making many questions effectively unanswerable under the actual model inputs. We improve evaluation validity by introducing ReVSI, a benchmark and protocol that ensures each QA pair is answerable and correct under the model’s actual inputs. To this end, we re-annotate objects and geometry across 381 scenes from 5 datasets to improve data quality, and regenerate all QA pairs with rigorous bias mitigation and human verification using professional 3D annotation tools. We further enhance evaluation controllability by providing variants across multiple frame budgets (16/32/64/all) and fine-grained object visibility metadata, enabling controlled diagnostic analyses. Evaluations of general and domain-specific VLMs on ReVSI reveal systematic failure modes that are obscured by prior benchmarks, yielding a more reliable and diagnostic assessment of spatial intelligence.


关键词: Vision-Language Model, Spatial Intelligence, 3D Reasoning, Benchmark, Evaluation Validity, Object Visibility, Frame Budget


210. ❌ Radiomics- and Clinical Feature-Driven Prediction of Volumetric Response in Skull-Base Meningioma after CyberKnife Radiosurgery

作者: Yin Lin, Elena De Martin, Giacomo Conte, Domenico Aquino, Cristiana Pedone, Alberto Redaelli, Riccardo Barbieri, Laura Fariselli, Simona Ferrante 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24230v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 该论文聚焦于放射组学和临床特征驱动的框架,用于预测颅底脑膜瘤在射波刀放射外科治疗后的体积反应,属于AI在医学影像和放射治疗中的应用,与’AI for Science’高度相关。论文未涉及大语言模型、深度学习技术原理创新或大模型在其他领域的应用,因此其他关键词得分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于放射组学和临床特征的机器学习框架,用于预测颅底脑膜瘤患者对射波刀放射外科治疗的体积反应,其中TabPFN模型在嵌套交叉验证下取得了最佳性能(AUC=0.81)。
摘要翻译

颅底脑膜瘤通常以良好的长期预后为特征,但其解剖结构的复杂性以及与关键神经血管结构的邻近性使得治疗选择颇具挑战。当手术切除不可行时,采用射波刀(CyberKnife)的立体定向放射外科是一种有效的治疗选择;然而,并非所有患者都能从该治疗中同等获益。早期识别可能对放射外科治疗有反应的患者仍是一个尚未解决的临床问题。在本研究中,我们提出了一种基于影像组学(radiomics)和临床特征驱动的框架,用于预测接受射波刀治疗的颅底脑膜瘤的体积反应。与大多数关注无进展生存期或复发的现有方法不同,我们的方法将体积反应作为治疗效果的指标。我们处理了104例患者的治疗前MRI图像以提取影像组学特征,并将其与临床变量相结合,使用六种模型进行分析。为确保方法学的严谨性,整个建模过程在嵌套交叉验证(nested cross-validation)方案中实施。在评估的模型中,TabPFN取得了最佳整体性能,AUC达到0.81,且分类指标持续表现良好。这些结果表明,先进的机器学习架构结合稳健的验证策略,即使在样本量小、维度高的情境下,也能有效捕捉与治疗反应相关的模式。


摘要 (Abstract)

Skull-base meningiomas are often characterized by favorable long-term prognosis, yet their anatomical complexity and proximity to critical neurovascular structures make treatment selection challenging. Stereotactic radiosurgery with CyberKnife represents an effective therapeutic option when surgical resection is not feasible; however, not all patients benefit equally from this treatment. Early identification of patients likely to respond to radiosurgery remains an open clinical problem. In this study, we propose a radiomics- and clinical feature-driven framework for predicting volumetric response in skull-base meningiomas treated with CyberKnife. Unlike most existing approaches that focus on progression-free survival or recurrence, our method targets volumetric response as an indicator of treatment efficacy. Pre-treatment MRI images from 104 patients were processed to extract radiomic features, which were combined with clinical variables and analyzed using six models. To ensure methodological rigor, the entire modeling process was implemented within a nested cross-validation scheme. Among the evaluated models, TabPFN achieved the best overall performance, with an AUC of 0.81 and consistently favorable classification metrics. These results suggest that advanced machine learning architectures, when combined with robust validation strategies, can effectively capture patterns associated with treatment response even in small-sample, high-dimensional settings.


关键词: Radiomics, Skull-base meningioma, CyberKnife radiosurgery, Volumetric response prediction, Machine learning, TabPFN, Nested cross-validation


211. ❌ Graph-augmented Segmentation of Complex Shapes in Laser Powder bed Fusion for Enhanced In Situ Inspection

作者: Stefano Raimondo, Matteo Bugatti, Marco Grasso 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24234v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是激光粉末床熔融(L-PBF)过程中复杂形状的图像分割,采用图神经网络(GNN)增强U-Net架构。论文不涉及大语言模型(LLM)、深度学习技术原理创新或AI在科学领域的应用(如生物信息学、化学信息学)。所有关键词均与论文内容无关,因此所有评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种图增强分割方法,通过图神经网络保留全局几何信息,以改善激光粉末床熔融过程中复杂形状的原位检测图像分割的鲁棒性和准确性。
摘要翻译

增材制造中原位检测与监测方法的技术成熟度正稳步提升,从而能够实现更高效且更具实用性的质量鉴定流程。在此背景下,众多研究者已针对激光粉末床熔融(Laser Powder Bed Fusion, L-PBF)过程中的粉末床图像分割展开探索,利用边缘检测与机器学习方法识别与名义几何结构的偏差。尽管取得了上述进展,仍存在若干挑战,包括分割性能对工业光照条件的敏感性,以及像素强度模式在层间的变异性。本研究通过提出一种图增强分割方法来解决这些局限。其基本原理在于从全局层面而非像素层面保留几何信息,利用嵌入U-Net架构中的图神经网络瓶颈层来建模空间区域间的依赖关系与关联信息。该方法能够增强在真实数据中系统面临的空间及层间光度变化条件下几何重建的一致性与准确性。我们以L-PBF制造的晶格结构原位重建为基准,将所提方法与现有技术进行对比评估,结果表明该方法具备作为工业环境中稳健原位检测与几何验证的可扩展解决方案的潜力。


摘要 (Abstract)

The technological maturity of in situ inspection and monitoring methods in additive manufacturing is steadily increasing, enabling more efficient and practical qualification procedures. In this context, image segmentation of powder bed images in Laser Powder Bed Fusion (L-PBF) has been investigated by various authors, leveraging both edge detection and machine learning approaches to identify deviations from nominal geometry. Despite these developments, several challenges remain, including the sensitivity of segmentation performance to industrial illumination conditions and layer-to-layer variability in pixel intensity patterns. The study addresses these limitations by proposing a graph-augmented segmentation approach. The underlying principle consists of preserving the geometrical information at a global level rather than at pixel-wise level, modeling dependencies and relational information among spatial regions with a Graph Neural Network bottleneck embedded into a U-Net architecture. This allows enhancing the consistency and accuracy of the geometry reconstruction in the presence of spatial and layer-wise photometric variability systematically faced in real data. The method is evaluated against benchmark techniques for the in situ reconstruction of lattice structures produced by L-PBF, demonstrating its potential as a scalable solution for robust in situ inspection and geometric verification in industrial environments.


关键词: Graph Neural Network, Image Segmentation, Laser Powder Bed Fusion, In Situ Inspection, Additive Manufacturing, U-Net, Lattice Structures


212. ❌ Computer Vision-Based Early Detection of Container Loss at Sea

作者: Vishakha Lall, Capt. Stanley S Pinto, Capt. Chu Xing Peng, Wu Kaiwen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24193v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是基于计算机视觉的集装箱丢失早期检测,属于传统计算机视觉应用,与大型语言模型、深度学习模型创新、AI for Science等关键词完全无关。所有关键词均未在摘要或标题中出现,且论文未涉及任何大模型或深度学习技术原理创新。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于计算机视觉的低成本系统,利用现有船载摄像头通过目标分割和光流跟踪早期检测失稳集装箱,以提升海上安全。
摘要翻译

集装箱航运支撑着全球贸易,然而集装箱海上丢失问题始终是安全、环境和经济领域的持续性挑战。尽管船舶已遵循《货物系固手册》操作,但船舶运动、风载荷及恶劣海况等动态海事条件仍会逐步破坏集装箱堆垛的稳定性,导致其落水丢失。随着国际海事组织(IMO)对丢失集装箱实施强制性报告新规,亟需一种可靠且基于实证的早期检测方案来识别失稳集装箱。本研究展示了一种低成本、可加装的计算机视觉系统,利用现有船载摄像头实现失稳集装箱的早期检测。该框架整合了目标分割技术以分离集装箱堆垛,采用光流法进行时序目标跟踪,并通过提取单个目标的残余运动来量化相对位移。基于真实船载视频的试验评估表明,所提方法能在不同海况与能见度的复杂条件下有效分离集装箱层级的运动。通过为船员干预和航线调整提供早期预警,本方法提升了货物安全性、运营韧性及法规合规性。


摘要 (Abstract)

Containerised shipping underpins global trade, yet container loss at sea remains a persistent safety, environmental, and economic challenge. Despite compliance with Cargo Securing Manuals, dynamic maritime conditions such as vessel motion, wind loading, and severe sea states can progressively destabilise container stacks, leading to overboard losses. With the new International Maritime Organisation’s (IMO) mandatory reporting requirements for lost containers, there is an urgent need for a reliable, evidence-based early detection solution for destabilised containers. This study showcases a low-cost, retrofittable computer vision-based system for early detection of destabilised containers using existing onboard cameras. The framework integrates object segmentation to isolate container stacks, temporal object tracking using optical flow and individual objects’ residual motion extraction to quantify relative movement. Experimental evaluation on real onboard ship footage demonstrates that the proposed pipeline effectively isolates container-level motion under challenging conditions of varying sea states and visibility conditions. By enabling early alerts for crew intervention and navigational adjustment, the proposed approach enhances cargo safety, operational resilience, and regulatory compliance.


关键词: computer vision, container loss detection, object segmentation, optical flow, maritime safety, early detection, cargo securing


213. ❌ Multivariate Gaussian NeRF for Wide Field-of-View Ultrasound Reconstruction

作者: Patris Valera, Magdalena Wysocki, Felix Duelmer, Mohammad Farid Azampour, Sebastian Herz, Stefan Wörz, Nassir Navab 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24187v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究的是3D超声重建,使用基于NeRF的多变量高斯方法,不涉及大语言模型或深度学习技术原理创新,与所有关键词均无关。


!!! tip deepseek-chat TL;DR

该论文提出Ultra-Wide-NeRF,一种基于多变量3D高斯NeRF的方法,用于宽视野超声重建,通过显式建模波束几何减少伪影并实现抗锯齿,在体模和猪数据集上验证了其扩展空间上下文的能力。
摘要翻译

宽视场(Wide Field-of-View, WFoV)重建通过为分割模型和可视化提供有价值的解剖学背景,增强了三维超声成像。临床超声容积主要使用凸阵探头采集,这类探头产生发散状声束以最大化解剖覆盖范围。传统上拼接这些扫描序列会因深度依赖的分辨率变化而引入显著的复合伪影和混叠。本文提出Ultra-Wide-NeRF,一种基于多变量三维高斯(Multivariate 3D Gaussian, MVG)的NeRF方法,用于WFoV超声重建。通过利用距离依赖的凸阵容积采样和各向异性三维高斯显式建模复杂的声束几何结构,我们的方法从本质上减轻了这些复合伪影并实现了抗混叠。除了重建静态三维网格外,这种基于NeRF的方法还生成了组织的连续神经表征,从而能够从任意虚拟轨迹合成高保真新视角。我们在体模和猪数据集上验证了Ultra-Wide-NeRF在心腔内超声心动图中的应用,结果表明该方法扩展了术中导航中重要的空间背景。代码将在发表后开源。


摘要 (Abstract)

Wide Field-of-View (WFoV) reconstruction enhances 3D ultrasound imaging by providing valuable anatomical context for segmentation models and visualization. Clinical ultrasound volumes are predominantly acquired using convex probes, which generate expanding, diverging acoustic beams to maximize anatomical coverage. Stitching these sweeps together traditionally introduces significant compounding artifacts and aliasing due to depth-dependent resolution changes. Here, we introduce Ultra-Wide-NeRF, a Multivariate 3D Gaussian (MVG) NeRF-based method for WFoV ultrasound reconstruction. By explicitly modeling the complex beam geometry using distance-dependent convex volumetric sampling and anisotropic 3D Gaussians, our method inherently mitigates these compounding artifacts and provides anti-aliasing. Beyond simply reconstructing a static 3D grid, our NeRF-based approach yields a continuous neural representation of the tissue, enabling the synthesis of high-fidelity novel views from arbitrary virtual trajectories. We validate Ultra-Wide-NeRF for intracardiac echocardiography on phantom and porcine datasets, demonstrating that our method expands the spatial context important in intraoperative navigation. Code will be open-sourced upon publication.


关键词: Wide Field-of-View Ultrasound, NeRF, Multivariate 3D Gaussian, Ultrasound Reconstruction, Intracardiac Echocardiography, Anti-aliasing, Novel View Synthesis


214. ❌ Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning

作者: Zhicheng Zhang, Wentao Gu, Weicheng Wang, Yongjie Zhu, Wenyu Qin, Meng Wang, Pengfei Wan, Jufeng Yang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24191v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.08.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.010.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.010.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.010.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.08.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出Omni-o3框架,专注于深度嵌套推理,用于音频-视觉推理任务。核心创新在于将推理建模为动态递归搜索,结合了链式思维(CoT)、系统2思维(慢思考)和蒙特卡洛树搜索(MCTS)等概念。训练阶段包括冷启动SFT和基于强化学习的探索,涉及自改进(self-correction/self-improvement)元素。因此,与CoT、System 2 Thinking、MCTS、Self-Correction高度相关;与LLMs、Post-training/SFT中等相关;其他关键词如MoE、SLMs、RAG等不相关。


!!! tip deepseek-chat TL;DR

Omni-o3通过深度嵌套递归搜索策略,结合链式思维、系统2推理和蒙特卡洛树搜索,显著提升了复杂音频-视觉推理任务的性能。
摘要翻译

全模态理解涉及一个庞大且高度冗余的跨模态交互搜索空间,需要集中且审慎的推理。当前的推理范式要么依赖顺序逐步生成,要么依赖并行逐样本展开,导致推理轨迹相互孤立。这种无法共享有希望的中间路径的缺陷严重限制了探索效率,并在复杂的视听任务中引发复合错误。为突破这一瓶颈,我们提出Omni-o3,一种由深度嵌套演绎策略驱动的新型框架。通过将推理形式化为动态递归搜索,Omni-o3天然地在各分支间共享推理前缀,从而能够迭代执行四种原子认知动作:扩展、选择、模拟和反向传播。为赋能这一框架,我们提出一种稳健的两阶段训练范式:(1)从350万多样化全模态样本中蒸馏出的10.1万条高质量长链轨迹上进行冷启动监督微调,以习得必要的递归搜索模式;(2)在1.8万条复杂多轮样本上,由一种新颖的多步奖励模型明确引导,进行嵌套式组展开驱动的探索性强化学习,以激发深度嵌套推理。大量实验表明,Omni-o3在11个基准测试中取得了具有竞争力的性能,并在综合视听、视觉中心及音频中心推理任务中解锁了高级能力。


摘要 (Abstract)

Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Current reasoning paradigms rely on either sequential step-by-step generation or parallel sample-by-sample rollouts, leading to isolated reasoning trajectories. This inability to share promising intermediate paths severely limits exploration efficiency and causes compounding errors in complex audio-visual tasks. To break this bottleneck, we introduce Omni-o3, a novel framework driven by a deep nested deduction policy. By formulating reasoning as a dynamic recursive search, Omni-o3 inherently shares reasoning prefixes across branches, enabling the iterative execution of four atomic cognitive actions: expansion, selection, simulation, and backpropagation. To empower this framework, we propose a robust two-stage training paradigm: (1) cold-start supervised fine-tuning on 101K high-quality, long-chain trajectories distilled from 3.5M diverse omnimodal samples, enabling necessary recursive search patterns; and (2) nested group rollout-driven exploratory reinforcement learning on 18K complex multi-turn samples, explicitly guided by a novel multi-step reward model to stimulate deep nested reasoning. Extensive experiments demonstrate that Omni-o3 achieves competitive performance across 11 benchmarks, unlocking advanced capabilities in comprehensive audio-visual, visual-centric, and audio-centric reasoning tasks.


关键词: Omni-o3, deep nested deduction, deliberative reasoning, audio-visual reasoning, chain of thought, Monte Carlo Tree Search, reinforcement learning, recursive search


215. ❌ POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation

作者: Yaohou Fan, Qingzhong Wang, Yongsong Huang, Junyi Liu, Tomo Miyazaki, Shinichiro Omachi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24171v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.010.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.010.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出POCA框架,用于视觉文本生成中的多目标对齐,涉及指令微调(Instruction Tuning)和RLHF/DPO等对齐方法,通过帕累托最优和课程学习优化多奖励。因此,‘Instruction Tuning OR Alignment OR Value Alignment’和’RLHF OR RLAIF OR Direct Preference Optimization OR DPO’高度相关(10分),其他关键词如LLMs、MoE等不相关(0分)。


!!! tip deepseek-chat TL;DR

论文提出POCA框架,通过帕累托最优和自适应课程对齐策略,解决视觉文本生成中文本准确性与图像质量之间的权衡问题,显著提升多项指标。
摘要翻译

当前的视觉文本生成模型在文本准确性与整体图像连贯性之间难以权衡。我们发现,追求高文本准确性会降低美学质量与指令遵循能力。尽管强化学习方法可通过多奖励对齐缓解该问题,但现有方法通常采用加权求和方式优化多个奖励,导致文本生成过程不稳定。此外,各奖励权重的平衡亦存在困难。更关键的是,强化学习需要一组训练指令:大量提示词会消耗更多训练时间与计算资源,而少量提示词则导致性能低下。因此,如何选择提示词以实现高效训练仍是一个未解难题。本研究提出帕累托最优课程对齐(Pareto-Optimal Curriculum Alignment, POCA)框架,通过以下方式将该问题作为多目标问题处理:1)识别帕累托最优集以避免简单标量化;2)设计自适应课程对齐策略,利用自动难度评估管理多奖励数据集的学习序列——这对强化学习在有限数据环境中实现最优收敛至关重要。通过协同作用,POCA在统一奖励空间中寻找帕累托最优集,消除不一致信号,从而在由易到难的优化景观中从不同奖励中找出最佳权衡方案。实验结果表明,POCA显著提升了CLIP分数、HPS分数及句子准确率等所有指标。


摘要 (Abstract)

Current visual text generation models struggle with the trade-off between text accuracy and overall image coherence. We find that achieving high text accuracy can reduce aesthetic quality and instruction-following capability. Although reinforcement learning approaches can alleviate the problem through aligning with multiple rewards, they are often unstable for text generation, as existing approaches normally optimize multiple rewards in a weighted-sum way. In addition, it is difficult to balance the weight of each reward. Moreover, reinforcement learning requires a set of training instructions. A large number of prompts require more training time and computing resources, while a small set leads to poor performance. Hence, how to select the prompts for efficient training is an unsolved problem. In this study, we propose Pareto-Optimal Curriculum Alignment (POCA), a framework that addresses this issue as a multi-objective problem by: 1) identifying the Pareto-optimal set to avoid simple scalarization and 2) designing an adaptive curriculum alignment strategy to manage a learning sequence of a multi-reward dataset using automatic difficulty assessment, which is crucial for optimal convergence as RL methods explore in a limited data environment. In synergy, POCA finds the Pareto-optimal set in a unified reward space, which eliminates inconsistent signals to find the best trade-off solution from different rewards under an easy-to-hard optimization landscape. The experimental results show that POCA significantly improves all metrics such as CLIP, HPS scores and sentence accuracy.


关键词: Visual Text Generation, Multi-objective Optimization, Pareto Optimality, Curriculum Alignment, Reinforcement Learning, Reward Alignment, Instruction Tuning


216. ❌ PEPS: Positional Encoding Projected Sampling – Extended

作者: Guillaume Perez, Janarbek Matai, Takahiro Harada 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24167v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是隐式神经表示(INR)中的位置编码投影采样方法,属于计算机视觉和图形学领域,与大型语言模型、深度学习技术原理创新(如注意力机制、强化学习等)以及AI for Science均无直接关联。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出位置编码投影采样(PEPS)方法,通过将位置编码分解为一系列有意义点的投影,利用点的运动模式进行学习,在图像表示、纹理压缩和符号距离函数任务上以更少参数超越现有方法。
摘要翻译

隐式神经表示(Implicit Neural Representations, INRs)正越来越多地被用作将坐标映射到信号的工具,其应用范围涵盖神经场、纹理压缩、形状表示等领域。大多数INR方法基于通过编码器(如网格编码或位置编码)对初始坐标进行高维投影。然而,位置编码往往不够充分,而网格编码(如本文所示)则需要高分辨率才能有效学习。在本文中,我们证明位置编码不仅可用作高维嵌入,还可分解为一系列有意义的点。我们提出位置编码投影采样(Positional Encoding Projected Sampling),将原始坐标在每个频率上的投影视为兴趣点。我们描述了每个点随频率变化的运动,并证明其遵循独特的模式。最后,我们利用每个点的独特运动作为基分解,通过网格实现学习型位置编码。通过三个具有竞争力的应用——图像表示、纹理压缩和有符号距离函数(Signed Distance Function, SDF)——我们证明所提出的方法优于当前最先进的方法,并且在达到同等重建误差或渲染效果时,通常可减少25%的参数。


摘要 (Abstract)

Implicit neural representations (INRs) are increasingly being used as tools to map coordinates to signals, encompassing applications from neural fields to texture compression, shape representations, and beyond. Most INR methods are based on using high-dimensional projections of the initial coordinates through encoders such as grid or positional encoding. Nevertheless, positional encoding is often insufficient and grids, as we show in this paper, require high resolution for being able to learn. In this paper, we demonstrate that positional encoding can be used not only as a high-dimensional embedding but also decomposed as a series of meaningful points. We propose the Positional Encoding Projected Sampling, where we treat the projection of the original coordinate at each frequency as a point of interest. We describe the motion of each point with respect to the frequencies and show that it follows a unique pattern. Finally, we use the unique motion of each point as a basis decomposition for doing learned positional encoding using grids. We prove, using three competitive applications; image representation, texture compression, and signed distance function; that the proposed approach outperforms the current state of the art methods, and often requires 25% less parameters for equivalent reconstruction error or rendering.


关键词: Implicit Neural Representations, Positional Encoding, Projected Sampling, Image Representation, Texture Compression, Signed Distance Function


217. ❌ PointTransformerX:Portable and Efficient 3D Point Cloud Processing without Sparse Algorithms

作者: Laurenz Reichardt, Nikolas Ebert, Oliver Wasenmüller 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24169v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文PointTransformerX专注于3D点云处理的视觉Transformer骨干网络,不涉及大语言模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

PointTransformerX提出了一种完全PyTorch原生的3D点云Transformer,通过3D-GS-RoPE和线性投影替代稀疏算子,在保持精度的同时大幅减少参数和内存,并支持多种硬件。
摘要翻译

三维点云感知仍高度依赖用于空间操作的自定义CUDA算子,这限制了其在非NVIDIA、AMD及嵌入式硬件上的可移植性与效率。我们提出PointTransformerX(PTX),一种完全基于PyTorch原生实现的视觉Transformer主干网络,用于三维点云处理,在移除所有自定义CUDA算子及外部库的同时保持了具有竞争力的精度。PTX引入了3D-GS-RoPE,一种无需邻域构建即可直接在自注意力机制中编码三维空间关系的旋转位置编码,并进一步用线性投影替代了稀疏卷积的块嵌入。PTX探索了注意力窗口的推理时缩放策略,无需重新训练即可提升精度。通过重新设计的前馈网络,PTX在ScanNet数据集上达到了PointTransformer V3 98.7%的精度,参数数量减少79.2%,执行速度提升1.6倍,且仅需253 MB内存。PTX可原生运行于NVIDIA GPU、AMD GPU(ROCm)及CPU上,为点云感知提供了高效且可移植的基础框架。


摘要 (Abstract)

3D point cloud perception remains tightly coupled to custom CUDA operators for spatial operations, limiting portability and efficiency on non-NVIDIA, AMD, and embedded hardware. We introduce PointTransformerX (PTX), a fully PyTorch-native vision transformer backbone for 3D point clouds, removing all custom CUDA operators and external libraries while retaining competitive accuracy. PTX introduces 3D-GS-RoPE, a rotary positional embedding that encodes 3D spatial relationships directly in self-attention without neighborhood construction, and further replaces sparse convolutional patch embedding with a linear projection. PTX explores inference-time scaling of attention windows to improve accuracy without retraining. With a redesigned feed-forward network, PTX achieves 98.7% of PointTransformer V3’s accuracy on ScanNet with 79.2% fewer parameters and executing 1.6\times faster while requiring just 253 MB memory. PTX runs natively on NVIDIA GPUs, AMD GPUs (ROCm), and CPUs, providing an efficient and portable foundation for point cloud perception.


关键词: PointTransformerX, 3D point cloud, vision transformer, rotary positional embedding, PyTorch-native, inference-time scaling, portable, efficient


218. ❌ Robust Deepfake Detection, NTIRE 2026 Challenge: Report

作者: Benedikt Hopf, Radu Timofte, Chenfan Qu, Junchi Li, Fei Wu, Dagong Lu, Mufeng Yao, Xinlei Xu, Fengjun Guo, Yongwei Tang, Zhiqiang Yang, Zhiqiang Wu, Jia Wen Seow, Hong Vin Koay, Haodong Ren, Feng Xu, Shuai Chen, Minh-Khoa Le-Phan, Minh-Hoang Le, Trong-Le Do, Minh-Triet Tran, Chih-Yu Jian, Yi-Fan Wang, Bang-Kang Chen, You-Chen Chao, Chia-Ming Lee, Fu-En Yang, Yu-Chiang Frank Wang, Chih-Chung Hsu, Aashish Negi, Hardik Sharma, Prateek Shaily, Jayant Kumar, Sachin Chaudhary, Akshay Dudhane, Praful Hambarde, Amit Shukla, Jielun Peng, Yabin Wang, Yaqi Li, Jincheng Liu, Xiaopeng Hong, Krish Wadhwani, Liam Fitzpatrick, Utkarsh Tiwari, Bilel Benjdira, Anas M. Ali, Wadii Boulila, Cristian Lazo Quispe, Aishwarya A, Akshara S, Ashwathi N, Jiachen Tu, Guoyi Xu, Yaoxin Jiang, Jiajia Liu, Yaokun Shi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24163v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注深度伪造检测的鲁棒性,并组织了一个挑战赛。摘要中提到’Top methods rely on large foundation models’,表明使用了大型基础模型(如LLMs),因此与’Large Language Models OR LLMs OR Foundation Models’相关,评分为8。其他关键词如MoE、SLMs、Scaling Laws等均未在摘要中提及,且论文主题为计算机视觉中的深度伪造检测,与LLM技术原理创新或AI for Science无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文报告了NTIRE 2026鲁棒深度伪造检测挑战赛,旨在解决深度伪造检测在图像退化下的鲁棒性问题,并发现基于大型基础模型、集成和退化训练的方法表现最佳。
摘要翻译

鲁棒性是深度伪造检测中长期被忽视的问题。然而,若检测性能在即使轻微图像退化的情况下也会受到影响,那么它在现实世界中几乎毫无价值。除了图像处理流程中可能偶然发生的较弱退化外,还存在另一种风险:恶意深度伪造会特意引入退化,故意利用检测器在该方面的弱点。本文概述了NTIRE 2026鲁棒深度伪造检测挑战赛(NTIRE 2026 Robust Deepfake Detection Challenge),该赛事专门针对这一问题。参赛者的任务是构建一个检测器,该检测器随后将在未知测试集上进行测试,其中包含各种强度的常见及不常见退化。本届挑战赛共有337名参赛者及57份最终排行榜提交,反响良好。为确保结果的可靠性,参赛者仅有24小时完成测试运行,且未提供标签,从而限制了在测试数据上进行训练的可能性。此外,顶级解决方案还在私有测试集上进行了评分,以检测任何此类过拟合现象。本报告介绍了比赛设置、数据集准备,以及方法的细节与性能。顶级方法依赖于大型基础模型(foundation models)、集成学习(ensembles)和退化训练(degradation training),以兼顾通用性与鲁棒性。


摘要 (Abstract)

Robustness is a long-overlooked problem in deepfake detection. However, detection performance is nearly worthless in the real world if it suffers under exposure to even slight image degradation. In addition to weaker degradations that can accidentally occur in the image processing pipeline, there is another risk of malicious deepfakes that specifically introduce degradations, purposefully exploiting the detector’s weaknesses in that regard. Here, we present an overview of the NTIRE 2026 Robust Deepfake Detection Challenge, which specifically addresses that problem. Participants were tasked with building a detector that would later be tested on an unknown test-set, which included both common and uncommon degradations of various strengths. With a total number of 337 participants and 57 submissions to the final leaderboard, the first edition of the challenge was well received. To ensure the reliability of the results, participants were given only 24h to complete the test run with no labels provided, limiting the possibility of training on the test data. Furthermore, the top solutions were scored on a private test-set to detect any such overfitting. This report presents the competition setting, dataset preparation, as well as details and performance of methods. Top methods rely on large foundation models, ensembles, and degradation training to combine generality and robustness.


关键词: Deepfake Detection, Robustness, Image Degradation, Foundation Models, Ensemble Methods, NTIRE Challenge


219. ❌ 6thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving

作者: Runci Bai, Kui Jiang, Xiang Chen, Chen Wu, Dianjie Lu, Guijuan Zhang, Zhuoran Zheng 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24149v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.02.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.08.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注遥感图像去雾,提出了一种基于颜色恢复和边缘保持的网格框架,涉及模型压缩(量化)和边缘设备部署,但与大型语言模型、深度学习技术原理创新无关。仅与’Quantization OR Model Compression OR Low-bit Weights’有一定关联(动态量化),以及’Small Language Models OR SLMs OR On-device AI’中的’on-device’概念(资源受限边缘设备),但并非核心。其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出了一种高效的遥感图像去雾框架6th Grid-Net,通过六维融合张量和流形自适应采样实现颜色恢复与边缘保持,并在多个基准数据集上取得最优结果。
摘要翻译

遥感图像常因恶劣天气条件(尤其是云和雾)而退化,严重损害下游应用。现有复原方法通常依赖计算密集型架构或顺序流水线(例如,先细节增强后色彩渲染),这些方法存在相互干扰和伪影累积的问题。此外,近期基于统一网格的方法采用固定的各向同性插值核,忽略了自然图像的内在低维流形,不可避免地导致边缘模糊。为解决这些局限,我们提出6th Grid-Net,一种专为资源受限的边缘设备设计的高效统一遥感图像复原框架。具体而言,我们构建了一种新颖的六维融合张量,该张量无缝集成了3D LUT(三维查找表)的色彩渲染能力与双边网格的空间-亮度细节保持能力。为克服标准三线性插值的缺陷,我们引入了一种流形自适应高维采样机制。该机制根据局部边缘方向、纹理强度和色彩相似性动态调整插值核,从而在单次前向传播中同时实现全局色彩风格化与局部边缘细化。此外,我们还融入了边缘感知网格平滑约束与动态量化,以抑制重影伪影并显著压缩模型体积。在多个基准数据集上的大量实验表明,6th Grid-Net在各种退化场景下均达到了最先进的复原质量。


摘要 (Abstract)

Remote sensing images are frequently degraded by adverse weather conditions, particularly clouds and haze, which severely impair downstream applications. Existing restoration methods typically rely on computationally heavy architectures or sequential pipelines (e.g., detail enhancement followed by color rendition) that suffer from mutual interference and artifact accumulation. Furthermore, recent unified grid-based approaches utilize fixed, isotropic interpolation kernels, neglecting the intrinsic low-dimensional manifold of natural images and inevitably causing edge blur. To address these limitations, we propose 6th Grid-Net, a highly efficient and unified remote sensing image restoration framework tailored for resource-constrained edge devices. Specifically, we construct a novel six-dimensional fusion tensor that seamlessly integrates the color rendition capabilities of 3D LUTs with the spatial-luminance detail preservation of bilateral grids. To overcome the drawbacks of standard trilinear interpolation, we introduce a manifold-adaptive high-dimensional sampling mechanism. This mechanism dynamically adjusts the interpolation kernel based on local edge orientation, texture strength, and color similarity, enabling simultaneous global color stylization and local edge refinement in a single forward pass. Additionally, an edge-aware grid smoothing constraint and dynamic quantization are incorporated to suppress ghosting artifacts and significantly compress the model size. Extensive experiments on multiple benchmark datasets demonstrate that 6th Grid-Net achieves state-of-the-art restoration quality across various degradation scenarios.


关键词: Remote Sensing Image Dehazing, Color Restoration, Edge-Preserving, Bilateral Grid, 3D LUT, Manifold-Adaptive Sampling, Dynamic Quantization, Edge-Aware Grid Smoothing


220. ❌ EXACT: an explainable anomaly-aware vision foundation model for analysis of 3D chest CT

作者: Xuguang Bai, Mingxuan Liu, Tongxi Song, Yifei Chen, Hongjia Yang, Kasidit Anmahapong, Zihan Li, Ying Zhou, Qiyuan Tian 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24146v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.010.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.010.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出EXACT,一个用于3D胸部CT的可解释异常感知视觉基础模型。它使用解剖感知弱监督在CT-报告对上预训练,学习器官分割和多实例异常定位,生成器官特异性异常感知图。与关键词的相关性:‘Large Language Models/Foundation Models’(10分)核心是视觉基础模型;‘Pre-training’(10分)涉及预训练;‘Post-training/SFT’(5分)提及下游适应;‘Mechanistic Interpretability/Explainable AI’(10分)强调可解释性;‘AI for Science’(10分)应用于医学影像。其他关键词如MoE、SLMs、RAG等不相关。


!!! tip deepseek-chat TL;DR

EXACT是一个可解释的异常感知视觉基础模型,通过弱监督预训练从CT-报告对中学习空间分辨表示,实现三维胸部CT的多疾病诊断、零样本异常定位和视觉化报告生成。
摘要翻译

胸部计算机断层扫描(CT)是胸部疾病检测与管理的核心手段,然而体成像的规模与复杂性日益增长,已远超仅凭扫描层面预测所能应对的范围。临床实用的CT人工智能不仅需在整个扫描体积中识别疾病,还需定位异常并提供可解释的视觉证据。现有的视觉-语言基础模型通常将扫描图像与报告压缩为全局图像-文本表征,限制了其保留空间证据及支持有临床意义解读的能力。为此,我们开发了EXACT——一种面向三维胸部CT的可解释异常感知基础模型,该模型能从配对的临床扫描图像与放射学报告中学习空间解析表征。EXACT基于25,692对CT-报告数据,采用解剖感知弱监督进行预训练,在无需人工体素级标注的情况下,联合学习了器官分割与多实例异常定位。由此生成的器官特异性异常感知图谱为每个体素赋予局限于其对应解剖结构内的疾病特异性异常评分,同时编码了病灶范围与器官级上下文。在回顾性跨国多中心评估中,EXACT在多项临床相关CT任务中展现出广泛且一致的性能提升,涵盖多疾病诊断、零样本异常定位、下游任务适配及视觉引导的报告生成,其表现优于现有三维医学基础模型。通过将常规临床CT扫描与自由文本报告转化为可解释的体素级表征,EXACT为可信赖的体医学人工智能建立了一种可扩展的范式。


摘要 (Abstract)

Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically useful AI for CT must not only recognize disease across the whole volume, but also localize abnormalities and provide interpretable visual evidence. Existing vision-language foundation models typically compress scans and reports into global image-text representations, limiting their ability to preserve spatial evidence and support clinically meaningful interpretation. Here we developed EXACT, an explainable anomaly-aware foundation model for three-dimensional chest CT that learns spatially resolved representations from paired clinical scans and radiology reports. EXACT was pre-trained on 25,692 CT-reports pairs using anatomy-aware weak supervision, jointly learning organ segmentation and multi-instance anomaly localization without manual voxel-level annotations. The resulting organ-specific anomaly-aware maps assign each voxel a disease-specific anomaly score confined to its corresponding anatomy, jointly encoding lesion extent and organ-level context. In retrospective multinational and multi-center evaluations, EXACT showed broad and consistent improvements across clinically relevant CT tasks, spanning multi-disease diagnosis, zero-shot anomaly localization, downstream adaptation, and visually grounded report generation, outperforming existing three-dimensional medical foundation models. By transforming routine clinical CT scans and free-text reports into explainable voxel-level representations, EXACT establishes a scalable paradigm for trustworthy volumetric medical AI.


关键词: vision foundation model, explainable AI, chest CT, anomaly localization, weakly supervised learning, medical imaging, pre-training


221. ❌ Bridging Restoration and Generation Manifolds in One-Step Diffusion for Real-World Super-Resolution

作者: Shyang-En Weng, Yi-Cheng Liao, Yu-Syuan Xu, Wei-Chen Chiu, Ching-Chun Huang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24136v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于真实世界图像超分辨率(Real-ISR),提出基于扩散模型的一步框架IDaS-SR,涉及生成模型和图像处理,但与给定的大语言模型、深度学习技术原理创新等关键词完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出IDaS-SR框架,通过自适应反演和退化感知采样,在单步扩散中桥接恢复与生成流形,实现真实世界图像超分辨率,优于现有方法。
摘要翻译

预训练扩散模型革新了真实世界图像超分辨率(Real-ISR)技术,但由于迭代采样过程存在计算瓶颈。近期提出的单步蒸馏方法加速了推理,却因僵化的时间步初始化、分布轨迹不匹配以及脆弱的随机调制而面临显著的感知-失真权衡。为解决这一问题,我们提出面向Real-ISR的自适应反演与退化感知采样(IDaS-SR),这是一个连接确定性恢复流形与随机生成流形的单步框架。其核心在于流形反演噪声估计器(MINE),通过预测感知退化程度的时间步与反演噪声,将低质量潜变量精确锚定至扩散轨迹,从而解决初始化与轨迹不匹配问题。此外,为缓解脆弱的随机调制,我们提出CHARIOT——一种连续生成式引导机制。通过重新调度轨迹并插值噪声,该机制能够在不破坏结构先验的前提下显式导航感知-失真边界。大量实验表明,IDaS-SR在单步推理中即可从严格的结构恢复器无缝过渡为精细的纹理幻觉生成器,性能超越现有最优方法。


摘要 (Abstract)

Pretrained diffusion models have revolutionized real-world image super-resolution (Real-ISR) but suffer from computational bottlenecks due to iterative sampling. Recent single-step distillation accelerates inference but faces a stark perception-distortion trade-off due to rigid timestep initialization, distributional trajectory mismatches, and fragile stochastic modulation. To address this, we present Adaptive Inversion and Degradation-aware Sampling for Real-ISR (IDaS-SR), a one-step framework bridging the deterministic restoration and stochastic generation manifolds. At its core, the Manifold Inversion Noise Estimator (MINE) resolves these initialization and trajectory mismatches by predicting a severity-aware timestep and inversion noise, precisely anchoring low-quality latents onto the diffusion trajectory. Furthermore, to mitigate fragile stochastic modulation, we propose CHARIOT, a continuous generative steering mechanism. By rescheduling trajectories and interpolating noise, it enables explicit navigation of the perception-distortion boundary without compromising structural priors. Extensive experiments demonstrate that IDaS-SR outperforms state-of-the-art methods, seamlessly transitioning from a rigorous structural restorer to a sophisticated texture hallucinator in a single inference step.


关键词: Real-ISR, Diffusion Models, One-Step Sampling, Manifold Inversion, Perception-Distortion Trade-off, Image Super-Resolution


222. ❌ Open-Vocabulary Semantic Segmentation Network Integrating Object-Level Label and Scene-Level Semantic Features for Multimodal Remote Sensing Images

作者: Jinkun Dai, Yuanxin Ye, Peng Tang, Tengfeng Tang, Xianping Ma, Jing Xiao, Mi Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24125v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文主要研究多模态遥感图像的开放词汇语义分割,通过文本监督融合视觉和文本特征。虽然涉及深度学习,但未涉及大语言模型、MoE、SLM、Scaling Laws、预训练/微调、指令调优、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我修正、LLM智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习或AI for Science等关键词。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出TSMNet,一种文本监督的多模态开放词汇语义分割网络,通过融合场景级语义和对象级标签文本信息,显著提升了遥感图像分割的准确性和泛化能力。
摘要翻译

多模态遥感影像语义分割在土地利用/土地覆盖(LULC)制图、环境监测及精准地球观测中发挥着关键作用。当前多模态方法主要聚焦于整合互补的视觉模态,却忽略了非视觉文本数据的融入——这类数据作为丰富知识源,能够弥合视觉模式与现实世界概念之间的语义鸿沟。为解决这一局限,我们提出TSMNet,一种文本监督的多模态开放词汇语义分割网络,该网络通过协同整合文本监督与视觉表征实现开放词汇语义分割。不同于传统多模态分割框架,TSMNet引入双分支文本编码器,从各类文本数据中提取场景级语义信息与目标级标签信息,从而实现动态跨模态融合。这些文本派生特征通过所提出的文本引导视觉语义融合模块与视觉嵌入动态交互,实现领域感知特征优化与人类可解释决策。为验证本方法,我们创新性地构建了两个多模态数据集,并开展大量实验,将所提方法与当前最先进的(SOTA)语义分割模型进行全面比较。结果表明,TSMNet在实现卓越分割精度的同时,在不同地理场景与传感器特定场景下展现出强大的泛化能力。本研究为可解释遥感分析建立了新范式,证实文本知识整合显著增强了模型泛化性。源代码将发布于 https://github.com/yeyuanxin110/TSMNet


摘要 (Abstract)

Semantic segmentation of multi-modal remote sensing imagery plays a pivotal role in land use/land cover (LULC) mapping, environmental monitoring, and precision earth observation. Current multi-modal approaches mainly focus on integrating complementary visual modalities, yet neglect the incorporating of non-visual textual data - a rich source of knowledge that can bridge semantic gaps between visual patterns and real-world concepts. To address this limitation, we propose TSMNet, a text supervised multi-modal open vocabulary semantic segmentation network that synergistically integrates textual supervision with visual representation for open-vocabulary semantic segmentation. Unlike conventional multi-modal segmentation frameworks, TSMNet introduces a dual-branch text encoder to extract both scene-level semantic and object-level label information from various textual data, enabling dynamic cross-modal fusion. These text-derived features dynamically interact with visual embeddings through the proposed text-guided visual semantic fusion module, enabling domain-aware feature refinement and human-interpretable decision-making. To verify our method, we innovatively construct two new multi-modal datasets, and carry out extensive experiments to make a comprehensive comparison between the proposed method and other state-of-the-art (SOTA) semantic segmentation models. Results demonstrate that TSMNet achieves superior segmentation accuracy while exhibiting robust generalization capabilities across diverse geographical and sensor-specific scenarios. This work establishes a new paradigm for explainable remote sensing analysis, demonstrating that textual knowledge integration significantly enhances model generalizability. The source code will be available at https://github.com/yeyuanxin110/TSMNet


关键词: Open-Vocabulary Semantic Segmentation, Multimodal Remote Sensing, Text Supervision, Cross-Modal Fusion, TSMNet, Land Use/Land Cover Mapping


223. ❌ FDIM: A Feature-distance-based Generic Video Quality Metric for Versatile Codecs

作者: Jiayi Wang, Lichun Zhang, Xiaoqi Zhuang, Jiaqi Zhang, Lu Yu, Yin Zhao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24123v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出了一种基于特征距离的视频质量评估指标FDIM,用于传统和神经视频编解码器,涉及深度特征和手工特征。论文内容与给定的关键词(大模型、深度学习技术原理创新、AI for Science等)完全无关,所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种名为FDIM的通用视频质量评估指标,通过混合深度和手工特征,在多种编解码器和动态范围下实现了与主观评估高度相关的性能。
摘要翻译

视频技术正朝着超高清(UHD)和高动态范围(HDR)方向发展,这加剧了对这些高规格视频更高压缩效率的需求。除传统编解码器的进步外,神经视频编解码器(NVC)在过去几年中吸引了大量研究关注并迅速发展。NVC的编码伪影通常表现出内容变化性和生成性特征,这与传统编解码器不同,且难以被传统视频质量评估(VQA)方法捕捉。因此,需要能够跨不同编解码器、内容类型和动态范围泛化的VQA指标,以更好地支持视频编解码器的研究与评估。本文提出FDIM,一种基于特征距离的通用视频质量指标,适用于传统和神经视频编解码器,覆盖SDR和HDR格式。FDIM采用混合架构,融合了深度特征与手工特征。深度特征组件学习多尺度表征,以捕捉从结构及纹理保真度退化到高层语义偏差的失真,而手工特征组件则提供稳定的互补线索以提升整体泛化能力。我们在一个大规模主观质量评估数据集(DCVQA)上训练了FDIM,该数据集包含超过1.6万个视频序列,由传统基于块的混合视频编解码器和端到端感知优化的神经视频编解码器编码而成。在十个包含多种未见编解码器的SDR/HDR VQA数据集上的大量实验表明,FDIM实现了强泛化能力,并与主观评估高度相关。FDIM的源代码及DCVQA验证集将在https://github.com/MCL-ZJU/FDIM发布。


摘要 (Abstract)

Video technology is advancing toward Ultra High Definition (UHD) and High Dynamic Range (HDR), which intensifies the need for higher compression efficiency for these high-specification videos. Beyond advances in traditional codecs, neural video codecs (NVCs) have attracted significant research attention and have evolved rapidly over the past few years. The coding artifacts of NVCs often exhibit content-varying and generative characteristics, which differ from those of conventional codecs and are challenging for traditional video quality assessment (VQA) methods to capture. Therefore, VQA metrics are required to generalize across different codecs, content types, and dynamic ranges to better support video codec research and evaluation. In this paper, we propose FDIM, a feature-distance-based generic video quality metric for both traditional and neural video codecs across SDR and HDR formats. FDIM employs a hybrid architecture that integrates deep and hand-crafted features. The deep feature component learns multi-scale representations to capture distortions ranging from structural and textural fidelity degradation to high-level semantic deviations, while the hand-crafted feature component provides stable complementary cues to improve overall generalization. We trained FDIM on a large-scale subjective quality assessment dataset (DCVQA) consisting of over 16k video sequences encoded by traditional block-based hybrid video codecs and end-to-end perceptually optimized neural video codecs. Extensive experiments on ten SDR/HDR VQA datasets containing diverse, previously unseen codecs demonstrate that FDIM achieves strong generalization and high correlation with subjective assessment. The source code for FDIM and the DCVQA validation set will be released at https://github.com/MCL-ZJU/FDIM.


关键词: video quality assessment, neural video codecs, feature distance, deep features, hand-crafted features, generalization, subjective assessment


224. ❌ TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations

作者: Yifeng Bai, Zhirong Chen, Erkang Cheng, Haibin Ling 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24119v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究自动驾驶场景中的拓扑推理,提出层次化中心线表示方法,不涉及大模型、深度学习技术原理创新或AI for Science。所有关键词均与论文主题无关,因此评分为0。


!!! tip deepseek-chat TL;DR

论文提出TopoHR框架,通过层次化中心线表示和点对实例关系实现驾驶场景中的循环拓扑推理,在OpenLane-V2基准上取得显著性能提升。
摘要翻译

拓扑推理对于自动驾驶至关重要。现有方法主要聚焦于中心线检测的实例级学习,随后通过依赖简化MLP层的顺序模块进行拓扑推理。此外,这些方法往往忽略了拓扑推理中\textit{点对实例}(P2I)关系的重要性。为解决上述局限,我们提出TopoHR(拓扑层次化表示),一种新颖的端到端框架,该框架在中心线检测与拓扑推理之间建立循环交互,使二者能够迭代式地相互增强。具体而言,我们引入了一种层次化中心线表示,包含点查询(point queries)、实例查询(instance queries)和语义表示(semantic representations)。这些多层级特征在层次化中心线解码器(hierarchical centerline decoder)中被无缝整合与融合。此外,我们设计了一个层次化拓扑推理模块(hierarchical topology reasoning module),能够在统一架构中同时捕获细粒度的P2I关系与全局的实例到实例(I2I)连接。凭借这些创新组件,TopoHR实现了准确且鲁棒的拓扑推理。在OpenLane-V2基准测试中,TopoHR以显著提升刷新了当前最优性能。值得注意的是,与先前最佳结果相比,TopoHR在$\text{subset_A}$上实现了$\mathrm{DET}{\text{l}}$提升+3.8、$\mathrm{TOP}{\text{ll}}$提升+5.4,在$\text{subset_B}$上实现了$\mathrm{DET}{\text{l}}$提升+11.0、$\mathrm{TOP}{\text{ll}}$提升+7.9,验证了所提组件的有效性。代码将公开发布于https://github.com/Yifeng-Bai/TopoHR.git。


摘要 (Abstract)

Topology reasoning is crucial for autonomous driving. Current methods primarily focus on instance-level learning for centerline detection, followed by a sequential module for topology reasoning that relies on simplified MLP layers. Moreover, they often neglect the importance of \textit{point-to-instance} (P2I) relationships in topology reasoning. To address these limitations, we present TopoHR (Topological Hierarchical Representation), a novel end-to-end framework that establishes cyclic interaction between centerline detection and topology reasoning, allowing them to iteratively enhance each other. Specifically, we introduce a hierarchical centerline representation including point queries, instance queries, and semantic representations. These multi-level features are seamlessly integrated and fused within a hierarchical centerline decoder. Furthermore, we design a hierarchical topology reasoning module that captures both fine-grained P2I relationships and global instance-to-instance (I2I) connections within a unified architecture. With these novel components, TopoHR ensures accurate and robust topology reasoning. On the OpenLane-V2 benchmark, TopoHR refreshes state-of-the-art performance with significant improvements. Notably, compared with previous best results, TopoHR achieves +3.8 in $\mathrm{DET}{\text{l}}$, +5.4 in $\mathrm{TOP}{\text{ll}}$ on $\text{subset_A}$ and +11.0 in $\mathrm{DET}{\text{l}}$, +7.9 in $\mathrm{TOP}{\text{ll}}$ on $\text{subset_B}$, validating the effectiveness of the proposed components. The code will be shared publicly at https://github.com/Yifeng-Bai/TopoHR.git.


关键词: Topology Reasoning, Centerline Detection, Hierarchical Representation, Point-to-Instance Relations, Autonomous Driving, End-to-End Framework


225. ❌ Light ’em Up: Enabling Few-Shot Low-Light 3D Gaussian Splatting with Multi-Scale Explicit Retinex Illumination Decoupling

作者: YuHao Yin, Zongji Wang, Yuanben Zhang, Biqing Li, Jiesong Bai, Junyi Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24053v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究低光照条件下的3D高斯泼溅新视角合成,属于计算机视觉和图形学领域,与给定的所有关键词(大模型、深度学习技术原理创新、AI for Science等)均无直接关联。论文未涉及任何大模型或深度学习技术原理创新,也未应用于科学领域。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出MERID-GS框架,基于Retinex理论显式分离光照和反射,实现低光照条件下360度新视角合成,支持少样本跨场景泛化。
摘要翻译

在低光照条件下进行全360°新视角合成仍然具有挑战性。光照不足、噪声放大以及视角依赖的光度不一致性,使得现有方法难以同时保持几何一致性与真实感。无监督方法在视角变化较大时常常出现色彩漂移,而有监督的低光照增强模型虽然在二维任务中有效,但难以泛化到新场景,通常需要重新训练。为解决这一问题,我们提出了MERID-GS,一种用于低光照360°合成的多尺度显式Retinex光照解耦高斯框架(Multi-Scale Explicit Retinex Illumination-Decoupled Gaussian framework)。该方法基于Retinex理论,显式分离光照与反射率,并通过可学习的增益和光照状态引导的频率门控(Illumination-State-Guided Frequency Gating)抑制噪声传播,同时增强暗区结构。结合轻量级反射头(Reflection Head)与三维高斯泼溅(3D Gaussian Splatting),MERID-GS仅需少量样本即可适应新场景,并实现从稀疏视角观测中稳定合成低光照新视角。此外,我们构建了一个覆盖全360°场景的低光照多视角数据集,用于联合评估。在该领域的多个数据集上进行的充分实验表明,MERID-GS达到了最先进的性能,展现出优越的跨场景泛化能力和视角一致性。源代码与预训练模型已发布于 https://github.com/YhuoyuH/MERID-GS


摘要 (Abstract)

Full 360$^\circ$ novel view synthesis under low-light conditions remains challenging. Insufficient illumination, noise amplification, and view-dependent photometric inconsistencies prevent existing methods from jointly preserving geometric consistency and photorealism. Unsupervised approaches often exhibit color drift under large viewpoint variations, while supervised low-light enhancement models, though effective for 2D tasks, struggle to generalize to new scenes and typically require retraining. To address this issue, we propose MERID-GS, a Multi-Scale Explicit Retinex Illumination-Decoupled Gaussian framework for low-light 360$^\circ$ synthesis. Based on Retinex theory, the method explicitly separates illumination and reflectance, and suppresses noise propagation while enhancing dark-region structures via a learnable gain and Illumination-State-Guided Frequency Gating. Combined with lightweight Reflection Head and 3D Gaussian Splatting, MERID-GS adapts to new scenes with only a few shots and enables stable low-light novel view synthesis from sparse-view observations. In addition, we construct a low-light multi-view dataset covering full 360$^\circ$ scenes for joint evaluation. Thorough experiments across multiple datasets in this area demonstrate that MERID-GS achieves SOTA performance, exhibiting superior cross-scene generalization and view consistency. The source code and pre-trained models are available at https://github.com/YhuoyuH/MERID-GS..


关键词: Low-Light 3D Gaussian Splatting, Retinex Theory, Novel View Synthesis, Multi-Scale Illumination Decoupling, Few-Shot Learning, 360-Degree Scenes


226. ❌ QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering

作者: Woojun Jung, Junyeong Kim 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24052v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.08.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.05.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出QEVA,一种基于多模态问答的无参考视频摘要评估指标,涉及大语言模型(LLM)用于评估,但核心是评估方法而非LLM技术本身。LLM相关度中等(8分),因为使用LLM但非核心创新;Hallucination Mitigation相关(5分),因为评估事实性;其他关键词如MoE、SLM等均不相关。


!!! tip deepseek-chat TL;DR

QEVA提出一种无需参考摘要的评估指标,通过多模态问答从视频中直接评估摘要的覆盖度、事实性和时序性,实验表明其与人类判断的相关性高于现有方法。
摘要翻译

视频到文本摘要的综合评估方法仍未被充分探索。传统的基于n-gram重叠的指标以及近期基于大语言模型(LLM)的方法严重依赖人工撰写的参考摘要,这限制了其实用性,且对细微语义方面的敏感性不足。本文提出QEVA,一种无参考指标,通过多模态问答直接对照源视频评估候选摘要。QEVA从三个清晰维度评估摘要:覆盖度(Coverage)、事实性(Factuality)和时序性(Chronology)。我们还引入了MLVU(VS)-Eval,一个源自MLVU数据集的新标注基准,包含使用最先进的视频-语言多模态模型从200个视频生成的800条摘要。该数据集为评估建立了透明且一致的框架。实验结果表明,与现有方法相比,QEVA与人工判断的相关性更高,其相关性通过Kendall’s $τ_b$、$τ_c$和Spearman’s $ρ$衡量。我们希望我们的基准和指标能够推动视频到文本摘要研究取得实质性进展,并为未来评估方法的开发提供宝贵见解。


摘要 (Abstract)

Video-to-text summarization remains underexplored in terms of comprehensive evaluation methods. Traditional n-gram overlap-based metrics and recent large language model (LLM)-based approaches depend heavily on human-written reference summaries, limiting their practicality and sensitivity to nuanced semantic aspects. In this paper, we propose QEVA, a reference-free metric evaluating candidate summaries directly against source videos through multimodal question answering. QEVA assesses summaries along three clear dimensions: Coverage, Factuality, and Chronology. We also introduce MLVU(VS)-Eval, a new annotated benchmark derived from the MLVU dataset, comprising 800 summaries generated from 200 videos using state-of-the-art video-language multimodal models. This dataset establishes a transparent and consistent framework for evaluation. Experimental results demonstrate that QEVA shows higher correlation with human judgments compared to existing approaches, as measured by Kendall’s $τ_b$, $τ_c$, and Spearman’s $ρ$. We hope that our benchmark and metric will facilitate meaningful progress in video-to-text summarization research and provide valuable insights for the development of future evaluation methods.


关键词: video summarization, reference-free evaluation, multimodal question answering, coverage, factuality, chronology, LLM-based evaluation


227. ❌ SemiSAM-O1: How far can we push the boundary of annotation-efficient medical image segmentation?

作者: Yichi Zhang, Le Xue, Bichun Xu, Judong Luo, Zhigang Wu, Yu Fu, Zixin Hu, Yuan Cheng, Yuan Qi 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24109v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.05.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文提出SemiSAM-O1,一种基于基础模型(SAM)的极低标注医学图像分割框架。核心是使用一个标注模板,通过特征相似度传播伪标签,并迭代训练与精炼。与关键词的相关性:‘Large Language Models OR LLMs OR Foundation Models’ 高度相关,因为SAM是视觉基础模型;‘Pre-training OR Continual Pre-training OR Domain Adaptation’ 中等相关,因为利用了预训练特征;‘Self-Correction OR Self-Improvement OR Self-Reflection’ 中等相关,因为迭代训练与精炼过程类似自我改进;‘AI for Science OR Bioinformatics OR Cheminformatics’ 高度相关,因为应用于医学图像分割。其他关键词不相关。


!!! tip deepseek-chat TL;DR

SemiSAM-O1利用单个标注模板和基础模型特征,通过迭代伪标签精炼实现极低标注下的医学图像分割,显著缩小与全监督的性能差距。
摘要翻译

半监督学习(SSL)已成为减轻基于深度学习的医学图像分割模型标注负担的一种有前景的解决方案。尽管近期基础模型驱动的SSL研究进展已将边界推至极端有限的标注场景,但在复杂成像模态下,这些方法难以保持稳健的竞争性能。本文提出SemiSAM-O1,一种仅使用单张标注模板图像进行分割的高效标注框架。SemiSAM-O1通过充分挖掘基础模型超越其提示接口的特征表示能力,将专家-通才协作学习框架扩展至极端单标签场景。该框架包含两个阶段:第一阶段中,基础模型的编码器从所有体数据中提取密集特征,基于单张标注模板生成的类别原型通过特征相似性传播至未标注池,以生成粗糙的初始伪标签;第二阶段中,迭代训练与精炼循环通过多轮次逐步提升分割模型与伪标签质量——每轮基于当前伪标签从头训练模型,并生成带有体素级不确定性估计的更新预测。不确定性引导的精炼步骤进一步利用基础模型的全局特征空间,通过聚合高置信度近邻标签来修正高不确定性区域,形成相互改进的良性循环。在涵盖不同模态与解剖目标的多项分割任务上的大量实验表明,SemiSAM-O1显著缩小了单标签半监督学习与全监督学习之间的性能差距,同时大幅降低了在线基础模型推理的计算开销。


摘要 (Abstract)

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to extremely limited annotation scenarios, they fail to maintain robust competitive performance in complex imaging modalities. In this paper, we propose SemiSAM-O1, an annotation-efficient framework using only one annotated template image for segmentation. SemiSAM-O1 extends the specialist-generalist collaborative learning framework to the extreme one-label setting by fully exploiting the foundation model’s feature representation capability beyond its prompting interface. SemiSAM-O1 operates in two stages. In the first stage, the foundation model’s encoder extracts dense features from all volumes, and class prototypes derived from the single annotated template are propagated to the unlabeled pool via feature similarity to produce coarse initial pseudo-labels. In the second stage, an iterative training-and-refinement loop progressively improves both the segmentation model and the pseudo-labels over multiple rounds, where each round trains the model from scratch on current pseudo-labels and generates updated predictions with voxel-wise uncertainty estimates. An uncertainty-guided refinement step further leverages the foundation model’s global feature space to correct high-uncertainty regions by aggregating labels from their most similar confident neighbors, establishing a virtuous cycle of mutual improvement. Extensive experiments on a wide range of segmentation tasks across different modalities and anatomical targets demonstrate that SemiSAM-O1 significantly narrows the performance gap between one-label semi-supervised learning and full supervision, while significantly reducing the computational overhead of online foundation model inference.


关键词: Semi-supervised learning, Medical image segmentation, Foundation model, SAM, Pseudo-label refinement, Uncertainty estimation, Annotation-efficient


228. ❌ Generalising maximum mean discrepancy: kernelised functional Bregman divergences

作者: Russell Tsuchida, Frank Nielsen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24047v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是泛化最大均值差异(MMD)的核化函数Bregman散度,属于核方法和信息几何的理论研究,与给定的大模型、深度学习应用或技术关键词完全无关。所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文将Bregman散度推广到希尔伯特空间中的函数,通过核均值嵌入简化估计,并应用于聚类、鲁棒估计和生成建模。
摘要翻译

布雷格曼散度(Bregman divergences)在统计学、机器学习与计算信息几何中扮演着关键角色。尤其在机器学习领域,它们对聚类、指数族分布、参数估计及优化等问题至关重要。尽管如此,希尔伯特空间(Hilbert spaces)的完整工具集,特别是再生核希尔伯特空间(reproducing kernel Hilbert spaces),尚未被系统性地开发并应用于函数型布雷格曼散度——其中点对象是函数而非有限维参数向量。尽管已有其他类型的函数型布雷格曼散度被研究,但这些通常基于巴拿赫空间(Banach space),而非更直接地契合机器学习中常用的核方法与希尔伯特空间几何。我们考虑希尔伯特空间上的函数型布雷格曼散度,其中自对偶配对(self-dual pairing)与里斯表示定理(Riesz representer)为我们提供了特别便捷的微积分运算。进一步将布雷格曼生成元(Bregman generators)特化为包含核均值嵌入(kernel mean embedding)的复合形式,使得此类散度易于估计。我们讨论了其在聚类、通用估计、稳健估计及生成式建模中的应用,并将我们的方法与其他类型的布雷格曼散度进行了对比。


摘要 (Abstract)

Bregman divergences play a pivotal role in statistics, machine learning and computational information geometry. Particularly in the context of machine learning, they are central to clustering, exponential families, parameter estimation and optimisation, among other things. Despite this, the full toolkit of Hilbert spaces and in particular reproducing kernel Hilbert spaces have not been systematically developed and applied to functional Bregman divergences, where points are functions rather than finite-dimensional parameter vectors. While other types of functional Bregman divergences have been studied, these are typically in a Banach space rather than more directly aligned with kernel methods and Hilbert-space geometry commonly used in machine learning. We consider functional Bregman divergences on a Hilbert space, where the self-dual pairing and Riesz representer afford us particularly convenient calculus. Further specialising Bregman generators as a composition involving a kernel mean embedding makes such divergences easy to estimate. We discuss applications in clustering, universal estimation, robust estimation and generative modelling, and contrast our approach with other types of Bregman divergences.


关键词: Bregman divergences, kernel methods, reproducing kernel Hilbert spaces, maximum mean discrepancy, functional Bregman divergences, kernel mean embedding, clustering, generative modelling


229. ❌ CLLAP: Contrastive Learning-based LiDAR-Augmented Pretraining for Enhanced Radar-Camera Fusion

作者: Bingyi Liu, Chuanhui Zhu, Hongfei Xue, Jian Teng, Jipeng Liu, Enshu Wang, Penglin Dai, Pu Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24044v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.08.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究雷达-相机融合的3D目标检测,利用对比学习和LiDAR数据生成伪雷达数据进行预训练。与关键词’Pre-training’高度相关(8分),因为核心是预训练框架。其他关键词如大模型、MoE、RLHF等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出CLLAP框架,通过对比学习利用LiDAR数据生成伪雷达数据预训练雷达-相机融合模型,显著提升3D目标检测性能。
摘要翻译

精确的三维目标检测对于自动驾驶至关重要,这需要能够在恶劣天气条件下运行的可靠且成本效益高的传感器。摄像头与毫米波雷达融合已成为一种有前景的解决方案;然而,这些方法通常依赖于精细标注的雷达数据,而此类数据稀缺且标注工作劳动密集。为应对这一挑战,我们提出CLLAP——一种基于对比学习的激光雷达增强预训练框架,用于提升现有雷达-摄像头融合方法在三维目标检测中的性能。CLLAP利用丰富的激光雷达数据,通过所提出的L2R(激光雷达转雷达)采样方法生成伪雷达数据。随后,该框架将这些数据融入一种新颖的双阶段、双模态对比学习策略,从而能够从配对的伪雷达与图像数据中进行有效的自监督学习。该方法以即插即用的方式实现对现有雷达-摄像头融合模型的有效预训练,增强其特征提取能力,并提升检测精度与鲁棒性。在NuScenes和Lyft Level 5数据集上的实验结果表明,三个基线模型的性能均获得显著提升,凸显了CLLAP在推动自动驾驶应用中雷达-摄像头融合技术发展方面的有效性。


摘要 (Abstract)

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution; however, these methods often rely on finely annotated radar data, which is scarce and labor-intensive to produce. To address this challenge, we present CLLAP, a Contrastive Learning-based LiDAR-Augmented Pretraining framework that enhances the performance of existing radar-camera fusion methods for 3D object detection. CLLAP leverages abundant LiDAR data to generate pseudo-radar data using the proposed L2R (LiDAR-to-Radar) Sampling method. Then, it incorporates this data into a novel dual-stage, dual-modality contrastive learning strategy, enabling effective self-supervised learning from paired pseudo-radar and image data. This approach facilitates effective pretraining of existing radar-camera fusion models in a plug-and-play manner, enhancing their feature extraction capabilities and improving detection accuracy and robustness. Experimental results using NuScenes and Lyft Level 5 datasets demonstrate significant performance improvements across three baseline models, highlighting CLLAP’s effectiveness in advancing radar-camera fusion for autonomous driving applications.


关键词: Contrastive Learning, LiDAR-Augmented Pretraining, Radar-Camera Fusion, 3D Object Detection, Autonomous Driving, Pseudo-radar Data, Self-supervised Learning


230. ❌ Robust Grounding with MLLMs against Occlusion and Small Objects via Language-guided Semantic Cues

作者: Beomchan Park, Seongho Kim, Hyunjun Kim, Sungjune Park, Yong Man Ro 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24036v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究多模态大语言模型(MLLMs)在拥挤场景中的鲁棒性,特别是针对遮挡和小物体的定位问题。核心创新是使用语言引导的语义线索(LGSCs)来增强视觉语义。与给定的关键词列表相比,论文仅与’Large Language Models’高度相关(MLLMs是LLMs的扩展),其他关键词如MoE、SLMs、Scaling Laws、Pre-training等均未涉及。论文不涉及AI for Science或生物信息学。因此,只有第一个关键词获得高分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文提出了一种利用语言引导语义线索(LGSCs)的方法,通过从多模态大语言模型中提取语义线索并用文本嵌入引导,有效提升了在拥挤场景(遮挡和小物体)中的定位准确性。
摘要翻译

尽管多模态大语言模型(Multimodal Large Language Models, MLLMs)在通用场景中增强了定位能力,但其在拥挤场景中的鲁棒性仍未得到充分探索。拥挤场景包含视觉挑战(即遮挡和小目标),这会损害目标语义并降低定位性能。相比之下,语言表达不受此类退化影响,并能保留目标语义。基于这些观察,我们提出了一种新颖方法,通过利用语言引导的语义线索(Language-Guided Semantic Cues, LGSCs)来克服上述限制。具体而言,我们的方法引入了一个语义线索提取器(Semantic Cue Extractor, SCE),从MLLM的视觉流程中提取目标的语义线索。随后,我们利用相应的文本嵌入来引导这些线索,生成LGSCs作为语言语义先验。接着,这些线索被重新整合到原始视觉流程中,以优化目标语义。大量实验与分析表明,将LGSCs融入MLLM可有效提升拥挤场景中的定位精度。


摘要 (Abstract)

While Multimodal Large Language Models (MLLMs) have enhanced grounding capabilities in general scenes, their robustness in crowded scenes remains underexplored. Crowded scenes entail visual challenges (i.e., occlusion and small objects), which impair object semantics and degrade grounding performance. In contrast, language expressions are immune to such degradation and preserve object semantics. In light of these observations, we propose a novel method that overcomes such constraints by leveraging Language-Guided Semantic Cues (LGSCs). Specifically, our approach introduces a Semantic Cue Extractor (SCE) to derive semantic cues of objects from the visual pipeline of an MLLM. We then guide these cues using corresponding text embeddings to produce LGSCs as linguistic semantic priors. Subsequently, they are reintegrated into the original visual pipeline to refine object semantics. Extensive experiments and analyses demonstrate that incorporating LGSCs into an MLLM effectively improves grounding accuracy in crowded scenes.


关键词: Multimodal Large Language Models, Grounding, Occlusion, Small Objects, Language-Guided Semantic Cues, Crowded Scenes, Semantic Cue Extractor


231. ❌ Breaking the Scalability Limit of Multi-Projector Calibration with Embedded Cameras

作者: Takumi Kawano, Kohei Miura, Daisuke Iwai 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24024v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多投影仪校准的缩放限制,使用嵌入式摄像头实现同时校准,属于计算机视觉和投影显示领域,与任何大模型、深度学习或AI for Science关键词无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出一种通过嵌入式摄像头同时校准多个投影仪的方法,将校准时间从线性减少到常数,突破了多投影仪系统的缩放限制。
摘要翻译

传统多投影仪标定方法需要依次对每台投影仪投射并采集结构光图案,导致标定时间和工作量随投影仪数量线性增长。这一可扩展性瓶颈长期制约着大规模投影映射系统的部署。我们提出一种新型标定框架,通过将相机嵌入标定靶表面突破该限制。嵌入式相机可直接捕获入射投影光线,从而根据入射方向分离多台投影仪同时投射的结构光图案。该方法建立了嵌入式相机光学中心与投影仪像素之间的对应关系,使得所有投影仪的内外参数可同步估计。我们进一步引入针对标定板与相机光学中心微小偏移的校正技术。实验表明,本系统在保持与传统方法相当标定精度的同时,将所需的投影-采集循环次数从线性复杂度降至与投影仪数量无关的近似常数,显著提升了密集多投影仪系统(如高亮度叠加、超分辨率、光场及阴影抑制显示等存在投影重叠区域的场景)的可扩展性。


摘要 (Abstract)

Conventional multi-projector calibration requires projecting and capturing structured light patterns for each projector sequentially, causing calibration time and effort to increase linearly with the number of projectors. This scalability bottleneck has long limited the deployment of large-scale projection mapping systems. We present a new calibration framework that breaks this limitation by embedding cameras into the surface of the calibration target. The embedded cameras directly capture the incoming projection light, enabling the separation of simultaneously projected structured light patterns from multiple projectors according to their incident directions. Our method establishes correspondences between the optical centers of the embedded cameras and the projector pixels, allowing the intrinsic and extrinsic parameters of all projectors to be simultaneously estimated. We further introduce a correction technique for small misalignments between the calibration board and camera optical centers. As a result, our system achieves calibration accuracy comparable to conventional methods while reducing the required number of projection-capture cycles from linear to nearly constant with respect to the number of projectors, dramatically improving scalability for dense multi-projector systems with overlapping projection regions, such as high-brightness stacking, super-resolution, light-field, and shadow-suppression displays.


关键词: multi-projector calibration, embedded cameras, scalability, structured light, projection mapping, simultaneous calibration


232. ❌ JSSFF: A Joint Structural-Semantic Fusion Framework for Remote Sensing Image Captioning

作者: Swadhin Das, Vivek Yadav 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24031v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究遥感图像描述,提出边缘感知融合框架,属于计算机视觉和图像描述领域,与给定的大模型、深度学习技术原理创新(如LLM、MoE、RLHF等)以及AI for Science(生物信息学、化学信息学)均无直接关联。论文未涉及任何大模型或深度学习技术原理创新,也未应用于科学领域,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种联合结构-语义融合框架(JSSFF),通过边缘感知融合和比较波束搜索提升遥感图像描述的准确性。
摘要翻译

编码器-解码器框架如今已广泛流行。在该模型中,编码器从输入图像中提取信息丰富的视觉特征,解码器则采用序列到序列(sequence-to-sequence)的公式化方法,基于这些特征生成对应的文本描述。现有模型更多地关注决策部分。然而,从图像中提取有意义的信息,能够通过提供关于物体及其关系的信息,帮助解码器生成准确的描述。遥感图像具有高度复杂性。其中一个主要挑战是检测因遮挡、结构重叠及边缘模糊而超出其可见边界的物体。因此,有必要设计一种能够有效捕捉高层语义与低层空间细节的方法,以实现准确的描述生成。在本工作中,我们提出了一种边缘感知融合方法,通过将原始图像及其边缘感知版本融入编码器,以增强特征表示与边界感知能力。我们采用基于比较的束搜索(comparison-based beam search, CBBS)来生成描述,通过对候选描述进行基于公平性的比较,在定量指标与定性描述相关性之间实现平衡折中。实验结果表明,我们的模型在定量与定性方面均优于多个基线模型。


摘要 (Abstract)

The encoder-decoder framework has become widely popular nowadays. In this model, the encoder extracts informative visual features from an input image, and the decoder employs a sequence-to-sequence formulation to generate the corresponding textual description from these features. The existing models focus more on the decision part. However, extracting meaningful information from the image can help the decoder generate an accurate caption by providing information about the objects and their relationship. Remote sensing images are highly complex. One major challenge is detecting objects that extend beyond their visible boundaries due to occlusion, overlapping structures, and unclear edges. Hence, there is a need to design an approach that can effectively capture both high-level semantics and low-level spatial details for accurate caption generation. In this work, we have proposed an edge-aware fusion method by incorporating the original image and its edge-aware version into the encoder to enhance feature representation and boundary awareness. We used a comparison-based beam search (CBBS) to generate captions to achieve a balanced trade-off between quantitative metrics and qualitative caption relevance through fairness-based comparison of candidate captions. Experimental results demonstrate our model’s superiority over several baseline models in quantitative and qualitative perspectives.


关键词: Remote Sensing Image Captioning, Edge-aware Fusion, Encoder-Decoder, Beam Search, Feature Representation, Boundary Awareness


233. ❌ ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services

作者: Fengxian Ji, Jingpu Yang, Zirui Song, Lang Gao, Junhong Liang, Zhenhao Chen, Jinghui Zhang, Xiuying Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24023v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注图像生成和编辑模型的商业价值评估,提出了一个包含数据集、评分系统和支付预测模型的基准。虽然涉及深度学习模型(图像生成模型),但未提及大语言模型、混合专家、小语言模型、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、KV缓存、思维链、系统2思维、MCTS、自我修正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习或AI for Science等关键词。因此所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

ServImage是一个从真实商业成像服务中构建的图像生成和编辑基准,通过数据集、评分系统和支付预测模型来评估模型的商业可行性。
摘要翻译

近期,图像生成与编辑模型在学术基准测试中展现出强大的指令遵循能力与高视觉质量。然而,其在真实付费商业设计项目中的表现仍不确定。我们提出 \textbf{ServImage},一个将模型输出与商业设计项目经济价值明确关联的基准。ServImage 包含:(i) \textbf{\textit{ServImageBench}}:一个包含1.07k个付费商业设计任务与2.05k份设计师交付成果的数据集,总价值超过29.5万美元,涵盖人像、产品及数字内容,并附带3.3万张候选图像与3.3万条人工标注。(ii) \textbf{\textit{ServImageScore}}:一个整合评分系统,结合三个质量维度:基线需求满足度、视觉执行质量与商业必要性满意度。这三个维度旨在刻画驱动人类付费决策的因素,并指示图像是否具有商业可接受性。(iii) \textbf{\textit{ServImageModel}}:在该评分体系下,我们提出一个基于人工标注候选图像训练的付费预测模型,在预测人类付费决策时达到82.00%的准确率,并输出校准后的付费概率。ServImage 为评估图像生成模型的商业可行性提供了全面基础,并为未来基于经济价值的视觉系统研究提供了可扩展的资源 \href{https://github.com/FengxianJi/ServImage}{Github}。


摘要 (Abstract)

Recent image generation and editing models demonstrate robust adherence to instructions and high visual quality on academic benchmarks. However, their performance on paid, real-world design projects remains uncertain. We introduce \textbf{ServImage}, a benchmark that explicitly correlates model outputs with economic value in commercial design projects. ServImage consists of (i) \textbf{\textit{ServImageBench}}: a dataset of 1.07k paid commercial design tasks and 2.05k designer deliverables totaling over $295k, covering portrait, product, and digital content, along with 33k candidate images and 33k human annotations. (ii) \textbf{\textit{ServImageScore}}: an integrated scoring system that combines three quality dimensions: baseline requirements fulfilment, visual execution quality, and commercial necessity satisfaction. These three dimensions are designed to characterize the factors that drive human payment decisions and indicate whether an image is commercially acceptable. (iii) \textbf{\textit{ServImageModel}}: under this scoring system, we propose a payment prediction model trained on the human-annotated candidate images, achieving 82.00% accuracy in predicting human payment decisions and producing calibrated payment probabilities. ServImage provides a comprehensive foundation for assessing the commercial viability of image generation models and offers a scalable resource for future research on economically grounded vision systems \href{https://github.com/FengxianJi/ServImage}{Github.}


关键词: Image Generation, Image Editing, Benchmark, Commercial Design, Payment Prediction, Human Annotations, Economic Value


234. ❌ Shared-kernel Wavelet Neural Networks for Poisson Image Reconstruction

作者: Yuanhao Gong, Tan Tang, Qianyan Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24000v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是基于小波神经网络的泊松图像重建,涉及图像处理、稀疏表示和神经网络,但完全不涉及大模型、深度学习技术原理创新或AI for Science(生物/化学信息学)。关键词均与论文无关,故所有评分为0。


!!! tip deepseek-chat TL;DR

论文提出一种共享核小波神经网络用于从稀疏拉普拉斯场重建图像,具有极低参数量和线性计算复杂度,实现实时高精度重建。
摘要翻译

拉普拉斯算子将图像转换为其拉普拉斯场(Laplacian field),该场通常是稀疏的且服从稳定分布。另一方面,通过求解具有适当边界条件的泊松方程(Poisson equation),可以从拉普拉斯场唯一地重建图像,这种唯一性在数学上是有保证的。基于这些特性,我们提出使用稀疏拉普拉斯场来表示图像。我们首先在数百张图像上证明了拉普拉斯场是稀疏的且服从稳定分布。接着,我们展示了图像可以从其拉普拉斯场中精确重建。针对重建任务,我们提出了一种共享核小波神经网络(shared-kernel wavelet neural network),该网络用于求解泊松方程,并具有三个优势:第一,其参数量少于{\bf 0.0002M},足够紧凑以适用于大多数设备;第二,它具有线性计算复杂度,可实现实时重建;第三,它比以往方法具有更高的精度。通过多项数值实验,验证了稀疏拉普拉斯场及所提泊松求解器的有效性与高效性。所提方法可广泛应用于图像压缩、低光照增强、目标跟踪等领域。


摘要 (Abstract)

The Laplacian operator transforms the image into its Laplacian field, which usually is sparse and satisfies a stable distribution. On the other hand, an image can be uniquely reconstructed from its Laplacian field via solving a Poisson equation with a proper boundary condition. Such uniqueness is mathematically guaranteed. Thanks to these properties, we propose to use the sparse Laplacian field to present the image. We first show that the Laplacian field is sparse and satisfies a stable distribution on hundreds images. Then, we show that the image can be accurately reconstruct from its Laplacian field. For the reconstruction task, we propose a shared-kernel wavelet neural network, which solves the Poisson equation and has three advantages. First, it has less than {\bf 0.0002M} parameters, which is compact enough for most of devices. Second, it has linear computation complexity, leading to a real-time reconstruction. Third, it achieves higher accuracy than previous methods. Several numerical experiments are conducted to show the effectiveness and efficiency of the sparse Laplacian field and the proposed Poisson solver. The proposed method can be applied in a large range of applications such as image compression, low light enhancement, object tracking, etc.


关键词: Poisson equation, image reconstruction, Laplacian field, wavelet neural network, shared kernel, sparse representation, real-time


235. ❌ FlashOverlap: Minimizing Tail Latency in Communication Overlap for Distributed LLM Training

作者: Rezaul Karim, Austin Wen, Wang Zongzuo, Weiwei Zhang, Yang Liu, Walid Ahmed 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24013v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注分布式LLM训练中的通信重叠技术,核心是减少尾延迟。与’Large Language Models’高度相关(10分),因为直接针对LLM训练优化。其他关键词如’Mixture of Experts’、‘Pre-training’等均未涉及,故评0分。


!!! tip deepseek-chat TL;DR

该论文提出FlashOverlap方法,通过分解集体通信为点对点通信并调度分区计算,消除了分布式LLM训练中通信重叠的尾延迟,提升了模型FLOPS利用率和吞吐量。
摘要翻译

大型语言模型规模的快速增长,使得计算工作负载必须跨加速器(如GPU、TPU和NPU)进行划分。然而,这些并行化策略会带来大量数据通信开销,显著阻碍计算效率。尽管通信-计算重叠是一个有前景的方向,但现有基于数据切分的解决方案存在尾部延迟问题。为克服这一局限,本研究提出一种新型通信-计算重叠技术,以消除当前最先进的分布式大语言模型训练重叠方法中的尾部延迟。该技术旨在有效缓解分布式训练与推理中张量并行和数据并行的通信瓶颈。具体而言,我们提出一种名为Flash-Overlap的新方法,该方法将传统的reduce-scatter和all-gather集合操作替换为分解的点对点(P2P)通信,并调度划分后的计算任务以实现细粒度重叠。我们的方法提供了一种精确的算法来减少通信开销,从而消除尾部延迟。此外,它提供了一种通用解决方案,兼容数据并行训练及多种张量级并行策略,包括TPSP和UP。实验评估表明,我们的技术始终能实现更低的延迟、更优的模型浮点运算利用率(MFU)以及高吞吐量。


摘要 (Abstract)

The rapid growth in the size of large language models has necessitated the partitioning of computational workloads across accelerators such as GPUs, TPUs, and NPUs. However, these parallelization strategies incur substantial data communication overhead significantly hindering computational efficiency. While communication-computation overlap presents a promising direction, existing data slicing based solutions suffer from tail latency. To overcome this limitation, this research introduces a novel communication-computation overlap technique to eliminate this tail latency in state of the art overlap methods for distributed LLM training. The aim of this technique is to effectively mitigate communication bottleneck of tensor parallelism and data parallelism for distributed training and inference. In particular, we propose a novel method termed Flash-Overlap that replaces conventional collective operations of reduce-scatter and all-gather with decomposed peer-to-peer (P2P) communication and schedules partitioned computations to enable fine-grained overlap. Our method provides an exact algorithm for reducing communication overhead that eliminates tail latency. Moreover, it presents a versatile solution compatible with data-parallel training and various tensor-level parallelism strategies, including TPSP and UP. Experimental evaluations demonstrate that our technique consistently achieves lower latency, superior Model FLOPS Utilization (MFU), and high throughput.


关键词: distributed LLM training, communication-computation overlap, tail latency, reduce-scatter, all-gather, peer-to-peer communication, tensor parallelism, data parallelism


236. ❌ SMoES: Soft Modality-Guided Expert Specialization in MoE-VLMs

作者: Zi-Hao Bo, Yaqian Li, Anzhou Hou, Rinyoichi Takezoe, Ertao Zhao, Tianxiang Pan, Jiale Yan, Mo Guang, Kaiwen Long 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23996v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.015.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究MoE在视觉语言模型中的应用,提出软模态引导的专家专业化方法。与’Mixture of Experts’高度相关(15分),因为MoE是核心主题;与’Large Language Models’相关(10分),因为VLMs包含LLM组件,但主要聚焦视觉语言;其他关键词如PEFT、RAG等均不涉及。


!!! tip deepseek-chat TL;DR

该论文提出软模态引导的专家专业化方法(SMoES),通过动态模态分数和互信息正则化优化MoE-VLM中的路由,在16个基准上平均提升多模态任务0.9%、语言任务4.2%,并减少56.1%的通信开销。
摘要翻译

混合专家模型(Mixture-of-Experts, MoE)已成为大型视觉-语言模型(large vision-language models, VLMs)的流行骨干架构,然而,模态特定信号应如何引导专家路由这一问题仍未得到充分探索。现有路由策略要么是手工设计的,要么是模态无关的,它们依赖于理想化的先验假设,忽略了MoE-VLM中与层相关的模态融合模式,且对专家专业化提供的指导甚少。我们提出软模态引导的专家专业化(Soft Modality-guided Expert Specialization, SMoES),该方法包括:捕捉与层相关融合模式的动态软模态分数、与专家并行部署对齐的专家分箱机制,以及鼓励连贯模态专业化的箱间互信息正则化。我们的方法利用基于注意力或高斯统计的模态分数来优化互信息正则化。在四种基于MoE的VLM和16个基准测试上的实验表明,该方法在有效性和效率上均有提升:在多模态任务和纯语言任务上平均增益分别为0.9%和4.2%,专家并行(EP)通信开销降低56.1%,实际部署下吞吐量提升12.3%。这些结果验证了将路由与模态感知的专家专业化对齐能够释放MoE-VLM的容量与效率。


摘要 (Abstract)

Mixture-of-Experts (MoE) has become a prevalent backbone for large vision-language models (VLMs), yet how modality-specific signals should guide expert routing remains under-explored. Existing routing strategies are either hand-crafted or modality-agnostic, relying on idealized priors that ignore the layer-dependent modality fusion patterns in MoE-VLMs and provide little guidance for expert specialization. We propose Soft Modality-guided Expert Specialization (SMoES), which consists of dynamic soft modality scores that capture layer-dependent fusion patterns, an expert binning mechanism aligned with expert-parallel deployment, and an inter-bin mutual information regularization that encourages coherent modality specialization. Our method leverages attention-based or Gaussian-statistics modality scores to optimize mutual information regularization. Experiments across four MoE-based VLMs and 16 benchmarks demonstrate improvement on both effectiveness and efficiency: 0.9% and 4.2% average gain on multimodal and language-only tasks, 56.1% reduction in EP communication overhead, and 12.3% throughput improvement under realistic deployment. These results validate that aligning routing with modality-aware expert specialization unlocks MoE-VLM capacity and efficiency.


关键词: Mixture-of-Experts, Vision-Language Models, Expert Specialization, Modality Guidance, Routing, Mutual Information Regularization, Efficiency


237. ❌ Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysis

作者: Xuemei Qiu, Dawei Fan, Yebin Huang, Yanping Chen, Lifang Wei 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23982v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.08.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.05.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注数字病理学中的多实例学习,提出HPDP框架,使用LLM生成描述进行跨模态对齐,属于AI for Science(生物信息学)领域,相关度10分。LLM作为辅助工具,相关度8分。模型具有一定可解释性(原型系统),相关度5分。其他关键词如MoE、SLM、预训练、微调、RAG、推理、智能体、量化、压缩、幻觉、世界模型、模型合并、上下文学习等均不涉及。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于层次原型域先验的多实例学习框架HPDP,利用LLM生成的描述进行跨模态对齐,在七个癌症数据集上实现了最先进的诊断和预后性能,并增强了可解释性。
摘要翻译

数字病理学通过实现对十亿像素级全切片图像(Whole Slide Images, WSIs)的计算分析,从根本上改变了诊断工作流程,然而有效解读其复杂的肿瘤微环境仍是一项艰巨挑战。现有的多实例学习(Multiple Instance Learning, MIL)框架通常将全切片图像视为无结构的图块集合,忽略了关键的形态学语义与空间几何结构。这种归纳偏置的缺失常导致模型对背景噪声过拟合,且无法将视觉特征与高层次诊断知识对齐。为克服这些局限,我们提出基于层级原型的领域先验(Hierarchical Prototype-based Domain Priors, HPDP)框架——一种用于联合组织病理学诊断与预后的统一多模态方法。HPDP通过引入形态锚定原型系统(Morphologically Anchored Prototype System, MAPS)将学习过程锚定于可解释的形态聚类,并采用正弦位置编码器(Sinusoidal Positional Encoder, SPE)显式建模组织结构,从而缓解数据驱动的“黑箱”问题。此外,我们借助层级跨模态对齐(Hierarchical Cross-Modal Alignment, HCMA)模块,利用大语言模型(Large Language Model, LLM)生成的描述对视觉表征进行上下文精细化调整,以此弥合语义鸿沟。在七个癌症队列上的大量实验表明,HPDP持续实现了最先进的性能,并展现出卓越的鲁棒性与可解释性。


摘要 (Abstract)

Digital pathology has fundamentally altered diagnostic workflows by enabling the computational analysis of gigapixel Whole Slide Images (WSIs), yet effectively deciphering their complex tumor microenvironments remains a formidable challenge. Existing Multiple Instance Learning (MIL) frameworks typically treat Whole Slide Images as unstructured bags of patches, discarding critical morphological semantics and spatial geometry. This lack of inductive bias often leads to overfitting on background noise and fails to align visual features with high-level diagnostic knowledge. To overcome these limitations, we propose the Hierarchical Prototype-based Domain Priors (HPDP) framework, a unified multimodal approach for joint histopathology diagnosis and prognosis. HPDP mitigates the data-driven “black box” issue by introducing a Morphologically Anchored Prototype System (MAPS), which anchors learning to interpretable morphological clusters, and a Sinusoidal Positional Encoder (SPE) to explicitly model tissue architecture. Furthermore, we bridge the semantic gap via a Hierarchical Cross-Modal Alignment (HCMA) module, using Large Language Model (LLM)-generated descriptions to contextually refine visual representations. Extensive experiments across seven cancer cohorts demonstrate that HPDP consistently achieves state-of-the-art performance with superior robustness and interpretability.


关键词: Multiple Instance Learning, Whole Slide Images, Hierarchical Prototype, Domain Priors, Large Language Model, Cross-Modal Alignment, Histopathology, Interpretability


238. ❌ Multi-View Synergistic Learning with Vision-Language Adaption for Low-Resource Biomedical Image Classification

作者: Xiaoliu Luo, Minxue Xiao, Ting Xie, Mengzhu Wang, Huiqing Qi, Joey Tianyi Zhou, Taiping Zhang, Xu Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23977v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.06.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.05.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.010.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文聚焦于低资源生物医学图像分类,使用视觉-语言模型(VLM)进行参数高效微调(PEFT),并利用大语言模型(LLM)生成结构化监督。关键词’PEFT OR LoRA OR Parameter-efficient Fine-tuning’高度相关(10分),因为核心是参数高效微调;‘AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分),因为应用于生物医学领域;‘Large Language Models OR LLMs OR Foundation Models’相关(6分),因为使用了LLM生成监督但非核心;‘Pre-training OR Continual Pre-training OR Domain Adaptation’部分相关(5分),涉及领域适应但非重点。其余关键词无关。


!!! tip deepseek-chat TL;DR

该论文提出多视图协同学习框架(MVSL),通过参数高效微调、多粒度对比学习和LLM引导的结构化监督,在低资源生物医学图像分类中显著提升少样本和零样本性能。
摘要翻译

在低资源条件下,由于标注数据有限、类别间视觉差异细微以及疾病语义复杂,准确的生物医学图像分类仍面临挑战。尽管视觉-语言模型为缓解数据稀缺提供了有前景的基础,但其在生物医学场景中的有效适配受到参数高效微调与细粒度、语义一致表示学习需求的制约。本文提出多视图协同学习(Multi-View Synergistic Learning, MVSL),这是一个统一框架,通过联合考虑适配范式、表示粒度与疾病语义关系来应对上述挑战。MVSL将视觉与文本编码器的适配过程解耦,以尊重其各自不同的表征特性,从而实现更稳定且高效的参数高效微调。该框架进一步引入多粒度对比学习,显式建模全局图像语义与局部病灶级证据,提升了对视觉相似疾病类别的细粒度判别能力。此外,MVSL通过融入由大语言模型导出的结构化监督信息,在类别层级约束文本表征,并借助跨模态对齐间接规整视觉嵌入,从而保留疾病级语义结构。这些组件共同实现了在有限监督下更稳定的跨模态对齐与更强的判别能力。在涵盖9种成像模态、10个解剖区域的11个公开生物医学数据集上的大量实验表明,MVSL在少样本与零样本分类场景中均持续优于现有最先进方法。


摘要 (Abstract)

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision–language models offer a promising foundation for mitigating data scarcity, their effective adaptation in biomedical settings is constrained by the need for parameter-efficient tuning alongside fine-grained and semantically consistent representation learning. In this work, we propose Multi-View Synergistic Learning (MVSL), a unified framework that addresses these challenges by jointly considering adaptation paradigms, representation granularity, and disease semantic relationships. MVSL decouples the adaptation of visual and textual encoders to respect their distinct representational characteristics, enabling more stable and effective parameter-efficient fine-tuning. It further introduces multi-granularity contrastive learning to explicitly model both global image semantics and localized lesion-level evidence, improving fine-grained discrimination for visually similar disease categories. In addition, MVSL preserves disease-level semantic structure by incorporating structured supervision derived from large language models, which constrains textual representations at the class level and indirectly regularizes visual embeddings through cross-modal alignment. Together, these components enable more stable cross-modal alignment and improved discrimination under limited supervision. Extensive experiments on $11$ public biomedical datasets spanning $9$ imaging modalities and $10$ anatomical regions demonstrate that MVSL consistently outperforms state-of-the-art methods in few-shot and zero-shot classification settings.


关键词: Multi-View Synergistic Learning, Vision-Language Models, Parameter-Efficient Fine-Tuning, Biomedical Image Classification, Low-Resource Learning, Contrastive Learning, Large Language Models


239. ❌ LLM-Guided Agentic Floor Plan Parsing for Accessible Indoor Navigation of Blind and Low-Vision People

作者: Aydin Ayanzadeh, Tim Oates 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23970v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.08.0/100.0
LLM Agents0.010.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.010.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文核心是使用LLM驱动的多智能体框架解析楼层平面图,生成导航指令。关键词’Large Language Models’、‘LLM Agents’、‘Multi-agent Systems’高度相关(10分),因为系统由多个LLM智能体组成并协作。‘Self-Correction’相关(8分),因为包含自纠正管道和迭代重试。其他关键词如MoE、SLM、Scaling等不相关(0分)。


!!! tip deepseek-chat TL;DR

该论文提出一个基于LLM的多智能体框架,通过解析楼层平面图生成结构化知识库,为盲人和低视力人群提供安全、可扩展的室内导航指令,在真实建筑上优于单次调用基线。
摘要翻译

室内导航对于盲人和低视力(BLV)群体而言仍是一项关键的可访问性挑战,因为现有解决方案依赖于成本高昂的每栋建筑基础设施。我们提出了一种智能体框架,该框架可将单张楼层平面图转换为结构化、可检索的知识库,从而以轻量级基础设施生成安全、可访问的导航指令。该系统包含两个阶段:一个多智能体模块,通过带有迭代重试循环和纠正性反馈的自校正流水线,将楼层平面图解析为空间知识图谱;以及一个路径规划器,用于生成可访问的导航指令,并配备安全评估智能体对每条路线上的潜在危险进行评估。我们在真实的UMBC数学与心理学大楼(MP-1和MP-3楼层)以及CVC-FP基准数据集上对该系统进行了评估。在MP-1楼层上,针对短、中、长路线,我们分别实现了92.31%、76.92%和61.54%的成功率,优于最强的单次调用基线(Claude 3.7 Sonnet)的84.62%、69.23%和53.85%。在MP-3楼层上,我们达到了76.92%、61.54%和38.46%的成功率,而最佳基线仅为61.54%、46.15%和23.08%。这些结果表明,相较于单次调用的大语言模型(LLM)基线,我们的方法取得了持续改进,并证明该工作流是一种可扩展的解决方案,能够为BLV群体提供可访问的室内导航。


摘要 (Abstract)

Indoor navigation remains a critical accessibility challenge for the blind and low-vision (BLV) individuals, as existing solutions rely on costly per-building infrastructure. We present an agentic framework that converts a single floor plan image into a structured, retrievable knowledge base to generate safe, accessible navigation instructions with lightweight infrastructure. The system has two phases: a multi-agent module that parses the floor plan into a spatial knowledge graph through a self-correcting pipeline with iterative retry loops and corrective feedback; and a Path Planner that generates accessible navigation instructions, with a Safety Evaluator agent assessing potential hazards along each route. We evaluate the system on the real-world UMBC Math and Psychology building (floors MP-1 and MP-3) and on the CVC-FP benchmark. On MP-1, we achieve success rates of 92.31%, 76.92%, and 61.54% for short, medium, and long routes, outperforming the strongest single-call baseline (Claude 3.7 Sonnet) at 84.62%, 69.23%, and 53.85%. On MP-3, we reach 76.92%, 61.54%, and 38.46%, compared to the best baseline at 61.54%, 46.15%, and 23.08%. These results show consistent gains over single-call LLM baselines and demonstrate that our workflow is a scalable solution for accessible indoor navigation for BLV individuals.


关键词: LLM Agents, Multi-agent Systems, Floor Plan Parsing, Indoor Navigation, Self-Correction, Accessibility, Spatial Knowledge Graph


240. ❌ Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Unified and Generalized Approach

作者: Jiebin Yan, Kangcheng Wu, Jingwen Hou, Jiayu Zhang, Pengfei Chen, Yuming Fang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23953v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是盲全景图像质量评估(BOIQA),提出了一种无需视口生成的统一方法,属于计算机视觉和图像处理领域,与给定的大模型、深度学习技术原理或AI for Science关键词完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种无需视口生成的盲全景图像质量评估方法,将BOIQA简化为盲平面图像质量评估问题,实现了统一性和泛化性。
摘要翻译

盲全向图像质量评估(BOIQA)因存储格式不同及用户观看行为的多样性,对视觉质量评估领域构成了重大挑战。BOIQA模型的主要范式包括两个步骤,即视口生成与质量预测,这带来了额外的计算负担,且难以推广至其他视觉内容(如二维平面图像)。为此,本文尝试解决这些问题。首先,我们通过实验发现,BOIQA可被建模为盲(二维平面)图像质量评估(BIQA)问题,即不再需要第一步——视口生成,从而缩小了BOIQA与BIQA之间的天然差距。随后,我们提出了一种新的BOIQA方法,该方法具有三大优点:即无视口依赖——可直接接受广泛使用的等距柱状投影格式的全向图像作为输入,无需任何变换;统一性——该方法同样适用于BIQA;以及泛化性——相较于其他竞争方法展现出更优的泛化能力。最后,我们通过留出测试、跨数据库验证以及成熟的gMAD竞赛验证了其应用前景。


摘要 (Abstract)

Blind omnidirectional image quality assessment (BOIQA) presents a great challenge to the visual quality assessment community, due to different storage formats and diverse user viewing behaviors. The main paradigm of BOIQA models includes two steps, ie, viewport generation, and quality prediction, which brings an extra computational burden and is hard to generalize to other visual contents (eg, 2D planar image). Thus, in this paper, we make an attempt to solve these issues. First, we experimentally find that BOIQA can be formulated as a blind (2D planar) image quality assessment (BIQA) problem, ie, the first step - viewport generation - is no longer needed, which narrows the natural gap between BOIQA and BIQA. Then, we present a new BOIQA approach, which has three merits: ie, viewport-unaware - it accepts an omnidirectional image in the widely used equirectangular projection format as input without any transformation; unified - it can also be applied to BIQA; and generalized - it shows better generalizability against other competitors. Finally, we validate its promise by held-out test, cross-database validation, and the well-established gMAD competition.


关键词: Blind Omnidirectional Image Quality Assessment, Viewport-Unaware, Equirectangular Projection, Generalization, Unified Model, BIQA


241. ❌ LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localization

作者: Bokang Zeng, Zheng Gao, Xiaoyu Li, Xiaoyan Feng, Jiaojiao Jiang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23957v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是音频-视觉水印融合框架用于深度伪造检测和定位,不涉及大模型、深度学习技术原理创新或科学应用。所有关键词均与论文主题无关,因此评分为0。


!!! tip deepseek-chat TL;DR

LAVA提出了一种分层音频-视觉防篡改水印框架,通过跨模态融合和校准对齐,在压缩和多模态异步条件下实现鲁棒的深度伪造检测和定位。
摘要翻译

主动水印技术为短视频深度伪造篡改检测与定位提供了一种有前景的方法。然而,现有方法通常将音频与视觉证据解耦,并假设水印信号在真实场景退化条件下仍保持可靠,这使得篡改定位容易受到多模态错位及压缩失真的影响。此外,现有的半脆弱视觉水印方法在编解码压缩下性能显著下降,其原因在于其嵌入频带与压缩敏感频率区域存在重叠。为解决上述局限,我们提出分层式音视频防篡改水印(Layered Audio-Visual Anti-tampering Watermarking, LAVA),一种面向深度伪造篡改检测与定位的校准感知音视频水印融合框架。LAVA通过跨模态水印融合与校准感知对齐,在压缩及音视频异步条件下保持一致且可靠的篡改证据,从而实现鲁棒的篡改定位。大量实验表明,LAVA达到了近乎完美的检测性能(AP = 0.999),对压缩与多模态错位保持鲁棒性,并显著提升了现有音视频融合基线方法的篡改定位可靠性。


摘要 (Abstract)

Proactive watermarking offers a promising approach for deepfake tamper detection and localization in short-form videos. However, existing methods often decouple audio and visual evidence and assume that watermark signals remain reliable under real-world degradations, making tamper localization vulnerable to multimodal misalignment and compression distortions. Moreover, existing semi-fragile visual watermarking methods often degrade significantly under codec compression because their embedding bands overlap with compression-sensitive frequency regions. To address these limitations, we propose Layered Audio-Visual Anti-tampering Watermarking (LAVA), a calibration-aware audio-visual watermark fusion framework for deepfake tamper detection and localization. LAVA leverages cross-modal watermark fusion and calibration-aware alignment to preserve consistent and reliable tamper evidence under compression and audio-visual asynchrony, enabling robust tamper localization. Extensive experiments demonstrate that LAVA achieves near-perfect detection performance (AP = 0.999), remains robust to compression and multimodal misalignment, and significantly improves tamper localization reliability over existing audio-visual fusion baselines.


关键词: audio-visual watermarking, deepfake detection, tamper localization, cross-modal fusion, calibration-aware alignment, compression robustness


242. ❌ LearnPruner: Rethinking Attention-based Token Pruning in Vision Language Models

作者: Rinyoichi Takezoe, Yaqian Li, Zihao Bo, Anzhou Hou, Mo Guang, Kaiwen Long 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23950v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究视觉语言模型中的token剪枝,核心涉及LLM(作为VLM的文本处理部分)和注意力机制分析。虽然主要关注视觉token剪枝,但直接使用了LLM的注意力进行剪枝指导,因此与’Large Language Models’高度相关。其他关键词如MoE、SLM、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

论文提出LearnPruner,通过分析视觉编码器和LLM中的注意力机制,设计两阶段token剪枝框架,在仅保留5.5%视觉token的情况下保持95%性能并实现3.2倍加速。
摘要翻译

视觉-语言模型(Vision-Language Models, VLMs)近年来在视觉理解与推理方面展现出卓越能力,但由于需要处理长视觉序列输入,也带来了显著的计算负担。近期研究通过剪除不重要的视觉令牌来解决这一问题,在保持模型性能的同时大幅降低计算量。令牌剪枝的核心在于确定令牌重要性,当前方法主要依赖视觉编码器或大语言模型(Large Language Models, LLMs)的注意力分数。本文分析了视觉编码器与大语言模型中注意力机制的有效性。我们发现,视觉编码器存在注意力汇聚(attention sink)问题,导致对信息丰富的前景区域关注不足;而在大语言模型中,尽管先前研究已指出注意力存在对令牌位置的偏向,但文本到视觉的注意力展现出对这种偏向的抵抗能力,并能在中间层提供有效的剪枝指导。基于这些观察,我们提出LearnPruner——一种两阶段令牌剪枝框架:首先通过视觉编码器后的可学习剪枝模块移除冗余视觉令牌,随后在大语言模型的中间层仅保留与任务相关的令牌。实验结果表明,我们的LearnPruner在使用仅5.5%视觉令牌的情况下,能保留约95%的原始性能,并实现3.2倍的推理加速,展现出优越的精度-效率平衡。


摘要 (Abstract)

Vision-Language Models (VLMs) have recently demonstrated remarkable capabilities in visual understanding and reasoning, but they also impose significant computational burdens due to long visual sequence inputs. Recent works address this issue by pruning unimportant visual tokens, achieving substantial computational reduction while maintaining model performance. The core of token pruning lies in determining token importance, with current approaches primarily relying on attention scores from vision encoders or Large Language Models (LLMs). In this paper, we analyze the effectiveness of attention mechanisms in both vision encoders and LLMs. We find that vision encoders suffer from attention sink, leading to poor focus on informative foreground regions, while in LLMs, although prior studies have identified attention bias toward token positions, text-to-vision attention demonstrates resistance to this bias and enables effective pruning guidance in middle layers. Based on these observations, we propose LearnPruner, a two-stage token pruning framework that first removes redundant vision tokens via a learnable pruning module after the vision encoder, then retains only task-relevant tokens in the LLM’s middle layer. Experimental results show that our LearnPruner can preserve approximately 95% of the original performance while using only 5.5% of vision tokens, and achieve 3.2$\times$ inference acceleration, demonstrating a superior accuracy-efficiency trade-off.


关键词: Vision-Language Models, Token Pruning, Attention Sink, Learnable Pruning, Inference Acceleration, Visual Token Reduction


243. ❌ GoClick: Lightweight Element Grounding Model for Autonomous GUI Interaction

作者: Hongxin Li, Yuntao Chen, Zhaoxiang Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23941v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.010.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.08.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出GoClick,一种轻量级GUI元素定位模型,核心关注小模型(230M参数)在设备端的高效部署,与’Small Language Models’高度相关(10分)。同时,该模型用于GUI代理,与’LLM Agents’相关(8分)。其他关键词如大模型、MoE、预训练等均不涉及。


!!! tip deepseek-chat TL;DR

GoClick通过编码器-解码器架构和数据精炼,以230M参数实现了与大型VLM相当的GUI元素定位精度,适用于设备端代理。
摘要翻译

图形用户界面(GUI)元素定位(即根据自然语言指令在截图中精确定位元素)是GUI智能体与界面交互的基础。在手机等资源受限设备上直接部署该能力,对于需要低延迟的GUI智能体而言日益关键。然而,这一目标面临重大挑战:当前视觉定位方法通常采用大型视觉语言模型(VLM)(参数超过25亿),受限于内存和计算约束,难以在设备端执行。为解决此问题,本文提出GoClick——一种仅含2.3亿参数的轻量级GUI元素定位VLM,其视觉定位精度优异,甚至可与规模显著更大的模型相媲美。直接缩小现有仅解码器VLM是设计轻量模型的直观途径,但实验表明该方法效果欠佳。我们转而选择编码器-解码器架构,在GUI定位任务的小参数量级下,该架构优于仅解码器方案。此外,小型VLM的容量限制促使我们开发渐进式数据精炼流程,通过任务类型过滤与数据比例调整,从1080万原始数据集中提取出含380万样本的高质量核心集。利用该核心集训练GoClick带来了显著的定位精度提升。实验表明,GoClick在多个GUI元素定位基准上表现优异,同时保持小体积与高推理速度。当集成至设备-云端协作框架时,GoClick还能增强GUI智能体性能:其辅助云端任务规划器实现精准元素定位,并取得更高任务成功率。我们期望该方法能为GUI智能体社区提供有意义的探索。


摘要 (Abstract)

Graphical User Interface (GUI) element grounding (precisely locating elements on screenshots based on natural language instructions) is fundamental for agents interacting with GUIs. Deploying this capability directly on resource-constrained devices like mobile phones is increasingly critical for GUI agents requiring low latency. However, this goal faces a significant challenge, as current visual grounding methods typically employ large vision-language model (VLM) (more than 2.5B parameters), making them impractical for on-device execution due to memory and computational constraints. To address this, this paper introduces GoClick, a lightweight GUI element grounding VLM with only 230M parameters that achieves excellent visual grounding accuracy, even on par with significantly larger models. Simply downsizing existing decoder-only VLMs is a straightforward way to design a lightweight model, but our experiments reveal that this approach yields suboptimal results. Instead, we select an encoder-decoder architecture, which outperforms decoder-only alternatives at small parameter scales for GUI grounding tasks. Additionally, the limited capacity of small VLMs encourages us to develop a Progressive Data Refinement pipeline that utilizes task type filtering and data ratio adjustment to extract a high-quality 3.8M-sample core set from a 10.8M raw dataset. Training GoClick using this core set brings notable grounding accuracy gains. Our experiments show that GoClick excels on multiple GUI element grounding benchmarks while maintaining a small size and high inference speed. GoClick also enhances GUI agent performance when integrated into a device-cloud collaboration framework, where GoClick helps cloud-based task planners perform precise element localization and achieve higher success rates. We hope our method serves as a meaningful exploration within the GUI agent community.


关键词: GUI element grounding, lightweight VLM, encoder-decoder architecture, on-device AI, data refinement, GUI agent


244. ❌ 2nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA

作者: Zhiyu Wang, Xudong Kang, Shutao Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23935v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.05.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究音频驱动的视频目标分割,提出ASR-SaSaSa2VA框架,利用ASR将音频转为文本,再使用预训练的文本引导视频分割模型。该方法涉及MLLM(多模态大语言模型)的微调(fine-tuned audio-based MLLM),但与核心关键词如LLMs、MoE、SLMs等关联较弱。仅与’Post-training or Supervised Fine-tuning’有中等关联(5分),因为使用了fine-tuned MLLM。其他关键词如AI for Science等不相关。


!!! tip deepseek-chat TL;DR

该论文提出ASR-SaSaSa2VA框架,通过ASR将音频转为文本描述,结合预训练文本引导视频分割模型,实现资源高效的音频视频目标分割,并在MeViS-v2-Audio挑战赛中获得第二名。
摘要翻译

基于音频的视频目标分割旨在根据音频线索定位并分割视频中的目标,要求对表观与运动具有精确理解。当前的音频驱动视频分割方法通过融合音频与视觉特征进行端到端定位,从而扩展了多模态大语言模型(MLLMs)。尽管这些方法前景可观,但它们计算开销大,难以将时序音频线索与动态视频内容对齐,且依赖大规模配对音频-视频数据集。为应对这些挑战,我们提出ASR-SaSaSa2VA,一种资源高效的音频引导视频分割框架。其核心思想是通过自动语音识别(ASR)模型将音频输入转换为文本形式的运动描述,进而利用预训练的基于文本的指代视频分割模型(如SaSaSa2VA)进行像素级预测。为进一步增强鲁棒性,我们引入一个非目标表达检测模块,该模块由微调后的基于音频的多模态大语言模型实现,用于过滤掉不指向任何目标对象的音频片段。该设计使系统能够利用强大的预训练模型,同时有效处理模糊或无关的音频输入。我们的方法在第五届PVUW挑战赛(MeViS-v2-Audio赛道)中取得80.7的最终得分,位列第二名。


摘要 (Abstract)

Audio-based video object segmentation aims to locate and segment objects in videos conditioned on audio cues, requiring precise understanding of both appearance and motion. Recent audio-driven video segmentation methods extend MLLMs by fusing audio and visual features for end-to-end localization. Despite their promise, these approaches are computationally intensive, struggle with aligning temporal audio cues to dynamic video content, and depend on large paired audio-video datasets. To address these challenges, we present ASR-SaSaSa2VA, a resource-efficient framework for audio-guided video segmentation. The key idea is to convert audio inputs into textual motion descriptions via automatic speech recognition (ASR) models and then leverage pre-trained text-based referring video segmentation models (e.g., SaSaSa2VA) for pixel-level predictions. To further enhance robustness, we incorporate a no-target expression detection module, implemented by a fine-tuned audio-based MLLM, which filters out audio clips that do not refer to any target object. This design allows the system to exploit strong pre-trained models while effectively handling ambiguous or irrelevant audio inputs. Our approach achieves a final score of 80.7 in the 5th PVUW Challenge (MeViS-v2-Audio track), earning the second-place ranking.


关键词: Audio-based video object segmentation, ASR, MLLM, Fine-tuning, Referring video segmentation, SaSaSa2VA, No-target detection


245. ❌ AMAVA: Adaptive Motion-Aware Video-to-Audio Framework for Visually-Impaired Assistance

作者: Benjamin Klein, Kazi Ruslan Rahman, Sanchita Ghose 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23909v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.010.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是实时视频到音频的框架,用于盲人辅助导航。它使用了一个基于decoder-only transformer的视觉语言模型,其中包含mixture-of-experts和cross-modal attention。因此,与’Large Language Models’和’Mixture of Experts’高度相关。其他关键词如RLHF、RAG、CoT等均未涉及,评分较低。


!!! tip deepseek-chat TL;DR

AMAVA是一个实时视频转音频框架,通过运动感知管道和混合专家视觉语言模型,为盲人提供上下文相关的音频反馈,显著提升用户信心和安全感。
摘要翻译

针对盲人和低视力人群的导航辅助设备在传达动态真实环境方面存在困难,持续且无差别的反馈会导致认知过载。我们提出AMAVA,一种新颖的实时视频到音频框架,可将移动设备视频转换为上下文相关的音效或文本转语音描述。我们提出一种基于运动感知的流水线,使用轻量级AI分类模型区分低运动场景与高运动场景,随后通过实时文本到音频合成流水线更高效地增强环境感知。在静态环境中,AMAVA生成口语化的音频场景描述以提供情境感知。在高运动场景中,它通过传递声音提示(如口语化危险警报和环境音效)优先保障安全。这些音频输出由一个基于仅解码器Transformer的视觉语言模型(采用混合专家机制与跨模态注意力进行视觉理解)结合神经文本转语音与自然声音合成网络生成。所提出的框架使用基于提示的缓存与类别特定的限流机制以避免听觉混乱并最小化延迟。我们对该系统进行了全面评估,包括一项对比仅使用白杖与结合AMAVA的实时导航研究,结果显示用户信心与感知安全性显著提升。


摘要 (Abstract)

Navigational aids for blind and low vision individuals struggle conveying dynamic real-world environments, leading to cognitive overload from continuous, undifferentiated feedback. We present AMAVA, a novel real-time video-to-audio framework that converts mobile device video into contextually relevant sound effects or text-to-speech descriptions. We propose a motion-aware pipeline using a lightweight AI classification model to distinguish between low and high-movement scenes followed by a real-time text-to-audio synthesis pipeline to enhance environmental perception more efficiently. In static environments, AMAVA generates spoken audio scene descriptions for situational awareness. In high-movement situations, it prioritizes safety by delivering sound cues, such as spoken hazard alerts and environmental sound effects. These audio outputs are produced by a decoder-only transformer-based vision-language model with mixture-of-experts and cross-modal attention for visual understanding, in conjunction with neural text-to-speech and natural sound synthesis networks. The proposed framework uses prompt-based caching and category-specific throttling to avoid auditory clutter and minimize latency. We present a comprehensive evaluation of the system, including a real-time navigation study comparing a white cane alone versus with AMAVA, that shows a significant increase in user confidence and perceived safety.


关键词: video-to-audio, visually-impaired assistance, mixture-of-experts, vision-language model, motion-aware, real-time navigation, text-to-speech, sound effects


246. ❌ Mammographic Lesion Segmentation with Lightweight Models: A Comparative Study

作者: Helder Oliveira 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23899v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是乳腺病变分割的轻量级深度学习模型,不涉及大语言模型、MoE、SLM、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我纠正、LLM代理、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习或AI for Science等关键词。论文专注于计算机视觉中的轻量级分割模型,与给定关键词完全无关。


!!! tip deepseek-chat TL;DR

该论文比较了多种轻量级深度学习模型(如MobileNetV2、EfficientNet Lite等)在乳腺X线摄影病变分割中的性能,发现MobileNetV2 with SCSE在参数减少75%的情况下取得了最佳Dice分数0.5766。
摘要翻译

乳腺癌是全球女性癌症相关死亡的主要原因之一,乳腺X线摄影(mammography)是主要的筛查工具。尽管深度学习模型在病灶分割方面表现出色,但大多数模型依赖计算密集型架构,这限制了其在资源受限环境中的应用。本研究评估了轻量级模型在乳腺X线摄影病灶分割中的性能与效率。使用INbreast数据集,通过5折交叉验证,将MobileNetV2、EfficientNet Lite、ENet和Fast-SCNN等架构与U-Net基线模型进行了比较。性能评估采用Dice系数(Dice score)、交并比(Intersection over Union, IoU)和召回率(Recall),同时考虑模型复杂度。带有挤压激励模块(Squeeze-and-Excitation, SCSE)的MobileNetV2取得了最佳性能,Dice系数达到0.5766,同时参数量比U-Net减少约75%。在DMID数据集上的跨数据集评估显示,由于域偏移(domain shift)导致准确率下降,但召回率得以保持。这些结果表明,轻量级架构在可部署的计算机辅助诊断(CAD)系统中,能够在性能与效率之间实现实用的平衡。


摘要 (Abstract)

Breast cancer is a leading cause of cancer-related mortality among women worldwide, with mammography as the primary screening tool. While deep learning models have shown strong performance in lesion segmentation, most rely on computationally intensive architectures that limit their use in resource-constrained environments. This study evaluates the performance and efficiency of lightweight models for mammographic lesion segmentation. Architectures including MobileNetV2, EfficientNet Lite, ENet, and Fast-SCNN were compared against a U-Net baseline using the INbreast dataset with 5-fold cross-validation. Performance was assessed using Dice score, Intersection over Union (IoU), and Recall, alongside model complexity. MobileNetV2 with Squeeze-and-Excitation (SCSE) achieved the best performance, with a Dice score of 0.5766 while using approximately 75% fewer parameters than U-Net. Cross-dataset evaluation on the DMID dataset showed reduced accuracy due to domain shift but preserved recall. These results demonstrate that lightweight architectures offer a practical balance between performance and efficiency for deployable CAD systems.


关键词: Mammographic lesion segmentation, Lightweight models, Deep learning, MobileNetV2, EfficientNet Lite, ENet, Fast-SCNN, INbreast dataset


247. ❌ Risk-Aware Robust Learning: Reducing Clinical Risk under Label Noise in Medical Image Classification

作者: Maycon R. S. Pereira, Filipe R. Cordeiro 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23875v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是医学图像分类中的标签噪声问题,提出风险感知的鲁棒学习方法,关注临床风险(假阴性代价)。关键词列表中所有术语均与论文内容无关:论文不涉及大语言模型、混合专家、小模型、缩放定律、预训练、微调、RLHF、PEFT、RAG、长上下文、KV缓存、思维链、系统2思维、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习或AI for Science(生物信息学/化学信息学)。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文研究在医学图像分类中,标签噪声下噪声鲁棒训练方法是否保持临床安全性,发现现有方法不能保证临床安全,而结合代价敏感优化可显著降低临床风险。
摘要翻译

噪声标签是医学图像分类中普遍存在的挑战,标注错误源于观察者间差异和诊断模糊性。尽管已有多种抗噪声学习方法被提出,但其评估主要依赖以准确率为导向的指标,忽视了非对称错误成本的临床意义。在医学诊断中,假阴性(漏诊)的后果远重于假阳性(误报),因为治疗延迟会直接影响患者预后。本研究探讨了抗噪声训练方法在标签噪声下能否保持临床安全性。我们在二值化DermaMNIST和PathMNIST数据集上,分别在干净标签及20%、40%噪声率条件下,对当前最先进的抗噪声方法Coteaching、DivideMix、UNICON及基于GMM(高斯混合模型)的过滤方法进行了系统性风险感知评估。除平衡准确率外,我们采用了一种代价敏感的全局风险(Global Risk)公式,该公式明确对假阴性进行惩罚。分析表明,现有最先进方法的鲁棒性并不能保证临床安全性。此外,我们证明将代价敏感优化融入抗噪声训练可在维持模型效用的同时显著降低临床风险。这些发现表明,抗噪声学习必须通过临床风险视角进行评估,而将鲁棒训练与代价敏感优化相结合,能够有效降低噪声标签医学影像场景中的风险。


摘要 (Abstract)

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their evaluation predominantly relies on accuracy-oriented metrics, overlooking the clinical implications of asymmetric error costs. In medical diagnosis, a false negative (missed disease) carries substantially higher consequences than a false positive (false alarm), as delayed treatment can directly impact patient outcomes. In this work, we investigate whether noise-robust training methods preserve clinical safety under label noise. We conduct a systematic risk-aware evaluation of the state-of-the-art noise-robust methods Coteaching, DivideMix, UNICON, and a GMM-based filtering approach on binarized DermaMNIST and PathMNIST datasets under clean and label noise rates of 20%, and 40%. Beyond balanced accuracy, we adopt a cost-sensitive Global Risk formulation that explicitly penalizes false negatives. Our analysis reveals that the robustness of state-of-the-art methods does not guarantee clinical safety. Furthermore, we demonstrate that integrating cost-sensitive optimization into noise-robust training significantly reduces clinical risk, while mantaining model utility. These findings demonstrate that noise-robust learning must be evaluated through a clinical risk lens, and that combining robust training with cost-sensitive optimization can meaningfully reduce risk in noisy-label medical imaging scenarios.


关键词: noisy labels, medical image classification, risk-aware learning, cost-sensitive optimization, clinical risk, false negative, robust learning


248. ❌ Empirical Ablation and Ensemble Optimization of a Convolutional Neural Network for CIFAR-10 Classification

作者: Naser Khatti Dizabadi 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23861v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是CNN在CIFAR-10图像分类上的消融实验和集成优化,完全不涉及大模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文通过消融实验和集成学习优化CNN在CIFAR-10上的分类性能,发现训练时长和精心选择的结构改进比盲目增加深度更有效,最终集成模型达到89.23%准确率。
摘要翻译

卷积神经网络(Convolutional Neural Networks, CNNs)仍是图像分类的核心方法,但其性能高度依赖于架构设计与训练策略的选择。本文针对CIFAR-10基准数据集,开展了一项基于消融实验的CNN优化实证研究。该研究评估了17种渐进式改进方案,涉及训练时长、学习率调度、丢弃(dropout)配置、池化策略、网络深度、滤波器排布及全连接层设计。研究旨在识别哪些改进能提升泛化能力,哪些虽增加复杂度却未改善性能。基线模型测试准确率为79.5%。延长训练时长可稳步提升性能,而多项结构重设计尽管增加了架构多样性,反而导致准确率下降。基于最优的单项配置,构建了加权集成模型,在缩减数据场景下达到86.38%的准确率,在使用完整CIFAR-10数据集训练时则达到89.23%。这些结果表明,基于CNN的分类性能提升,更多依赖于对训练策略与架构改进的审慎实证选择,而非盲目增加网络深度或参数量。因此,本研究凸显了面向消融实验的优化与集成学习在小图像分类中的实用价值。


摘要 (Abstract)

Convolutional neural networks (CNNs) remain a central approach in image classification, but their performance depends strongly on architectural and training choices. This paper presents an empirical ablation-based study of CNN optimization for the CIFAR-10 benchmark. The study evaluates 17 progressive modifications involving training duration, learning-rate scheduling, dropout configuration, pooling strategy, network depth, filter arrangement, and dense-layer design. The goal is to identify which changes improve generalization and which increase complexity without improving performance. The baseline model achieved 79.5% test accuracy. Extending training duration improved performance steadily, whereas several structural redesigns reduced accuracy despite greater architectural variation. Based on the strongest individual configurations, a weighted ensemble was constructed, achieving 86.38% accuracy in the reduced-data setting and 89.23% when trained using the full CIFAR-10 dataset. These results suggest that performance gains in CNN-based classification depend less on indiscriminate increases in depth or parameter count than on careful empirical selection of training and architectural modifications. The study therefore highlights the practical value of ablation-oriented optimization and ensemble learning for small-image classification.


关键词: Convolutional Neural Networks, CIFAR-10, Ablation Study, Ensemble Learning, Image Classification, Optimization


249. ❌ Exploring Audio Hallucination in Egocentric Video Understanding

作者: Ashish Seth, Xinhao Mei, Changsheng Zhao, Varun Nagaraja, Ernie Chang, Gregory P. Meyer, Gael Le Lan, Yunyang Xiong, Vikas Chandra, Yangyang Shi, Dinesh Manocha, Zhipeng Cai 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23860v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是音频幻觉(audio hallucination)在自我中心视频理解中的问题,核心是评估大型音频-视觉语言模型(AV-LLMs)的幻觉现象。与关键词’Large Language Models’高度相关,因为AV-LLMs属于LLMs的扩展;与’Hallucination Mitigation’高度相关,因为论文聚焦于幻觉的评估和分类。其他关键词如MoE、SLMs、Scaling Laws等均不涉及。


!!! tip deepseek-chat TL;DR

该论文系统评估了大型音频-视觉语言模型在自我中心视频理解中的音频幻觉问题,发现现有模型(如Qwen2.5 Omni)在区分前景和背景声音时准确率低,强调了评估幻觉可靠性的必要性。
摘要翻译

第一人称视频提供了一种独特场景,其中声音是理解用户活动及周围环境的关键线索,尤其是在因摄像机持续运动而导致视觉信息不稳定或被遮挡的情况下。最先进的音视频大语言模型(AV-LLMs)能够生成多模态描述。然而,我们在本研究中表明,这些模型容易产生听觉幻觉,常常从可见但未听到的视觉线索中推断出声音。我们提出了一套系统且自动化的评估框架,通过针对性的问答(Q/A)协议来分析第一人称视频中的听觉幻觉。我们整理了一个包含300个第一人称视频的数据集,并设计了1000个聚焦声音的问题来探究模型输出。为了描述幻觉特征,我们提出了一种基于分类的体系,将用户活动产生的前景动作声音与背景环境声音区分开来。我们的评估显示,先进的AV-LLMs(如Qwen2.5 Omni)表现出较高的幻觉率,在与前景声音和背景声音相关的问答上分别仅达到27.3%和39.5%的准确率。通过本研究,我们强调了对多模态响应可靠性进行测量的必要性,并指出对幻觉的稳健评估对于开发可靠的AV-LLMs至关重要。


摘要 (Abstract)

Egocentric videos provide a distinctive setting in which sound serves as crucial cues to understand user activities and surroundings, particularly when visual information is unstable or occluded due to continuous camera movement. State-of-the-art large audio-visual language models (AV-LLMs) can generate multimodal descriptions. However, we show in this work that they are prone to audio hallucinations, often inferring sounds from visual cues that are visible but not heard. We present a systematic and automatic evaluation framework for analyzing audio hallucinations in egocentric video through a targeted question-answering (Q/A) protocol. We curate a dataset of 300 egocentric videos and design 1,000 sound-focused questions to probe model outputs. To characterize hallucinations, we propose a grounded taxonomy that distinguishes between foreground action sounds from the user activities and background ambient sounds. Our evaluation shows that advanced AV-LLMs, such as Qwen2.5 Omni, exhibit high hallucination rates, achieving only 27.3% and 39.5% accuracy on Q/As related to foreground and background sounds, respectively. With this work, we highlight the need to measure the reliability of multimodal responses, emphasizing that robust evaluation of hallucinations is essential to develop reliable AV-LLMs.


关键词: audio hallucination, egocentric video, audio-visual language models, hallucination evaluation, multimodal understanding, Qwen2.5 Omni


250. ❌ Latent Inter-Frame Pruning: A Training-Free Method Bridging Traditional Video Compression and Modern Diffusion Transformers for Efficient Generation

作者: Dennis Menn, Chih-Hsien Chou 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23858v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注视频生成中的效率优化,提出Latent Inter-Frame Pruning方法,利用传统视频压缩思想减少冗余计算。虽然涉及扩散模型和注意力机制,但未涉及大语言模型、深度学习技术原理创新或科学应用。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种无需训练的潜在帧间剪枝方法,通过跳过重复的潜在块来加速视频生成,并引入注意力恢复机制解决训练-推理差异,在保持质量的同时将视频编辑吞吐量提升1.44倍。
摘要翻译

视频生成虽然能够生成逼真的视频,但计算成本高且速度慢,限制了其实时应用。本文观察到,在潜在扩散模型(Latent Diffusion Model, LDM)框架下,通过自编码器编码的视频潜在表示在时间轴上存在冗余。类似于传统视频压缩算法避免传输冗余帧数据的方式,我们提出了潜在帧间剪枝(Latent Inter-frame Pruning)框架,用于剪枝(即跳过重新计算)重复的潜在块,从而降低计算负担并提高吞吐量。然而,由于全序列训练与剪枝推理之间的差异,直接剪枝会导致视觉伪影。为解决这些伪影,我们提出了一种注意力恢复(Attention Recovery)机制,以弥合训练与推理之间的差距。通过我们提出的方法,视频编辑吞吐量提升了1.44倍,在NVIDIA RTX 6000上实现了12.44 FPS,同时保持了视频质量。我们希望我们的工作能激发将传统视频压缩方法与现代视频生成流水线相结合的进一步研究。本工作是关于无需训练的潜在帧间剪枝与注意力恢复的初步研究。


摘要 (Abstract)

Video generation, while capable of generating realistic videos, is computationally expensive and slow, prohibiting real-time applications. In this paper, we observe that video latents encoded via an autoencoder under the Latent Diffusion Model (LDM) framework contain redundancy along the temporal axis. Analogous to how traditional video compression algorithms avoid transmitting redundant frame data, we propose the Latent Inter-frame Pruning framework to prune (skip the re-computation of) duplicated latent patches, thereby reducing computational burden and increasing throughput. However, direct pruning results in visual artifacts due to the discrepancy between full-sequence training and pruned inference. To resolve these artifacts, we propose an Attention Recovery mechanism to bridge the train-inference gap. With our proposed method, we increase video editing throughput by 1.44$\times$, achieving 12.44 FPS on an NVIDIA RTX 6000 while maintaining video quality. We hope our work inspires further research into integrating traditional video compression methods with modern video generation pipelines. This work is a preliminary work on Training-free Latent Inter-Frame Pruning with Attention Recovery.


关键词: Video Generation, Latent Diffusion Model, Inter-Frame Pruning, Attention Recovery, Inference Acceleration, Training-free


251. ❌ Focus on What Matters: Two-Stage ROI-Aware Refinement for Anatomy-Preserving Fetal Ultrasound Reconstruction

作者: Ines Abbes, Mahmood Alzubaidi, Mowafa Househ, Khalid Alyafei, Marco Agus, Samir Brahim Belhaouari 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23839v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文专注于胎儿超声重建中的ROI感知表示学习,使用卷积自编码器(CAE)和MS-SSIM、L1、Sobel边缘约束等传统计算机视觉技术,不涉及任何大模型、深度学习技术原理创新或AI for Science关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种两阶段ROI感知细化框架,用于保留解剖结构的胎儿超声重建,通过全局MS-SSIM和局部ROI约束提升重建质量,并在多医院域转移下验证了有效性。
摘要翻译

在测量关键型超声任务中,诊断往往依赖于微小的解剖区域,这使得全局重建指标难以可靠地反映临床保真度。我们提出了一种面向感兴趣区域(ROI)的表征学习框架,并将其实例化应用于多医院域迁移场景下的早孕期颈项透明层(NT)筛查。该框架采用两阶段卷积自编码器(CAE):首先通过多尺度结构相似性(MS-SSIM)学习一个全局保真的128维潜在编码,随后利用强度(L1)约束和归一化Sobel边缘约束对NT的ROI进行细化。为在不需手动调参的情况下融合这些异构目标,我们基于逐项梯度幅值通过梯度校准方法初始化损失权重。在严格的逐医院留出评估中,ROI细化同时提升了全局质量和测量相关质量:在标准开发集划分下,峰值信噪比(PSNR)在验证集上提升+0.27 dB,在留出测试集上提升+0.29 dB;ROI平均绝对误差(MAE)在验证集上降低8.87%,在留出测试集上降低6.43%;ROI边缘MAE在源医院降低11.10%,在未见医院降低4.90%。除重建任务外,冻结潜在编码的探针实验提供了泛化性的额外证据:在未见站点上,医院来源的可预测置信度降低(最大softmax从0.556降至0.541;熵从0.684升至0.688),而跨站点留出协议下的异常检测(OOD)性能依然强劲(马氏距离AUROC最高达0.9956,在具有挑战性的划分中KNN方法亦有适度提升)。这一基于ROI细化的原则与解剖结构无关,可推广至其他胎儿生物测量目标(如头臀长(CRL)、鼻骨(NB))以及更广泛的、以小ROI主导临床决策的医学影像场景。


摘要 (Abstract)

Measurement-critical ultrasound tasks often depend on a small anatomical region, making global reconstruction metrics an unreliable proxy for clinical fidelity. We propose an ROI-aware representation learning framework and instantiate it for first-trimester nuchal translucency (NT) screening under multi-hospital domain shift. A two-phase convolutional autoencoder (CAE) first learns a globally faithful 128-D latent code via MS-SSIM, then refines the NT ROI using intensity (L1) and normalized Sobel-edge constraints. To combine these heterogeneous objectives without manual tuning, we initialize loss weights via gradient-based calibration from per-term gradient magnitudes. Under strict hospital-wise evaluation with one hospital held out, ROI refinement improves both global and measurement-relevant quality: on the standard dev split it increases PSNR by +0.27 dB (val) and +0.29 dB (held-out test), reduces ROI MAE by 8.87% (val) and 6.43% (held-out test), and reduces ROI Edge-MAE by 11.10% on source hospitals and 4.90% on the unseen hospital. Beyond reconstruction, frozen-latent probes provide additional evidence of generalization: hospital provenance becomes less confidently predictable on the unseen site (0.556 to 0.541 max-softmax; 0.684 to 0.688 entropy) while OOD detection remains strong across site-held-out protocols (Mahalanobis AUROC up to 0.9956, with modest KNN gains in challenging splits). The same ROI-aware refinement principle is anatomy-agnostic and can be adopted for other fetal biometry targets (e.g., crown-rump length (CRL), nasal bone (NB)) and broader medical imaging settings where small ROIs dominate clinical decisions.


关键词: Fetal Ultrasound, ROI-aware, Reconstruction, Nuchal Translucency, Domain Shift, Convolutional Autoencoder, MS-SSIM


252. ❌ Mapping License Plate Recoverability Under Extreme Viewing Angles for Oppor-tunistic Urban Sensing

作者: Igor Adamenko, Orpaz Ben Aharon, Yehudit Aperstein, Alexander Apartsin 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23814v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究极端视角下车牌恢复的可行性,使用U-Net、Restormer等图像恢复模型,不涉及大模型、深度学习技术原理创新或AI for Science(生物/化学信息学)。所有关键词均与论文内容无关,故评分为0。


!!! tip deepseek-chat TL;DR

该论文提出恢复性地图方法,量化极端视角下车牌图像的可恢复性边界,并评估多种图像恢复模型,发现感知几何而非模型架构决定恢复极限。
摘要翻译

城市环境中部署了大量专用于特定目的的成像传感器,包括自动取款机(ATM)摄像头、随身摄像头、闭路电视(CCTV)摄像头及行车记录仪。在机会感知范式下,这些传感器可被重新用于辅助推理任务,例如车牌识别。然而,此类图像中的目标对象通常存在噪声大、分辨率低且拍摄视角极端的问题。基于人工智能的修复技术的最新进展,即使从严重退化的图像中也能恢复有用信息。一个核心挑战在于确定哪些失真参数能够实现可靠恢复,而哪些会导致推理失败。本文引入“可恢复性图”(recoverability maps),这是一种与任务无关的量化该边界的方法。该方法将密集的退化参数合成扫描与两种汇总指标相结合:边界曲线下面积(boundary area-under-curve),用于估计参数空间中可恢复部分的比例;以及可靠性评分(reliability score),用于捕捉该区域内故障的频率与严重程度。我们在真实相机伪影条件下,针对高角度视角的车牌识别任务验证了该方法。研究训练并评估了多种修复架构,包括U-Net、Restormer、Pix2Pix及SR3扩散模型。最佳模型可恢复约93%的参数空间。不同模型间的相似结果表明,限制恢复能力的因素在于传感几何结构,而非模型架构本身。


摘要 (Abstract)

Urban environments contain many imaging sensors built for specific purposes, including ATM, body-worn, CCTV, and dashboard cameras. Under the opportunistic sensing paradigm, these sensors can be repurposed for secondary inference tasks such as license plate recognition. Yet objects of interest in such imagery are often noisy, low-resolution, and captured from extreme viewpoints. Recent advances in AI-based restoration can recover use-ful information even from severely degraded images. A central challenge is determining which distortion parame-ters allow reliable recovery and which lead to inference failure. This paper introduces recoverability maps, a task-agnostic method for quantifying this boundary. The method combines a dense synthetic sweep of degrada-tion parameters with two summary measures: boundary area-under-curve, which estimates the recoverable frac-tion of the parameter space, and a reliability score, which captures the frequency and severity of failures within that region. We demonstrate the method on license plate recognition from highly angled views under realistic camera artifacts. Several restoration architectures are trained and evaluated, including U-Net, Restormer, Pix2Pix, and SR3 diffusion. The best model recovers about 93% of the parameter space. Similar results across models sug-gest that sensing geometry, rather than architecture, sets the limit of recovery.


关键词: license plate recognition, recoverability maps, extreme viewing angles, image restoration, opportunistic sensing, U-Net, Restormer


253. ❌ Bringing a Personal Point of View: Evaluating Dynamic 3D Gaussian Splatting for Egocentric Scene Reconstruction

作者: Jan Warchocki, Xi Wang, Jonas Kulhanek, Jan van Gemert 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23803v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究动态3D高斯泼溅在自我中心场景重建中的应用,属于计算机视觉和图形学领域,与给定的所有关键词(大模型、深度学习技术原理创新、AI for Science等)均无直接关联。论文未涉及任何大模型、深度学习技术原理创新或科学应用,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文评估了动态单目3D高斯泼溅模型在自我中心视频上的场景重建效果,发现重建质量低于外部中心视角,主要差距源于静态内容的重建,指出了现有方法的局限性并呼吁开发自我中心特定的解决方案。
摘要翻译

自我中心视频提供了对人类感知与交互的独特视角,在增强现实、机器人技术和辅助技术领域具有日益增长的重要性。然而,快速的相机运动与复杂的场景动态给从该视角进行三维重建带来了重大挑战。尽管三维高斯泼溅(3D Gaussian Splatting, 3DGS)已成为高效、高质量新视角合成的最先进方法,但针对从单目视频重建动态场景的变体方法,却鲜少在自我中心视频上进行评估。现有模型是否能泛化至该场景,抑或需要针对自我中心的专用解决方案,目前尚不明确。本研究利用EgoExo4D数据集中的配对自我中心与外部中心(ego-exo)录像,评估了动态单目3DGS模型在自我中心与外部中心视频上的表现。我们发现,自我中心视角下的重建质量始终较低。分析表明,以峰值信噪比(peak signal-to-noise ratio)衡量的重建质量差异,源于静态内容而非动态内容的重建。我们的发现揭示了当前的局限性,并推动针对自我中心的专用方法的发展,同时也凸显了分别评估视频中静态与动态区域的价值。


摘要 (Abstract)

Egocentric video provides a unique view into human perception and interaction, with growing relevance for augmented reality, robotics, and assistive technologies. However, rapid camera motion and complex scene dynamics pose major challenges for 3D reconstruction from this perspective. While 3D Gaussian Splatting (3DGS) has become a state-of-the-art method for efficient, high-quality novel view synthesis, variants, that focus on reconstructing dynamic scenes from monocular video are rarely evaluated on egocentric video. It remains unclear whether existing models generalize to this setting or if egocentric-specific solutions are needed. In this work, we evaluate dynamic monocular 3DGS models on egocentric and exocentric video using paired ego-exo recordings from the EgoExo4D dataset. We find that reconstruction quality is consistently lower in egocentric views. Analysis reveals that the difference in reconstruction quality, measured in peak signal-to-noise ratio, stems from the reconstruction of static, not dynamic, content. Our findings underscore current limitations and motivate the development of egocentric-specific approaches, while also highlighting the value of separately evaluating static and dynamic regions of a video.


关键词: 3D Gaussian Splatting, Egocentric Video, Dynamic Scene Reconstruction, Novel View Synthesis, EgoExo4D Dataset, Monocular Video, Scene Dynamics


254. ❌ VitaminP: cross-modal learning enables whole-cell segmentation from routine histology

作者: Yasin Shokrollahi, Karina B. Pinao Gonzales, Elizve N. Barrientos Toro, Paul Acosta, Patient Mosaic Team, Pingjun Chen, Yinyin Yuan, Xiaoxi Pan 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23799v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要涉及跨模态学习用于全细胞分割,属于AI在生物医学领域的应用(AI for Science),与关键词’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。其他关键词如大模型、强化学习、推理等均未涉及,故评分为0。


!!! tip deepseek-chat TL;DR

该论文提出VitaminP框架,通过跨模态学习从H&E染色图像中实现全细胞分割,克服了传统H&E染色缺乏细胞质对比度的限制,并在多个数据集上优于现有方法。
摘要翻译

精确的全细胞与细胞核分割对于精准病理学及空间组学至关重要,然而常规苏木精-伊红(H&E)染色仅能提供有限的细胞质对比度,导致分析局限于细胞核。多重免疫荧光(mIF)技术虽能实现精确的全细胞描绘,但其应用仍受限于成本和可及性。我们提出VitaminP——一种实现基于H&E图像的全细胞分割的跨模态学习框架。通过从配对的H&E-mIF数据中学习,VitaminP将mIF的分子边界信息迁移至H&E图像,以克服其细胞质对比度不足的问题,从而将跨模态监督确立为恢复缺失生物学结构的通用策略。我们在涵盖34种癌症类型及超过700万个实例的14个公共数据集上训练VitaminP,整合了公开标签与本研究生成的大规模标注,构建了当前规模最大的分割资源之一。VitaminP的性能优于四种现有最优方法,并能泛化至未见数据集,包括涵盖24种罕见癌症类型的内部数据集。我们进一步开发了开源平台VitaminPScope,提供可扩展推理的交互界面,以推动该技术的广泛应用。


摘要 (Abstract)

Accurate whole-cell and nuclear segmentation is essential for precision pathology and spatial omics, yet routine hematoxylin and eosin (H&E) staining provides limited cytoplasmic contrast, restricting analyses to nuclei. Multiplex immunofluorescence (mIF) facilitates precise whole-cell delineation but remains constrained by cost and accessibility. We introduce VitaminP, a cross-modal learning framework enabling whole cell segmentation from H&E images. By learning from paired H&E-mIF data, VitaminP transfers molecular boundary information from mIF to overcome cytoplasmic contrast in H&E, establishing cross-modal supervision as a general strategy for recovering missing biological structure. We train VitaminP on 14 public datasets covering 34 cancer types and over 7 million instances, integrating publicly available labels with extensive annotations generated in this study, forming one of the largest resources for segmentation. VitaminP outperforms four state-of-the-art methods and generalizes to unseen datasets, including an in-house dataset spanning 24 rare cancer types. We further developed VitaminPScope, an open-source platform providing an interface for scalable inference and enabling broad adoption.


关键词: cross-modal learning, whole-cell segmentation, H&E staining, multiplex immunofluorescence, histology, deep learning, AI for Science


255. ❌ MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation

作者: Haojie Zhang, Di Wu, Bingyan Liu, Linjie Zhong, Yuancheng Wei, Xingsong Ye, Nanqing Liu, Yaling Liang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23789v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究多镜头视频生成和主题到视频(S2V)生成,属于计算机视觉和视频生成领域,与给定的大模型、深度学习技术原理创新或AI for Science等关键词完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一个大规模多镜头视频生成数据集MuSS和电影叙事基准,旨在解决多镜头视频生成中的叙事逻辑、时空对齐和复制粘贴问题。
摘要翻译

尽管视频基础模型在单次生成任务中表现出色,但现实世界的电影叙事本质上依赖于复杂的多镜头序列。当前进展受限于缺乏能够应对三大核心挑战的数据集:真实的叙事逻辑、时空文本-视频对齐冲突,以及主体到视频生成中普遍存在的“复制-粘贴”困境。为弥补这一空白,我们提出MuSS——一个专为多镜头视频与主体到视频生成设计的大规模双轨数据集。该数据集源自3000余部电影,明确支持复杂的蒙太奇转场与以主体为中心的叙事。为构建该数据集,我们首创了一种渐进式字幕生成流水线,通过先确保局部镜头级别的准确性,再强化全局叙事连贯性,从而消除上下文冲突。关键的是,我们实现了一种跨镜头匹配机制,从根本上杜绝了主体到视频生成中的复制-粘贴捷径。除数据集外,我们还提出了电影叙事基准,该基准采用视觉逻辑驱动范式,并引入新型抗复制-粘贴方差指标,以严格评估连续叙事能力与三维结构一致性。大量实验表明,当前基线模型要么难以处理连续叙事逻辑,要么退化为简单的二维贴纸生成器,而经MuSS增强的模型在叙事效果与跨镜头身份保持方面均达到了最优水平。


摘要 (Abstract)

While video foundation models excel at single-shot generation, real-world cinematic storytelling inherently relies on complex multi-shot sequencing. Further progress is constrained by the absence of datasets that address three core challenges: authentic narrative logic, spatiotemporal text-video alignment conflicts, and the “copy-paste” dilemma prevalent in Subject-to-Video (S2V) generation. To bridge this gap, we introduce MuSS, a large-scale, dual-track dataset tailored for multi-shot video and S2V generation. Sourced from over 3,000 movies, MuSS explicitly supports both complex montage transitions and subject-centric narratives. To construct this dataset, we pioneer a progressive captioning pipeline that eliminates contextual conflicts by ensuring local shot-level accuracy before enforcing global narrative coherence. Crucially, we implement a cross-shot matching mechanism to fundamentally eradicate the S2V copy-paste shortcut. Alongside the dataset, we propose the Cinematic Narrative Benchmark, featuring a visual-logic-driven paradigm and a novel Anti-Copy-Paste Variance (ACP-Var) metric to rigorously assess continuous storytelling and 3D structural consistency. Extensive experiments demonstrate that while current baselines struggle with continuous narrative logic or degenerate into trivial 2D sticker generators, our MuSS-augmented model achieves state-of-the-art narrative effectiveness and cross-shot identity preservation.


关键词: Multi-shot Video Generation, Subject-to-Video Generation, Cinematic Narrative, Dataset, Benchmark, Anti-Copy-Paste


256. ❌ ELSA: Exact Linear-Scan Attention for Fast and Memory-Light Vision Transformers

作者: Chih-Chung Hsu, Xin-Di Ma, Wo-Ting Liao, Chia-Ming Lee 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23798v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.05.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.010.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.08.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出ELSA,一种精确线性扫描注意力机制,旨在加速视觉Transformer中的注意力计算,同时保持精确softmax语义。核心创新在于将在线softmax更新转化为前缀扫描,降低并行深度至O(log n),且不依赖Tensor Core,适用于边缘设备。与关键词’KV Cache Compression OR Linear Attention OR FlashAttention’高度相关(10分),因为ELSA直接改进注意力计算效率;与’Speculative Decoding OR Inference Acceleration’相关(8分),因为其加速推理;与’Small Language Models OR SLMs OR On-device AI’部分相关(5分),因为支持边缘设备。其他关键词如LLM、MoE等不相关。


!!! tip deepseek-chat TL;DR

ELSA通过将在线softmax注意力重写为可并行前缀扫描,实现了精确、硬件无关且高效的注意力计算,在FP32下比FlashAttention快1.3-3.5倍,并能在边缘设备上运行。
摘要翻译

现有注意力加速器往往牺牲精确的softmax语义、依赖融合张量核心指令,或引入顺序深度从而限制长序列上的FP32吞吐量。本文提出\textbf{ELSA}——一种在线softmax注意力的算法重构,其特点为:(i) 在实数运算中保留精确softmax语义,并具有可证明的$\mathcal{O}(u\log n)$ FP32相对误差界;(ii) 将在线softmax更新转化为基于可结合幺半群$(m,S,W)$的前缀扫描,仅需$O(n)$额外内存和$O(\log n)$并行深度;(iii) 不依赖张量核心(Tensor Core),通过Triton和CUDA C++实现,可作为无需重新训练或修改权重的\textit{即插即用}替代方案。与依赖HMMA/GMMA张量核心指令且不提供兼容FP32路径的FlashAttention-2/3不同,ELSA在A100和资源受限的边缘设备(如Jetson TX2)上运行方式完全相同——使其成为唯一一种硬件无关的精确注意力内核,能在全精度下将并行深度降至$O(\log n)$。在A100 FP32基准测试(1K–16K tokens)中,ELSA相比内存高效SDPA实现$1.3$–$3.5\times$加速,在BERT上达到$1.97$–$2.27\times$;在Jetson TX2上,ELSA相比Math(64–900 tokens)实现$1.5$–$1.6\times$加速,在LLaMA-13B卸载场景下($\ge$32K tokens)吞吐量提升$17.8$–$20.2%$。在FP16精度下,ELSA在长序列上接近硬件融合基线,同时保留完整FP32能力,为跨平台高精度推理提供统一内核。我们的代码与实现见https://github.com/ming053l/ELSA。


摘要 (Abstract)

Existing attention accelerators often trade exact softmax semantics, depend on fused Tensor Core kernels, or incur sequential depth that limits FP32 throughput on long sequences. We present \textbf{ELSA}, an algorithmic reformulation of online softmax attention that (i)~preserves exact softmax semantics in real arithmetic with a \emph{provable} $\mathcal{O}(u\log n)$ FP32 relative error bound; (ii)~casts the online softmax update as a prefix scan over an associative monoid $(m,S,W)$, yielding $O(n)$ extra memory and $O(\log n)$ parallel depth; and (iii)~is Tensor-Core independent, implemented in Triton and CUDA C++, and deployable as a \emph{drop-in replacement} requiring no retraining or weight modification. Unlike FlashAttention-2/3, which rely on HMMA/GMMA Tensor Core instructions and provide no compatible FP32 path, ELSA operates identically on A100s and resource-constrained edge devices such as Jetson TX2 – making it the only hardware-agnostic exact-attention kernel that reduces parallel depth to $O(\log n)$ at full precision. On A100 FP32 benchmarks (1K–16K tokens), ELSA delivers $1.3$–$3.5\times$ speedup over memory-efficient SDPA and $1.97$–$2.27\times$ on BERT; on Jetson TX2, ELSA achieves $1.5$–$1.6\times$ over Math (64–900 tokens), with $17.8$–$20.2%$ throughput gains under LLaMA-13B offloading at $\ge$32K. In FP16, ELSA approaches hardware-fused baselines at long sequences while retaining full FP32 capability, offering a unified kernel for high-precision inference across platforms. Our code and implementation are available at https://github.com/ming053l/ELSA.


关键词: exact linear-scan attention, online softmax, prefix scan, attention acceleration, edge devices, Triton, CUDA


257. ❌ MIRAGE: A Micro-Interaction Relational Architecture for Grounded Exploration in Multi-Figure Artworks

作者: Jui-Cheng Chiu, Yu-Chao Wang, Shengyang Luo, Tongyan Wang, Qi Yang, Nabin Khanal, Yingjie Victor Chen 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23788v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.010.0/100.0
Mechanistic Interpretability OR Explainable AI0.08.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要关注多人物画作中微交互的视觉叙事理解,提出MIRAGE框架,通过结构化中间表示(身份、姿态、视线假设)来减少视觉语言模型(VLM)的幻觉,提高解释的可靠性和可验证性。与关键词的相关性:Hallucination Mitigation(10分)直接相关,因为论文明确减少关系幻觉;Mechanistic Interpretability(8分)相关,因为框架提供了可验证的证据层,增强可解释性。其他关键词如LLMs、RAG、CoT等均不涉及。


!!! tip deepseek-chat TL;DR

MIRAGE通过构建结构化中间表示来减少多人物画作中视觉语言模型的关系幻觉,提高解释的可靠性和可验证性。
摘要翻译

欣赏多人物绘画需要理解人物之间如何通过视线对齐、手势和空间布局等微妙线索产生关联。我们提出MIRAGE,一个以证据为核心的框架,旨在支撑对多人物艺术作品中这些“微观互动”的探索。尽管此类线索对于深层叙事欣赏至关重要,但它们往往分布于复杂场景中,且观众难以系统性地识别。现有的视觉语言模型(VLM)通常无法提供可靠帮助,其给出的无依据解读缺乏可追溯的视觉证据。

MIRAGE通过构建一个包含身份、姿态线索和视线假设的结构化中间表征来解决这一问题。然而,挑战不仅在于提取这些线索,更在于解读过程中对它们的协调。如果没有明确的机制来组织和整合关系证据,即便底层信号可用,模型也常会将多个互动假设合并为一个不稳定或缺乏依据的叙事。该表征使用户能够验证高层级解读如何锚定于低层级视觉事实。

通过将空间定位与叙事生成相分离,MIRAGE使用户能够通过可验证的证据层来审视和推理人物间的关系。我们采用盲评协议,将MIRAGE与仅基于绘画的VLM基线模型进行对比评估。结果表明,MIRAGE显著提升了身份一致性,减少了关系幻觉,并增加了对微妙互动的覆盖范围。这些发现表明,结构化定位可作为关键的互动控制层,为更可靠、透明且以人类为主导的复杂视觉叙事理解提供必要支撑。


摘要 (Abstract)

Appreciating multi-figure paintings requires understanding how characters relate through subtle cues like gaze alignment, gesture, and spatial arrangement. We present MIRAGE, an evidence-centric framework designed to scaffold the exploration of these “micro-interactions” in multi-figure artworks. While such cues are essential for deep narrative appreciation, they are often distributed across complex scenes and difficult for viewers to systematically identify. Existing vision-language models (VLMs) frequently fail to provide reliable assistance, offering ungrounded interpretations that lack traceable visual evidence. MIRAGE addresses this by constructing a structured intermediate representation capturing identities, pose cues, and gaze hypotheses. However, the challenge extends beyond extracting these cues to coordinating them during interpretation. Without an explicit mechanism to organize and reconcile relational evidence, models often collapse multiple interaction hypotheses into a single unstable or weakly grounded narrative, even when low-level signals are available. This representation allows users to verify how high-level interpretations are anchored in low-level visual facts. By separating spatial grounding from narrative generation, MIRAGE enables users to inspect and reason about figure-to-figure relationships through a verifiable evidence layer. We evaluate MIRAGE against painting-only VLM baselines using a blind assessment protocol. Results show that MIRAGE significantly improves identity consistency, reduces relational hallucinations, and increases the coverage of subtle interactions. These findings suggest that structured grounding can serve as a critical interaction control layer, providing the necessary scaffolding for a more reliable, transparent, and human-led understanding of complex visual narratives.


关键词: multi-figure artworks, micro-interactions, visual grounding, hallucination mitigation, structured intermediate representation, vision-language models, interpretability


258. ❌ ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agents

作者: Fanqing Meng, Lingxiao Du, Zijian Wu, Guanzheng Chen, Xiangyan Liu, Jiaqi Liao, Chonghe Jiang, Zhenglin Wan, Jiawei Gu, Pengfei Zhou, Rui Huang, Ziqi Zhao, Shengyuan Ding, Ailing Yu, Bo Peng, Bowei Xia, Hao Sun, Haotian Liang, Ji Xie, Jiajun Chen, Jiajun Song, Liu Yang, Ming Xu, Qionglin Qiu, Runhao Fu, Shengfang Zhai, Shijian Wang, Tengfei Ma, Tianyi Wu, Weiyang Jin, Yan Wang, Yang Dai, Yao Lai, Youwei Shu, Yue Liu, Yunzhuo Hao, Yuwei Niu, Jinkai Huang, Jiayuan Zhuo, Zhennan Shen, Linyu Wu, Cihang Xie, Yuyin Zhou, Jiaheng Zhang, Zeyu Zheng, Mengkang Hu, Michael Qizhe Shieh 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23781v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.010.0/100.0
Multi-agent Systems OR Agent Coordination0.05.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出ClawMark基准,用于评估多轮、多天、多模态的协作者智能体。核心关注LLM Agents、Tool Use和Multi-agent Systems,因此这些关键词得分高。其他关键词如预训练、微调、推理加速等与论文内容无关,得分为0。


!!! tip deepseek-chat TL;DR

论文提出了ClawMark基准,用于评估在动态变化环境中工作的多轮、多天、多模态协作者智能体,发现现有最强模型在完整端到端工作流完成率上仅达20%,环境变化后的适应能力是主要挑战。
摘要翻译

语言模型智能体正日益被用作跨多个工作日协助用户的持久型协作者。在此类工作流程中,智能体所处的环境可能独立于其自身发生变化:新邮件到达、日历条目变更、知识库记录更新,以及图像、扫描版PDF、音频、视频和电子表格中出现证据。现有基准测试未能充分评估这一场景,因为它们通常运行在单一的静态回合中,且仍以文本为中心。我们提出\bench{}——一个围绕多轮次多日任务构建的协作者智能体基准测试,包含一个状态化的沙盒服务环境(其状态在轮次间演变)以及基于规则的验证机制。当前版本包含13个专业场景下的100项任务,针对五个状态化沙盒服务(文件系统、电子邮件、日历、知识库、电子表格)执行,并通过1537个确定性Python检查器对执行后的服务状态进行评分;评分过程中未调用大语言模型作为评判者。我们对七个前沿智能体系统进行了基准测试。最强模型达到了75.8的加权分数,但最佳严格任务完成率仅为20.0%,这表明部分进展虽常见,但完整的端到端工作流完成仍属罕见。轮次级分析显示,在首次外部环境更新后性能出现下降,这凸显出对变化状态的适应能力是一个关键开放挑战。我们公开了该基准测试、评估框架及构建流程,以支持可复现的协作者智能体评估。


摘要 (Abstract)

Language-model agents are increasingly used as persistent coworkers that assist users across multiple working days. During such workflows, the surrounding environment may change independently of the agent: new emails arrive, calendar entries shift, knowledge-base records are updated, and evidence appears across images, scanned PDFs, audio, video, and spreadsheets. Existing benchmarks do not adequately evaluate this setting because they typically run within a single static episode and remain largely text-centric. We introduce \bench{}, a benchmark for coworker agents built around multi-turn multi-day tasks, a stateful sandboxed service environment whose state evolves between turns, and rule-based verification. The current release contains 100 tasks across 13 professional scenarios, executed against five stateful sandboxed services (filesystem, email, calendar, knowledge base, spreadsheet) and scored by 1537 deterministic Python checkers over post-execution service state; no LLM-as-judge is invoked during scoring. We benchmark seven frontier agent systems. The strongest model reaches 75.8 weighted score, but the best strict Task Success is only 20.0%, indicating that partial progress is common while complete end-to-end workflow completion remains rare. Turn-level analysis shows that performance drops after the first exogenous environment update, highlighting adaptation to changing state as a key open challenge. We release the benchmark, evaluation harness, and construction pipeline to support reproducible coworker-agent evaluation.


关键词: LLM Agents, Multi-turn Multi-day Tasks, Stateful Sandboxed Services, Benchmark, Tool Use, Multi-agent Systems, Environment Adaptation


259. ❌ From Noisy Historical Maps to Time-Series Oil Palm Mapping Without Annotation in Malaysia and Indonesia (2020-2024)

作者: Nuttaset Kuapanich, Juepeng Zheng, Bohan Shi, Jiaying Liu, Jiayin Jiang, Jiatao Huang, Shenghan Tan, Qingmei Li, Haohuan Fu 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23776v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文主要研究利用深度学习(U-Net)从历史噪声地图生成油棕榈种植园时间序列地图,属于遥感与农业应用,不涉及大语言模型或深度学习技术原理创新。唯一相关关键词是’AI for Science’,因为其将AI应用于环境科学领域,但并非核心创新点。其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出一种基于U-Net和DMI的深度学习框架,利用Sentinel-2影像和噪声历史标签生成2020-2024年印尼和马来西亚10米分辨率油棕榈地图,揭示了油棕榈覆盖面积在2022年达到峰值后下降的趋势。
摘要翻译

对油棕榈种植园进行精确监测,对于平衡东南亚地区的经济发展与环境保护至关重要。然而,现有的种植园地图常存在空间分辨率低、时间覆盖范围缺乏时效性等问题,从而阻碍了对快速土地利用变化进行有效监测。本研究提出一种深度学习框架,利用哨兵二号(Sentinel-2)影像,无需新增人工标注,即可生成2020至2024年间印度尼西亚和马来西亚地区10米分辨率的油棕榈种植园地图。为解决粗分辨率100米历史标签与10米影像之间的分辨率不匹配问题,我们采用基于行列式互信息(Determinant-based Mutual Information, DMI)优化的U-Net架构。该方法有效减轻了标签噪声的影响。我们利用2058个人工验证点对方法进行验证,2020、2022和2024年的总体精度分别达到70.64%、63.53%和60.06%。综合分析显示,该区域油棕榈覆盖面积在2022年达到峰值,随后在2024年出现下降。此外,土地覆盖变化分析揭示了一个令人担忧的趋势:尽管与其他作物类型的轮作总体趋于稳定,但种植园正持续向洪泛植被区扩张。这些高分辨率地图为监测该区域的可持续性承诺及森林砍伐动态提供了关键数据,生成的数据集已公开共享于https://doi.org/10.5281/zenodo.17768444。


摘要 (Abstract)

Accurate monitoring of oil palm plantations is critical for balancing economic development with environmental conservation in Southeast Asia. However, existing plantation maps often suffer from low spatial resolution and a lack of recent temporal coverage, impeding effective surveillance of rapid land-use changes. In this study, we propose a deep learning framework to generate 10-meter resolution oil palm plantation maps for Indonesia and Malaysia from 2020 to 2024, utilizing Sentinel-2 imagery without requiring new manual annotations. To address the resolution mismatch between coarse 100-meter historical labels and 10-meter imagery, we employ a U-Net architecture optimized with Determinant-based Mutual Information (DMI). This approach effectively mitigates the influence of label noise. We validated our method against 2,058 manually verified points, achieving overall accuracies of 70.64%, 63.53%, and 60.06% for the years 2020, 2022, and 2024, respectively. Our comprehensive analysis reveals that oil palm coverage in the region peaked in 2022 before experiencing a decline in 2024. Furthermore, land cover transition analysis highlights a concerning trajectory of plantation expansion into flooded vegetation areas, despite a general stabilization in rotations with other crop types. These high-resolution maps provide essential data for monitoring sustainability commitments and deforestation dynamics in the region, and the generated datasets are made publicly available at https://doi.org/10.5281/zenodo.17768444.


关键词: oil palm mapping, deep learning, U-Net, Sentinel-2, label noise, time-series, Indonesia, Malaysia


260. ❌ Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing

作者: Honghao Cai, Xiangyuan Wang, Yunhao Bai, Haohua Chen, Tianze Zhou, Runqi Wang, Wei Zhu, Yibo Chen, Xu Tang, Yao Hu, Zhen Li 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23763v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.010.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究图像编辑,使用扩散Transformer(DiT)和适配器(adapter)实现局部编辑,与PEFT(参数高效微调)高度相关,因为Block Adapter是一种轻量级适配器,属于PEFT范畴。其他关键词如大模型、MoE、SLM等均不相关。


!!! tip deepseek-chat TL;DR

提出REDEdit框架,通过区域感知适配器注入实现无掩码局部图像编辑,在保持背景不变的同时精确编辑指定区域。
摘要翻译

大型扩散变换器(Large Diffusion Transformers, DiTs)能够很好地遵循全局编辑指令,但始终会将局部编辑泄露到无关区域,这是因为联合注意力架构没有提供明确的通道来告知网络应在何处应用编辑。我们提出REDEdit,一种协同训练、指令与区域感知的适配器框架,它能在不修改骨干网络权重的情况下,将冻结的DiT改造为精确的局部编辑器。每个变换器模块中的轻量级块适配器(Block Adapter)注入一个结构化的条件流,将编辑内容(指令语义)与编辑位置(空间掩码)进行分解;学习得到的空间门控(SpatialGate)选择性地将适配器信号路由到编辑区域,同时保持图像其余部分与源图像近乎一致;区域感知损失(Region-Aware Loss)则将训练目标聚焦于发生变化的像素。由于这些组件使骨干网络的内部表示实现端到端的掩码感知,一个与编辑器联合训练的轻量级掩码预测头(MaskPredictor)能够直接从指令和源图像中定位编辑区域,从而在部署时消除对用户掩码的需求。我们在两个互补基准上进行评估:MagicBrush(具有配对真实目标)用于衡量像素级保持与编辑精度,以及Emu-Edit Test(无真实图像,涵盖9种不同编辑类别)用于对指令遵循能力和跨编辑类型的泛化能力进行压力测试。在这两个基准上,REDEdit均取得了最先进的结果,同时优于无掩码和带掩码的基线方法。一项包含七种变体的消融实验清晰地分离了每个组件的贡献。


摘要 (Abstract)

Large diffusion transformers (DiTs) follow global editing instructions well but consistently leak local edits into unrelated regions, because joint-attention architectures offer no explicit channel telling the network where to apply the edit. We introduce REDEdit, a co-trained, instruction- and region-aware adapter framework that retrofits a frozen DiT into a precise local editor without modifying its backbone weights. A lightweight Block Adapter at every transformer block injects a structured condition stream that factorizes what to edit (instruction semantics) from where to edit (spatial mask); a learned SpatialGate routes the adapter signal selectively into the edit region while keeping the rest of the image near-identical to the source; and a Region-Aware Loss focuses the training objective on the changing pixels. Because these components make the backbone’s internal representation mask-aware end-to-end, a thin MaskPredictor head trained jointly with the editor can ground the edit region directly from the instruction and source image eliminating any user-mask requirement at deployment. We evaluate on two complementary benchmarks: MagicBrush (paired ground-truth targets) to measure pixel-level preservation and edit accuracy, and Emu-Edit Test (no ground-truth images, 9 diverse edit categories) to stress-test instruction following and generalization across edit types. On both, REDEdit achieves state-of-the-art results, simultaneously outperforming mask-free and oracle-mask baselines. A seven-variant ablation cleanly isolates the contribution of each component.


关键词: Diffusion Transformers, Local Image Editing, Adapter Injection, Region-Aware, Mask-Free, Block Adapter, SpatialGate, Region-Aware Loss


261. ❌ The Optimal Sample Complexity of Multiclass and List Learning

作者: Chirag Pabbaraju 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24749v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究多类分类和列表学习的样本复杂度,属于学习理论,与给定的大模型、深度学习应用或技术原理关键词完全无关。所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文证明了多类假设类的最大超图密度由其DS维数上界,解决了Daniely和Shalev-Shwartz的猜想,从而确定了多类分类和列表学习样本复杂度的最优依赖关系。
摘要翻译

尽管基于VC维的二元分类最优样本复杂度已得到充分确立,但多元分类的最优样本复杂度问题仍未解决。多元分类的适当复杂度参数是DS维,尽管已有大量研究,其样本复杂度的上下界之间仍存在$\sqrt{\text{DS}}$的差距。
Hanneke等人(2026)的最新研究从DS维角度给出了多元分类假设类的一种新颖代数刻画。在此基础上,我们证明任何多元分类假设类的最大超图密度均受其DS维的上界约束。这证实了Daniely与Shalev-Shwartz(2014)的一个长期猜想。由此,我们确定了多元分类及列表学习(list learning)中样本复杂度对DS维的最优依赖关系。


摘要 (Abstract)

While the optimal sample complexity of binary classification in terms of the VC dimension is well-established, determining the optimal sample complexity of multiclass classification has remained open. The appropriate complexity parameter for multiclass classification is the DS dimension, and despite significant efforts, a gap of $\sqrt{\text{DS}}$ has persisted between the upper and lower bounds on sample complexity. Recent work by Hanneke et al. (2026) shows a novel algebraic characterization of multiclass hypothesis classes in terms of their DS dimension. Building up on this, we show that the maximum hypergraph density of any multiclass hypothesis class is upper-bounded by its DS dimension. This proves a longstanding conjecture of Daniely and Shalev-Shwartz (2014). As a consequence, we determine the optimal dependence of the sample complexity on the DS dimension for multiclass as well as list learning.


关键词: multiclass classification, list learning, sample complexity, DS dimension, hypergraph density, VC dimension, algebraic characterization


262. ❌ DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detection

作者: Yanqi Wu, Xinhua Lu, Runhe Lai, Qichao Chen, Jia-Xin Zhuang, Wei-Shi Zheng, Ruixuan Wang 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23729v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主要研究视觉语言模型中的分布外检测问题,提出动态原型进化方法,不涉及大模型、深度学习技术原理创新或AI for Science等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出DynProto方法,通过动态学习OOD原型来改进视觉语言模型中的分布外检测,显著降低了FPR95并提升了AUROC。
摘要翻译

近期研究表明,利用大规模语料库中的潜在分布外(OOD)标签作为辅助信息,能够提升视觉语言模型(VLM)的OOD检测性能。然而,当现实世界中的OOD样本超出预定义的OOD标签集时,这些方法往往失效。为解决这一局限,我们提出DynProto——一种仅利用分布内(ID)信息在测试阶段动态学习OOD原型的新方法。DynProto的灵感源于一项关键发现:被预测为同一ID类别的OOD样本倾向于在特征空间中聚类。基于这一洞察,我们利用易于检测的OOD样本作为“锚点”,以发现其难以检测的相似样本。为此,DynProto引入两个模块:粗粒度OOD模式捕获模块在测试阶段缓存易与各ID类别混淆的OOD模式,细粒度OOD模式精炼模块随后对每个缓存中的模式进行聚类,并将其聚合为具有代表性的OOD原型。通过计算与ID原型及动态OOD原型的相似度,DynProto实现了精准的OOD检测。在多个基准测试中,DynProto显著优于先前方法。在ImageNet OOD基准上,DynProto将FPR95降低了11.60%,并将AUROC提升了4.70%。此外,该框架与架构无关,可集成至多种骨干网络中。


摘要 (Abstract)

Recent studies show that using potential out-of-distribution (OOD) labels from large corpora as auxiliary information can improve OOD detection in vision-language models (VLMs). However, these methods often fail when real-world OOD samples fall outside the predefined OOD label set. To address this limitation, we propose DynProto, a novel approach that learns OOD prototypes dynamically during testing using only in-distribution (ID) information. DynProto is inspired by a key observation: OOD samples predicted as the same ID class tend to cluster in the feature space. With this insight, we leverage easy-to-detect OOD samples as ``anchors’’ to find their harder-to-detect, similar counterparts. To this end, DynProto introduces two modules: \textbf{Coarse OOD Pattern Capturing Module} caches OOD patterns that are easily confused with each ID class during testing, and \textbf{Fine-grained OOD Pattern Refinement Module} subsequently clusters these patterns within each cache and aggregates them into representative OOD prototypes. By measuring similarity to ID and dynamic OOD prototypes, DynProto enables accurate OOD detection. DynProto significantly outperforms prior methods across multiple benchmarks. On ImageNet OOD benchmark, DynProto reduces FPR95 by 11.60% and improves AUROC by 4.70%. Moreover, the framework is architecture-agnostic and can be integrated into various backbones.


关键词: Out-of-Distribution Detection, Vision-Language Models, Prototype Learning, Dynamic Evolution, OOD Detection, Feature Clustering


263. ❌ SpecRLBench: A Benchmark for Generalization in Specification-Guided Reinforcement Learning

作者: Zijian Guo, İlker Işık, H. M. Sabbir Ahmad, Wenchao Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24729v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主题为规范引导的强化学习(RL)基准测试,不涉及大模型、深度学习技术原理创新或AI在科学领域的应用。所有关键词均与LLM、深度学习模型或AI for Science相关,而论文专注于LTL规范下的RL泛化能力,与给定关键词完全无关。


!!! tip deepseek-chat TL;DR

该论文提出了SpecRLBench基准,用于评估基于线性时序逻辑的规范引导强化学习方法在未见规范和多样化环境中的泛化能力。
摘要翻译

规范引导的强化学习(specification-guided reinforcement learning, RL)提供了一种基于原则的框架,用于利用线性时序逻辑(linear temporal logic, LTL)等形式化规范对复杂的、具有时间延展性的任务进行编码。尽管近期方法已展现出有前景的结果,但其在未见过的规范及多样化环境中的泛化能力仍未被充分理解。在本工作中,我们提出了SpecRLBench,一个旨在评估基于LTL的规范引导强化学习方法泛化能力的基准测试。该基准涵盖导航与操作领域中的多个难度层级,包含静态与动态环境、多样的机器人动力学特性以及不同的观测模态。通过广泛的实证评估,我们刻画了现有方法的优势与局限,并揭示了随着规范与环境复杂度增加而涌现的挑战。SpecRLBench为系统性比较提供了结构化平台,并支持开发更具泛化能力的规范引导强化学习方法。代码已开源:https://github.com/BU-DEPEND-Lab/SpecRLBench。


摘要 (Abstract)

Specification-guided reinforcement learning (RL) provides a principled framework for encoding complex, temporally extended tasks using formal specifications such as linear temporal logic (LTL). While recent methods have shown promising results, their ability to generalize across unseen specifications and diverse environments remains insufficiently understood. In this work, we introduce SpecRLBench, a benchmark designed to evaluate the generalization capabilities of LTL-based specification-guided RL methods. The benchmark spans multiple difficulty levels across navigation and manipulation domains, incorporating both static and dynamic environments, diverse robot dynamics, and varied observation modalities. Through extensive empirical evaluation, we characterize the strengths and limitations of existing approaches and reveal the challenges that emerge as specification and environment complexity increase. SpecRLBench provides a structured platform for systematic comparison and supports the development of more generalizable specification-guided RL methods. Code is available at https://github.com/BU-DEPEND-Lab/SpecRLBench.


关键词: Specification-guided RL, Linear Temporal Logic, Generalization, Benchmark, Navigation, Manipulation, Dynamic Environments


264. ❌ Conflict-Aware Harmonized Rotational Gradient for Multiscale Kinetic Regimes

作者: Zhangyong Liang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24745v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多尺度动力学问题的梯度方法,属于科学计算和数值方法领域,与关键词中的大模型、深度学习技术原理创新无关,也未涉及AI for Science中的生物信息学或化学信息学。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

论文提出一种冲突感知的协调旋转梯度方法(HRGrad),用于同时求解多尺度时间依赖动力学问题,克服了渐近保持神经网络的失败模式。
摘要翻译

本文提出一种名为HRGrad的协调旋转梯度方法,用于同时处理具有变化小参数的多尺度含时动力学问题。这些参数展现出从微观到宏观物理的渐近转变,使得在所有范围内同时求解成为一个具有挑战性的多任务问题。在不同渐近区域求解任务时常会遇到梯度冲突,这可能导致多任务学习的失败。为应对这一挑战,我们显式编码了这些参数的隐藏表示,确保相应的求解任务被序列化以进行同步训练。此外,为缓解梯度冲突,我们对预测结果进行分段以构建任务损失,并引入一种新颖的梯度对齐度量,确保最终更新与每个特定损失梯度之间的点积为正。该度量维持所有任务损失的一致优化速率,并根据冲突水平动态调整梯度幅度。进一步地,我们提供了数学证明,展示了HRGrad方法的收敛性,并在一系列具有挑战性的渐近保持神经网络(APNNs)场景中对其进行了评估。我们开展了大量实验,涵盖了所有克努森数范围内的Bhatnagar-Gross-Krook(BGK)方程和线性输运方程。结果表明,HRGrad有效克服了这些问题中APNNs的“失效模式”。


摘要 (Abstract)

In this paper, we propose a harmonized rotational gradient method, termed HRGrad, for simultaneously tackling multiscale time-dependent kinetic problems with varying small parameters. These parameters exhibit asymptotic transitions from microscopic to macroscopic physics, making it a challenging multi-task problem to solve over all ranges simultaneously. Solving tasks in different asymptotic regions often encounter gradient conflicts, which can lead to the failure of multi-task learning. To address this challenge, we explicitly encode a hidden representation of these parameters, ensuring that the corresponding solving tasks are serialized for simultaneous training. Furthermore, to mitigate gradient conflicts, we segment the prediction results to construct task losses and introduce a novel gradient alignment metric to ensure a positive dot product between the final update and each loss-specific gradient. This metric maintains consistent optimization rates for all task losses and dynamically adjusts gradient magnitudes based on conflict levels. Moreover, we provide a mathematical proof demonstrating the convergence of the HRGrad method, which is evaluated across a range of challenging asymptotic-preserving neural networks (APNNs) scenarios. We conduct an extensive set of experiments encompassing the Bhatnagar-Gross-Krook (BGK) equation and the linear transport equation in all ranges of Knudsen number. Our results indicate that HRGrad effectively overcomes the `failure modes’ of APNNs in these problems.


关键词: Harmonized Rotational Gradient, Multiscale Kinetic Regimes, Asymptotic-Preserving Neural Networks, Gradient Conflict, Bhatnagar-Gross-Krook Equation, Linear Transport Equation, Multi-task Learning


265. ❌ Exploiting Differential Flatness for Efficient Learning-based Model Predictive Control of Constrained Multi-Input Control Affine Systems

作者: Tobias A. Farger, Adam W. Hall, Angela P. Schoellig 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24706v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究基于微分平坦性的学习型模型预测控制,属于机器人控制领域,未涉及大模型、深度学习或AI for Science等关键词。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出一种利用微分平坦性的高效学习型模型预测控制器,适用于多输入约束仿射系统,在满足约束的同时显著提升计算效率。
摘要翻译

基于学习的控制技术利用历史轨迹数据来对具有不确定动态特性的系统进行控制。然而,基于学习的控制器通常计算效率低下,限制了其实用性。为解决这一局限,我们提出了一种利用微分平坦性(differential flatness)的基于学习的控制器,该性质为许多机器人系统所具备。近期关于利用平坦性进行基于学习控制的研究存在局限性,具体表现为:(i) 忽略输入约束,(ii) 仅适用于单输入系统,或 (iii) 针对特定平台定制。相比之下,我们的方法通过系统扩展和块对角代价函数(block-diagonal cost formulation)来对通用的多输入非线性仿射系统进行控制。此外,该方法满足输入约束和半空间平坦状态约束(half-space flat state constraints),并仅通过两次顺序凸优化即可保证概率意义上的李雅普诺夫下降(probabilistic Lyapunov decrease)。我们通过仿真实验表明,该方法与高斯过程模型预测控制器(Gaussian process model predictive controller)性能相近,但计算效率高出数倍,并在真实硬件实验中实现了具有竞争力的跟踪效果。


摘要 (Abstract)

Learning-based control techniques use data from past trajectories to control systems with uncertain dynamics. However, learning-based controllers are often computationally inefficient, limiting their practicality. To address this limitation, we propose a learning-based controller that exploits differential flatness, a property of many robotic systems. Recent research on using flatness for learning-based control either is limited in that it (i) ignores input constraints, (ii) applies only to single-input systems, or (iii) is tailored to specific platforms. In contrast, our approach uses a system extension and block-diagonal cost formulation to control general multi-input, nonlinear, affine systems. Furthermore, it satisfies input and half-space flat state constraints and guarantees probabilistic Lyapunov decrease using only two sequential convex optimizations. We show that our approach performs similarly to, but is multiple times more efficient than, a Gaussian process model predictive controller in simulation, and achieves competitive tracking in real hardware experiments.


关键词: differential flatness, learning-based model predictive control, multi-input control affine systems, input constraints, probabilistic Lyapunov decrease, convex optimization, robotic systems


266. ❌ A Functorial Formulation of Neighborhood Aggregating Deep Learning

作者: Sun Woo Park, Yun Young Choi, U Jin Choi, Youngho Woo 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24672v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出了一种基于预层和余层的数学框架来解释卷积神经网络(消息传递神经网络)的局限性,属于深度学习理论,但完全不涉及大语言模型、生成式AI、微调、推理加速等关键词。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文通过拓扑空间上连续函数集的预层和余层,为邻域聚合深度学习(如图卷积网络)提供了数学解释,并揭示了其经验局限性。
摘要翻译

我们通过使用拓扑空间上连续函数集合的预层(presheaf)与共预层(copresheaf),对卷积(或消息传递)神经网络给出了一种数学解释。基于这一解释,我们提出了一种理论启发式方法,通过利用拓扑空间上此类连续函数集合在成为层(sheaf)或共预层(copresheaf)时所存在的障碍,详细阐述了这些神经网络的一系列经验局限性。


摘要 (Abstract)

We provide a mathematical interpretation of convolutional (or message passing) neural networks by using presheaves and copresheaves of the set of continuous functions over a topological space. Based on this interpretation, we formulate a theoretical heuristic which elaborates a number of empirical limitations of these neural networks by using obstructions on such sets of continuous functions over a topological space to be sheaves or copresheaves.


关键词: convolutional neural networks, message passing neural networks, presheaves, copresheaves, topological space, sheaf theory, neighborhood aggregation


267. ❌ Diffusion-Guided Feature Selection via Nishimori Temperature: Noise-Based Spectral Embedding

作者: Vasiliy S. Usatyuk, Denis A. Sapozhnikov, Sergey I. Egorov 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24692v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出了一种基于噪声的谱嵌入方法(NBSE)用于高维数据特征选择,利用Nishimori温度从Bethe Hessian矩阵中提取特征。该方法与深度学习或大语言模型无关,主要涉及图论、谱分析和统计物理。虽然实验使用了ImageNet嵌入(来自MobileNetV2和EfficientNet-B4),但核心方法并非深度学习创新,也未涉及大模型或AI for Science的具体应用。因此,所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于Nishimori温度的噪声谱嵌入方法(NBSE),用于高维数据的无监督特征选择,通过构建稀疏相似图并利用Bethe Hessian矩阵的临界特征向量来识别冗余特征,实验表明在ImageNet嵌入上压缩70%特征时准确率下降不到1%。
摘要翻译

我们提出基于噪声的谱嵌入(Noise-Based Spectral Embedding, NBSE),这是一种物理信息驱动的框架,无需贪婪搜索即可从高维数据中选择信息性特征。NBSE在样本上构建一个稀疏相似图,并识别出Nishimori温度$β_N$,即Bethe Hessian矩阵变为奇异时的临界逆温度。对应的最小特征向量捕捉了内在度校正扩散过程的主导模式,自然地重新加权节点以防止枢纽节点主导。通过转置数据矩阵并在特征空间中应用NBSE,我们获得一个一维谱嵌入,该嵌入揭示了冗余或语义相关维度的分组;随后通过平衡分箱从每组中选取一个代表性特征。我们证明,有色高斯扰动最多使$β_N$偏移$O(\barσ^2)$,从而保证对测量噪声的鲁棒性。在来自MobileNetV2和EfficientNet-B4的ImageNet嵌入上的实验表明,即使在激进压缩下,NBSE也能保持分类准确率:在EfficientNet-B4上,当仅保留$30%$的特征时,准确率下降低于$1%$,比ANOVA $F$检验和随机选择方法高出最多$6.8%$。


摘要 (Abstract)

We propose Noise-Based Spectral Embedding (NBSE), a physics-informed framework for selecting informative features from high-dimensional data without greedy search. NBSE constructs a sparse similarity graph on the samples and identifies the Nishimori temperature $β_N$ the critical inverse temperature at which the Bethe Hessian becomes singular. The corresponding smallest eigenvector captures the dominant mode of an intrinsically degree-corrected diffusion process, naturally reweighting nodes to prevent hub dominance. By transposing the data matrix and applying NBSE in feature space, we obtain a one-dimensional spectral embedding that reveals groups of redundant or semantically related dimensions; balanced binning then selects one representative per group. We prove that coloured Gaussian perturbations shift $β_N$ by at most $O(\barσ^2)$, guaranteeing robustness to measurement noise. Experiments on ImageNet embeddings from MobileNetV2 and EfficientNet-B4 show that NBSE preserves classification accuracy even under aggressive compression: on EfficientNet-B4 the accuracy drop is below $1%$ when retaining only $30%$ of features, outperforming ANOVA $F$-test and random selection by up to $6.8%$.


关键词: Noise-Based Spectral Embedding, Nishimori temperature, Bethe Hessian, feature selection, spectral embedding, ImageNet embeddings


268. ❌ Energy-Arena: A Dynamic Benchmark for Operational Energy Forecasting

作者: Max Kleinebrahm, Jonathan Berrisch, Philipp Eiser, Wolf Fichtner, Veit Hagenmeyer, Matthias Hertel, Nils Koster, Sebastian Lerch, Ralf Mikut, Jan Priesmann, Melanie Schienle, Benjamin Schaefer, Jann Weinand, Florian Ziel 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24705v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文专注于能源时间序列预测的基准平台,不涉及大模型、深度学习或AI for Science(生物/化学信息学)等关键词。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了Energy-Arena,一个动态的、基于API的能源时间序列预测基准平台,通过前瞻性评估和标准化提交来解决传统基准的不可比性问题。
摘要翻译

能源预测研究长期面临可比较性差距,这使得难以衡量随时间推移的一致进展。已报告的精度提升往往无法直接比较,因为模型是在特定研究的数据集、时间段、信息集和评分设置下进行评估的,而广泛使用的基准测试和竞赛数据集通常与固定的历史窗口绑定。本文介绍了Energy-Arena(能源竞技场),这是一个面向运行级能源时间序列预测的动态基准测试平台,能够随着能源系统的演变提供持续更新的参考点。该平台以开放的、基于API(应用程序接口)的提交系统运行,并根据运行约束标准化挑战定义与提交截止日期。通过持久排行榜在滚动评估窗口上报告性能。通过从事后回测转向前瞻性基准测试,Energy-Arena强制执行标准化的事前提交与事后评估,从而通过防止信息泄露和回溯调优来提高透明度。该平台可通过Energy-Arena.org公开访问。


摘要 (Abstract)

Energy forecasting research faces a persistent comparability gap that makes it difficult to measure consistent progress over time. Reported accuracy gains are often not directly comparable because models are evaluated under study-specific datasets, time periods, information sets, and scoring setups, while widely used benchmarks and competition datasets are typically tied to fixed historical windows. This paper introduces the Energy-Arena, a dynamic benchmarking platform for operational energy time series forecasting that provides a continuously updated reference point as energy systems evolve. The platform operates as an open, API-based submission system and standardizes challenge definitions and submission deadlines aligned with operational constraints. Performance is reported on rolling evaluation windows via persistent leaderboards. By moving from retrospective backtesting to forward-looking benchmarking, the Energy-Arena enforces standardized ex-ante submission and ex-post evaluation, thereby improving transparency by preventing information leakage and retroactive tuning. The platform is publicly available at Energy-Arena.org.


关键词: energy forecasting, benchmarking platform, time series forecasting, operational forecasting, API-based submission, rolling evaluation, transparency


269. ❌ Dual Control of Linear Systems from Bilinear Observations with Belief Space Model Predictive Control

作者: Daniel Cao, Beixi Du, Andrew Lowitt, Sunmook Choi, Sarah Dean, Yahya Sattar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24663v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究线性系统的双控制问题,涉及状态估计和模型预测控制,与所有列出的关键词(大模型、深度学习、AI for Science等)完全无关。没有匹配任何关键词。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于信念空间模型预测控制的方法,用于解决具有双线性观测的线性系统的有限时域二次控制问题,通过考虑输入依赖的卡尔曼滤波器来优化控制输入,从而改善状态估计和不确定性感知。
摘要翻译

我们研究了具有双线性观测的线性系统的有限时域二次控制问题,其中控制输入不仅影响状态动态,还影响状态的部分观测。在此设定下,分离原理可能失效,因为控制输入会影响未来状态估计的质量。状态估计需要一种依赖于输入的卡尔曼滤波器,其增益和误差协方差随控制输入的函数而变化。为应对这一挑战,我们提出了一种信念空间模型预测控制($\texttt{B-MPC}$)方法,该方法直接对估计状态及其误差协方差进行规划。具体而言,$\texttt{B-MPC}$ 利用由输入依赖型卡尔曼滤波器定义的信念演化的确定性替代模型进行规划。通过在两个合成场景中的数值实验,我们表明 $\texttt{B-MPC}$ 在有利条件下能够优于分离原理控制器及其MPC变体,并且这些性能提升伴随着更低的估计协方差以及更具不确定性意识的行动选择。


摘要 (Abstract)

We study finite-horizon quadratic control of linear systems with bilinear observations, in which the control input affects not only the state dynamics but also the partial observations of the state. In this setting, the separation principle can fail because control inputs influence the future quality of state estimates. State estimation requires an input-dependent Kalman filter whose gain and error covariance evolve as functions of the control inputs. To address this challenge, we propose a belief-space model predictive control ($\texttt{B-MPC}$) method that plans directly over both the estimated state and its error covariance. In particular, $\texttt{B-MPC}$ plans with a deterministic surrogate of the belief evolution defined by the input-dependent Kalman filter. Through numerical experiments in two synthetic settings, we show that $\texttt{B-MPC}$ can outperform both the separation-principle controller and its MPC variant in favorable regimes, and that these gains are accompanied by lower estimation covariance and more uncertainty-aware action choices.


关键词: Bilinear Observations, Belief Space, Model Predictive Control, Kalman Filter, Control Theory, State Estimation, Uncertainty


270. ❌ Computational Design and Experimental Validation of Photoactive PARP1 Inhibitors

作者: Simon Axelrod, Miroslav Kašpar, Kristýna Jelínková, Markéta Šmídková, Erika Bartůňková, Sille Štěpánová, Eugene Shakhnovich, Václav Kašička, Martin Dračínský, Zlatko Janeba, Rafael Gómez-Bombarelli 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24634v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注计算设计和实验验证光激活PARP1抑制剂,使用了机器学习(ML)力场、量子化学计算、分子对接、自由能微扰等计算技术,但未涉及任何大模型(LLMs)或相关技术(如MoE、RLHF、RAG等)。关键词中仅’AI for Science’高度相关,因为论文将AI/ML应用于药物发现(生物信息学/化学信息学)。其他关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文通过结合机器学习力场、量子化学计算和分子对接等计算技术,从500万虚拟配体中筛选并实验验证了光激活PARP1抑制剂,其中化合物1在绿光照射下对PARP1的抑制活性提高了15倍。
摘要翻译

光激活药物是一种有前景的治疗局部疾病的方法,尤其适用于现有疗法存在严重副作用的疾病。然而,这类药物的开发因需要同时优化一系列光物理和生物学性质而变得复杂。本研究利用计算技术,筛选出一组有望用于光激活抑制聚(ADP-核糖)聚合酶1(PARP1)癌症靶点的候选化合物。基于我们近期开发的原子模拟与机器学习(ML)方法,我们对500万个假设性光活性配体进行了筛选。我们的工作流程包括:利用蛋白质-配体对接识别在光照和黑暗条件下对PARP1结合能力存在差异的候选分子;采用ML力场和量子化学计算预测p$K_\mathrm{a}$、吸收光谱和热半衰期;使用基于图的替代模型筛选更多化合物;结合ML力场的激发态非绝热动力学估算量子产率;以及利用自由能微扰(FEP)优化结合预测。基于这些预测,我们优先选出了一小组合成可行的候选分子,这些分子预期具有红移吸收光谱、秒至分钟量级的热半衰期,并在可见光控制下表现出依赖于异构体的PARP1结合能力。我们合成了10个候选分子,并实验表征了它们的光行为及PARP1抑制常数。在验证的化合物中,\textbf{1}在519 nm绿光照射下对PARP1的抑制活性提高了15倍(208.8 $\pm$ 28.3 $μ$M 对比 14.4 $\pm$ 1.9 $μ$M)。这些结果验证了计算引导的筛选策略在识别红移PARP1光抑制剂方面的有效性,同时也揭示了当前存在的局限性,例如在水性介质中快速的热弛豫问题。


摘要 (Abstract)

Light-activated drugs are a promising way to treat localized diseases for which existing treatments have severe side effects. However, their development is complicated by the set of photophysical and biological properties that must be simultaneously optimized. Here we used computational techniques to find a set of promising candidates for the photoactive inhibition of the poly(ADP-ribose) polymerase 1 (PARP1) cancer target. Using our recently developed methods based on atomistic simulation and machine learning (ML), we screened a set of 5 million hypothetical photoactive ligands. Our workflow used protein-ligand docking to identify candidates with differential PARP1 binding under light and dark conditions; ML force fields and quantum chemistry calculations to predict p$K_\mathrm{a}$, absorption spectra, and thermal half-lives; graph-based surrogate models to screen additional compounds; excited-state nonadiabatic dynamics with ML force fields to estimate quantum yields; and free energy perturbation (FEP) to refine binding predictions. From these predictions, we prioritized a small set of synthetically feasible candidates expected to have red-shifted absorption spectra, thermal half-lives on the order of seconds to minutes, and isomer-dependent PARP1 binding under visible-light control. We synthesized 10 candidates and experimentally characterized their photobehavior and PARP1 inhibition constants. Among the validated compounds, \textbf{1} showed a 15-fold increase in inhibition of PARP1 upon green-light irradiation at 519 nm (208.8 $\pm$ 28.3 $μ$M vs 14.4 $\pm$ 1.9 $μ$M). These results validate the computation-guided screening strategy for identifying red-shifted PARP1 photoinhibitors, while also underscoring current limitations such as rapid thermal relaxation in aqueous media.


关键词: photoactive PARP1 inhibitors, machine learning force fields, protein-ligand docking, quantum chemistry, free energy perturbation, drug discovery, computational screening


271. ❌ The Last Human-Written Paper: Agent-Native Research Artifacts

作者: Jiachen Liu, Jiaxin Pei, Jintao Huang, Chenglei Si, Ao Qu, Xiangru Tang, Runyu Lu, Lichang Chen, Xiaoyan Bai, Haizhong Zheng, Carl Chen, Zhiyang Chen, Haojie Ye, Yujuan Fu, Zexue He, Zijian Jin, Zhenyu Zhang, Shangquan Sun, Maestro Harmon, John Dianzhuo Wang, Jianqiao Zeng, Jiachen Sun, Mingyuan Wu, Baoyu Zhou, Yuchen You, Shijian Lu, Yiming Qiu, Fan Lai, Yuan Yuan, Yao Li, Junyuan Hong, Ruihao Zhu, Beidi Chen, Alex Pentland, Ang Chen, Mosharaf Chowdhury, Zechen Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24658v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.015.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文提出Agent-Native Research Artifact (Ara)协议,旨在用机器可执行的研究包替代传统论文,以支持AI代理理解、复现和扩展研究。核心涉及LLM Agents(权重1.0),因为Ara专门为AI代理设计,使其能够自主执行研究任务。其他关键词如LLMs本身是基础,但论文更侧重代理工作流而非模型技术。无专家作者。


!!! tip deepseek-chat TL;DR

该论文提出Agent-Native Research Artifact (Ara)协议,通过结构化研究包提升AI代理对科学论文的理解和复现能力,实验显示问答准确率从72.4%提升至93.7%,复现成功率从57.4%提升至64.4%。
摘要翻译

科学出版物将分支迭代的研究过程压缩为线性叙事,丢弃了沿途发现的大部分内容。这种编纂方式带来了两种结构性成本:一是“叙事税”(Storytelling Tax),即失败的实验、被否定的假设以及分支探索过程被舍弃以适配线性叙事;二是“工程税”(Engineering Tax),即审稿人可读的文本与智能体可执行的规范之间存在差距,导致关键实现细节未被记录。这些成本对人类读者而言尚可容忍,但当AI智能体必须理解、复现并扩展已发表成果时,便成为关键障碍。我们提出“智能体原生研究制品”(Agent-Native Research Artifact, Ara),这是一种以机器可执行研究包替代叙事论文的协议,其结构包含四个层次:科学逻辑、附带完整规范的可执行代码、保留被丢弃失败记录的探索图谱,以及将每项主张锚定于原始输出的证据。生态系统由三种机制支撑:在常规开发过程中捕获决策与死胡同的“实时研究管理器”(Live Research Manager);将传统PDF与代码仓库转化为Ara的“Ara编译器”(Ara Compiler);以及自动化客观检查的“Ara原生评审系统”(Ara-native review system),使人类审稿人可聚焦于重要性、新颖性与品味。在PaperBench与RE-Bench基准测试中,Ara将问答准确率从72.4%提升至93.7%,复现成功率从57.4%提升至64.4%。在RE-Bench的五项开放式扩展任务中,Ara保留的失败轨迹加速了进展,但根据智能体的能力差异,也可能限制其跳出先前运行框架的探索范围。


摘要 (Abstract)

Scientific publication compresses a branching, iterative research process into a linear narrative, discarding the majority of what was discovered along the way. This compilation imposes two structural costs: a Storytelling Tax, where failed experiments, rejected hypotheses, and the branching exploration process are discarded to fit a linear narrative; and an Engineering Tax, where the gap between reviewer-sufficient prose and agent-sufficient specification leaves critical implementation details unwritten. Tolerable for human readers, these costs become critical when AI agents must understand, reproduce, and extend published work. We introduce the Agent-Native Research Artifact (Ara), a protocol that replaces the narrative paper with a machine-executable research package structured around four layers: scientific logic, executable code with full specifications, an exploration graph that preserves the failures compilation discards, and evidence grounding every claim in raw outputs. Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an Ara Compiler that translates legacy PDFs and repos into Aras; and an Ara-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste. On PaperBench and RE-Bench, Ara raises question-answering accuracy from 72.4% to 93.7% and reproduction success from 57.4% to 64.4%. On RE-Bench’s five open-ended extension tasks, preserved failure traces in Ara accelerate progress, but can also constrain a capable agent from stepping outside the prior-run box depending on the agent’s capabilities.


关键词: Agent-Native Research Artifact, AI agents, scientific reproducibility, research artifacts, machine-executable research, exploration graph


272. ❌ Uncovering Latent Patterns in Social Media Usage and Mental Health: A Clustering-Based Approach Using Unsupervised Machine Learning

作者: Md All Shahria, Sanjeda Dewan Mithila, Touhid Alam, Mohammad Sakib Mahmood, Mahfuza Khatun 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24611v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文使用无监督机器学习(K-Means聚类)分析社交媒体使用与心理健康的关系,不涉及大模型、深度学习技术原理或AI for Science。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该研究通过K-Means聚类方法对551名参与者的社交媒体使用和心理健康数据进行聚类分析,发现6个用户群体,并揭示了社交媒体使用时长与焦虑之间的弱相关性。
摘要翻译

社交媒体的广泛普及引发了对其心理效应的关注,尤其是在焦虑、抑郁、孤独感和睡眠质量等心理健康指标方面,因为这些平台正日益影响社交互动与个体福祉。尽管已有研究探讨了社交媒体使用与心理健康之间的相关性,但鲜有研究利用无监督机器学习(unsupervised machine learning)基于行为与心理模式对用户进行细分,从而在识别不同群体的差异化风险特征方面存在空白。本研究旨在通过聚类分析(clustering)根据个体的社交媒体使用模式与心理健康状况进行人群细分,以揭示潜在模式并评估其心理健康影响。研究通过在线问卷调查收集了551名参与者的数据,采用KNN插补(KNN imputation)处理缺失值,对包含5个唯一值的分类变量(如性别)进行独热编码(one-hot encoding),并运用IQR(四分位距)与Z-score(Z分数)方法进行异常值检测。通过肘部法则(Elbow Method)与轮廓系数(Silhouette Score)0.32确定最优聚类数为6的K-Means聚类(K-Means clustering)被应用于分析,同时采用主成分分析(PCA)将22个维度降维以进行可视化,并通过相关性热图(correlation heatmap)揭示变量间关系,例如社交媒体使用时长与焦虑之间的相关系数为0.28。


摘要 (Abstract)

The widespread adoption of social media has heightened interest in its psychological effects, particularly on mental health indicators such as anxiety, depression, loneliness, and sleep quality, as these platforms increasingly influence social interactions and well-being. Although previous research has examined correlations between social media use and mental health, few studies have utilized unsupervised machine learning to segment users based on behavioral and psychological patterns, leaving a gap in identifying distinct risk profiles across diverse groups. This study seeks to address this by segmenting individuals according to their social media usage and psychological well-being, employing clustering to reveal hidden patterns and evaluate their mental health implications. Data from 551 participants, collected via an online survey, were preprocessed using KNN imputation for missing values, one-hot encoding for categorical variables like Gender with 5 unique values, and outlier detection via IQR and Z-score methods. K-Means clustering, optimized at 6 clusters using the Elbow Method and a Silhouette Score of 0.32, was applied, with PCA reducing 22 dimensions for visualization and a correlation heatmap highlighting relationships, such as a 0.28 correlation between social media hours and anxiety.


关键词: social media, mental health, clustering, K-Means, unsupervised machine learning, anxiety, depression


273. ❌ Fraud Detection in Cryptocurrency Markets with Spatio-Temporal Graph Neural Networks

作者: Lidia Losavio, Luca Persia, Madan Sathe, Dimosthenis Pasadakis 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24590v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究加密货币市场中的欺诈检测,使用时空图神经网络(GNN),未涉及任何大模型或深度学习技术原理创新,也未涉及AI for Science(生物/化学信息学)。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出基于图神经网络的时空模型检测加密货币市场中的操纵行为,实验表明图模型优于传统机器学习方法。
摘要翻译

加密货币市场的技术进步提高了投资者的可及性,但同时也使其面临市场操纵的风险。现有的欺诈检测机制通常依赖机器学习方法,将每个金融资产(即代币)及其相关交易视为独立对象。然而,市场操纵策略很少是孤立事件,其特点在于协调性、重复性以及相关资产之间的频繁转移。这表明关系结构构成了信号的重要组成部分,并可通过图形化手段有效表示。本文提出了三种基于聚合小时级市场数据的图构建方法。所构建的图由统一的时空图神经网络(Graph Neural Network, GNN)架构处理,该架构结合了基于注意力的空间聚合与时间Transformer编码。我们在一个包含加密货币市场拉高出货(pump-and-dump)方案的真实数据集上评估了该方法,该数据集涵盖三年以上的时间跨度。对比结果表明,基于图的模型在检测异常事件方面相较于标准机器学习基线取得了显著改进。我们的工作强调,学习到的市场连通性为检测协调性市场操纵方案提供了实质性增益。


摘要 (Abstract)

Technological advancements in cryptocurrency markets have increased accessibility for investors, but concurrently exposed them to the risks of market manipulations. Existing fraud detection mechanisms typically rely on machine learning methods that treat each financial asset (i.e., token) and its related transactions independently. However, market manipulation strategies are rarely isolated events, but are rather characterized by coordination, repetition, and frequent transfers among related assets. This suggests that relational structure constitutes an integral component of the signal and can be effectively represented through graphical means. In this paper, we propose three graph construction methods that rely on aggregated hourly market data. The proposed graphs are processed by a unified spatio-temporal Graph Neural Network (GNN) architecture that combines attention-based spatial aggregation with temporal Transformer encoding. We evaluate our methodology on a real-world dataset comprised of pump-and-dump schemes in cryptocurrency markets, spanning a period of over three years. Our comparative results showcase that our graph-based models achieve significant improvements over standard machine learning baselines in detecting anomalous events. Our work highlights that learned market connectivity provides substantial gains for detecting coordinated market manipulation schemes.


关键词: Fraud Detection, Cryptocurrency Markets, Graph Neural Networks, Spatio-Temporal, Pump-and-Dump Schemes, Market Manipulation


274. ❌ Efficient learning by implicit exploration in bandit problems with side observations

作者: Tomas Kocak, Gergely Neu, Michal Valko, Remi Munos 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24555v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究在线学习中的部分可观测问题,提出了一种名为’implicit exploration’的策略,用于bandit问题。论文内容与给定的所有关键词(大模型、深度学习、AI for Science等)均无直接关联,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文针对部分可观测的bandit问题,提出了一种基于隐式探索的高效学习算法,在无需事先知道观测系统的情况下实现了近最优的遗憾界。
摘要翻译

我们考虑在部分可观测模型下的在线学习问题,该模型描述了学习者所获信息介于完全信息与赌博机反馈之间的情境。在最简变体中,我们假设学习者除自身损失外,还能观测到其他某些行动的损失。所揭示的损失取决于学习者的行动以及由环境选择的有向观测系统。针对这一设定,我们提出了首个无需在行动选择前知晓观测系统即可获得近最优遗憾保证的算法。类似地,我们还定义了一种新的部分信息设定,用于建模在线组合优化问题,其中学习者接收的反馈介于半赌博机反馈与完全反馈之间。由于我们的第一个算法在此设定下无法始终高效计算,我们提出了另一种具有相似性质且始终具备计算高效性的算法,但代价是调参机制稍显复杂。两种算法均依赖于一种名为隐式探索的新型探索策略,该策略在计算效率与信息论效率上均优于此前针对该问题研究的探索策略。


摘要 (Abstract)

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition to its own loss, the learner also gets to observe losses of some other actions. The revealed losses depend on the learner’s action and a directed observation system chosen by the environment. For this setting, we propose the first algorithm that enjoys near-optimal regret guarantees without having to know the observation system before selecting its actions. Along similar lines, we also define a new partial information setting that models online combinatorial optimization problems where the feedback received by the learner is between semi-bandit and full feedback. As the predictions of our first algorithm cannot be always computed efficiently in this setting, we propose another algorithm with similar properties and with the benefit of always being computationally efficient, at the price of a slightly more complicated tuning mechanism. Both algorithms rely on a novel exploration strategy called implicit exploration, which is shown to be more efficient both computationally and information-theoretically than previously studied exploration strategies for the problem.


关键词: online learning, bandit problems, partial observability, implicit exploration, regret bounds, combinatorial optimization


275. ❌ Enhancing molecular dynamics with equivariant machine-learned densities

作者: Mihail Bogojeski, Muhammad R. Hasyim, Leslie Vogt-Maranto, Klaus-Robert Müller, Kieron Burke, Mark E. Tuckerman 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24563v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注机器学习在科学领域的应用,特别是使用等变神经网络预测电子密度以加速分子动力学模拟,属于AI for Science范畴,与AI for Science关键词高度相关(10分)。其他关键词如大语言模型、MoE、SLM等均不涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出DenSNet,一种基于等变神经网络预测电子密度的方法,结合Δ学习策略,实现了从核构型到电子密度的映射,并用于分子动力学模拟,在红外光谱预测上取得与实验和DFT一致的结果。
摘要翻译

机器学习原子间势能(MLIPs)已能够以接近从头算的精度进行分子动力学模拟,但其构造本身仅限于能量和力的预测,无法获取诸如偶极矩和极化率等电子可观测量。我们提出DenSNet,一种以密度为先的机器学习电子结构方法,该方法学习从核构型到基态电子密度的Hohenberg-Kohn映射。我们的方法采用SE(3)-等变神经网络来预测柔性原子中心高斯基组的密度系数,并结合Δ-学习策略,将叠加的原子密度作为先验以加速训练。随后,第二个等变网络将预测的密度映射到总能量,从而为分子动力学和电子结构提供统一框架。我们在乙醇、乙硫醇和间苯二酚上验证了DenSNet,从机器学习轨迹获得的红外光谱与实验气相测量结果高度吻合。为测试可扩展性,我们在含1至6个单体的聚噻吩低聚物上进行训练,并外推至多达12个单体的链,生成了稳定的长时间轨迹,其红外光谱与参考密度泛函理论计算结果一致。在此,我们证明将电子密度恢复为核心学习量,为大规模分子模拟中光谱与电子观测量的可迁移预测开辟了一条实用路径。


摘要 (Abstract)

Machine-learning interatomic potentials (MLIPs) have enabled molecular dynamics at near ab initio accuracy, yet remain limited to energies and forces by construction, leaving electronic observables such as dipole moments and polarizabilities inaccessible. We introduce DenSNet, a density-first approach to machine-learned electronic structure that learns the Hohenberg–Kohn map from nuclear configurations to the ground-state electron density. Our approach employs an SE(3)-equivariant neural network to predict density coefficients of a flexible atom-centered Gaussian basis, combined with a $Δ$-learning strategy that uses superposed atomic densities as a prior to accelerate training. A second equivariant network then maps the predicted density to the total energy, providing a unified framework for molecular dynamics and electronic structure. We validate DenSNet on ethanol, ethanethiol, and resorcinol, where infrared spectra from machine-learned trajectories show excellent agreement with experimental gas-phase measurements. To test scalability, we train on polythiophene oligomers with 1–6 monomers and extrapolate to chains of up to 12 monomers, generating stable long-time trajectories whose infrared spectra agree with reference density functional theory calculations. Here, we show that reinstating the electron density as the central learned quantity opens a practical route to transferable prediction of spectroscopic and electronic observables in large-scale molecular simulations.


关键词: equivariant neural network, electron density, molecular dynamics, machine learning interatomic potentials, infrared spectra, Δ-learning, DenSNet


276. ❌ GSC-QEMit: A Telemetry-Driven Hierarchical Forecast-and-Bandit Framework for Adaptive Quantum Error Mitigation

作者: Steven Szachara, Sheeraja Rajakrishnan, Dylan Jay Van Allen, Jason Pollack, Travis Desell, Daniel Krutz 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24551v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究量子误差缓解(QEM),提出GSC-QEMit框架,使用GHSOM聚类、高斯过程预测和上下文多臂老虎机进行自适应缓解。论文完全不涉及大模型、深度学习或AI for Science(生物/化学信息学),所有关键词均与论文内容无关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一个基于遥测的分层预测与老虎机框架GSC-QEMit,用于自适应量子误差缓解,在非平稳噪声下提高逻辑保真度并减少不必要的重干预。
摘要翻译

量子误差缓解(QEM)对于从近期量子设备中提取可靠结果至关重要,然而实际部署必须在时变噪声环境下平衡缓解强度与运行时开销。我们提出了一种名为GSC-QEMit的遥测驱动型自适应缓解框架,该框架采用“上下文-预测-赌博机”(context-forecast-bandit)架构,能够根据噪声漂移的演变在轻量级抑制与较重干预之间动态切换。GSC-QEMit由三个耦合模块组成:(G)一种生长型层次自组织映射(GHSOM),用于将流式遥测数据聚类为运行上下文;(S)一种不确定性感知的子采样高斯过程预测器,用于预测短时保真度退化;(C)一种成本感知的上下文多臂赌博机(CMAB),通过引入显式干预成本的汤普森采样来选择缓解动作。我们在Qiskit Aer模拟的非平稳噪声环境下,基于基准电路系列(GHZ态、量子傅里叶变换和Grover搜索)对GSC-QEMit进行了评估,并使用了一个仪器化测试平台,其中动作标签对应分级缓解强度。在克利福德(Clifford)、非克利福德(non-Clifford)及结构化工作负载上,与未缓解的执行相比,GSC-QEMit将平均逻辑保真度提升了**+9.0%**,同时通过将重干预保留用于推断出的噪声尖峰,减少了不必要的重干预次数。由此产生的策略在保真度与成本之间展现出良好的权衡,并且无需针对特定电路进行调优即可在评估的工作负载间迁移。


摘要 (Abstract)

Quantum error mitigation (QEM) is essential for extracting reliable results from near-term quantum devices, yet practical deployments must balance mitigation strength against runtime overhead under time-varying noise. We introduce \emph{GSC-QEMit}, a telemetry-driven, \textbf{context–forecast–bandit} framework for \emph{adaptive} mitigation that switches between lightweight suppression and heavier intervention as drift evolves. GSC-QEMit composes three coupled modules: (G) a Growing Hierarchical Self-Organizing Map (GHSOM) that clusters streaming telemetry into operating contexts; (S) an uncertainty-aware subsampled Gaussian-process forecaster that predicts short-horizon fidelity degradation; and (C) a cost-aware contextual multi-armed bandit (CMAB) that selects mitigation actions via Thompson sampling with explicit intervention cost. We evaluate GSC-QEMit on benchmark circuit families (GHZ, Quantum Fourier Transform, and Grover search) under nonstationary noise regimes simulated in Qiskit Aer, using an instrumented testbed where action labels correspond to graded mitigation intensity. Across Clifford, non-Clifford, and structured workloads, GSC-QEMit improves average logical fidelity by \textbf{+9.0%} relative to unmitigated execution while reducing unnecessary heavy interventions by reserving them for inferred noise spikes. The resulting policies exhibit a favorable fidelity–cost trade-off and transfer across the evaluated workloads without circuit-specific tuning.


关键词: Quantum Error Mitigation, Adaptive Mitigation, GHSOM, Gaussian Process, Contextual Multi-Armed Bandit, Nonstationary Noise, Logical Fidelity


277. ❌ Extreme bandits

作者: Alexandra Carpentier, Michal Valko 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24545v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究极端值检测的bandit算法,属于统计学和机器学习领域,与LLM、深度学习、大模型等关键词完全无关。所有关键词相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文提出ExtremeHunter算法,用于在有限反馈下高效分配资源以检测极端值,并分析了极端遗憾。
摘要翻译

在医学、安全及生命科学的诸多领域中,我们常需将有限资源分配至不同来源,以检测极端值。本文研究在有限反馈条件下,如何高效地序贯分配这些资源。尽管序贯实验设计在赌博机理论中已有深入研究,但最常优化的性质是相对于最大均值奖励的遗憾值。然而,在网络入侵检测等其他问题中,我们关注的是检测各来源输出的最极端值。因此,本研究聚焦于极端遗憾值——该指标衡量算法相较于选择具有最重尾分布来源的基准策略的效率。我们提出ExtremeHunter算法,对其进行理论分析,并通过合成数据与真实实验进行实证评估。


摘要 (Abstract)

In many areas of medicine, security, and life sciences, we want to allocate limited resources to different sources in order to detect extreme values. In this paper, we study an efficient way to allocate these resources sequentially under limited feedback. While sequential design of experiments is well studied in bandit theory, the most commonly optimized property is the regret with respect to the maximum mean reward. However, in other problems such as network intrusion detection, we are interested in detecting the most extreme value output by the sources. Therefore, in our work we study extreme regret which measures the efficiency of an algorithm compared to the oracle policy selecting the source with the heaviest tail. We propose the ExtremeHunter algorithm, provide its analysis, and evaluate it empirically on synthetic and real-world experiments.


关键词: extreme bandits, extreme regret, ExtremeHunter, sequential design, heavy-tailed distributions, resource allocation, network intrusion detection


278. ❌ Dialysis Risk Prediction and Treatment Effect Estimation for AKI patients using Longitudinal Electronic Health Records

作者: Kalyani P. Pande, Evan Yang, Bryan Zhu, Sandeep K. Mallipattu, Alisa Yurovsky, Tengfei Ma 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24547v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文使用Transformer模型进行AKI患者的透析风险预测和药物效果估计,属于AI在医学领域的应用,与’AI for Science’高度相关(10分)。其他关键词如大模型、预训练、微调等未明确提及,论文未涉及这些技术原理的创新,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文构建了一个基于Transformer的因果模型,利用纵向电子健康记录预测AKI患者的透析风险并估计药物平均治疗效果,但预测性能有限(AUC 0.694)。
摘要翻译

进展至透析或终末期肾病是罕见但具有临床重要性的结局。临床医生需要了解药物暴露如何影响下游风险的证据。我们构建了一个固定时间窗的电子健康记录队列(观察期90天,预测期730天;样本量N=81401;透析/终末期肾病患病率:1.1%),并对诊断、操作及药物序列结合肾脏实验室指标趋势(肌酐、血尿素氮、估算肾小球滤过率)进行建模。基于Transformer的因果多头模型经过训练,在完整用药史设定下通过反事实暴露移除与插入来估计药物及成分层面的平均处理效应(ATEs)。在测试集上,预测性能达到AUC为0.694,PR-AUC为0.094。在选定决策阈值(0.883)下,模型F1得分为0.201,Brier得分为0.018。采用逆概率治疗加权(IPTW)、增强逆概率加权(AIPW)、朴素法及协变量校正普通最小二乘法(OLS)对实验室指标变化(eGFR、肌酐、BUN)进行事后因果分析,以评估临床方向性。结果显示,ACE抑制剂/血管紧张素受体阻滞剂(ACE/ARB)暴露呈现部分保护性方向支持,而袢利尿剂则呈现恶化方向信号。


摘要 (Abstract)

Progression to dialysis or end-stage renal disease is a rare but clinically important outcome. Clinicians need evidence on how medication exposures influence downstream risk. We constructed a fixed-window EHR cohort (90-day observation, 730-day prediction; N=81401; dialysis/ESRD prevalence: 1.1%) and modeled sequences of diagnoses, procedures, and medications with kidney laboratory trends (creatinine, BUN, eGFR). A transformer-based causal multi-head model was trained to estimate drug- and ingredient-level average treatment effects (ATEs) using counterfactual exposure removal and insertion under a full medication history setup. On test set, predictive performance reached an AUC of 0.694 and PR-AUC of 0.094. At the selected decision threshold (0.883), the model achieved an F1 score of 0.201 with a Brier score of 0.018. Post-hoc causal analyses of lab changes (eGFR, creatinine, BUN) using IPTW, AIPW, naive, and covariate-adjusted OLS methods assessed clinical directionality. Results showed partial protective-direction support for ACE/ARB exposures and worsening-direction signals for loop diuretics.


关键词: AKI, dialysis risk prediction, treatment effect estimation, electronic health records, transformer, causal model, ACE/ARB, loop diuretics


279. ❌ Stochastic simultaneous optimistic optimization

作者: Michal Valko, Alexandra Carpentier, Rémi Munos 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24537v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是噪声环境下函数全局最大化的随机同时乐观优化算法(StoSOO),属于经典的优化和bandit理论,完全不涉及大模型、深度学习或AI for Science等关键词。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种无需知道局部光滑度半度量的随机同时乐观优化算法(StoSOO),用于噪声扰动下的函数全局最大化,并证明了其性能与最佳特定调优算法几乎一样好。
摘要翻译

我们研究在有限次受噪声干扰的函数评估下,实现函数f全局最大化的问题。我们对函数施加了一个非常弱的假设,即在其某个全局最大值附近,该函数相对于某个半度量(semi-metric)是局部光滑的(在某种精确意义下)。与先前关于一般空间中的多臂赌博机(bandits)的研究(Kleinberg等人,2008;Bubeck等人,2011a)相比,我们的算法无需知晓该半度量的具体信息。我们提出的算法StoSOO采用乐观策略,通过迭代构建函数域层次化分区上的置信上界(upper confidence bounds),以决定下一步的采样点。对StoSOO的有限时间分析表明,即使函数的局部光滑性未知,其表现也几乎与经过特定调优的最佳算法相当。


摘要 (Abstract)

We study the problem of global maximization of a function f given a finite number of evaluations perturbed by noise. We consider a very weak assumption on the function, namely that it is locally smooth (in some precise sense) with respect to some semi-metric, around one of its global maxima. Compared to previous works on bandits in general spaces (Kleinberg et al., 2008; Bubeck et al., 2011a) our algorithm does not require the knowledge of this semi-metric. Our algorithm, StoSOO, follows an optimistic strategy to iteratively construct upper confidence bounds over the hierarchical partitions of the function domain to decide which point to sample next. A finite-time analysis of StoSOO shows that it performs almost as well as the best specifically-tuned algorithms even though the local smoothness of the function is not known.


关键词: global maximization, noisy evaluations, local smoothness, optimistic strategy, hierarchical partitions, finite-time analysis, bandit theory


280. ❌ A Reward-Free Viewpoint on Multi-Objective Reinforcement Learning

作者: Ying-Tu Chen, Wei Hung, Bing-Shu Wu, Zhang-Wei Hong, Ping-Chun Hsieh 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24532v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究多目标强化学习(MORL),利用无奖励强化学习(RFRL)作为辅助任务。所有关键词均涉及大模型、深度学习技术或AI for Science,与论文内容无直接关联。论文未提及任何大模型、深度学习技术原理创新或科学领域应用,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出将无奖励强化学习(RFRL)作为辅助任务来增强多目标强化学习(MORL),通过偏好引导的探索策略显著提升了性能和样本效率。
摘要翻译

许多序贯决策任务涉及优化多个相互冲突的目标,这要求策略能够适应不同的用户偏好。在多目标强化学习(MORL)中,一种广泛研究的方法是通过训练一个以偏好加权奖励为条件的单一策略网络来解决这一问题。本文探索了一种新颖的算法视角:将无奖励强化学习(RFRL)应用于MORL。尽管RFRL历来与MORL独立研究,但它能为任意可能的奖励函数学习最优策略,这使其天然适合处理MORL中未知用户偏好的挑战。我们提出将RFRL的训练目标作为辅助任务来增强MORL,从而在训练时给定的多目标奖励函数之外实现更有效的知识共享。为此,我们将一种最先进的RFRL算法适配到MORL场景中,并引入一种偏好引导的探索策略,使学习聚焦于环境中的相关部分。通过大量实验和消融研究,我们证明该方法在多种MO-Gymnasium任务中显著优于最先进的MORL方法,实现了卓越的性能和数据效率。本工作首次系统地将RFRL适配到MORL,展示了其作为多目标策略学习的一种可扩展且经验有效的解决方案的潜力。


摘要 (Abstract)

Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. In multi-objective reinforcement learning (MORL), one widely studied approach} addresses this by training a single policy network conditioned on preference-weighted rewards. In this paper, we explore a novel algorithmic perspective: leveraging reward-free reinforcement learning (RFRL) for MORL. While RFRL has historically been studied independently of MORL, it learns optimal policies for any possible reward function, making it a natural fit for MORL’s challenge of handling unknown user preferences. We propose using the RFRL’s training objective as an auxiliary task to enhance MORL, enabling more effective knowledge sharing beyond the multi-objective reward function given at training time. To this end, we adapt a state-of-the-art RFRL algorithm to the MORL setting and introduce a preference-guided exploration strategy that focuses learning on relevant parts of the environment. Through extensive experiments and ablation studies, we demonstrate that our approach significantly outperforms the state-of-the-art MORL methods across diverse MO-Gymnasium tasks, achieving superior performance and data efficiency. This work provides the first systematic adaptation of RFRL to MORL, demonstrating its potential as a scalable and empirically effective solution to multi-objective policy learning.


关键词: Multi-Objective Reinforcement Learning, Reward-Free Reinforcement Learning, Preference-Guided Exploration, Auxiliary Task, Policy Learning, MO-Gymnasium


281. ❌ Prior-Agnostic Robust Forecast Aggregation

作者: Zhi Chen, Cheng Peng, Wei Tang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24517v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是鲁棒预测聚合,属于统计学和决策理论领域,与大型语言模型、深度学习、AI for Science等关键词完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

本文提出了一种先验无关的鲁棒预测聚合方法,通过log-odds聚合器在未知状态空间下实现最小化最大遗憾,并给出了严格的遗憾界。
摘要翻译

鲁棒预测聚合结合多个信息源的预测,以在所有可能的信息结构中实现最坏情况下的良好表现。以往的研究主要集中于已知二元状态空间(状态为0或1)的情形。我们研究先验无关的鲁棒预测聚合,其中聚合者仅观察专家的报告,但对潜在联合信息结构、完整先验(包括潜在状态空间)均一无所知。与固定二元状态空间{0,1}的标准模型不同,我们允许(二元)未知状态值为[0,1]中的任意数值,因此相同的报告概率在不同环境中可能对应截然不同的实际结果频率。

我们的主要贡献是一个简单、显式、闭式的对数几率聚合器,该聚合器在logit空间中对预测进行线性池化,并针对三种知识体系给出了(近乎)紧的极小化最大遗憾保证。我们首先证明,在条件独立(CI)信号下,通过建立更大的下界,未知状态空间下的鲁棒聚合严格难于已知状态空间的情形,而我们的聚合规则可实现0.0255的最坏情况遗憾。在此过程中,我们还刻画了Blackwell有序结构及一般信息结构下的紧遗憾界。在已知状态空间{0,1}的经典设定中,我们的聚合器在CI结构下实现了严格低于0.0226的遗憾。据我们所知,这是首个实现遗憾上界严格低于0.0226的显式闭式聚合器。最后,我们将模型扩展至聚合者额外知晓每位专家边际预测分布的情形;在此设定下,针对CI结构,我们证明广义对数几率规则可实现0.0228的遗憾,并辅以0.0225的下界。


摘要 (Abstract)

Robust forecast aggregation combines the predictions of multiple information sources to perform well in the worst case across all possible information structures. Previous work largely focuses on settings with a known binary state space, where the state is either 0 or 1. We study prior-agnostic robust forecast aggregation in which the aggregator observes only experts’ reports, yet is ignorant of both the underlying joint information structure and the full prior, including the underlying state space. Unlike the standard model that fixes the binary state space {0, 1}, we allow the (binary) unknown state values to be arbitrary numbers in [0, 1], so the same reported probability may correspond to very different realized outcome frequencies across environments. Our main contribution is a simple, explicit, closed-form log-odds aggregator that linearly pools forecasts in logit space, together with (nearly-)tight minimax-regret guarantees across three knowledge regimes. We first show that under conditionally independent (CI) signals, robust aggregation with an unknown state space is strictly harder than in the known-state setting by establishing a larger lower bound, and our aggregation rule can achieve a worst-case regret of 0.0255. Along the way, we also characterize tight regret bounds for Blackwell-ordered structures and for general information structures. In the classical setting with known state space {0,1}, our aggregator achieves regret strictly below 0.0226 for CI structures. To the best of our knowledge, this is the first explicit closed-form aggregator that achieves a regret upper bound strictly less than 0.0226. Finally, we extend the model where the aggregator additionally knows each expert’s marginal forecast distribution; in this setting, with the CI structures, we show that a generalized log-odds rule achieves regret of 0.0228, complementing with a lower bound of 0.0225.


关键词: robust forecast aggregation, prior-agnostic, log-odds aggregator, minimax regret, conditionally independent signals, unknown state space


282. ❌ SceneSelect: Selective Learning for Trajectory Scene Classification and Expert Scheduling

作者: Xinrun Wang, Deshun Xia, Ke Xu, Weijie Zhu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24514v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.010.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出了一种场景中心的选择性学习范式,通过无监督聚类发现场景分类,并动态调度专家模型进行轨迹预测。核心思想是混合专家(MoE)系统,其中专家模型针对不同场景类型。虽然不涉及大语言模型,但MoE概念高度相关。其他关键词如预训练、微调、推理加速等均未涉及。


!!! tip deepseek-chat TL;DR

该论文提出SceneSelect,一种基于场景分类和专家调度的选择性学习框架,用于解决轨迹预测中的场景异质性问题,在多个基准上平均提升10.5%。
摘要翻译

准确的轨迹预测因场景高度异质性而面临根本性挑战——不同真实环境中的运动速度、空间密度和交互模式存在显著差异。然而,现有方法通常训练单一统一模型,期望固定容量的架构能泛化至所有可能场景。这种传统的以模型为中心(model-centric)范式在面对极端异质性时存在根本缺陷,不可避免地导致严重的泛化差距、精度下降及大量计算资源浪费。为突破这一瓶颈,我们不再改进受限的以模型为中心架构,而是提出选择性学习(selective learning),一种新颖的以场景为中心(scene-centric)范式。该方法通过显式分析底层场景特征,将输入动态路由至最合适的专家模型。作为该范式的具体实现,我们引入SceneSelect。具体而言,SceneSelect利用可解释的几何与运动特征进行无监督聚类,以发现潜在的场景分类体系;随后训练高度解耦的分类模块,将实时输入分配至这些场景类别;并通过高度可扩展的即插即用调度策略,自动将轨迹序列分派至最优预测专家。关键在于,这种解耦设计确保了卓越的泛化能力,可无缝集成不同现成模型,并在无需高成本联合重训练的情况下稳健适应新数据集。在三个公开基准(ETH-UCY、SDD和NBA)上的大量实验表明,我们的方法持续优于强单模型与集成基线,平均提升10.5%,充分展示了场景感知选择性学习的有效性。


摘要 (Abstract)

Accurate trajectory prediction is fundamentally challenging due to high scene heterogeneity - the severe variance in motion velocity, spatial density, and interaction patterns across different real-world environments. However, most existing approaches typically train a single unified model, expecting a fixed-capacity architecture to generalize universally across all possible scenarios. This conventional model-centric paradigm is fundamentally flawed when confronting such extreme heterogeneity, inevitably leading to a severe generalization gap, degraded accuracy, and massive computational waste. To overcome this bottleneck, rather than refining restricted model-centric architectures, we propose selective learning, a novel scene-centric paradigm. It explicitly analyzes the characteristics of the underlying scene to dynamically route inputs to the most appropriate expert models. As a concrete implementation of this paradigm, we introduce SceneSelect. Specifically, SceneSelect utilizes unsupervised clustering on interpretable geometric and kinematic features to discover a latent scene taxonomy. A highly decoupled classification module is then trained to assign real-time inputs to these scene categories, and a highly extensible, plug-and-play scheduling policy automatically dispatches the trajectory sequence to the optimal expert predictor. Crucially, this decoupled design ensures excellent generalization capabilities, allowing seamless integration with different off-the-shelf models and robust adaptation across new datasets without requiring computationally expensive joint retraining. Extensive experiments on three public benchmarks (ETH-UCY, SDD, and NBA) demonstrate that our method consistently outperforms strong single-model and ensemble baselines, achieving an average improvement of 10.5%, showcasing the effectiveness of scene-aware selective learning.


关键词: Selective Learning, Scene-Centric Paradigm, Mixture of Experts, Trajectory Prediction, Scene Classification, Expert Scheduling, Unsupervised Clustering


283. ❌ Advancing Ligand-based Virtual Screening and Molecular Generation with Pretrained Molecular Embedding Distance

作者: Shiyun Wa, Yifei Wang, Simone Sciabola, Ye Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24474v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.08.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文聚焦于分子嵌入距离在基于配体的虚拟筛选和分子生成中的应用,属于AI for Science(生物信息学/化学信息学)领域,与预训练模型相关(Pre-training),但未涉及大语言模型、MoE、SLM、Scaling Laws、后训练、指令微调、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等关键词。因此,仅’Pre-training’和’AI for Science’有较高相关度。


!!! tip deepseek-chat TL;DR

该论文提出使用预训练分子嵌入距离(PED)作为传统分子相似性度量的替代,在虚拟筛选和分子生成中表现出有效性,无需任务特定训练。
摘要翻译

分子相似性在基于配体的药物发现中扮演核心角色,例如虚拟筛选、类似物搜索以及目标导向的分子生成。然而,传统的相似性度量方法——从基于指纹的Tanimoto系数到三维形状叠加——在大规模应用中往往计算成本高昂,或依赖于人工设计的分子描述符。与此同时,许多基于深度学习的相似性感知设计方法仍依赖于针对相似性的专门监督或昂贵的数据整理,这限制了它们在不同靶标间的通用性。在本研究中,我们提出预训练嵌入距离(PED)作为一种有效的替代方案,该距离可直接从预训练分子模型中计算得出,无需特定任务的训练。实验结果表明,PED与传统相似性度量之间存在显著相关性,并且在虚拟筛选中的分子排序以及通过奖励设计引导分子生成方面均表现出色。这些发现表明,预训练分子嵌入能够捕获丰富的结构信息,并有望成为现代人工智能辅助药物发现中一种可扩展且极具前景的相似性度量方法。


摘要 (Abstract)

Molecular similarity plays a central role in ligand-based drug discovery, such as virtual screening, analog searching, and goal-directed molecular generation. However, traditional similarity measures, ranging from fingerprint-based Tanimoto coefficients to 3D shape overlays, are often computationally expensive at scale or rely on hand-crafted molecular descriptors. Meanwhile, many deep learning approaches to similarity-aware design still depend on similarity-specific supervision or costly data curation, limiting their generality across targets. In this work, we propose pretrained embedding distance (PED) as an effective alternative, computed directly from pretrained molecular models without task-specific training. Experimental results show that PED exhibits distinct correlations with traditional similarity metrics, and performs effectively in both ranking molecules for virtual screening and guiding molecular generation via reward design. These findings suggest that pretrained molecular embeddings capture rich structural information and can serve as a promising and scalable similarity measurement for modern AI-aided drug discovery.


关键词: pretrained molecular embedding, ligand-based virtual screening, molecular generation, molecular similarity, drug discovery, AI for drug discovery, embedding distance


284. ❌ An Automatic Ground Collision Avoidance System with Reinforcement Learning

作者: Seyyid Osman Sevgili, Atahan Cilan, Mahir Demir, Özgün Can Yürütken, Ümit Can Bekar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24403v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究基于强化学习的自动地面防撞系统,属于航空航天领域的AI应用,但未涉及大模型、深度学习技术原理创新或科学领域AI应用。所有关键词均不相关,故评分为0。


!!! tip deepseek-chat TL;DR

该论文设计了一个基于强化学习的自动地面防撞系统,用于高级喷气教练机,通过视线查询地形服务器实现精确避撞。
摘要翻译

本文评估了一种基于人工智能(AI)的自动地面防撞系统(AGCAS),该系统专为高级喷气教练机设计,旨在提升作战效能。在航空航天工程这一持续发展的领域中,AI的集成对于在更严格的时间约束和更高效率下推进作战行动至关重要。本研究探讨了AI驱动的AGCAS的设计过程,该系统特别针对高级喷气教练机进行了定制,重点解决有限观测空间内的AGCAS问题。该系统利用地形服务器上的视线查询,以确保精确且高效的防撞能力。该方法旨在显著提升高级喷气教练机的安全性与作战能力。


摘要 (Abstract)

This article evaluates an artificial intelligence (AI)-based Automatic Ground Collision Avoidance System (AGCAS) designed for advanced jet trainers to enhance operational effectiveness. In the continuously evolving field of aerospace engineering, the integration of AI is crucial for advancing operations with improved timing constraints and efficiency. Our study explores the design process of an AI-driven AGCAS, specifically tailored for advanced jet trainers, focusing on addressing the AGCAS problem within a limited observation space. The system utilizes line-of-sight queries on a terrain server to ensure precise and efficient collision avoidance. This approach aims to significantly improve the safety and operational capabilities of advanced jet trainers.


关键词: Automatic Ground Collision Avoidance System, Reinforcement Learning, Jet Trainers, Line-of-Sight Queries, Terrain Server, Collision Avoidance


285. ❌ Few-Shot Cross-Device Transfer for Quantum Noise Modeling on Real Hardware

作者: Sahil Al Farib, Sheikh Redwanul Islam, Azizur Rahman Anik 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24397v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文研究量子噪声建模的跨设备迁移,使用残差神经网络和微调,属于AI for Science(量子计算)领域,与LLM等大模型技术无关。


!!! tip deepseek-chat TL;DR

该论文提出一种基于残差神经网络和少量微调样本的跨设备量子噪声迁移方法,在IBM量子设备上验证了噪声模型的可迁移性。
摘要翻译

在含噪中等规模量子(NISQ)时代,量子设备包含硬件特有的噪声源,这限制了设备无关的误差缓解策略。我们探索了迁移学习方法,借助少量数据将在一个量子设备上学习的噪声模型应用于另一不同设备。我们利用两台IBM量子设备——ibm_fez(源设备)和ibm_marrakesh(目标设备)——构建了一个真实硬件数据集,包含170个含噪和理想电路输出分布,并加入了设备校准特征。我们在源设备上训练了一个残差神经网络,用于将含噪结果映射为理想结果。零样本迁移测试显示KL散度为1.6706(相较于0.3014有所上升),证实了设备特异性。当使用K=20个微调样本时,KL散度降至1.1924(相比零样本提升28.6%),恢复了零样本与域内KL散度之间差距的34.9%。消融研究表明,跨设备不匹配的主要原因是CX门误差,其次是读出误差。结果表明,量子噪声可以通过极少量样本进行学习和微调,并为跨设备量子误差缓解提供了一种可行的方法。


摘要 (Abstract)

In the noisy intermediate-scale quantum (NISQ) regime, quantum devices contain hardware-specific noise sources which restrict device-invariant error mitigation strategies. We explore transfer learning approaches to apply noise models learned on one quantum device to a different device with the help of a small amount of data. We create a real-hardware dataset from two IBM quantum devices, ibm_fez (source) and ibm_marrakesh (target), comprising 170 noisy and ideal circuit output distributions, with device calibration features added. We train a residual neural network on the source device to map noisy to ideal outcomes. The zero-shot transfer test shows a KL divergence of 1.6706 (up from 0.3014), establishing device specificity. With K = 20 fine-tuning samples, KL drops to 1.1924 (28.6% improvement over zero-shot), recovering 34.9% of the gap between zero-shot and in-domain KL. Ablation studies reveal that the major cause of mismatches across devices is CX gate error, followed by readout error. The results show quantum noise can be learned and fine-tuned with minimal samples, and provide a plausible approach to cross-device quantum error mitigation.


关键词: quantum noise modeling, transfer learning, residual neural network, cross-device, NISQ, error mitigation, fine-tuning


286. ❌ Primitive Recursion without Composition: Dynamical Characterizations, from Neural Networks to Polynomial ODEs

作者: Olivier Bournez 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24356v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究递归神经网络、多项式ODE和离散多项式映射在原始递归计算中的等价性,属于理论计算机科学和动力系统领域,与所列的大模型、深度学习应用及技术关键词完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文证明了原始递归函数在递归神经网络、多项式ODE和离散多项式映射三种框架下的等价表征,揭示了动力学计算与符号编程的结构性差异。
摘要翻译

递归神经网络、多项式常微分方程与离散多项式映射各自为计算带来了什么,又各自缺少什么?这三者均在连续域上运行——由实值动力学演化的实值状态——即便目标函数是离散的。我们通过原始递归来研究它们。

我们证明,原始递归在这三种框架中均具有等价的刻画:固定递归ReLU网络的有界迭代、固定多项式常微分方程的鲁棒计算,以及带有外部给定步长参数的固定多项式映射的迭代。在每一种框架中,时间界限本身是原始递归的,组合是从动力学中涌现出来的而非作为闭包规则,输入是原始整数向量。每个原始递归函数首先被编译为单个阈值仿射范式(threshold-affine normal form)的有界迭代,然后被解释为ReLU计算和多项式常微分方程。

这些等价性揭示了一种结构上的不对称性:没有任何固定的多项式映射能够一致地将数值四舍五入到最接近的整数,或实现精确的相位选择——而这些操作是多项式常微分方程通过连续时间流鲁棒地执行的。每种形式体系都弥补了其他形式体系所缺乏的局限:ReLU门提供了精确的分支,连续时间提供了自主的四舍五入与控制,而步长参数则以离散化精度为代价恢复了这两者。这为通过在一个框架内限制时间界限、多项式次数或离散化资源来刻画次递归层次与复杂度类开辟了动力学途径。

更广泛地说,这些模型并非通过组合子程序进行计算:它们通过内置于动力学中的时钟、相位选择器和纠错机制来塑造动力系统的轨迹。这在结构上不同于符号编程,而我们的定理为研究这种差异提供了一个精确的框架。


摘要 (Abstract)

What do recurrent neural networks, polynomial ODEs, and discrete polynomial maps each bring to computation, and what do they lack? All three operate over the continuum–real-valued states evolved by real-valued dynamics–even when the target functions are discrete. We study them through primitive recursion. We prove that primitive recursion admits equivalent characterizations in all three frameworks: bounded iteration of a fixed recurrent ReLU network, robust computation by a fixed polynomial ODE, and iteration of a fixed polynomial map with an externally supplied step-size parameter. In each, the time bound is itself primitive recursive, composition emerges from the dynamics rather than as a closure rule, and inputs are raw integer vectors. Every primitive recursive function is first compiled into bounded iteration of a single threshold-affine normal form, then interpreted as a ReLU computation and as a polynomial ODE. The equivalences expose a structural asymmetry: no fixed polynomial map can round uniformly to the nearest integer or realize exact phase selection–operations polynomial ODEs perform robustly via continuous-time flow. Each formalism compensates for a limitation the others lack: the ReLU gate provides exact branching, continuous time provides autonomous rounding and control, and the step-size parameter recovers both at the cost of discretization precision. This opens dynamical characterizations of subrecursive hierarchies and complexity classes by restricting time bounds, polynomial degrees, or discretization resources within one framework. More broadly, these models do not compute by composing subroutines: they shape the trajectory of a dynamical system through clocks, phase selectors, and error correction built into the dynamics. This differs structurally from symbolic programming, and our theorem gives a precise framework to study the difference.


关键词: primitive recursion, recurrent neural networks, polynomial ODEs, discrete polynomial maps, bounded iteration, dynamical systems, computability


287. ❌ SAGE: Sparse Adaptive Guidance for Dependency-Aware Tabular Data Generation

作者: Shuo Yang, Zheyu Zhang, Bardh Prenkaj, Gjergji Kasneci 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24368v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用LLM进行表格数据生成,提出了Sparse Adaptive Guidance方法,涉及LLM应用,但未涉及其他关键词如MoE、SLM、Scaling Laws、预训练、微调、对齐、RLHF、PEFT、RAG、长上下文、KV缓存、CoT、系统2思维、MCTS、自我纠正、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习、AI for Science等。因此,只有’Large Language Models’得高分,其余均为0分。


!!! tip deepseek-chat TL;DR

SAGE通过稀疏自适应依赖引导,利用LLM生成高保真表格数据,相比先前方法F1分数提升10%并减少策略违规。
摘要翻译

生成高保真合成表格数据仍是提升隐私敏感和低资源领域数据可用性的关键挑战。现有方法通过将表格行表示为序列来利用大语言模型(LLMs),但存在两个根本性局限:(1)密集建模特征依赖关系,引入虚假相关性;(2)假设特征间关系静态不变,忽略这些依赖关系随特征值变化的情况。为克服这些局限,我们提出SAGE(稀疏自适应引导,Sparse Adaptive Guidance),一种基于LLM的新型生成框架,通过强制稀疏与动态依赖引导。SAGE将特征离散化为值感知伪特征,并构建基于互信息的稀疏依赖图。该图通过显式上下文选择或隐式对数校正自适应引导生成过程,使LLM在合成时聚焦于真正相关的信息。我们在六个数据集及多项任务上的广泛实验表明,SAGE不仅提升了数据保真度与下游效用——相比此前基于LLM的方法将F1分数提升10%,还将策略违规次数降低一个百分点。这些结果凸显了自适应结构在表格数据生成中的重要性,并为LLM的上下文敏感控制提供了新见解。


摘要 (Abstract)

Generating high-fidelity synthetic tabular data remains a critical challenge for enhancing data availability in privacy-sensitive and low-resource domains. Recent approaches leverage LLMs by representing table rows as sequences, yet suffer from two fundamental limitations: (1) they model feature dependencies densely, introducing spurious correlations; and (2) they assume static relationships between features, ignoring how these dependencies vary with feature values. To overcome these limitations, we introduce SAGE (Sparse Adaptive Guidance), a novel LLM-based generation framework that enforces sparse and dynamic dependency guidance. SAGE discretizes features into value-aware pseudo-features and constructs a mutual information-based sparse dependency graph. This graph adaptively guides generation through explicit context selection or implicit logit correction, enabling LLMs to focus on truly relevant information during synthesis. Our extensive experiments across six datasets and multiple tasks reveal that SAGE not only improves data fidelity and downstream utility, boosting F1 scores by 10% compared to previous LLM-based methods, but also reduces policy violations by one point. These results highlight the importance of adaptive structure in tabular data generation and provide new insights into context-sensitive control of LLMs.


关键词: Sparse Adaptive Guidance, Tabular Data Generation, LLM, Dependency Graph, Synthetic Data, Context Selection, Logit Correction


288. ❌ Perfecting Aircraft Maneuvers with Reinforcement Learning

作者: Atahan Cilan, Mahir Demir, Özgün Can Yürütken, Seyyid Osman Sevgili, Ümit Can Bekar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24338v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主题是使用强化学习(RL)进行飞机特技机动,不涉及大模型、深度学习技术原理创新或AI for Science(生物/化学信息学)。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文利用强化学习智能体模拟多种飞机特技机动,旨在开发AI辅助飞行员训练模块。
摘要翻译

本文评估了一种高级喷气式教练机对基于人工智能(AI)的飞机特技机动动作的运用,旨在开发用于特定飞机机动动作的AI辅助飞行员训练模块。通过强化学习(RL)智能体模拟了大量飞机机动动作,这些动作将作为未来飞行员的训练工具。


摘要 (Abstract)

This paper evaluates an advanced jet trainer’s utilization of artificial intelligence (AI)-based aircraft aerobatic maneuvers with the intention of developing an AI-assisted pilot training module for specific aircraft maneuvers. A multitude of aircraft maneuvers have been simulated using reinforcement learning (RL) agents, which will serve as a training tool for future pilots.


关键词: Reinforcement Learning, Aircraft Maneuvers, Jet Trainer, AI-assisted Pilot Training, Aerobatic Maneuvers


289. ❌ An Aircraft Upset Recovery System with Reinforcement Learning

作者: Mahir Demir, Atahan Cilan, Seyyid Osman Sevgili, Özgün Can Yürütken, Ümit Can Bekar 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24355v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是基于强化学习的飞机失速恢复系统,使用软演员-评论家(SAC)模型,属于强化学习在航空领域的应用。所有关键词均涉及大模型、深度学习技术原理或AI for Science,但论文未提及任何相关概念,如LLMs、MoE、预训练、微调、RAG、推理加速、可解释性等。因此所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于强化学习(SAC)的飞行员激活恢复系统(PARS),用于高级喷气教练机,通过负重力惩罚等特征优化,相比传统控制方法表现更优。
摘要翻译

本文探讨了为先进喷气式教练机开发的、利用人工智能(AI)提升运行效率的试验性主动恢复系统(PARS)所取得的进展。PARS模型采用了一种先进的强化学习(RL)架构,融合了前沿的软演员-评论家(SAC)模型与超参数优化方法。该系统还考虑了控制工程师及领域专家针对PARS所提及的负过载惩罚及其他手工设计的特征。经专家评估,该AI模型的行为被认为优于传统控制方法。


摘要 (Abstract)

This article explores the progress made in the creation of a pilot activated recovery system (PARS) for advanced jet trainers that utilizes artificial intelligence (AI) in an effort to enhance operational efficiency. The PARS model employs an advanced reinforcement learning (RL) architecture, incorporating a cutting-edge soft-actor critic (SAC) model and hyper-parameter optimization methods. Negative-g punishments and other handcrafted features remarked upon by control engineers and domain experts regarding PARS are also taken into account by the system. When evaluated by them, the AI model’s behavior is deemed more desirable than that of conventional control methods.


关键词: Reinforcement Learning, Soft Actor-Critic, Aircraft Upset Recovery, Pilot Activated Recovery System, Hyper-parameter Optimization, Negative-g Punishment


290. ❌ Model-Free Inference of Investor Preferences: A Relative Entropy IRL Approach

作者: Chen Xu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24280v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究使用相对熵逆强化学习(RE-IRL)从投资者行为和市场数据中推断投资者偏好,属于金融经济学和机器学习交叉领域,完全不涉及大模型、深度学习或相关技术(如LLM、MoE、RLHF等),也与AI for Science无关。所有关键词得分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于相对熵逆强化学习的框架,用于从观测到的投资行为和市场条件中恢复投资者奖励函数,并利用K近邻方法处理数据稀疏性问题。
摘要翻译

我们提出了一种基于相对熵逆强化学习(Relative Entropy Inverse Reinforcement Learning, RE-IRL)的框架,用于从观测到的投资行为和市场状况中恢复投资者的奖励函数。与传统的逆强化学习(IRL)算法不同,RE-IRL被用于处理转移概率未知或不可获取的环境。为应对数据稀疏性的挑战,我们采用K近邻($K$-nearest neighbor)方法来估计观测到的行为策略。此外,我们还提出了一种统计检验框架,用于评估估计结果的有效性和稳健性。


摘要 (Abstract)

We present a framework using Relative Entropy Inverse Reinforcement Learning (RE-IRL) to recover investor reward functions from observed investment actions and market conditions. Unlike traditional IRL algorithms, RE-IRL is employed to account for environments where transition probabilities are unknown or inaccessible. To address the challenge of data sparsity, we utilize a $K$-nearest neighbor approach to estimate the observed behavior policy. Furthermore, we propose a statistical testing framework to evaluate the validity and robustness of the estimated results.


关键词: Inverse Reinforcement Learning, Relative Entropy, Investor Preferences, Reward Function, K-nearest Neighbors, Behavior Policy, Statistical Testing


291. ❌ New non-Euclidean neural quantum states from additional types of hyperbolic recurrent neural networks

作者: H. L. Dao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24337v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究非欧几里得神经量子态,使用双曲循环神经网络(Poincaré RNN/GRU, Lorentz RNN/GRU)进行变分蒙特卡洛模拟,应用于量子多体问题。论文完全不涉及大语言模型、深度学习技术原理创新或AI在科学领域的应用(如生物医药、化学信息学等),而是专注于量子物理中的神经网络方法。所有关键词均与论文内容无关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文扩展了非欧几里得神经量子态,引入新的双曲循环神经网络变体,并在Heisenberg模型上证明其优于欧几里得对应模型。
摘要翻译

在本工作中,我们将先前提出的仅由庞加莱双曲门控循环单元(Poincaré hyperbolic GRU)构成的非欧几里得神经量子态(non-Euclidean neural quantum states, NQS)类别,扩展至包含庞加莱循环神经网络(Poincaré RNN)以及洛伦兹循环神经网络(Lorentz RNN)和洛伦兹门控循环单元(Lorentz GRU)的新变体。除了构建并引入新的非欧几里得双曲NQS拟设外,我们还推广了先前工作的结论,即在涉及海森堡$J_1J_2$和$J_1J_2J_3$模型的量子多体设定(这些模型以不同程度的最近邻相互作用形式展现出层级结构)的变分蒙特卡洛(Variational Monte Carlo, VMC)实验中,双曲庞加莱GRU NQS拟设相较于其欧几里得对应物具有明确优势。具体而言,在此利用包含100个自旋的更大系统,我们发现所有四种双曲RNN/GRU NQS变体始终优于其各自的欧几里得对应物。具体来说,对于所考虑的所有$J_2$和$(J_2,J_3)$耦合(包括$J_2=0.0$),洛伦兹RNN NQS和庞加莱RNN NQS始终优于欧几里得RNN NQS,而洛伦兹/庞加莱GRU NQS始终优于欧几里得GRU NQS,仅有一个例外,即当$J_2=0.0$时庞加莱GRU NQS未能胜出。此外,在这四种双曲NQS拟设中,根据具体的$J_2$或$(J_2,J_3)$耦合,在八个实验设定中的四个里,洛伦兹GRU和庞加莱GRU轮流成为所有被考虑的欧几里得和双曲NQS拟设中表现最佳的变体;而洛伦兹RNN尽管参数数量最多可减少三分之二,却不仅能在全部八次实验中超越欧几里得GRU,还能在八次实验中的四次里同时优于洛伦兹GRU和庞加莱GRU,从而成为整体最优的双曲NQS拟设。


摘要 (Abstract)

In this work, we extend the class of previously introduced non-Euclidean neural quantum states (NQS) which consists only of Poincaré hyperbolic GRU, to new variants including Poincaré RNN as well as Lorentz RNN and Lorentz GRU. In addition to constructing and introducing the new non-Euclidean hyperbolic NQS ansatzes, we generalized the results of our earlier work regarding the definitive outperformances delivered by hyperbolic Poincaré GRU NQS ansatzes when benchmarked against their Euclidean counterparts in the Variational Monte Carlo (VMC) experiments involving the quantum many-body settings of the Heisenberg $J_1J_2$ and $J_1J_2J_3$ models, which exhibit hierarchical structures in the forms of the different degrees of nearest-neighbor interactions. Here, in particular, using larger systems consisting of 100 spins, we found that all four hyperbolic RNN/GRU NQS variants always outperformed their respective Euclidean counterparts. Specifically, for all $J_2$ and $(J_2,J_3)$ couplings considered, including $J_2=0.0$, Lorentz RNN NQS and Poincaré RNN NQS always outperformd Euclidean RNN NQS, while Lorentz/Poincaré GRU NQS always outperformed Euclidean GRU NQS, with a single exception when $J_2=0.0$ for Poincaré GRU NQS. Furthermore, among the four hyperbolic NQS ansatzes, depending on the specific $J_2$ or $(J_2, J_3)$ couplings, on four out of eight experiment settings, Lorentz GRU and Poincaré GRU took turns to be the top performing variant among all Euclidean and hyperbolic NQS ansatzes considered, while Lorentz RNN, with up to three times fewer parameters, was capable of not only surpassing the Euclidean GRU eight out of eight times but also outperforming both Lorentz GRU and Poincaré GRU four out of eight times, to emerge as the best overall hyperbolic NQS ansatz.


关键词: non-Euclidean neural quantum states, hyperbolic recurrent neural networks, Poincaré RNN, Lorentz GRU, Variational Monte Carlo, Heisenberg model, quantum many-body systems


292. ❌ Mitigating Error Amplification in Fast Adversarial Training

作者: Mengnan Zhao, Lihe Zhang, Bo Wang, Tianhang Zheng, Hong Zhong, Geyong Min 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24332v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究快速对抗训练中的误差放大问题,属于传统机器学习鲁棒性领域,与大型语言模型、深度学习技术原理创新(如注意力机制、推理、微调等)以及AI for Science均无直接关联。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种分布感知动态引导策略(DDG),通过调整扰动幅度和监督信号来缓解快速对抗训练中的灾难性过拟合和鲁棒性-准确性权衡问题。
摘要翻译

快速对抗训练(Fast Adversarial Training, FAT)已被证明能够通过鼓励网络学习对扰动具有不变性的表征来有效提升模型鲁棒性。然而,FAT 常遭受灾难性过拟合(Catastrophic Overfitting, CO),即模型过度拟合训练攻击,而无法泛化至未见过的攻击。此外,以鲁棒性为导向的优化通常会导致模型在干净输入上的性能显著下降,且这种退化会随着扰动预算的增加而愈发严重。在本工作中,我们通过在不同置信度分组中调节扰动与监督水平,系统分析了引导强度对模型性能的影响。研究结果表明,低置信度样本是导致灾难性过拟合及鲁棒性-准确率权衡的主要因素。基于这一发现,我们提出了一种分布感知动态引导(Distribution-aware Dynamic Guidance, DDG)策略,该策略能够动态调整扰动预算与监督信号。具体而言,DDG 根据样本在真实标签类别上的置信度来缩放扰动幅度,从而引导样本趋向一致的决策边界,同时减轻学习虚假相关性带来的影响。与此同时,DDG 还根据每个样本的预测状态动态调整监督信号,避免过度强调错误信号。为缓解动态引导可能引发的梯度不稳定性,我们进一步设计了加权正则化约束。在标准基准上的大量实验表明,DDG 能够有效缓解灾难性过拟合以及鲁棒性-准确率权衡问题。


摘要 (Abstract)

Fast Adversarial Training (FAT) has proven effective in enhancing model robustness by encouraging networks to learn perturbation-invariant representations. However, FAT often suffers from catastrophic overfitting (CO), where the model overfits to the training attack and fails to generalize to unseen ones. Moreover, robustness oriented optimization typically leads to notable performance degradation on clean inputs, and such degradation becomes increasingly severe as the perturbation budget grows. In this work, we conduct a comprehensive analysis of how guidance strength affects model performance by modulating perturbation and supervision levels across distinct confidence groups. The findings reveal that low confidence samples are the primary contributors to CO and the robustness accuracy trade off. Building on this insight, we propose a Distribution-aware Dynamic Guidance (DDG) strategy that dynamically adjusts both the perturbation budget and supervision signal. Specifically, DDG scales the perturbation magnitude according to the sample confidence at the ground truth class, thereby guiding samples toward consistent decision boundaries while mitigating the influence of learning spurious correlations. Simultaneously, it dynamically adjusts the supervision signal based on the prediction state of each sample, preventing overemphasis on incorrect signals. To alleviate potential gradient instability arising from dynamic guidance, we further design a weighted regularization constraint. Extensive experiments on standard benchmarks demonstrate that DDG effectively alleviates both CO and the robustness accuracy trade off.


关键词: Fast Adversarial Training, Catastrophic Overfitting, Robustness-Accuracy Trade-off, Dynamic Guidance, Distribution-aware, Perturbation Budget, Supervision Signal


293. ❌ BitRL: Reinforcement Learning with 1-bit Quantized Language Models for Resource-Constrained Edge Deployment

作者: Md. Ashiq Ul Islam Sajid, Mohammad Sakib Mahmood, Md. Tareq Hasan, Md Abdur Rahim, Rafat Ara, Md. Arafat Hossain 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24273v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.012.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.012.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.03.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.05.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.05.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.015.0/100.0
Speculative Decoding OR Inference Acceleration0.08.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是使用1-bit量化语言模型(BitNet b1.58)构建强化学习智能体,实现资源受限边缘设备上的部署。与量化、模型压缩、低比特权重高度相关(15分);与LLMs、SLMs、On-device AI高度相关(12分);涉及推理加速(8分);与RL结合,但未深入探讨LLM Agents(5分);提及预训练但非重点(3分)。其他关键词如MoE、RAG、CoT等不相关。


!!! tip deepseek-chat TL;DR

该论文提出BitRL框架,通过1-bit量化语言模型(BitNet b1.58)实现强化学习智能体在资源受限边缘设备上的高效部署,在保持85-98%任务性能的同时实现10-16倍内存压缩和3-5倍能效提升。
摘要翻译

在资源受限的边缘设备上部署智能强化学习(RL)智能体仍是一项根本性挑战,原因在于现代深度学习系统对内存、计算和能源的大量需求。尽管大语言模型(LLMs)已成为决策智能体的强大架构,但其数十亿参数规模使其局限于云端部署,从而引发了对延迟、隐私和连接依赖性的担忧。

我们提出BitRL框架,该框架利用1比特量化语言模型构建RL智能体,能够在严重资源约束下实现实用的设备端学习与推理。通过采用具有三值权重(-1, 0, +1)的BitNet b1.58架构及优化的推理栈,BitRL相较于全精度基线实现了10至16倍的内存缩减和3至5倍的能效提升,同时在各项基准测试中保持了85%至98%的任务性能。

我们从理论上将量化分析为结构化参数扰动,推导了冻结骨干架构下量化策略梯度的收敛界,并识别出极端量化中的探索-稳定性权衡。该框架系统性地将1比特量化语言模型与强化学习相结合以支持边缘部署,并在商用硬件上验证了其有效性。


摘要 (Abstract)

The deployment of intelligent reinforcement learning (RL) agents on resource-constrained edge devices remains a fundamental challenge due to the substantial memory, computational, and energy requirements of modern deep learning systems. While large language models (LLMs) have emerged as powerful architectures for decision-making agents, their multi-billion parameter scale confines them to cloud-based deployment, raising concerns about latency, privacy, and connectivity dependence. We introduce BitRL, a framework for building RL agents using 1-bit quantized language models that enables practical on-device learning and inference under severe resource constraints. Leveraging the BitNet b1.58 architecture with ternary weights (-1, 0, +1) and an optimized inference stack, BitRL achieves 10-16x memory reduction and 3-5x energy efficiency improvements over full-precision baselines while maintaining 85-98 percent of task performance across benchmarks. We provide theoretical analysis of quantization as structured parameter perturbation, derive convergence bounds for quantized policy gradients under frozen-backbone architectures, and identify the exploration-stability trade-off in extreme quantization. Our framework systematically integrates 1-bit quantized language models with reinforcement learning for edge deployment and demonstrates effectiveness on commodity hardware.


关键词: 1-bit Quantization, Reinforcement Learning, Edge Deployment, BitNet b1.58, Model Compression, On-device AI, Energy Efficiency


294. ❌ GeoEdit: Local Frames for Fast, Training-Free On-Manifold Editing in Diffusion Models

作者: Yiming Zhang, Sitong Liu, Ke Li, Zhihong Wu, Alex Cloninger, Melvin Leok 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24238v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是扩散模型中的编辑方法,涉及局部流形、切线空间等几何概念,属于图像生成领域,与给定的大模型、深度学习技术原理关键词(如LLM、MoE、RLHF等)完全无关,也未涉及AI for Science。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种无需训练、基于局部流形切空间的扩散模型编辑方法,通过小扰动构建切向帧实现快速、连续的图像编辑,避免了完整重扩散过程。
摘要翻译

扩散模型是数据生成领域的主流范式,但无需训练的编辑操作通常需要针对每种编辑强度重新运行完整的去噪轨迹,这使得迭代优化的成本高昂。为解决此问题,我们转而选择在数据流形附近进行编辑,通过微小的局部更新即可替代重复的重新合成。为此,我们直接从扰动样本中估计局部流形切空间,并证明这种基于样本的估计量能够紧密逼近真实切空间。基于这一理论保证,我们设计了一种无需雅可比矩阵的算法:通过对初始噪声施加微小扰动来构建切标架,并将微小的切向移动与基于扩散的投影交替进行。在该标架内的更新遵循原则性的流形内方向,同时抑制偏离流形的漂移,从而无需完整的重新扩散或额外训练即可实现细粒度编辑。编辑强度通过步数控制,以实现快速、连续的调整,同时保持保真度,并可接入现有采样器。实验表明,由此产生的切向方向能够生成平滑、语义化的无监督遍历路径,并实现有效的CLIP引导优化,展示了实用的交互式连续编辑能力。


摘要 (Abstract)

Diffusion models are a leading paradigm for data generation, but training-free editing typically re-runs the full denoising trajectory for every edit strength, making iterative refinement expensive. To address this issue, we instead edit near the data manifold, where small local updates can replace repeated re-synthesis. To enable this, we estimate a local manifold tangent space directly from perturbed samples and prove that this sample-based estimator closely approximates the true tangent. Building on this guarantee, we devise a Jacobian-free algorithm that constructs a tangent frame via small perturbations to the initial noise and alternates small tangent moves with diffusion-based projections. Updates within this frame follow principled on-manifold directions while suppressing off-manifold drift, enabling fine-grained edits without full re-diffusion or additional training. Edit strength is controlled by the number of steps for rapid, continuous adjustments that preserve fidelity and plug into existing samplers. Empirically, the resulting tangent directions yield smooth, semantic unsupervised traversals and effective CLIP-guided optimization, demonstrating practical interactive continuous editing.


关键词: Diffusion Models, Training-free Editing, Local Manifold, Tangent Space, Jacobian-free, On-Manifold Editing, CLIP-guided Optimization


295. ❌ IMPA-Net: Meteorology-Aware Multi-Scale Attention and Dynamic Loss for Extreme Convective Radar Nowcasting

作者: Haofei Cui, Guangxin He, Juanzhen Sun, Jingjia Luo, Haonan Chen, Xiaoran Zhuang, Mingxuan Chen, Xian Xiao 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24224v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文主要关注气象雷达的短时临近预报,使用深度学习和注意力机制,但未涉及大语言模型、基础模型或任何LLM相关技术。唯一相关的关键词是’AI for Science’,因为论文将AI应用于气象科学领域,但并非大模型或深度学习技术原理的创新,因此给予中等相关度8分。其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出IMPA-Net,一种基于气象感知的多尺度注意力和动态损失函数的深度学习模型,用于极端对流雷达的短时临近预报,显著提高了强回波区域的预测技能分数。
摘要翻译

基于天气雷达观测的对流降水短时预报对于强天气预警至关重要。然而,采用逐像素误差指标训练的深度学习模型往往产生过度平滑的预报,抑制了对灾害检测至关重要的强回波信号。这一问题因多尺度特征交互不足以及异质地物理输入的次优融合而进一步加剧。我们提出IMPA-Net(集成多尺度预测注意力网络),这是一个0-2小时确定性临近预报框架,通过在输入层、架构层和损失函数层引入气象学启发的设计来应对上述局限。一种无参数的空间混合器(Spatial Mixer)通过确定性通道置换,在中尺度-γ邻域(约2公里)内重组异质输入通道,提供结构化的跨场先验知识。集成多尺度预测注意力模块作为时空转换器,捕捉从中尺度-β到中尺度-γ尺度的动态特征。气象感知动态损失函数采用三级非对称加权——在训练轮次、风暴强度和预报提前时间上自适应调整——以抑制回归至均值效应。基于中国东部多源雷达数据集,与七个基线模型对比,IMPA-Net在匹配设置下将≥45 dBZ的Heidke技能评分从0.049(SimVP基线)提升至0.143。相较于pySTEPS,该方法在强事件检测与虚警控制之间实现了更优的权衡。频谱分析证实,在竞争方法呈现渐进平滑的中尺度波段上,IMPA-Net的能量得以保持。上述改进仅在单一区域和对流模态下得到验证;其向其他地形与气候区域的泛化能力仍有待检验。


摘要 (Abstract)

Short-range prediction of convective precipitation from weather radar observations is essential for severe weather warnings. However, deep learning models trained with pixel-wise error metrics tend to produce overly smooth forecasts that suppress intense echoes critical for hazard detection. This issue is exacerbated by insufficient multi-scale feature interaction and suboptimal fusion of heterogeneous geophysical inputs. We propose IMPA-Net (Integrated Multi-scale Predictive Attention Network), a deterministic 0-2 hour nowcasting framework that addresses these limitations through meteorologically-informed designs at the input, architecture, and loss function levels. A parameter-free Spatial Mixer reorganizes heterogeneous input channels at the mesoscale-$γ$ neighborhood (~2 km) via deterministic channel permutation, providing a structured cross-field prior. An integrated multi-scale predictive attention module serves as the spatiotemporal translator, capturing dynamics from mesoscale-$β$ to mesoscale-$γ$ scales. A Meteorologically-Aware Dynamic Loss employs three-level asymmetric weighting – adapting across training epochs, storm intensity, and forecast lead time – to counteract regression-to-the-mean. Evaluated against seven baselines on a multi-source radar dataset over eastern China, IMPA-Net raises the Heidke Skill Score at $\geq$45 dBZ from 0.049 (SimVP baseline) to 0.143 under matched settings. Relative to pySTEPS, it provides a better trade-off between severe-event detection and false-alarm control. Spectral analysis confirms preserved energy across mesoscale bands where competing methods show progressive smoothing. These improvements are shown within a single domain and convective regime; generalizability to other orographic and climatic regions remains to be tested.


关键词: radar nowcasting, deep learning, multi-scale attention, dynamic loss, convective precipitation, meteorology-aware, IMPA-Net


296. ❌ A Divergence-Based Method for Weighting and Averaging Model Predictions

作者: Olav Benjamin Vassend 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24172v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文提出了一种基于最小散度框架的模型预测加权平均方法,属于统计模型平均领域,与给定的所有关键词(大模型、深度学习、AI for Science等)均无直接关联。论文未涉及大模型、深度学习技术原理创新或科学应用,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于最小散度框架的模型加权平均新方法,在样本量较小时表现优于标准模型平均方法。
摘要翻译

本文采用最小散度框架,提出了一种计算模型权重的新方法,可用于对统计模型与机器学习模型产生的概率预测进行加权平均。该方法具有普适性,无论所考虑的模型是基于频率学派、贝叶斯学派还是其他拟合方法对数据进行拟合,均可适用。所提方法从两种不同角度得到论证,且实证研究表明,其表现优于或等同于标准模型平均方法(包括模型堆叠及依赖赤池式负指数化模型加权的模型平均方法),尤其在样本量较小时优势更为显著。本文的理论分析揭示了该方法在小样本情形下具有优势的原因。


摘要 (Abstract)

This paper uses a minimum divergence framework to introduce a new way of calculating model weights that can be used to average probabilistic predictions from statistical and machine learning models. The method is general and can be applied regardless of whether the models under consideration are fit to data using frequentist, Bayesian, or some other fitting method. The proposed method is motivated in two different ways and is shown empirically to perform better than or on a par with standard model averaging methods, including model stacking and model averaging that relies on Akaike-style negative exponentiated model weighting, especially when the sample size is small. Our theoretical analysis explains why the method has a small-sample advantage.


关键词: minimum divergence, model averaging, probabilistic predictions, model weighting, small sample advantage


297. ❌ Identifiability and Stability of Generative Drifting with Companion-Elliptic Kernel Families

作者: Hak Geun Lee 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24196v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是生成漂移框架中漂移场的可识别性和稳定性,涉及伴随椭圆核族(如拉普拉斯核、高斯核、Matérn核)的数学性质。内容完全属于概率论和统计学习理论,与大型语言模型、深度学习、人工智能应用或任何关键词均无关联。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文证明了伴随椭圆核族(包括高斯核和Matérn核)下漂移场消失当且仅当两个概率测度相等,并揭示了弱收敛失败仅发生在特定一维射线上,可通过内禀重叠标量恢复收敛。
摘要翻译

本文分析了邓等人提出的生成性漂移框架中,分布匹配所依赖的漂移场的可辨识性与稳定性。首先,我们引入了伴随椭圆核函数类,该类包含拉普拉斯核,其特点在于该类中每个核函数$κ$与其伴随函数$η$之间存在二阶椭圆耦合。对于该类中的每个核函数及任意一对博雷尔概率测度,我们证明了漂移场为零当且仅当这两个概率测度相等。我们进一步证明,该类核函数恰好由高斯核函数和参数$ν\ge 1/2$的Matérn核函数组成。其次,通过构造反例,我们展示了质量逃逸至无穷远而场趋于零的序列;特别地,仅控制场范数并不能保证弱收敛。然而,我们证明这种失效的唯一可能模式局限于射线${c,p:0\le c\le 1}$。因此,通过施加内在重叠标量(一种由核函数与目标测度定义的线性可观测指标)的渐近下界,可以恢复弱收敛性。


摘要 (Abstract)

This paper analyzes identifiability and stability for the drifting field underlying distributional matching in the Generative Drifting framework of Deng et al. First, we introduce the class of companion-elliptic kernels, which includes the Laplace kernel and is characterized by a second-order elliptic coupling between each kernel $κ$ in this class and its companion function $η$. For each kernel in this class and each pair of Borel probability measures, we prove that the drifting field vanishes if and only if the two probability measures are equal. We further show that this class consists precisely of Gaussian kernels and Matérn kernels with $ν\ge 1/2$. Second, by constructing counterexamples, we exhibit sequences for which mass escapes to infinity while the field tends to zero; in particular, control of the field norm alone does not guarantee weak convergence. Nevertheless, we prove that the only possible mode of failure is confined to the one-dimensional ray ${c,p:0\le c\le 1}$. Consequently, weak convergence can be restored by imposing an asymptotic lower bound on the intrinsic overlap scalar, a linear observable defined by the kernel and the target measure.


关键词: Generative Drifting, companion-elliptic kernels, identifiability, stability, Matérn kernels, Gaussian kernels, weak convergence


298. ❌ CMGL: Confidence-guided Multi-omics Graph Learning for Cancer Subtype Classification

作者: Boyang Fan, Hengchuang Yin, Siyu Yi, Yifan Wang, Zhicheng Li, Leijiyu Zhou, Jiancheng Lv, Wei Ju 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24201v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文研究多组学图学习用于癌症亚型分类,属于AI for Science和生物信息学领域,与’AI for Science OR Bioinformatics OR Cheminformatics’高度相关(10分)。其他关键词涉及大模型、深度学习技术原理等,论文未涉及,故评0分。


!!! tip deepseek-chat TL;DR

该论文提出CMGL框架,通过置信度引导的多组学图学习,有效整合多组学数据并提升癌症亚型分类性能,在多个数据集上超越现有方法。
摘要翻译

动机:多组学整合可提升癌症亚型分类效果,但不同癌症类型及患者间的模态信息含量与噪声水平存在差异。现有基于图的方法将模态权重与分类目标联合优化,因而缺乏独立的可靠性估计,导致低质量组学数据会扭曲患者相似性图,并通过消息传递放大噪声。
结果:我们提出CMGL框架,该两阶段方法通过证据深度学习估算每个样本的模态可靠性,并利用冻结后的置信度分数指导跨组学融合与图构建。在四项MLOmics癌症亚型任务及32类泛癌任务中,CMGL持续优于最强基线模型,在四项单癌任务上的平均准确率提升4.03%。其表征可还原乳腺浸润癌(BRCA)的PAM50内在亚型,且基于BRCA训练的模型无需微调即可迁移至肾透明细胞癌(KIRC),将患者划分为预后显著不同的分组。


摘要 (Abstract)

Motivation: Multi-omics integration can improve cancer subtyping, but modality informativeness and noise vary across cancer types and patients. Existing graph-based methods optimize modality weights jointly with the classification objective and therefore lack independent reliability estimates, so low-quality omics distort patient similarity graphs and amplify noise through message passing. Results: We propose CMGL, a two-stage framework that estimates per-sample modality reliability through evidential deep learning and uses the frozen confidence scores to guide cross-omics fusion and graph construction. On four MLOmics cancer-subtype tasks and the 32-class pan-cancer task, CMGL consistently improves over the strongest baseline, surpassing it by 4.03% in average accuracy on the four single-cancer tasks. Its representations recover the PAM50 intrinsic subtypes of breast invasive carcinoma (BRCA), and the BRCA-trained model transfers without fine-tuning to kidney renal clear cell carcinoma (KIRC), stratifying patients into prognostically distinct groups.


关键词: Multi-omics integration, Cancer subtype classification, Graph learning, Evidential deep learning, Confidence estimation, Transfer learning, PAM50 subtypes


299. ❌ Explaining Temporal Graph Predictions With Shapley Values

作者: Lea-Marie Sussek, Stefan Heindorf 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24078v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.08.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究时间图神经网络的局部解释方法,基于Shapley值和Owen值提出两种模型无关的解释器。虽然涉及可解释性(Mechanistic Interpretability),但与大语言模型、深度学习技术原理创新或科学应用无关,因此仅在该关键词上得8分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文提出了两种基于Shapley和Owen值的模型无关解释器,用于解释时间图神经网络的预测,并在多个指标和数据集上优于现有方法。
摘要翻译

时序图神经网络(Temporal Graph Neural Networks, TGNNs)近年来因融合空间与时间信息而展现出卓越的预测性能,因而日益受到关注。然而,这些模型如何利用信息进行预测仍鲜有探究,可能导致模型存在潜在错误或偏差。本文基于沙普利值(Shapley value)与欧文值(Owen value)提出了两种新颖的模型无关解释器,用于TGNNs的局部解释。第一种方法为事件级(边级)沙普利解释器,通过应用KernelSHAP算法估计单个时序事件的贡献分数,为模型行为提供可解释的描述。第二种方法为特征级沙普利解释器,通过将事件级沙普利值分解为欧文值来扩展该框架,从而揭示事件及其特征之间的层级依赖关系。所提出的解释器在不同指标与数据集上均优于现有最优(SOTA)解释器。此外,特征解释器揭示了一种常用TGAT实现中实际时间戳的错误提取方式,有助于进一步理解在极稀疏解释条件下性能下降的原因。


摘要 (Abstract)

Temporal Graph Neural Networks (TGNNs) have become increasingly popular in recent years due to their superior predictive performance by combining both spatial and temporal information. However, how these models utilize the information to make predictions is rather unexplored, leading to potentially faulty or biased models. This work introduces two novel model-agnostic explainers for local explanations of TGNNs based on Shapley and Owen values. The first method, an event-level (edge-level) Shapley explainer, applies the KernelSHAP algorithm to estimate contribution scores for individual temporal events, providing interpretable descriptions for model behavior. The second, a feature-level Shapley explainer, extends this framework by decomposing event-level Shapley values into Owen values, and thereby uncovers hierarchical dependencies of the event and its features. The explainers outperform SOTA explainers on different metrics and datasets. Additionally, the Feature Explainer reveals a faulty extraction of actual timestamps of a commonly used TGAT implementation, helping to further understand performance drops on very sparse explanations.


关键词: Temporal Graph Neural Networks, Shapley Values, Owen Values, Explainability, Model-Agnostic Explainers, Event-Level Explanation, Feature-Level Explanation


300. ❌ Fed-DLoRA: Efficient Wireless Federated Learning with Dynamic Low-Rank Adaptation

作者: Huaicheng Li, Junhui Zhao, Haoyu Quan, Xiaoming Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24103v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.015.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心是联邦学习中的低秩适应(LoRA)方法,与PEFT/LoRA高度相关(15分)。其他关键词如大模型、MoE、预训练等均未涉及,得0分。


!!! tip deepseek-chat TL;DR

该论文提出Fed-DLoRA算法,通过动态低秩适应(LoRA)减少联邦学习中的通信开销和参数,并联合优化秩、带宽和车辆选择,提升准确率和收敛速度。
摘要翻译

联邦学习(FL)为车联网(IoV)应用提供了一种有前景的分布式学习范式,然而,它面临着通信开销和动态环境的挑战。模型压缩技术虽能降低计算与通信负担,却会在压缩率与车辆参与策略之间产生权衡。本文提出一种轻量级联邦学习算法——动态低秩自适应联邦学习(Fed-DLoRA),该算法结合低秩自适应(LoRA)技术,在有效减少参数与通信成本的同时提升训练效率。通过随机梯度下降优化与奇异值分解相结合的方法,对Fed-DLoRA进行了收敛性分析,建立了LoRA秩、车辆调度策略与模型收敛特性之间的理论关系。基于这些分析,我们构建了一个以最大化系统性能为目标的联合优化问题。为解决该问题,提出一种融合枚举法与贪心优化策略的自适应秩、带宽与车辆选择(ARBVS)算法。该算法为每轮联邦学习通信提供高效的秩选择与资源调度策略,从而有效提升联邦学习系统的性能。实验结果表明,与传统联邦学习方法相比,Fed-DLoRA在精度、收敛速度及通信效率方面均表现出更优性能。


摘要 (Abstract)

Federated learning (FL) offers a promising distributed learning paradigm for internet of vehicles (IoV) applications. However, it faces challenges from communication overhead and dynamic environments. Model compression techniques reduce computing and communication burden yet create trade-offs between compression ratios and vehicle participation strategies. In this paper, we propose a lightweight FL algorithm named federated learning with dynamic low-rank adaptation (Fed-DLoRA), which is combined with low-rank adaptation (LoRA) to effectively reduce parameters and communication costs while enhancing training efficiency. The convergence analysis of Fed-DLoRA is conducted through stochastic gradient descent optimization coupled with singular value decomposition. This analysis establishes the theoretical relationships among LoRA rank, vehicular scheduling strategies and the model’s convergence characteristics. Building on these insights, we formulate a joint optimization problem aimed at maximizing system performance. To address this problem, we propose an adaptive rank, bandwidth and vehicle selection (ARBVS) algorithm that integrates enumeration with greedy optimization strategies. The algorithm provides efficient rank selection and resource scheduling strategies for each FL communication round, thereby achieving effective performance improvements for the FL system. Experimental results demonstrate that Fed-DLoRA achieves superior performance compared to conventional federated learning approaches, exhibiting enhanced accuracy, faster convergence, and improved communication efficiency.


关键词: Federated Learning, Low-Rank Adaptation, LoRA, Communication Efficiency, Vehicle Selection, Resource Scheduling


301. ❌ Machine-Learning-Based Classification of Radio Frequency Building Loss

作者: Jiayi Tan, Neelabhro Roy, James Gross, Rohit Chandra, Tsao-Tsen Chen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24143v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究的是基于机器学习的射频建筑损耗分类,使用了随机森林、XGBoost、LightGBM等传统机器学习方法,以及半监督学习。论文完全不涉及大语言模型、深度学习技术原理创新或大模型在科学领域的应用,与所有关键词均无关联。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种结合半监督学习的机器学习框架,利用众包用户设备数据和公共建筑信息,对室外到室内和室内到室内信号损耗进行分类,相比纯监督学习提升了预测准确率和置信度。
摘要翻译

对室外到室内(O2I)及室内到室内(I2I)信号损耗的精确建模,对于提升密集城区室内无线网络性能至关重要。传统的现场测量方法成本高昂、耗时费力,且难以在广阔区域实施。真实世界的数据集往往存在噪声大、分布不平衡的问题,这使得信号损耗预测颇具挑战。本研究提出了一种用于射频(RF)建筑损耗分类的机器学习框架。该框架将被动收集的、来自符合3GPP标准的网络的众包用户设备(UE)数据与公开的建筑信息相结合。我们评估了随机森林、XGBoost、LightGBM以及一种投票分类器,分别采用监督学习(SL)和半监督学习(SSL)方法。与仅使用SL的推理相比,所提出的SL与SSL框架在相同数据约束条件下,同时提升了预测准确率与置信度:O2I损耗的相对准确率提升最高达12.6%,I2I损耗提升3.4%,同时预测熵降低最高达8.4%。在所评估的模型中,SSL XGBoost在O2I损耗分类中置信度最高,而SSL LightGBM在I2I损耗分类中表现最佳。这些结果表明,所提出的方法为传统模型提供了一种实用的、数据驱动的替代方案,在支持更优的网络规划与室内覆盖优化方面具有广阔潜力。


摘要 (Abstract)

Accurate modeling of outdoor-to-indoor (O2I) and indoor-to-indoor (I2I) signal loss is important for improving indoor wireless network performance in dense urban areas. Traditional on-site measurements are expensive, time-consuming, and difficult to conduct across wide regions. Real-world datasets also tend to be noisy and imbalanced, which makes signal loss prediction challenging. This study presents a machine learning framework for classifying radio frequency (RF) building loss. The framework combines passively collected, crowdsourced user equipment (UE) data from 3GPP-compliant networks with public building information. We evaluated Random Forest, XGBoost, LightGBM, and a voting classifier using both supervised (SL) and semi-supervised learning (SSL). Compared to SL-only inference, the proposed SL and SSL framework improved both prediction accuracy and confidence under identical data constraints, achieving up to 12.6% relative accuracy gain for O2I loss and 3.4% for I2I loss, while reducing prediction entropy by up to 8.4%. Among the evaluated models, SSL XGBoost provided the most confident O2I loss classification, whereas SSL LightGBM achieved the best performance for I2I loss. These results demonstrate that the proposed approach provides a practical, data-driven alternative to traditional models, with promising potential to support better network planning and indoor coverage optimization.


关键词: Machine Learning, Radio Frequency Building Loss, Outdoor-to-Indoor Loss, Indoor-to-Indoor Loss, Semi-supervised Learning, XGBoost, LightGBM, Crowdsourced Data


302. ❌ FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost

作者: Chenhao Feng, Haoli Zhang, Shakhzod Ali-Zade, Yanli Zhao, Liang Luo, Jennifer Cao, Lisen Deng, Siqiao Chen, Chenyu Zhao, Tristan Rice, Daniel Johnson, Min Si, Tiantu Xu, Yi Zhang, Siqi Yan, Chuanhao Zhuge, Min Ni, Bi Xue, Qunshu Zhang, Shen Li 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24073v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要关注深度学习推荐系统的分布式训练优化,涉及负载均衡、通信重叠和GPU资源管理,与给定的关键词(大模型、AI for Science等)完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

FreeScale通过负载均衡、通信重叠和SM-Free技术,在256个H100 GPU上实现推荐模型训练中计算气泡减少90.3%。
摘要翻译

现代工业深度学习推荐模型通常通过分析序列化交互历史来提取用户偏好,并基于这些推导出的兴趣生成预测。数据特征固有的异质性常常导致大规模训练过程中计算资源的严重利用不足,这主要是由严重的掉队节点和阻塞性慢速通信所引发的计算气泡造成的。本文提出了FreeScale解决方案,旨在:(1) 通过精心负载均衡的输入样本缓解掉队节点问题;(2) 通过将优先化的嵌入通信与计算重叠来最小化阻塞通信;(3) 通过采用SM-Free技术进行通信与计算重叠,解决GPU资源竞争问题。实验评估表明,在256块H100 GPU上运行实际工作负载时,FreeScale可将计算气泡减少高达90.3%。


摘要 (Abstract)

Modern industrial Deep Learning Recommendation Models typically extract user preferences through the analysis of sequential interaction histories, subsequently generating predictions based on these derived interests. The inherent heterogeneity in data characteristics frequently result in substantial under-utilization of computational resources during large-scale training, primarily due to computational bubbles caused by severe stragglers and slow blocking communications. This paper introduces FreeScale, a solution designed to (1) mitigate the straggler problem through meticulously load balanced input samples (2) minimize the blocking communication by overlapping prioritized embedding communications with computations (3) resolve the GPU resource competition during computation and communication overlapping by communicating through SM-Free techniques. Empirical evaluation demonstrates that FreeScale achieves up to 90.3% reduction in computational bubbles when applied to real-world workloads running on 256 H100 GPUs.


关键词: Distributed Training, Recommendation Models, Load Balancing, Communication Overlap, SM-Free, Straggler Mitigation, GPU Resource Competition


303. ❌ End-to-End Learning for Partially-Observed Time Series with PyPOTS

作者: Wenjie Du, Yiyuan Yang, Tianxiang Zhan, Qingsong Wen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24041v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.05.0/100.0

评分理由: 论文介绍PyPOTS,一个用于部分观测时间序列的端到端学习工具包,主要关注数据挖掘和机器学习,不涉及大模型或深度学习技术原理创新。唯一相关的关键词是’AI for Science’,因为时间序列分析在科学领域有应用,但并非核心创新点。其他关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文提出了PyPOTS,一个用于部分观测时间序列的端到端学习开源工具包,提供了从缺失值模拟到下游任务评估的完整工作流。
摘要翻译

部分观测时间序列(Partially-observed time series, POTS)在现实应用中普遍存在,然而现有的大多数工具链将缺失值处理与下游学习任务相分离,这限制了可重复性和整体性能。本教程介绍了PyPOTS,一个面向POTS的端到端数据挖掘与机器学习的开源Python生态系统。我们展示了涵盖缺失值模拟、数据预处理、模型训练以及核心任务(包括插补、预测、分类、聚类和异常检测)评估的实用工作流程。教程分为两部分:第一部分通过统一API和面向基准的实验,强调面向实践者的动手应用;第二部分面向开发者和研究人员,聚焦于通过自定义模型、领域特定约束以及可贡献的工程实践来扩展PyPOTS。参与者将获得在研究和生产环境中构建稳健、透明且可复用的POTS管道的概念理解与实现经验。PyPOTS公开获取地址为 https://github.com/WenjieDu/PyPOTS


摘要 (Abstract)

Partially-observed time series (POTS) is ubiquitous in real-world applications, yet most existing toolchains separate missing-value handling from downstream learning, which limits reproducibility and overall performance. This tutorial introduces PyPOTS, an open-source Python ecosystem for end-to-end data mining and machine learning on POTS. We present practical workflows spanning missingness simulation, data preprocessing, model training, and evaluation across core tasks, including imputation, forecasting, classification, clustering, and anomaly detection. The tutorial consists of two parts: Part I emphasizes hands-on application for practitioners through unified APIs and benchmark-oriented experiments. Part II targets developers and researchers, focusing on extending PyPOTS with custom models, domain-specific constraints, and contribution-ready engineering practices. Participants will gain both conceptual understanding and implementation experience for building robust, transparent, and reusable POTS pipelines in research and production settings. PyPOTS is publicly available at https://github.com/WenjieDu/PyPOTS


关键词: partially-observed time series, end-to-end learning, imputation, forecasting, classification, clustering, anomaly detection, PyPOTS


304. ❌ A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws

作者: Jun Shu, Junxiong Jia, Deyu Meng, Zongben Xu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24037v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.010.0/100.0
Pre-training0.05.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文主要研究基础模型的涌现智能和缩放定律,提出了基于极限理论的数学框架。与’Large Language Models’高度相关,因为基础模型包括LLMs;与’Scaling Laws’高度相关,因为论文推导了缩放定律;与’Pre-training’有一定关联,因为涉及训练步骤和数据规模,但未具体讨论预训练方法。其他关键词如MoE、SLMs、Post-training等均未涉及。


!!! tip deepseek-chat TL;DR

该论文通过极限理论数学框架,证明了涌现智能存在的充要条件,并推导了基础模型的缩放定律,揭示了涌现智能源于参数极限架构。
摘要翻译

涌现智能在现代人工智能发展中扮演了重要角色。尽管现有研究主要依赖经验观察来描述这一现象,但严格的理论框架仍未得到充分探索。本研究尝试从极限理论(limit theory)的视角出发,发展一种数学方法来形式化涌现智能。具体而言,我们引入了一个依赖于数据规模N、模型规模P和训练步数K的性能函数E(N, P, K),用以量化智能行为。我们假设智能是从有限知识向有效无限知识的转变,因此将涌现智能重新表述为极限$\lim_{N,P,K \to \infty} \mathcal{E}(N,P,K)$的存在性,而涌现能力则对应于该极限行为。这一极限理论有助于揭示:涌现智能源于参数极限架构(称为极限架构,limit architecture)的存在,且涌现智能在理性上对应于该极限系统的学习行为。通过引入非线性Lipschitz算子理论(nonlinear Lipschitz operator theory)的工具,我们证明了极限架构存在的充要条件。此外,我们利用Lipschitz算子(Lipschitz operator)和覆盖数(covering number)的工具推导了基础模型(foundation models)的缩放定律(scaling law)。理论结果表明:1)涌现智能受三个关键因素——训练步数、数据规模和模型架构——的支配,其中基本模块(basic blocks)的性质在构建基础模型中起着至关重要的作用;2)涌现智能的临界条件Lip(T)=1为现有发现提供了理论支持;3)涌现智能由一个无限维系统决定,但在实践中可通过有限维架构有效实现。我们的实证结果证实了这些理论发现。


摘要 (Abstract)

Emergent intelligence have played a major role in the modern AI development. While existing studies primarily rely on empirical observations to characterize this phenomenon, a rigorous theoretical framework remains underexplored. This study attempts to develop a mathematical approach to formalize emergent intelligence from the perspective of limit theory. Specifically, we introduce a performance function E(N, P, K), dependent on data size N, model size P and training steps K, to quantify intelligence behavior. We posit that intelligence emerges as a transition from finite to effectively infinite knowledge, and thus recast emergent intelligence as existence of the limit $\lim_{N,P,K \to \infty} \mathcal{E}(N,P,K)$, with emergent abilities corresponding to the limiting behavior. This limit theory helps reveal that emergent intelligence originates from the existence of a parameter-limit architecture (referred to as the limit architecture), and that emergent intelligence rationally corresponds to the learning behavior of this limit system. By introducing tools from nonlinear Lipschitz operator theory, we prove that the necessary and sufficient conditions for existence of the limit architecture. Furthermore, we derive the scaling law of foundation models by leveraging tools of Lipschitz operator and covering number. Theoretical results show that: 1) emergent intelligence is governed by three key factors-training steps, data size and the model architecture, where the properties of basic blocks play a crucial role in constructing foundation models; 2) the critical condition Lip(T)=1 for emergent intelligence provides theoretical support for existing findings. 3) emergent intelligence is determined by an infinite-dimensional system, yet can be effectively realized in practice through a finite-dimensional architecture. Our empirical results corroborate these theoretical findings.


关键词: Foundation Models, Emergent Intelligence, Scaling Laws, Limit Theory, Lipschitz Operator, Model Architecture, Data Size


305. ❌ Geometry-Aware Offline-to-Online Learning in Linear Contextual Bandits

作者: Zean Han, Ruihan Lin, Zezhen Ding, Jiheng Zhang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24016v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究线性上下文赌博机中的离线到在线学习问题,属于机器学习中的强化学习和统计学习领域,与关键词列表中的大模型、深度学习技术原理创新或AI for Science等均无直接关联。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种几何感知的离线到在线学习方法(Ellipsoidal-MINUCB),用于线性上下文赌博机,通过利用离线数据的几何结构来改进在线学习,并证明了在偏移证书下的遗憾界。
摘要翻译

我们研究线性上下文赌博机中从离线到在线学习的问题,其中离线回归数据存在偏差:离线参数不必与在线参数匹配,因此历史数据不应被视为单一的冷启动。我们利用偏移证书$(M_{\mathrm{shift}},ρ)$和离线岭估计对方向性迁移进行建模,从而为在线参数生成一个具有几何感知的置信区域,而非各向同性的半径。我们提出\emph{Ellipsoidal-MINUCB}算法,该算法将标准在线分支与基于离线信息的合并分支相结合,并仅在离线信息能够收紧不确定性时使用它。在高概率下,遗憾值受限于标准SupLinUCB型备选方案与一个合并项中的最小值,该合并项将统计宽度与证书加权的偏移惩罚分开。在简单的对齐条件下,合并项进一步简化为由离线几何结构所诱导的有效维度所决定的速率。我们还表明,纯欧几里得(标量)偏移界限本身并不能确定哪些特征方向是可迁移的。在此固定证书之外,我们展示了如何在有限个刷新时刻从数据中学习数据驱动的证书,并为采用基于轮次学习证书的Ellipsoidal-MINUCB建立了高概率遗憾界。实验验证了主要预测:当离线覆盖范围与可迁移性对齐时,在中等时间范围内增益最强,否则该方法会跟踪安全的在线基线。


摘要 (Abstract)

We study offline-to-online learning in linear contextual bandits with biased offline regression data: the offline parameter need not match the online one, so history should not be treated as a single warm start. We model directional transfer with a shift certificate $(M_{\mathrm{shift}},ρ)$ and offline ridge estimation, yielding a geometry-aware confidence region for the online parameter rather than an isotropic radius. We propose \emph{Ellipsoidal-MINUCB}, which combines a standard online branch with an offline-informed pooled branch and uses offline information only when it tightens uncertainty. With high probability, regret is bounded by the minimum of a standard SupLinUCB-style fallback and a pooled term that separates statistical width from a certificate-weighted shift penalty. Under a simple alignment condition, the pooled term further simplifies to a rate governed by an effective dimension induced by the offline geometry. We also show that a purely Euclidean (scalar) shift bound, by itself, does not determine which feature directions are transferable. Beyond this fixed certificate, we show how to learn a data-driven certificate from data at finitely many refresh times and establish a high-probability regret bound for Ellipsoidal-MINUCB with epoch-wise learned certificates. Experiments match the main prediction: gains are strongest at intermediate horizons when offline coverage and transferability align, while the method otherwise tracks the safe online baseline.


关键词: linear contextual bandits, offline-to-online learning, shift certificate, ridge estimation, confidence region, regret bound, Ellipsoidal-MINUCB


306. ❌ FedSLoP: Memory-Efficient Federated Learning with Low-Rank Gradient Projection

作者: Yutong He, Zhengyang Huang, Jiahe Geng 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24012v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.08.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文提出FedSLoP,一种联邦学习优化算法,使用低秩子空间投影来减少通信和内存开销。虽然标题和摘要中未明确提及PEFT或LoRA,但低秩梯度投影与参数高效微调(PEFT)概念高度相关,因此PEFT得8分。其他关键词如大语言模型、预训练、RLHF等与论文主题无关,得0分。论文主要关注联邦学习中的通信和内存效率,不涉及大模型或科学应用。


!!! tip deepseek-chat TL;DR

FedSLoP通过随机低秩子空间梯度投影,在联邦学习中实现通信和内存高效,理论保证收敛,实验表明在异构数据下性能优于FedAvg。
摘要翻译

联邦学习使一组客户端能够在无需交换原始数据的情况下协作训练机器学习模型,但诸如FedAvg等标准算法在异构、资源受限的环境中会出现收敛缓慢、通信和内存成本高昂的问题。我们提出FedSLoP,一种结合梯度随机低秩子空间投影的联邦优化算法,从而在保持优化进程的同时降低通信和存储更新的维度。在理论方面,我们在标准光滑性和有界方差假设下进行了详细的非凸收敛分析,表明FedSLoP能够以$O(1/\sqrt{NT})$的速率保证收敛到一阶驻点。在实证方面,我们在具有异构数据分区的联邦MNIST分类任务上进行了大量实验,结果表明,与FedAvg及具有代表性的稀疏或低秩基线方法相比,FedSLoP在显著降低通信量和客户端内存的同时,达到了具有竞争力或更优的准确率。综合来看,我们的结果表明,诸如FedSLoP之类的随机子空间动量方法为通信和内存高效的联邦学习提供了一种有原则且有效的途径。代码可在以下网址获取:https://github.com/pkumelon/FedSLoP.git。


摘要 (Abstract)

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory costs in heterogeneous, resource-constrained environments. We introduce FedSLoP, a federated optimization algorithm that combines stochastic low-rank subspace projections of gradients, thereby reducing the dimension of communicated and stored updates while preserving optimization progress. On the theoretical side, we develop a detailed nonconvex convergence analysis under standard smoothness and bounded-variance assumptions, showing that FedSLoP is guaranteed to converge to a first-order stationary point at a rate of $O(1/\sqrt{NT})$. On the empirical side, we conduct extensive experiments on federated MNIST classification with heterogeneous data partitions, showing that FedSLoP substantially reduces communication volume and client-side memory while achieving competitive or better accuracy compared with FedAvg and representative sparse or low-rank baselines. Together, our results demonstrate that random subspace momentum methods such as FedSLoP provide a principled and effective approach to communication- and memory-efficient federated learning. Codes are available at: https://github.com/pkumelon/FedSLoP.git.


关键词: Federated Learning, Low-rank Projection, Memory Efficiency, Communication Efficiency, Stochastic Optimization, Nonconvex Convergence


307. ❌ Coverage-Based Calibration for Post-Training Quantization via Weighted Set Cover over Outlier Channels

作者: Ibne Farabi Shihab, Sanjeda Akter, Anuj Sharma 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24008v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.010.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.010.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文聚焦于大语言模型(LLMs)的后训练量化(Post-Training Quantization),核心是校准集选择问题,通过加权集合覆盖异常通道来改进量化质量。与关键词’Large Language Models’高度相关(10分),因为工作直接针对LLMs;与’Post-training’高度相关(10分),因为PTQ是后训练步骤;与’Quantization’高度相关(10分),因为量化是核心主题。其他关键词如MoE、SLMs、Scaling Laws等均不相关(0分)。


!!! tip deepseek-chat TL;DR

论文提出COVERCAL方法,将后训练量化校准集选择建模为加权集合覆盖问题,通过覆盖异常通道来提高量化质量,在多个LLM上优于随机等基线。
摘要翻译

后训练量化(Post-Training Quantization, PTQ)利用小型校准集将大语言模型压缩至低位宽,其质量高度依赖于所选样本。我们发现一种失效模式:校准样本未能激活异常通道(outlier channels),即激活值异常大的隐藏维度,导致量化器低估其动态范围,并产生逐通道重构误差,该误差主导了逐层损失。基于这一观察,我们认为PTQ校准质量更多地取决于加权异常通道覆盖率,而非样本的通用代表性,并将校准选择问题形式化为异常通道上的加权集合覆盖问题。该目标函数是单调子模的,贪心算法COVERCAL基于预计算的激活统计量运行,且在样本选择过程中无需GPU时间。我们进一步证明权重选择具有内在一致性:在一种简化裁剪模型下,未覆盖的加权损失上界替代了代理损失,从而表明加权覆盖目标具有理论依据,而非纯粹经验性。在LLaMA-2、LLaMA-3和Mistral模型上,基于AWQ和GPTQ后端及五项下游评估,COVERCAL在随机、最大困惑度、最大激活方差和分层基线方法上均取得改进,其中在校准预算较小时提升最为显著。在INT4精度下使用128个样本时,COVERCAL相较于随机校准在MMLU上提升1.2至1.5个百分点,并将困惑度退化降低15%至30%;使用64个样本时,其性能达到或超过使用256个样本的随机校准。本文的贡献并非提出新的PTQ后端,而是将校准选择问题形式化为加权异常通道覆盖,并提供了一种简单高效的算法及基于代理损失的合理性论证。


摘要 (Abstract)

Post-Training Quantization (PTQ) compresses large language models to low bit-widths using a small calibration set, and its quality depends strongly on which samples are chosen. We identify a failure mode in which calibration samples fail to activate outlier channels, hidden dimensions with unusually large activations, causing the quantizer to underestimate their dynamic range and producing per-channel reconstruction errors that dominate layer-wise loss. Motivated by this observation, we argue that PTQ calibration quality is governed more by weighted outlier-channel coverage than by generic sample representativeness, and formulate calibration selection as a weighted set cover problem over outlier channels. The objective is monotone submodular, and the greedy algorithm, COVERCAL, operates on pre-computed activation statistics and requires no GPU time at selection. We further show that the weight choice is internally consistent: under a stylized clipping model, missed weighted coverage upper-bounds surrogate loss, justifying the weighted coverage objective as principled rather than purely empirical. Across LLaMA-2, LLaMA-3, and Mistral, under AWQ and GPTQ backends and five downstream evaluations, COVERCAL improves over random, max-perplexity, max-activation-variance, and stratified baselines, with the largest gains at small calibration budgets. At INT4 with 128 samples, COVERCAL improves MMLU by 1.2 to 1.5 points over random calibration and reduces perplexity degradation by 15 to 30%; with 64 samples, it matches or exceeds random calibration at 256. The contribution is not a new PTQ backend but a formulation of calibration selection as weighted outlier coverage, with a simple, efficient algorithm and a surrogate-based justification.


关键词: Post-Training Quantization, Calibration Set Selection, Outlier Channels, Weighted Set Cover, Large Language Models, COVERCAL, AWQ, GPTQ


308. ❌ TCOD: Exploring Temporal Curriculum in On-Policy Distillation for Multi-turn Autonomous Agents

作者: Jiaqi Wang, Wenhao Zhang, Weijie Shi, Yaliang Li, James Cheng 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24005v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.08.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.08.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.08.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.05.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.05.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.010.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文聚焦于多轮对话智能体场景下的在线蒸馏(On-policy Distillation),核心是改进蒸馏方法以提升小模型在复杂任务中的表现。与LLMs高度相关(10分),因为蒸馏对象通常是LLM;涉及Small Language Models(8分)作为学生模型;Post-training/SFT(8分)因为蒸馏属于微调;Chain of Thought(8分)因为蒸馏通常传递推理能力;System 2 Thinking(5分)间接相关;Self-Correction(5分)涉及错误累积;LLM Agents(10分)是核心应用场景。其他关键词如MoE、Scaling Laws、Pre-training等不相关。


!!! tip deepseek-chat TL;DR

该论文提出TCOD框架,通过时间课程在线蒸馏解决多轮智能体训练中轨迹级KL不稳定性问题,在多个基准上提升性能高达18个点。
摘要翻译

在线策略蒸馏(On-policy Distillation, OPD)在将前沿或特定领域模型的推理能力迁移至较小学生模型方面展现出巨大潜力。尽管该方法在静态单轮任务中效果显著,但其在多轮智能体场景中的行为仍未被充分探索。本研究中,我们发现了原始OPD在此类场景下的一个关键局限性,并将其命名为轨迹级KL不稳定性(Trajectory-Level KL Instability)。具体而言,我们观察到KL散度会随成功率的下降而上升,且即使在收敛后,KL值仍居高不下,导致训练不稳定。这种不稳定性源于轮次间误差的累积:随着误差不断叠加,学生模型被推向教师模型有效支持范围之外,使得监督信号变得不可靠。为解决这一问题,我们提出TCOD(时序课程在线策略蒸馏,Temporal Curriculum On-Policy Distillation),这是一个简单而有效的框架,通过控制学生模型所接触的轨迹深度,并采用课程学习策略逐步将轨迹从短到长扩展。在三个多轮智能体基准测试(ALFWorld、WebShop、ScienceWorld)中,针对四组师生模型对的实验结果表明,TCOD能够缓解KL激增现象,并在整个训练过程中增强KL稳定性,使智能体性能相比原始OPD提升高达18个百分点。进一步评估显示,TCOD甚至能超越教师模型的性能,并泛化至教师模型失败的任务。


摘要 (Abstract)

On-policy distillation (OPD) has shown strong potential for transferring reasoning ability from frontier or domain-specific models to smaller students. While effective on static single-turn tasks, its behavior in multi-turn agent settings remains underexplored. In this work, we identify a key limitation of vanilla OPD in such settings, which we term Trajectory-Level KL Instability. Specifically, we observe that KL divergence increases together with a drop in success rate, and even after convergence, the KL remains high, leading to unstable training. This instability arises from inter-turn error compounding: as errors accumulate, the student is driven beyond the teacher’s effective support, rendering the supervision signal unreliable. To address this, we propose TCOD (Temporal Curriculum On-Policy Distillation), a simple yet effective framework that controls the trajectory depth exposed to the student and progressively expands it from short to long with a curriculum schedule.Experimental results across four student-teacher pairs on three multi-turn agent benchmarks (ALFWorld, WebShop, ScienceWorld) show that TCOD mitigates KL escalation and enhances KL stability throughout training, improving agent performance by up to 18 points over vanilla OPD. Further evaluations show that TCOD can even surpass the teacher’s performance and generalize to tasks on which the teacher fails.


关键词: On-policy Distillation, Multi-turn Agents, Curriculum Learning, KL Divergence, LLM Agents, Small Language Models, Chain of Thought


309. ❌ Adaptive-Distribution Randomized Neural Networks for PDEs: A Low-Dimensional Distribution-Learning Framework

作者: You Yang, Fei Wang 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23999v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是随机神经网络(RaNNs)在偏微分方程(PDEs)求解中的应用,提出自适应分布随机神经网络(AD-RaNN)框架,优化隐藏层参数的采样分布。论文完全不涉及大语言模型(LLMs)、深度学习技术原理创新(如MoE、RLHF、RAG等)或AI for Science中的生物/化学信息学。虽然属于科学计算领域,但关键词列表中无匹配项,故所有关键词评分为0。


!!! tip deepseek-chat TL;DR

论文提出自适应分布随机神经网络(AD-RaNN)框架,通过优化低维分布参数来替代手工调整隐藏层采样分布,从而提升随机神经网络求解偏微分方程的精度和鲁棒性。
摘要翻译

随机神经网络(RaNNs)因其通过随机化隐层特征上的线性最小二乘求解替代昂贵的端到端训练,在偏微分方程(PDEs)领域颇具吸引力。然而,其实际性能强烈依赖于隐层参数的采样分布,该分布通常基于启发式方法并针对具体问题逐一选择。这种分布敏感性是随机神经PDE求解器的核心瓶颈。本文提出自适应分布随机神经网络(AD-RaNN),该框架将随机化特征生成从固定的启发式选择提升为低维自适应优化问题。AD-RaNN并非训练所有隐层权重和偏置,而是通过低维向量p参数化隐层特征采样分布,并仅优化p,从而在保留RaNN最小二乘结构的同时减少人工分布调参。该方法采用两阶段策略:首先进行岭正则化缩减训练以实现稳定的分布参数优化,随后通过无正则化最小二乘重拟合获得最终解。我们发展了两种自适应机制——PDE驱动自适应分布(PDAD)与数据驱动自适应分布(DDAD),并将其部署于时空求解器、离散时间求解器及算子学习模型中。此外,针对局部化结构,我们还引入了自适应层增长增强技术。针对缩减优化问题,我们建立了缩减目标函数的适定性、岭正则化极小化子的一致性、高效梯度公式以及岭参数实用下界估计。基准问题的数值实验表明,AD-RaNN提供了有效的分布级自适应机制,降低了对人工设计隐层特征分布的依赖,并实现了强经验精度。


摘要 (Abstract)

Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance, however, depends strongly on the sampling distribution of the hidden-layer parameters, which is usually chosen heuristically and problem by problem. This distribution sensitivity is a central bottleneck in randomized neural PDE solvers. In this work, we propose Adaptive-Distribution Randomized Neural Networks (AD-RaNN), a framework that promotes randomized feature generation from a fixed heuristic choice to a low-dimensional adaptive optimization problem. Instead of training all hidden weights and biases, AD-RaNN parameterizes the hidden-feature sampling distribution by a low-dimensional vector p and optimizes only p, thereby preserving the least-squares structure of RaNNs while reducing manual distribution tuning. The method uses a two-stage strategy: ridge-regularized reduced training for stable distribution-parameter optimization, followed by an unregularized least-squares refit for final solution recovery. We develop two adaptive mechanisms, PDE-Driven Adaptive Distribution (PDAD) and Data-Driven Adaptive Distribution (DDAD), and deploy them in space-time solvers, discrete-time solvers, and operator-learning models. We also incorporate an adaptive layer-growth enhancement for localized structures. For the reduced optimization problem, we establish well-posedness of the reduced objectives, consistency of ridge-regularized minimizers, an efficient gradient formula, and a practical lower-bound estimate for the ridge parameter. Numerical experiments on benchmark problems show that AD-RaNN provides an effective distribution-level adaptation mechanism, reduces reliance on hand-crafted hidden-feature distributions, and achieves strong empirical accuracy.


关键词: Randomized Neural Networks, Partial Differential Equations, Adaptive Distribution, Least-Squares, Ridge Regularization, Space-Time Solvers, Operator Learning


310. ❌ Fix Initial Codes and Iteratively Refine Textual Directions Toward Safe Multi-Turn Code Correction

作者: Yuto Tanaka, Issei Sato 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23989v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.010.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.010.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.08.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.05.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文核心研究LLM推理时扩展计算,提出IRTD方法,使用MCTS进行多轮代码修正,因此与’Large Language Models’和’Monte Carlo Tree Search OR MCTS AND LLM’高度相关。涉及自我修正(Self-Correction)和LLM代理(LLM Agents)概念,但非核心。其他关键词如MoE、SLM、预训练等均未涉及。


!!! tip deepseek-chat TL;DR

论文提出了一种简化的多轮代码修正方法IRTD,通过固定初始代码并迭代优化文本方向,在代码生成基准上达到与复杂搜索方法相当的推理性能,并理论证明了其安全性。
摘要翻译

近期关于大型语言模型(LLMs)的研究强调了扩展推理计算的重要性。基于这一视角,现有最优方法——分散森林搜索(SFS)被提出,该方法采用蒙特卡洛树搜索,结合精心设计的初始种子与文本优化策略,用于多轮代码修正。然而,其复杂性导致难以明确哪些因素促进了推理性能的提升。为解决该问题,我们分析了SFS并提出一种更简洁的方法——文本方向迭代精炼(IRTD),该方法固定初始代码并迭代优化文本方向。由于IRTD的简洁性,我们利用引导式归纳合成(OGIS)从理论上证明了IRTD的安全性。在多个代码生成基准上的实验表明,IRTD实现了与现有最优方法相当的推理性能。这些结果表明,即使不采用复杂的搜索结构,仅通过高质量文本方向对初始代码进行精炼,也能有效提升推理性能。


摘要 (Abstract)

Recent work on large language models (LLMs) has emphasized the importance of scaling inference compute. From this perspective, the state-of-the-art method Scattered Forest Search (SFS) has been proposed, employing Monte Carlo Tree Search with carefully crafted initial seeds and textual optimization for multi-turn code correction. However, its complexity makes it unclear what factors contribute to improvements in inference performance. To address this problem, we analyze SFS and propose a simpler method, Iterative Refinement of Textual Directions (IRTD), which fixes initial codes and iteratively refines textual directions. Because of the simplicity of IRTD, we theoretically establish the safety of IRTD using Oracle-Guided Inductive Synthesis (OGIS). Experiments on several code generation benchmarks suggest that IRTD achieves inference performance comparable to state-of-the-art methods. These results indicate that, even without complex search structures, refining initial codes with high-quality textual directions alone can effectively improve inference performance.


关键词: Large Language Models, Monte Carlo Tree Search, Multi-turn Code Correction, Iterative Refinement, Textual Directions, Inference Compute, Code Generation


311. ❌ Hindsight Preference Optimization for Financial Time Series Advisory

作者: Yanwei Cui, Guanghui Wang, Xing Zhang, Peiyang He, Ziyuan Li, Bing Zhu, Wei Qiu, Xusheng Wang, Zheng Yu, Anqi Xin 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23988v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.012.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.010.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文提出Hindsight Preference Optimization,利用事后观察结果生成偏好对,通过DPO对齐LLM,核心涉及RLHF/DPO(10分)。使用VLM进行金融时间序列预测咨询,属于AI for Science/金融应用(5分)。其他关键词如MoE、SLM、Scaling等未涉及。


!!! tip deepseek-chat TL;DR

论文提出Hindsight Preference Optimization,利用事后观察结果生成偏好对,通过DPO对齐LLM,在金融时间序列预测咨询任务中,4B模型在准确性和咨询质量上超越235B教师模型。
摘要翻译

时间序列模型预测数字,而决策者需要的是咨询建议——包含推理、可操作建议及风险管理的方向性信号。针对此类预测性咨询训练语言模型面临一个根本性挑战:其质量取决于预测时未知的结果。我们融合了强化学习中的两个思想——利用执行时不可用的信息回溯生成训练信号,以及偏好对齐——并提出了“事后偏好优化”:通过观察到的结果,让大语言模型(LLM)在标量指标无法捕捉的维度上对候选咨询建议进行排序,从而无需人工标注即可生成用于直接偏好优化(DPO)的偏好对。我们将该方法应用于基于视觉语言模型(VLM)的标普500股票时间序列预测性咨询,实验表明,一个4B参数的模型在准确性和咨询质量上均超越了其235B参数的教师模型。


摘要 (Abstract)

Time series models predict numbers; decision-makers need advisory – directional signals with reasoning, actionable suggestions, and risk management. Training language models for such predictive advisory faces a fundamental challenge: quality depends on outcomes unknown at prediction time. We bridge two ideas from reinforcement learning – using information unavailable during execution to retrospectively generate training signal, and preference alignment – and propose Hindsight Preference Optimization: observed outcomes let an LLM judge rank candidate advisories on dimensions that scalar metrics cannot capture, producing preference pairs for DPO without human annotation. We apply this to Vision-Language-Model-based predictive advisories on S&P 500 equity time series, demonstrated by a 4B model outperforming its 235B teacher on both accuracy and advisory quality.


关键词: Hindsight Preference Optimization, DPO, LLM alignment, financial time series, predictive advisory, VLM


312. ❌ Continual Calibration: Coverage Can Collapse Before Accuracy in Lifelong LLM Fine-Tuning

作者: Ibne Farabi Shihab, Sanjeda Akter, Anuj Sharma 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23987v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.010.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究持续微调大语言模型时的校准问题,核心关注不确定性可靠性(覆盖率和校准误差)而非准确率。与Large Language Models高度相关(10分),因为研究直接针对LLM的持续学习。其他关键词如Post-training、Instruction Tuning、PEFT、RLHF等与持续微调相关但论文未具体涉及这些技术;Hallucination Mitigation与校准相关但论文未直接讨论幻觉;其余关键词均不相关。


!!! tip deepseek-chat TL;DR

该论文发现大语言模型在持续微调过程中,不确定性可靠性(覆盖率)比准确率下降得更早更快,并提出了校准回放(calibration replay)这一轻量级后处理方法,能在不增加训练成本的情况下恢复覆盖率。
摘要翻译

大语言模型的持续学习通常通过顺序微调下的准确率保持性来评估。我们认为这一视角并不完整,因为不确定性可靠性可能比前1名性能更早、更剧烈地退化。我们通过测量三类模型家族及主要来自分类与多项选择基准的八个任务序列上顺序微调模型的共形覆盖率与校准误差,对此进行了实证研究。在我们研究的分类式设定中,覆盖率损失平均超出准确率损失约 (3.4\times \pm 0.5\times)(跨随机种子);在最显著的情况下,覆盖率从 (0.92) 降至 (0.61),而准确率仍保持在基准的三个百分点以内。标准持续学习方法虽能保持准确率,却无法自动保持覆盖率,且朴素校准基线仅能弥补部分差距。我们提出校准回放(calibration replay)这一轻量级事后程序:维护一个任务特定的留出缓冲区,并在每次更新后基于当前模型重新拟合任务特定的共形阈值。该方法不增加训练时的梯度开销,内存使用量不足普通经验回放的百分之一,且在缓冲区大小 (m = 200) 时通常能将覆盖率恢复至标称值的两个百分点以内。我们为实证研究辅以漂移分解、一个在可交换性条件下证明精确共形有效性的有限样本恢复定理,以及一个解释为何合并阈值不足够的混合有效性命题。我们的保证针对具有任务特定缓冲区的分类式任务给出;对开放式生成的扩展仍处于探索阶段。


摘要 (Abstract)

Continual learning for large language models is typically evaluated through accuracy retention under sequential fine-tuning. We argue that this perspective is incomplete, because uncertainty reliability can degrade earlier and more sharply than top-1 performance. We study this empirically by measuring conformal coverage and calibration error on sequentially fine-tuned models across three model families and eight task sequences drawn primarily from classification and multiple-choice benchmarks. Across the classification-style settings we study, coverage loss exceeds accuracy loss by a factor of roughly (3.4\times \pm 0.5\times) on average across seeds; in the most pronounced case, coverage drops from (0.92) to (0.61), while accuracy remains within three points of baseline. Standard continual-learning methods that preserve accuracy do not automatically preserve coverage, and naive calibration baselines recover only part of the gap. We propose calibration replay, a lightweight post-hoc procedure that maintains a task-specific held-out buffer and refits a task-specific conformal threshold under the current model after each update. It adds no training-time gradient cost, uses less than one percent of the memory of ordinary experience replay, and typically restores coverage to within two points of nominal at buffer size (m = 200). We accompany the empirical study with a drift decomposition, a finite-sample recovery theorem showing exact conformal validity under exchangeability, and a mixture-validity proposition explaining why pooled thresholds do not suffice. Our guarantees are stated for classification-style tasks with task-specific buffers; extensions to open-ended generation are exploratory.


关键词: continual learning, calibration, conformal prediction, coverage, large language models, fine-tuning, uncertainty reliability


313. ❌ DecompKAN: Decomposed Patch-KAN for Long-Term Time Series Forecasting

作者: Naveen Mysore 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23968v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文提出DecompKAN架构用于长期时间序列预测,属于时间序列预测领域,与AI for Science有一定关联(应用于气候、生理等科学领域),但完全不涉及大模型、深度学习技术原理创新或关键词中的其他技术。因此仅AI for Science得5分,其余均为0分。


!!! tip deepseek-chat TL;DR

DecompKAN是一种轻量级、无注意力的时间序列预测架构,通过分解、分块和KAN边缘函数实现高精度和可解释性,在多个基准上取得优异性能。
摘要翻译

在气候建模、生理监测与能源系统等科学领域中,准确的时间序列预测既得益于具有竞争力的预测性能,也依赖于模型的可解释性。本文提出DecompKAN——一种轻量级无注意力机制架构,该架构融合了趋势-残差分解、通道级分块、学习型实例归一化以及B样条Kolmogorov-Arnold网络(KAN)边缘函数。每个KAN边缘在学习到的分块嵌入坐标上学习一个显式、可检查的一维标量函数,该函数可直接可视化。在标准基准测试中,DecompKAN在所选已发表基线方法的32个数据集-时间跨度组合中有15个达到最佳或并列最佳均方误差(MSE),并在包含生理PPG-DaLiA基准在内的9个数据集上,通过受控的相同配方评估,在36项比较中有20项达到最佳或并列最佳MSE。该架构在具有平滑时间动态特性的数据集(Solar -17%、ECL -10%,相较于iTransformer、Weather)以及生理时间序列上展现出显著优势。对学习到的边缘函数的可视化揭示了不同领域间定性的潜在非线性差异。消融分析表明,架构流程(分解、分块、归一化)对性能的驱动作用大于非线性层的选择,而KAN公式则使得对学习到的潜在变换的检查成为可能。


摘要 (Abstract)

Accurate time series forecasting in scientific domains such as climate modeling, physiological monitoring, and energy systems benefits from both competitive predictions and model transparency. This work proposes DecompKAN, a lightweight attention-free architecture that combines trend-residual decomposition, channel-wise patching, learned instance normalization, and B-spline Kolmogorov-Arnold Network (KAN) edge functions. Each KAN edge learns an explicit, inspectable 1D scalar function over learned patch-embedding coordinates that can be directly visualized. On standard benchmarks, DecompKAN achieves best or tied-best MSE on 15 of 32 dataset-horizon combinations among selected published baselines, and achieves best or tied-best MSE on 20 of 36 comparisons under a controlled same-recipe evaluation across 9 datasets including the physiological PPG-DaLiA benchmark. The architecture shows particular strength on datasets with smooth temporal dynamics (Solar -17%, ECL -10% vs. iTransformer, Weather) and physiological time series. Visualization of learned edge functions reveals qualitatively different latent nonlinearities across domains. Ablation analysis shows that the architectural pipeline (decomposition, patching, normalization) drives performance more than the choice of nonlinear layer, while the KAN formulation enables inspection of learned latent transformations.


关键词: Time Series Forecasting, Kolmogorov-Arnold Network, Decomposition, Patching, Interpretability, Lightweight Architecture


314. ❌ Sliced-Regularized Optimal Transport

作者: Khai Nguyen 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23944v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是最优传输(OT)中的新正则化方法,与LLM、深度学习或科学应用无关。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种新的正则化最优传输方法SROT,通过使用平滑切片OT计划作为参考,改进了经典OT的近似精度。
摘要翻译

我们提出了一种新的正则化最优传输(OT)公式,称为切片正则化最优传输(SROT)。与将传输计划向独立耦合进行正则化的熵正则化OT(EOT)不同,SROT将其向平滑后的切片OT(SOT)计划进行正则化。据我们所知,SROT是首个利用某种版本的SOT计划作为参考来改进经典OT的方法。我们给出了SROT的形式化定义,推导了其对偶公式,并提供了SROT的后贝叶斯解释。随后,我们开发了一种Sinkhorn风格的算法以实现高效计算,保留了与EOT相同的可扩展性优势。通过将可扩展的SOT计划作为先验,在相同正则化水平下,SROT对精确OT计划的近似比EOT更为准确。此外,由此产生的传输计划本身也优于作为参考的SOT计划。我们进一步引入了由SROT诱导的相应OT散度,称为SROT散度,并分析了其拓扑与计算性质。最后,我们通过在合成数据集和颜色迁移任务上的实验验证了该方法,结果表明SROT在近似精确OT方面优于EOT和SOT。关于梯度流的额外实验进一步凸显了SROT散度的优势。


摘要 (Abstract)

We propose a new regularized optimal transport (OT) formulation, termed sliced-regularized optimal transport (SROT). Unlike entropic OT (EOT), which regularizes the transport plan toward an independent coupling, SROT regularizes it toward a smoothened sliced OT (SOT) plan. To the best of our knowledge, SROT is the first approach to leverage a version of SOT plan as a reference to improve classical OT. We provide a formal definition of SROT, derive its dual formulation, and provide a post-Bayesian interpretation of SROT. We then develop a Sinkhorn-style algorithm for efficient computation, retaining the same scalability advantages as EOT. By incorporating a scalable SOT plan as a prior, SROT yields more accurate approximations of the exact OT plan than EOT under the same level of regularization. Moreover, the resulting transport plan improves upon the reference SOT plan itself. We further introduce the corresponding OT divergence induced by SROT, named SROT divergence, and analyze its topological and computational properties. Finally, we validate our approach through experiments on synthetic datasets and color transfer tasks, demonstrating that SROT is better than both EOT and SOT in approximating exact OT. Additional experiments on gradient flows further highlight the advantages of SROT divergence.


关键词: Optimal Transport, Sliced Regularization, Sinkhorn Algorithm, Transport Plan, OT Divergence, Color Transfer, Gradient Flows


315. ❌ Conditional Score-Based Modeling of Effective Langevin Dynamics

作者: Ludovico T. Giorgini 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23952v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文提出了一种基于条件分数的随机降阶模型校准方法,用于从数据中学习有效朗之万动力学。该方法涉及复杂系统的随机建模,与AI for Science领域有一定关联,因为其可应用于科学计算和动力学建模。但论文完全不涉及大语言模型、深度学习或任何现代AI技术(如Transformer、注意力机制等),因此除AI for Science外,其他关键词均为0分。AI for Science得5分,因为该方法属于科学建模,但未直接使用AI技术。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于条件分数的数据驱动方法,通过有限时间转移密度的条件分数来校准随机降阶模型的漂移和扩散系数,从而在不进行轨迹微分或状态空间划分的情况下,从数据中学习有效的朗之万动力学。
摘要翻译

随机降阶模型被广泛用于表示复杂系统的有效动力学,但根据数据估计其漂移系数和扩散系数仍具挑战性。标准方法通常依赖于短时轨迹增量、状态空间划分或候选模型的重复模拟,但对于高维系统、粗时间采样或非均匀采样数据,这些方法变得不可靠或计算成本高昂。我们提出了一种基于数据驱动的校准方法,该方法利用了随机降阶模型系数与有限时间转移密度的条件得分(定义为转移密度对数相对于初始状态的梯度)之间的新型关系。由此得到的恒等式将滞后相关函数的导数表示为关于观测到的滞后对的平稳期望,其中涉及该条件得分和未知模型系数。这一表述允许直接从有限滞后统计量中约束漂移和扩散结构,而无需在校准过程中对轨迹进行微分、划分状态空间或重复积分候选降阶模型,从而形成一个关于平稳滞后对的最小二乘拟合问题。我们在可解析处理及数据驱动的非平衡扩散过程中验证了该方法,结果表明推断出的模型在精确再现有限滞后动力学相关性的同时,保留了不变统计量。该框架为从数据中学习能够再现指定统计与动力学特性的随机降阶模型提供了一条可扩展的途径。


摘要 (Abstract)

Stochastic reduced-order models are widely used to represent the effective dynamics of complex systems, but estimating their drift and diffusion coefficients from data remains challenging. Standard approaches often rely on short-time trajectory increments, state-space partitioning, or repeated simulation of candidate models, which become unreliable or computationally expensive for high-dimensional systems, coarse temporal sampling, or unevenly sampled data. We introduce a data-driven calibration method based on a novel relationship between the coefficients of a stochastic reduced model and the conditional score of the finite-time transition density, defined as the gradient of the logarithm of the transition density with respect to the initial state. The resulting identity expresses derivatives of lagged correlation functions as stationary expectations over observed lagged pairs involving this conditional score and the unknown model coefficients. This formulation allows the drift and diffusion structure to be constrained directly from finite-lag statistics, without differentiating trajectories, partitioning state space, or repeatedly integrating candidate reduced models during calibration, yielding a least-squares fitting problem over stationary lagged pairs. We validate the approach on analytically tractable and data-driven nonequilibrium diffusions, demonstrating that the inferred models preserve the invariant statistics while accurately reproducing finite-lag dynamical correlations. The framework provides a scalable route for learning stochastic reduced-order models from data that reproduce prescribed statistical and dynamical properties.


关键词: conditional score, stochastic reduced-order models, effective Langevin dynamics, drift and diffusion estimation, finite-time transition density, data-driven calibration, nonequilibrium diffusions


316. ❌ Task-guided Spatiotemporal Network with Diffusion Augmentation for EEG-based Dementia Diagnosis and MMSE Prediction

作者: Xiaoyu Zheng, Xu Tian, Bin Jiao, Kunbo Cui, Hanhe Lin, Lu Shen, Jin Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23964v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究基于EEG的痴呆诊断和MMSE预测,提出任务引导的时空网络(TGSN)和扩散增强。论文内容属于生物医学信号处理和深度学习应用,不涉及大语言模型、基础模型、MoE、SLM、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、KV缓存压缩、CoT、系统2思维、MCTS、自我修正、LLM智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等关键词。唯一可能相关的’AI for Science’也因论文未提及AI for Science或生物信息学/化学信息学而评0分。因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文提出一种任务引导的时空网络(TGSN)结合扩散数据增强,用于基于EEG的痴呆诊断和MMSE预测,在分类和回归任务上均显著优于现有方法。
摘要翻译

痴呆症患者通常表现出认知功能障碍,临床常规采用简明精神状态检查(MMSE)进行评估。同时,其潜在的神经生理学异常可通过脑电图(EEG)反映,这为联合建模提供了基础。然而,传统多任务方法存在特征纠缠问题,在处理异质性目标时会导致任务间干扰。针对这一挑战,我们提出了一种基于扩散增强的任务引导时空网络(TGSN),用于EEG驱动的痴呆症诊断与MMSE预测。具体而言,TGSN集成了多频带特征融合模块,以捕获EEG中的互补频谱信息;同时引入基于扩散过程的预训练数据增强模块以增加样本多样性。为建模EEG复杂的时空模式,我们提出了一种门控时空注意力模块,可捕获长程空间依赖性与时间动态特征。此外,我们设计了任务引导查询模块以实现任务特异性特征提取,从而缓解任务干扰。在XY02数据集上的评估表明,该网络性能优于多种现有方法:对阿尔茨海默病(AD)/额颞叶痴呆(FTD)的分类准确率达97.78%,对AD/FTD/血管性认知障碍(VCI)的分类准确率达83.93%,分别超过最优基线16.39%和8.28%;同时将MMSE预测的均方根误差(RMSE)降至1.93和2.38,相较于最优基线分别实现了1.44和1.43的显著误差降低。此外,在DS004504数据集上的验证结果显示了其强大的跨数据集泛化能力……


摘要 (Abstract)

Patients with dementia typically exhibit cognitive impairment, which is routinely assessed using the Mini-Mental State Examination (MMSE). Concurrently, their underlying neurophysiological abnormalities are reflected in Electroencephalography (EEG), providing a basis for joint modeling. However, traditional multi-task approaches suffer from feature entanglement, which leads to inter-task interference when handling heterogeneous objectives.To address this challenge, we propose a task-guided spatiotemporal network (TGSN) with diffusion augmentation for EEG-based dementia diagnosis and MMSE prediction. Specifically, TGSN integrates a multi-band feature fusion module to capture complementary spectral information from EEG. Meanwhile, a pre-trained data augmentation module utilizing a diffusion process is introduced toincrease sample diversity. To model the complex spatiotemporal patterns of EEG, we propose a gated spatiotemporal attention module that captures long-range spatial dependencies and temporal dynamics. Moreover, we design a task-guided query module to achieve task-specific feature extraction, thereby mitigating task interference. The effectiveness of TGSN is evaluated on the XY02 dataset. Experimental results demonstrate that the proposed network outperforms several state-of-the-art methods, achieving classification accuracies of 97.78% for Alzheimer’s Disease (AD)/Frontotemporal Dementia (FTD) and 83.93% for AD/FTD/Vascular Cognitive Impairment (VCI), which exceed the best baselines by 16.39% and 8.28%, respectively. In parallel, it reduces the RMSE for MMSE prediction to 1.93 and 2.38, achieving significant error reductions of 1.44 and 1.43 compared to the best baselines. Additionally, validation on the DS004504 dataset demonstrates strong cross-dataset generalization…


关键词: EEG, dementia diagnosis, MMSE prediction, spatiotemporal network, diffusion augmentation, multi-task learning


317. ❌ Multi-scale Dynamic Wake Modeling of Floating Offshore Wind Turbines via Fourier Neural Operators and Physics-Informed Neural Networks

作者: Guodan Dong, Jianhua Qin, Chang Xu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23937v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.06.0/100.0

评分理由: 论文使用Fourier Neural Operators (FNO)和Physics-Informed Neural Networks (PINNs)进行浮式海上风力发电机尾流建模,属于AI for Science领域,与’AI for Science’关键词相关(6分)。其他关键词如大语言模型、MoE、RLHF等均不涉及,因此得0分。


!!! tip deepseek-chat TL;DR

该论文利用Fourier Neural Operators和Physics-Informed Neural Networks首次对浮式海上风力发电机在耦合纵摇和垂荡运动下的多尺度动态尾流进行重建和预测,结果表明FNO在捕捉高保真湍流结构和训练速度上优于PINN。
摘要翻译

多尺度动态尾流预测对于浮式海上风力发电机(FOWTs)的实时控制与性能优化至关重要。本研究首次利用傅里叶神经算子(FNOs)和物理信息神经网络(PINNs)来重构并预测FOWT在耦合纵荡与俯仰运动下、涵盖一系列斯特劳哈尔数(St = [0, 0.6])范围内的复杂湍流尾流。结果表明,尽管两种模型均能成功捕捉尾流蜿蜒等主导动态特征,但PINN生成的尾流显得相对平滑,无法解析高频相干结构以及尾流中心和尾流半宽的时间变化强度。FNO则能有效解析大尺度和小尺度相干湍流结构,且保真度显著更高。此外,FNO的训练速度约为PINN的八倍,在远更少的训练周期内即可收敛。功率谱密度(PSD)分析表明,FNO不仅能更有效地捕捉尾流蜿蜒的主频(St),还能捕捉其高阶谐波(如2St和3St)以及小尺度相干结构。事实上,PINN相当于一个时空低通滤波器:它仅能解析大尺度动态特征,无法捕捉由耦合纵荡与俯仰运动引起的其他频谱特征,从而显著低估了高频区域的能量。这些发现表明,FNO是一种极具前景的FOWT尾流预测方法。


摘要 (Abstract)

Multi-scale dynamic wake prediction is essential for the real-time control and performance optimization of floating offshore wind turbines (FOWTs). In this study, Fourier neural operators (FNOs) and physics-informed neural networks (PINNs) are utilized for the first time to reconstruct and predict the complex turbulent wakes of the FOWT under coupled surge and pitch motions across a range of Strouhal numbers (St = [0, 0.6]). Results demonstrate that while both models successfully capture dominant dynamic characteristics such as wake meandering, PINN-generated wakes appear relatively smooth, failing to resolve high-frequency coherent structures as well as the intensity of temporal variations in wake center and wake half-width. FNO effectively resolves both large- and small-scale coherent turbulent structures with significantly higher fidelity. Furthermore, FNO achieves a training speed approximately eight times faster than PINN, converging in far fewer epochs. Power spectral density (PSD) analysis reveals that FNO is more effective at capturing not only the primary wake meandering frequencies (St) but also their higher-order harmonics (e.g., 2St and 3St) and small-scale coherent structures. In fact, PINN effectively acts as a spatiotemporal low-pass filter; they resolve only large-scale dynamic features and fail to capture other spectral signatures induced by coupled surge and pitch motions, thereby significantly underestimating the energy in the high-frequency regime. These findings suggest that FNO is a promising approach for FOWT wake prediction.


关键词: Fourier Neural Operators, Physics-Informed Neural Networks, Floating Offshore Wind Turbines, Dynamic Wake Modeling, Multi-scale, Turbulent Wakes, Surge and Pitch Motions


318. ❌ Persistent and anti-persistent stride-to-stride fluctuations: an ARFIMA decomposition consistent with closed-loop sensorimotor control

作者: Philippe Terrier 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24365v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究人类步态中的步间波动,使用ARFIMA模型分析时间序列,完全不涉及大模型、深度学习或AI技术。所有关键词均与论文内容无关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文通过ARFIMA分解证明步态波动中的长记忆性是真实的分数现象,并揭示了传感器运动控制机制。
摘要翻译

人类步行中的步幅间波动具有分形相关结构,该结构在外界提示下会发生符号反转:自定步态表现为持续性,而节拍器或视觉提示步态则表现为反持续性。三十年的去趋势波动分析(DFA)已证实这种反转是标度指数的偏移,但DFA无法区分真正的长记忆动力学与产生相同表观指数的短记忆自回归滑动平均(ARMA)过程。我们针对来自三个独立数据集(N=70名受试者)的步幅间隔和步幅速度序列(涵盖地面行走、定速跑步机行走、节拍器与视觉提示以及分级位置约束条件),拟合了完整的八模型ARFIMA(1,d,1)族。通过基于贝叶斯信息准则(BIC)的施瓦茨权重聚合模型证据,并采用贝叶斯模型平均法估计分数差分参数d以及自回归和滑动平均系数phi与theta。研究获得三项发现:在持续性与反持续性条件下,长记忆模型均显著优于ARMA备选模型,证实提示步态的反持续性是一种真正的分数现象;由于DFA将短记忆成分与长记忆持续性混为一谈,导致DFA的alpha值将d+0.5高估了0.25至0.34个alpha单位,从而确立基于ARFIMA的分解方法作为更具信息量的估计手段;所估计的(d, phi, theta)参数与一种修正性感觉运动模型一致——该模型中,分形内在发生器、反应性反馈修正以及运动延迟成分共同塑造步幅间隔波动,且修正强度随外部约束的类型与紧密度而变化。在节律性、空间性及无约束条件下对这些参数范围建立统一的机理性解释,仍是一个待解问题。


摘要 (Abstract)

Stride-to-stride fluctuations in human walking carry a fractal correlation structure that reverses sign under external cueing: self-paced gait is persistent, whereas metronomic or visually cued gait is anti-persistent. Three decades of detrended fluctuation analysis (DFA) have established this reversal as a scaling-exponent shift, but DFA cannot distinguish genuine long-memory dynamics from short-memory autoregressive moving-average (ARMA) processes that produce the same apparent exponent. We fit the full eight-model ARFIMA(1,d,1) family to stride interval and stride speed series from three independent datasets (N = 70 subjects) spanning overground walking, fixed-speed treadmill walking, metronomic and visual cueing, and graded positional constraint. Model evidence is aggregated through BIC-based Schwarz weights, and the fractional differencing parameter d together with the autoregressive and moving-average coefficients phi and theta are estimated by Bayesian model averaging. Three findings emerge. Long-memory specifications decisively outweigh ARMA alternatives under both persistent and anti-persistent conditions, establishing cued gait anti-persistence as a genuine fractional phenomenon. DFA alpha overestimates d + 0.5 by 0.25 to 0.34 alpha units owing to short-memory components that DFA conflates with long-memory persistence, establishing ARFIMA-based decomposition as the more informative estimator. The estimated (d, phi, theta) parameters are consistent with a corrective sensorimotor model in which a fractal intrinsic generator, a reactive feedback correction, and a motor-delay component together shape stride-interval fluctuations, with the strength of the correction varying according to the type and tightness of external constraint. A unified mechanistic account of these parameter ranges across rhythmic, spatial, and unconstrained conditions remains an open question.


关键词: stride-to-stride fluctuations, ARFIMA, detrended fluctuation analysis, long-memory dynamics, sensorimotor control, gait, fractal correlation


319. ❌ Robust and Clinically Reliable EEG Biomarkers: A Cross Population Framework for Generalizable Parkinson’s Disease Detection

作者: Nicholas R. Rasmussen, Longwei Wang, Rodrigue Rizk, Md Rezwanul Akter Pallab, Samuel Stuwart, Martina Mancini, Arun Singh, KC Santosh 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.23933v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.08.0/100.0

评分理由: 论文主要关注帕金森病检测的EEG生物标志物,涉及跨群体泛化框架,属于生物医学AI应用,与’AI for Science’相关(评分8),但完全不涉及大模型、深度学习技术原理创新或其他关键词。


!!! tip deepseek-chat TL;DR

该论文提出一个跨群体评估框架,通过多群体训练提高EEG生物标志物在帕金森病检测中的泛化性和临床可靠性,在保留数据集上达到94.1%准确率。
摘要翻译

开发稳健且临床可靠的脑电图生物标志物需要构建评估框架,以明确解决跨人群泛化问题,例如在帕金森病(Parkinson’s disease, PD)检测等多中心场景中。基于独立同分布假设训练的模型往往捕获的是人群特异性伪迹而非疾病相关的神经结构,导致其在临床队列间泛化能力较差。脑电图(EEG)因信噪比低及采集条件异质性进一步加剧了这一挑战。我们提出了一种人群感知评估框架,用于评估脑电图生物标志物在分布偏移下的稳健性与临床可靠性。采用n元扩展策略,我们在五个独立队列中枚举了所有跨人群训练-测试配置,共计75项定向评估。结合通道选择的嵌套交叉验证设计确保了前瞻性生物标志物识别过程中无人群信息泄露。结果表明,跨人群迁移具有非对称性,且随着训练人群多样性的增加,准确率与生物标志物稳定性均得到提升,在留出队列上最高可达94.1%。基于混合风险优化与假设空间收缩的理论分析解释了上述趋势,表明多人群训练促进了人群稳健表征的生成。本研究为学习面向多中心生物医学应用的稳健、可泛化且临床可靠的脑电图生物标志物建立了原则性框架。


摘要 (Abstract)

Developing robust and clinically reliable EEG biomarkers requires evaluation frameworks that explicitly address cross population generalization in multi site settings such as Parkinsons disease (PD) detection. Models trained under i.i.d. assumptions often capture population specific artifacts rather than disease relevant neural structure, leading to poor generalization across clinical cohorts. EEG further amplifies this challenge due to low signal to noise ratio and heterogeneous acquisition conditions. We propose a population aware evaluation framework to assess the robustness and clinical reliability of EEG biomarkers under distribution shift. Using an n gram expansion strategy, we enumerate all cross population train test configurations across five independent cohorts, resulting in 75 directional evaluations. A nested cross validation design with integrated channel selection ensures prospective biomarker identification without population leakage. Results show that cross population transfer is asymmetric and that both accuracy and biomarker stability improve with increasing training population diversity, achieving up to 94.1% accuracy on held out cohorts. A theoretical analysis based on mixture risk optimization and hypothesis space contraction explains these trends, showing that multi population training promotes population robust representations. This work establishes a principled framework for learning robust, generalizable, and clinically reliable EEG biomarkers for multi site biomedical applications.


关键词: EEG biomarkers, Parkinson’s disease, cross-population generalization, distribution shift, multi-site, n-gram expansion, nested cross-validation


320. ❌ Messaging strategies and the emergence of echo chambers in collective decision-making

作者: Ling-Wei Kong, Naomi Ehrich Leonard, Andrew M. Hein 期刊/来源: arxiv 发布日期: 2026-04-25 arXiv链接: http://arxiv.org/abs/2604.23408v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究集体决策中的信息传递和回声室形成,使用非线性动力学方法,与AI/大模型技术无关。所有关键词均不相关,评分为0。


!!! tip deepseek-chat TL;DR

该论文通过非线性动力学模型揭示了集体决策中信息约束导致回声室状态的形成机制,并提出了避免参数精细调节的生物学可行策略。
摘要翻译

集体决策源于个体将自身观察与社会伙伴获取的信息进行整合。在许多展现集体决策的生物系统中,社会信息的产生、传递与利用过程受到两个关键约束。其一,个体通常无法直接观测到邻居的内部状态或个人观察,而只能观察到邻居的离散行为。其二,个体往往注意力有限,因此在任何给定时刻,仅有部分社会伙伴能影响其决策。通过运用非线性动力学方法,我们证明这两种约束中的任何一种都可能导致集体准确性对个体赋予他人信息的权重变得极度敏感。这种敏感性源于类似回音室状态的自主形成——在此状态下,个体接收并传递着同质化的社会信息。在此类条件下,集体会陷入自我强化的状态,从而无法追踪环境变化。我们揭示了这一现象的数学基础,并证明它不仅出现在通用集体决策模型中,也出现在描述特定生物系统(包括神经回路、真社会性昆虫群体及移动动物群体)的模型中。最后,我们识别出具有生物学合理性的机制,个体可通过这些机制降低回音室形成的风险,在无需精细调参的情况下实现稳健且灵敏的集体决策。我们的研究揭示了通信的基本约束如何塑造不同生物系统中集体决策的动态特性与可靠性。


摘要 (Abstract)

Collective decision-making arises from individual agents integrating their own personal observations with information obtained from social partners. In many biological systems that exhibit collective decision-making, the process by which social information is produced, transmitted, and used is subject to two key constraints. First, individuals often do not observe the internal states or personal observations of their neighbors; instead, they observe neighbors’ discrete actions. Second, agents often have limited attention, such that, at any given moment, only a subset of social partners influences decisions. Using methods from nonlinear dynamics, we show that either of these constraints can cause collective accuracy to become extremely sensitive to the weight individuals place on the information they receive from others. This sensitivity arises from the spontaneous formation of echo chamber-like states in which individuals receive and transmit homogeneous social messages. Under such conditions, collectives become locked in self-reinforcing states that prevent them from tracking changes in the environment. We reveal the mathematical basis of this phenomenon, and show that it emerges not only in generic models of collective decision-making but also in models developed to describe specific biological systems, including neural circuits, eusocial insect colonies, and mobile animal groups. Finally, we identify biologically plausible mechanisms through which individuals may reduce the risk of echo chamber formation and achieve robust yet sensitive collective decisions without requiring fine-tuning parameters. Our results reveal how fundamental constraints on communication shape the dynamics and reliability of collective decisions across diverse biological systems.


关键词: collective decision-making, echo chambers, social information, nonlinear dynamics, communication constraints, self-reinforcing states, biological systems


321. ❌ HyperEvoGen: Exploring deep phylogeny using non-Euclidean variational inference

作者: Jason Lamanna, Erfan Mowlaei, Xinghua Shi, Sudhir Kumar, Vincenzo Carnevale 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22997v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文提出HyperEvoGen,一种基于庞加莱变分自编码器的蛋白质进化建模方法,属于AI for Science(生物信息学)领域,与深度学习在科学中的应用高度相关。但论文未涉及大语言模型、混合专家、小模型、缩放定律、预训练/微调、RLHF、PEFT、RAG、长上下文、KV缓存、思维链、系统2思维、MCTS、自我改进、智能体、工具使用、多智能体、量化、推测解码、幻觉缓解、可解释性、世界模型、模型合并、上下文学习等关键词,因此这些关键词得分为0。


!!! tip deepseek-chat TL;DR

HyperEvoGen利用非欧几里得变分推断(庞加莱变分自编码器)从蛋白质序列中学习进化上有意义的表示,在祖先序列重建和序列生成方面优于传统方法。
摘要翻译

同源蛋白质从共同的祖先序列进化而来,并受到残基共进化复杂模式的约束。准确重建进化历史仍是一项挑战,主要原因是现有方法无法捕捉长程共进化关联,且缺乏精确度量序列间进化距离的指标。标准方法基于p-距离或替代校正度量(如Jukes-Cantor)。这些方法在进化分歧较深的情况下会趋于饱和,在足够长的时间后丧失所有进化信号。我们提出HyperEvoGen,一种结合对抗训练、双曲潜在几何结构及复合损失函数的庞加莱变分自编码器,能够从单家族比对中学习具有进化意义的表征。HyperEvoGen双曲嵌入中蛋白质序列的排列旨在保留系统发育结构,并产生与真实进化分歧成比例的潜在距离。HyperEvoGen可在保留几何感知表征中层级关联性的同时,实现快速、可扩展的蛋白质进化建模。在Potts耦合模拟基准测试中,它比传统基线方法产生更准确的祖先重建结果,且与Potts模型相比,能以更少的训练时间生成更高质量的序列。这种精度与效率的结合支持大规模家族进化研究,并加速面向设计的应用。


摘要 (Abstract)

Homologous proteins evolve from a common ancestral sequence, constrained by intricate patterns of co-evolving residues. Accurate reconstruction of evolutionary histories remains a challenge, primarily due to the inability of the existing approaches to capture long-range coevolutionary ties and lack of a precise metric to represent the evolutionary distance between sequences. Standard approaches are based on p-distance or substitution-corrected measures such as Jukes-Cantor. These methods saturate in cases of deep evolutionary divergence, losing all evolutionary signal after enough time. We present HyperEvoGen, a Poincaré variational autoencoder with adversarial training, hyperbolic latent geometry, and a compound loss function that learns evolutionarily meaningful representations from single-family alignments. The arrangement of protein sequences in HyperEvoGen’s hyperbolic embedding aims to preserve phylogenetic structure and produce latent distances which scale with true evolutionary divergence. HyperEvoGen enables fast, scalable modeling of protein evolution while preserving hierarchical relatedness in a geometry-aware representation. On Potts-coupled simulation benchmarks, it produces more accurate ancestral reconstructions than conventional baselines, and offers higher-quality sequence generation with less training time than Potts models. This combination of accuracy and throughput supports large-family evolutionary studies and accelerates design-oriented applications.


关键词: HyperEvoGen, Poincaré variational autoencoder, protein evolution, phylogenetic reconstruction, hyperbolic geometry, ancestral sequence reconstruction, coevolution


322. ❌ CNN-ViT Fusion with Adaptive Attention Gate for Brain Tumor MRI Classification: A Hybrid Deep Learning Model

作者: Syed Ibad Hasnain, Muhammad Faris, Hafiza Syeda Yusra Tirmizi, Rabail Khowaja, Hafsa Israr 期刊/来源: arxiv 发布日期: 2026-04-25 arXiv链接: http://arxiv.org/abs/2604.23137v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究的是基于CNN和ViT融合的脑肿瘤MRI分类模型,属于医学图像分析领域,不涉及任何大语言模型(LLM)或深度学习技术原理的创新。论文未提及任何与LLM相关的关键词,如预训练、微调、RLHF、RAG、Agent等,也未涉及AI for Science中的生物信息学或化学信息学。因此,所有关键词的相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文提出一种结合SqueezeNet风格CNN和MobileViT风格Transformer的混合架构,通过自适应注意力门动态融合局部和全局特征,在脑肿瘤MRI分类任务上达到97.60%的准确率。
摘要翻译

利用磁共振成像(MRI)图像对脑肿瘤进行早期检测与分类至关重要,但在医学图像中提取相关特征却十分困难。卷积神经网络(CNN)擅长捕捉局部纹理与空间信息,而视觉Transformer(ViT)则擅长捕捉长距离全局依赖关系。本文提出一种新型混合架构,该架构通过自适应注意力门控机制,将SqueezeNet风格的CNN分支与MobileViT风格的全局Transformer分支相结合。该门控机制能够针对每个样本、每个特征动态学习权重,以调节各分支的贡献,从而实现局部与全局表征的上下文敏感融合。所提模型在脑肿瘤MRI数据集(Kaggle)上进行训练与评估后,测试准确率达到97.60%,精确率为97.30%,召回率为97.50%,F1分数为97.40%,宏平均曲线下面积(AUC)为0.9946。这些指标均高于单一CNN与ViT基线模型以及当前具有竞争力的融合方法,表明动态特征加权是医学图像分类的有效途径。


摘要 (Abstract)

Early detection and classifying brain tumors using Magnetic Resonance Imaging (MRI) images is highly important but difficult to extract in medical images. Convolutional Neural Networks (CNNs) are good at capturing both local texture and spatial information whereas Vision Transformers (ViTs) are good at capturing long-range global dependencies. We propose a new hybrid architecture that combines a SqueezeNet-style CNN branch with a MobileViT-style global transformer branch, through an Adaptive Attention Gate mechanism, in this paper. The gate learns dynamically per-sample, per-feature weights to weight the contribution of each branch, allowing context-sensitive merging of local and global representations. The proposed model has a test accuracy of 97.60, a precision of 97.30, a recall of 97.50, an F1-score of 97.40, and a macro-average area under the curve (AUC) of 0.9946 with a trained and evaluated on the Brain Tumor MRI Dataset (Kaggle). These scores are higher than single CNN and ViT baselines, and current competitive fusion methods, showing that dynamic feature weighting is an effective way to classify medical images.


关键词: CNN, Vision Transformer, Adaptive Attention Gate, Brain Tumor MRI Classification, Hybrid Deep Learning, SqueezeNet, MobileViT


323. ❌ Local growth laws determine global shape of molluscan shells

作者: Huan Liu, Kaushik Bhattacharya 期刊/来源: arxiv 发布日期: 2026-04-23 arXiv链接: http://arxiv.org/abs/2604.21988v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究软体动物壳的形态发生,提出基于局部生长律和Lie群的数学模型,与深度学习、大模型、AI for Science等关键词完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文提出一个基于局部几何生长律和Lie群的数学模型,用三个参数描述几乎所有软体动物壳的形状,并关联到系统发育树。
摘要翻译

软体动物的贝壳形态各异、大小不一。尽管存在这种多样性,每个物种都能产生一种特征形状的贝壳,且该形状不受环境条件影响。我们试图理解这种稳健的复杂性。我们遵循达西·汤普森(D’Arcy Thompson)精神的两条原则:第一,即使贝壳整体形状在演化过程中发生变化,其生长也受固定生长法则的重复与持续应用所支配,无需任何复杂的生物机制来监测和控制生长;第二,生长法则仅取决于贝壳生长边缘的局部几何形态。第一条原则自然引出一个数学表述:贝壳形状是由一个李群(Lie group)作用于原壳(protoconch)而产生的。第二条原则则自然引出了该李群的一个特定表示。我们利用这一表示证明,几乎所有已知软体动物贝壳的形状均可由三个基本参数描述:一个标量(缩放比例)、一个向量(方向)和一条曲线(原壳边缘)。我们将这些参数与系统发育树相关联。除了形态发生学上的洞见,我们的研究结果还可能为复杂结构的工程化设计提供新思路。


摘要 (Abstract)

Molluscan shells come in various shapes and sizes. Despite this diversity, each species produces a shell with a characteristic shape that is independent of environmental conditions. We seek to understand this robust complexity. We are guided by two principles in the spirit of D’Arcy Thompson. First, the growth is governed by the repeated and continuous application of a fixed growth law, even as the shell evolves in overall shape, without any complex biological machinery to monitor and control the growth. Second, the growth law depends solely on local geometry at the shell’s growing edge. The first principle naturally leads to the mathematical statement that the shape of the shell is generated by the action of a Lie group on a protoconch. The second naturally leads to a particular representation of the Lie group. We use this representation to show that the shapes of nearly all known molluscan shells can be described by essentially three parameters: a scalar (scaling), a vector (orientation), and a curve (edge of the protoconch). We relate these parameters to the phylogenetic tree. In addition to the morphogenetic insight, our results potentially point to a new approach to engineering complex structures.


关键词: molluscan shells, growth law, Lie group, morphogenesis, local geometry, protoconch, phylogenetic tree


324. ❌ Improved Electrochemical Performance and Diffusion kinetics by Boron-doping in Na${0.66}$Mn${0.8}$Fe${0.2}$O${2}$ Layered Cathodes for Sodium-Ion Batteries

作者: Jayashree Pati, P. Senthilkumar, Deepak Seth, Riya Gulati, Manish Kr. Singh, Madhav Sharma, Anita Dhaka, M. Ali Haider, Rajendra S. Dhaka 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24683v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究硼掺杂的钠离子电池正极材料,属于材料科学和电化学领域,与关键词中的大模型、深度学习、AI技术等完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文通过硼掺杂提高了Na0.66Mn0.8Fe0.2O2层状正极材料的电化学性能和扩散动力学,实现了更高的比容量和容量保持率。
摘要翻译

我们报道了用于钠离子电池的硼掺杂Na${0.66}$Mn${0.8}$Fe${0.2}$O${2}$(B-NMFO)正极材料的电化学研究及其扩散动力学。值得注意的是,与NMFO正极在0.1 C倍率下133 mAh g$^{-1}$的比容量相比,B-NMFO正极表现出163 mAh g$^{-1}$的更高比容量。此外,我们观察到在1 C倍率下经过200次循环后,B-NMFO的容量保持率(70%)优于NMFO(60%),这表明由于强B-O键的存在,其结构稳定性较高。通过恒电流间歇滴定技术和循环伏安法评估的扩散系数在10$^{-8}$–10$^{-10}$ cm$^{2}$s$^{-1}$范围内。有趣的是,温度依赖的弛豫时间分布(DRT)分析清晰揭示了电化学测试过程中不同时间域内发生的各个物理过程。此外,采用密度泛函理论确定了B-NMFO的能量学和电子性质,表明间隙四面体位点,尤其是邻近空位的位点,是B进入主体结构的主要掺入路径。同时,应用经典分子动力学(MD)模拟深入理解了体相正极材料中的钠离子输运特性。


摘要 (Abstract)

We report the electrochemical investigation and study the diffusion kinetics of boron doped Na${0.66}$Mn${0.8}$Fe${0.2}$O${2}$ (B-NMFO) cathode materials for sodium-ion batteries. Notably, the B-NMFO cathode exhibits improved specific capacity of 163 mAh g$^{-1}$ as compared to 133 mAhg$^{-1}$ at 0.1~C for the NMFO cathode. Further, we observe better capacity retention of 70% for B-NMFO as compared to the NMFO (60%) at 1 C after 200 cycles, indicating high structural stability due to the presence of strong B-O bonds. The diffusion coefficient evaluation through galvanostatic intermittent titration technique and cyclic voltammetry, which is found to be in the range of 10$^{-8}$–10$^{-10}$ cm$^{2}$s$^{-1}$. Interestingly, the temperature dependent distribution of relaxation time (DRT) analysis provides a clear understanding about the individual physical processes occurring at different time domains during the electro-chemical testing. Moreover, density functional theory is employed to determine the energetics and the electronic properties of B-NMFO, which suggests that the interstitial tetrahedral sites, especially those next to vacancies, are the dominant incorporation path ways for B in the host structure. Additionally, classical molecular dynamics (MD) simulations are applied to gain insights into the Na-ion transport properties in the bulk structures cathode materials.


关键词: Sodium-ion batteries, Boron doping, Layered cathode, Electrochemical performance, Diffusion kinetics, Density functional theory, Molecular dynamics


325. ❌ Errors that matter: Uncertainty-aware universal machine-learning potentials calibrated on experiments

作者: Matthias Kellner, Teitur Hansen, Thomas Bligaard, Karsten Wedel Jacobsen, Michele Ceriotti 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24607v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要研究机器学习势函数(ML potentials)在原子尺度模拟中的应用,通过不确定性量化校准实验数据,属于AI for Science领域。与LLM、MoE、SLM、Scaling Laws、Pre-training、Post-training、Instruction Tuning、RLHF、PEFT、RAG、Context Window、KV Cache、CoT、System 2 Thinking、MCTS、Self-Correction、LLM Agents、Tool Use、Multi-agent Systems、Quantization、Speculative Decoding、Hallucination Mitigation、Mechanistic Interpretability、World Models、Model Merging、In-context Learning等关键词完全无关。仅与AI for Science相关,评分为10。


!!! tip deepseek-chat TL;DR

该论文提出了一种不确定性感知的通用机器学习势函数(PET-UAFD),通过校准多个电子结构参考和实验数据,实现了对原子尺度模拟的准确预测,并引入了PET-EXP协议以低成本估计预测不确定性。
摘要翻译

原子尺度相互作用的机器学习模型能够达到其所训练的量子力学计算的精度,但计算成本显著降低。通过不确定性量化技术(可估算相对于参考值的残差),其预测结果可变得可信。然而,这些误差并未包含电子结构计算中固有近似所带来的不确定性贡献,而后者往往是导致与经验观测结果存在偏差的主要来源。我们构建了一个基于多种电子结构参考值训练的机器学习势能集成模型,并针对简单材料与分子的内聚能、原子化能、晶格常数及体积模量等实验数据进行校准,类似于不确定性感知的泛函分布方法。由此产生的集成模型(我们称之为PET-UAFD)可用于模拟多种成分与热力学条件下的物质。通过与液体密度和结构的实验测量结果对比,我们证明:即使在未参与校准的静态性质方面,PET-UAFD也能提供与现有最佳电子结构参考值同等精度的实验预测,且集成模型的离散度可用于评估此类预测的可靠性。我们还引入了PET-EXP协议,该协议利用浅层集成与统计重加权技术,在基于单个传统机器学习势能的模拟基础上,几乎不增加额外成本即可提供相对于实验测量的准确不确定性估计。最终,该方法提供了一种实用且低成本的途径,将机器学习势能从近似理论的可信插值器提升为锚定于实验现实的真正预测工具。


摘要 (Abstract)

Machine-learning models of atomic-scale interactions achieve the accuracy of the quantum mechanical calculations on which they are trained, but at a dramatically lower computational cost. Their predictions can be made trustworthy by uncertainty quantification techniques that estimate the residual error relative to their reference. These errors, however, do not include uncertainty contributions from the approximations inherent in the electronic structure calculations, which are often the main source of discrepancy with empirical observations. We construct an ensemble of ML potentials trained on multiple electronic-structure references and calibrate it against experimental data on cohesive energies, atomization energies, lattice constants and bulk moduli of simple materials and molecules, similar to the uncertainty-aware functional distribution approach. The resulting ensemble of models, which we call PET-UAFD, can be used to simulate matter across a wide range of compositions and thermodynamic conditions. By comparison with experimental measurements of the density and structure of liquids, we demonstrate that, even outside the static properties on which it was calibrated, PET-UAFD enables predictions that are as accurate against experiments as the best available electronic-structure reference and that the spread in the ensemble can be used to assess the reliability of such predictions. We also introduce the PET-EXP protocol that uses shallow ensembles and statistical reweighting techniques to provide accurate estimates of uncertainty relative to experimental measurements at virtually no additional cost over a simulation based on a single conventional ML potential. Ultimately, this approach provides a practical and inexpensive approach to elevate machine-learning potentials from faithful interpolators of approximate theories to genuinely predictive tools anchored in experimental reality.


关键词: machine-learning potentials, uncertainty quantification, electronic structure, experimental calibration, PET-UAFD, PET-EXP, atomistic simulations


326. ❌ Vib2Conf: AI-driven discrimination of molecular conformations from vibrational spectra

作者: Xin-Yu Lu, De-Yi Lin, Tong Zhu, Bin Ren, Hao Ma, Guo-Kun Liu 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24310v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.010.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文主要研究利用深度学习模型从振动光谱中区分分子构象,核心创新在于使用Mixture-of-Experts(MoE)模块来划分构象空间,属于AI for Science(AI for Science)领域,与MoE高度相关。其他关键词如LLMs、预训练、微调等均未涉及,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了Vib2Conf模型,利用注意力重采样器和混合专家模块从振动光谱中高精度区分三维分子构象,在多个基准上达到领先性能。
摘要翻译

基于振动光谱检索或生成二维分子结构已通过深度学习模型得到充分验证。然而,由于构象异质性引起的光谱模糊性难以解决,从振动光谱中解析三维分子构象仍具挑战。为克服这一局限,我们提出Vib2Conf——一种能够直接从振动光谱中判别三维分子构象的深度学习模型。我们采用注意力重采样器从稀疏光谱信号中提取构象敏感特征,并集成混合专家系统(Mixture-of-Experts, MoE)对构象空间进行划分以实现精确几何映射。这些模块使Vib2Conf在传统光谱-结构基准测试(包括QM9S、VB-Mols和QMe14S)中实现了超过95%的顶尖top-1召回率。更重要的是,在VB-Confs测试集上,Vib2Conf能够以82.06%的top-1召回率区分近异构构象体,其中构象异构体间的均方根偏差(root-mean-square deviation, RMSD)仅为约1 Å。总体而言,Vib2Conf为细粒度光谱-构象分析提供了一种极具前景的方法。


摘要 (Abstract)

Retrieving or generating two-dimensional molecular structures on the basis of vibrational spectra has been well demonstrated via deep learning models. However, deciphering three-dimensional molecular conformations is still challenging, primarily due to spectral ambiguities caused by conformational heterogeneity, which are difficult to resolve. To address this limitation, we propose Vib2Conf, a deep learning model directly discriminating 3D molecular conformations from vibrational spectra. We implement an attentional resampler to distill conformation-sensitive features from sparse spectral signals, and integrate Mixture-of-Experts (MoE) to partition the conformational space for precise geometric mapping. These modules enable Vib2Conf to achieve state-of-the-art top-1 recall exceeding 95% on traditional spectrum-structure benchmarks, including QM9S, VB-Mols, and QMe14S. More importantly, Vib2Conf can discriminate near-isomeric conformers with a top-1 recall of 82.06% on VB-Confs test set, where conformational isomers differ by a root-mean-square deviation (RMSD) of only ~1 Å. In general, Vib2Conf is a promising method for fine-grained spectrum-to-conformation analysis.


关键词: Vibrational spectra, Molecular conformations, Mixture-of-Experts, Deep learning, Spectrum-to-conformation, Attentional resampler, Conformational heterogeneity


327. ❌ A Machine-Learned Symbolic Committor for a Chemical Reaction: Retinal Isomerization

作者: Kai Töpfer, Gianmarco Lazzeri, Vittoria Ossanna, Florian Renner, Gianluca Lattanzi, Roberto Covino, Bettina G. Keller 期刊/来源: arxiv 发布日期: 2026-04-27 arXiv链接: http://arxiv.org/abs/2604.24245v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文使用机器学习(神经网络和符号回归)学习化学反应(视网膜异构化)的committor,属于AI for Science领域,与AI for Science关键词高度相关(10分)。其他关键词如大语言模型、MoE、预训练、微调、RAG、推理、智能体等均不涉及,评分为0。


!!! tip deepseek-chat TL;DR

该论文利用机器学习方法从无偏分子动力学轨迹中学习视网膜异构化反应的committor,并通过符号回归揭示反应坐标的动力学特征,发现自由能面无法捕捉的S形路径。
摘要翻译

视黄醛C${13}$=C${14}$双键周围的热致顺反异构是一个典型的高能垒反应,其机理依赖于微妙的离面弯曲运动。我们将人工智能分子机理发现方法(AIMMD)应用于真空中的N-视黄基亚胺基赖氨酸,通过双向射击生成的无偏分子动力学轨迹学习反应概率函数。对反应概率函数的logit函数(而非函数本身)进行参数化,使得神经网络能够解析整个过渡区域的反应坐标,而不仅限于等概率面$p_B(\mathbf{x}) = 0.5$。留出输入随机化方法识别出反应键周围的四个正规二面角为信息坐标,而C${13}$和C${14}$处的非正规二面角因反应物、过渡态和产物态具有相同取值而被证明不适用。符号回归随后将神经网络提炼为紧凑的解析表达式,并表明需要所有四个二面角的非线性耦合才能再现过渡路径系综中观察到的S形逐步路径。这种S形特征在最小自由能路径中缺失:它源于短时间(约0.13皮秒)过渡事件的非平衡动力学,以及重原子二面角与含氢二面角之间的质量不对称性。因此,可解释的机器学习反应概率函数揭示了自由能面无法察觉的机理动力学特征。该工作流程无需对反应坐标进行先验假设,并可自然推广至其他异构化反应及更广泛的化学反应。


摘要 (Abstract)

The thermal cis-trans isomerization around the C${13}$=C${14}$ double bond of retinal is a prototypical high-barrier reaction whose mechanism hinges on subtle out-of-plane bending motions. We apply Artificial Intelligence for Molecular Mechanism Discovery (AIMMD) to N-retinylidene-lysine in vacuum, learning the committor from unbiased molecular dynamics trajectories generated by two-way shooting. Parametrizing the logit of the committor, rather than the committor itself, allows the neural network to resolve the reaction coordinate across the full transition region, not only at the isocommittor surface $p_B(\mathbf{x}) = 0.5$. Holdback input randomization identifies four proper dihedrals around the reactive bond as the informative coordinates, while the improper dihedrals at C${13}$ and C${14}$ prove unsuitable because reactant, transition, and product states share the same values. Symbolic regression then distills the network into compact analytical expressions and shows that a nonlinear coupling of all four dihedrals is required to reproduce the S-shaped, stepwise pathway seen in the transition path ensemble. This S-shape is absent from the minimum-free-energy path: it arises from the non-equilibrium dynamics of the short ($\sim 0.13$ ps) transition events combined with the mass asymmetry between heavy-atom and hydrogen-bearing dihedrals. An interpretable, machine-learned committor thus exposes dynamical features of the mechanism to which the free-energy surface is blind. The workflow requires no prior assumptions about the reaction coordinate and extends naturally to other isomerizations and to chemical reactions more broadly.


关键词: committor, reaction coordinate, machine learning, symbolic regression, retinal isomerization, molecular dynamics, AI for Science


328. ❌ Electronic Final States in Nuclear $β$ Decay: A Sudden-Approximation Framework

作者: G. V. D’yakonov 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23910v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究核β衰变中电子末态的突然近似框架,涉及量子力学和核物理,与所有列出的关键词(大模型、深度学习、AI等)完全无关。没有提到任何机器学习或人工智能技术。


!!! tip deepseek-chat TL;DR

该论文提出了一个基于突然近似的框架,通过λ参数化哈密顿量和奇异值分解,计算核β衰变中电子末态的跃迁概率。
摘要翻译

本文研究了哈密顿量突变产生的电子终态,重点关注β衰变中核电荷的变化。引入了一个由参数λ标记的族$\hat H(λ)$,该族连续连接初始与终态哈密顿量,从而使得电子响应可表示为希尔伯特空间中的连续形变。在突变近似下,跃迁振幅被写为不同哈密顿量本征态之间的重叠。为稳定地关联非正交单电子基组,本文采用了一种基于重叠度量与截断奇异值分解(SVD)的实用输运方案。该映射被解释为沿λ路径连续输运的离散对应。该形式首先针对单电子情形展开,明确了其解析结构与选择定则,随后通过非正交行列式重叠表达式推广至多电子体系。最终得到的公式可同时给出束缚态与连续道中的跃迁概率,兼具数值稳定性与易于解释的特点。


摘要 (Abstract)

Electronic final states generated by sudden changes of the Hamiltonian are studied here, with emphasis on nuclear charge variation in $β$ decay. A $λ$-parametrized family $\hat H(λ)$ that continuously connects the initial and final Hamiltonians, so that the electronic response can be represented as a continuous deformation in Hilbert space, is introduced. Within the sudden approximation, transition amplitudes are written as overlaps between eigenstates of distinct Hamiltonians. To relate non-orthogonal one-electron basis sets in a stable way, the paper uses a practical transport scheme based on overlap metrics and truncated singular value decomposition (SVD). This mapping is interpreted as a discrete counterpart of continuous transport along the $λ$ path. The formalism is first developed for the one-electron case, where analytic structure and selection rules are made explicit, and then generalized to many-electron systems via nonorthogonal determinant overlap expressions. The resulting formulation gives transition probabilities in bound and continuum channels in a way that is both numerically stable and easy to interpret.


关键词: β decay, sudden approximation, electronic final states, Hamiltonian, singular value decomposition, non-orthogonal basis, transition amplitudes


329. ❌ Representability for Quantum Theory beyond Particle-Number Conservation

作者: David A. Mazziotti 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23869v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.05.0/100.0

评分理由: 论文研究量子力学中的表示性问题,与AI/ML无关。唯一可能相关的是’AI for Science’,因为量子计算可视为科学计算的一部分,但论文本身未涉及AI方法,仅给出5分作为弱关联。


!!! tip deepseek-chat TL;DR

该论文解决了无粒子数守恒量子系统的2-RDM表示性问题,通过极锥推导出系统性的表示性条件,并统一了粒子数守恒与非守恒系统的处理框架。
摘要翻译

可表示性决定了双粒子约化密度矩阵(2-RDM)何时对应于一个物理量子态,从而使得利用2-RDM而非波函数进行多粒子量子计算成为可能。在本快报中,我们提出了无粒子数守恒量子系统的可表示性问题的解决方案。物理上允许的2-RDM集合可由一个几何上“正交”的集合——极锥——来刻画。我们推导了极锥中两体算符的显式线性方程(该极锥为$p$-正锥与两体算符空间的交集),从而获得了一个不依赖于更高阶RDM或波函数的系统化可表示性条件层级。此外,通过将这些条件与粒子数方差相结合,我们得到了一个统一框架,可同时处理粒子数守恒与非守恒系统。我们以自旋系统和分子H$_4$为例进行了说明。


摘要 (Abstract)

Representability determines when a two-particle reduced density matrix (2-RDM) corresponds to a physical quantum state, enabling many-particle quantum calculations with 2-RDMs rather than the wave function. In this Letter, we present a solution of the representability problem for quantum systems without particle-number conservation. The physically allowed set of 2-RDMs can be characterized from a geometrically `orthogonal’ set, the polar cone. We derive explicit linear equations for the two-body operators in the polar cone – the intersection of the $p$-positive cone with the two-body operator space – to obtain a systematic hierarchy of representability conditions that do not depend on higher RDMs or the wave function. Moreover, by augmenting these conditions with the particle-number variance, we obtain a unified framework for treating both particle-number-conserving and nonconserving systems. We illustrate with a spin system and molecular H$_4$.


关键词: representability, two-particle reduced density matrix, quantum systems, particle-number nonconservation, polar cone, p-positive cone, spin system, molecular H4


330. ❌ Broadband impulsive stimulated Raman spectroscopy reveals electronic state-specific vibronic coupling and vibrational coherence transfer through nonadiabatic electronic coupling

作者: Ramandeep Kaur, Shaina Dhamija, Garima Bhutani, Amit Kumar, Arijit K. De 期刊/来源: arxiv 发布日期: 2026-04-26 arXiv链接: http://arxiv.org/abs/2604.23731v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是碘分子在超快激光激发下的振动波包动力学,属于超快光谱学领域,与人工智能、大模型、深度学习等关键词完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文利用宽带脉冲受激拉曼光谱研究了碘分子电子态特定的振动耦合以及通过非绝热电子耦合的振动相干转移,揭示了振动相干性从B态到A态的转移机制。
摘要翻译

在脉冲泵浦/宽带探测激发下,碘分子基态(X)与激发态(B)的振动波包动力学被重新审视。本文引入了一种精确的啁啾校正方法,该方法对于确定光谱色散数据各分量的零时间点至关重要,从而能够将相干振动动力学与相干伪迹及布居动力学区分开来。虽然利用这些处理后的时域数据,结合稳态吸收可计算基态的绝对拉曼截面,但我们证明同样可以利用泵浦-探测数据本身实现这一计算,并进一步将该方法作为基准,用于计算激发态的绝对拉曼截面;这些截面反映了特定于这些态的振动耦合信息。此外,由于处理后的数据经傅里叶变换可得到去相位时间平均的振动模式信息,我们进行了小波分析,以获取振动模式的联合时频分布,从而展示其频率随时间演化的方式。结果表明,基态与激发态的振动模式展现出不同的色散特性。由于重叠的光谱特征出现在不同的时间窗口,此类分析能够解析光谱拥堵,即便仅基于简单的一维测量。最有趣的是,B态模式快速的时间相关光谱位移与衰减,随后伴随A态模式的出现与增强,直接关联于预解离过程,以及后续的溶剂笼效应诱导的复合。因此,本工作揭示了振动相干性通过非绝热耦合经由中间解离态(a)从一个电子态(B)转移到另一个电子态(A)的过程,凸显了电子相干性的重要性。


摘要 (Abstract)

Vibrational wavepacket dynamics in the ground (X) and excited (B) electronic states of iodine under impulsive-pump/broadband-probe excitation are revisited. A method for accurate chirp correction, necessary to determine the zero time for each component of spectrally dispersed data and thereby separate coherent vibrational dynamics from coherent artifacts and population kinetics, is introduced. While from these processed time-domain data the absolute Raman cross-section in the ground electronic state can be calculated using steady-state absorption, we show that the same can be done using the pump-probe data itself, and further extend this method as a benchmark to calculate the same for the excited electronic state; these cross-sections report on vibronic couplings specific to these states. Further, since the Fourier transform of the processed data yields information on vibrational modes averaged over the dephasing time, a wavelet analysis is performed to yield a joint time-frequency distribution of the vibrational modes, demonstrating how the time evolution of their frequencies can be extracted. The vibrational modes of the ground and excited electronic states are shown to exhibit distinct dispersion characteristics. Since overlapping spectral features appear at different time windows, such an analysis can disentangle spectral congestion, even from a simple one-dimensional measurement. Most interestingly, a rapid time-dependent spectral shift and decay of the B state mode, followed by the appearance and growth of the A-state mode, directly correlates with the pre-dissociation, followed by solvent caging-induced recombination. Thus, the present work reveals transfer of vibrational coherence from one electronic state (B) to another (A), mediated via nonadiabatic coupling to the intermediate dissociative state (a), underscoring the importance of electronic coherence.


关键词: vibrational wavepacket dynamics, impulsive stimulated Raman spectroscopy, vibronic coupling, nonadiabatic electronic coupling, chirp correction, wavelet analysis, coherence transfer


331. ❌ Role of ultrafast electron-optical-phonon interactions in high harmonic generation from graphene

作者: Adam Herling, Ofer Neufeld 期刊/来源: arxiv 发布日期: 2026-04-25 arXiv链接: http://arxiv.org/abs/2604.23294v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究石墨烯中电子-光学声子相互作用对高次谐波产生的影响,属于凝聚态物理和超快光学领域,与关键词中的大模型、深度学习、AI技术等完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文通过理论模型研究石墨烯中光学声子对高次谐波产生的抑制和退相干效应,解释了实验观测到的谐波截止能量和温度依赖性。
摘要翻译

高次谐波产生(HHG)是固体中广泛研究的过程,其中强激光驱动带内阿秒至飞秒尺度的电子动力学,从而引发高能辐射。尽管电子和光子被认为是HHG的主要参与者,但固体中也普遍存在声子,由于其时间尺度较长,通常被认为在HHG中可忽略不计。我们采用包含光学声子在静态极限下的理论框架,对石墨烯中的HHG进行了理论研究——在该框架中,晶格在电子时间尺度上被冻结,并通过采样热占据声子并进行系综平均来计算HHG。我们证明,在石墨烯中:(i)光学声子通过与带间电流耦合并引起谐波相位扰乱(相消干涉),强烈抑制HHG产率,这解释了在约3 eV以上缺乏实验观测到的HHG现象。(ii)由于声子占据数,HHG产率变得依赖于温度,但在石墨烯中这种依赖性较弱,因为声子能量尺度主要由零点运动主导。(iii)光学声子以等效于T₂~5.7 fs的速率使带间相干性退相,该速率显著快于电子-电子散射,表明热声子在强场中主导电子退相干过程。(iv)声子使HHG椭圆率依赖曲线变得平滑,从而与实验取得更好的一致性。值得注意的是,所有效应均与时间尺度无关,源于电子-声子相互作用的静态图像,使得结果可推广至阿秒现象。我们的研究揭示了HHG中的退相时间问题以及声子在阿秒时间尺度上的作用,并对其他系统及过程(如石墨烯中的Floquet能隙与光电流)具有启示意义。


摘要 (Abstract)

High harmonic generation (HHG) is a widely explored process in solids, where intense lasers drive attosecond-to-femtosecond electron dynamics within bands, causing high-energy emission. While electrons and photons are considered the main players in HHG, solids also host ubiquitous phonons that are typically assumed negligible in HHG due to their longer timescales. We theoretically study HHG in graphene with a formalism including optical phonons in the static limit, where the lattice is frozen on the electronic timescale and HHG is computed by sampling thermally-occupied phonons and ensemble-averaging. We show that in graphene: (i) Optical phonons strongly suppress HHG yields by coupling to interband currents and causing harmonic phase scrambling (destructive interference), explaining the lack of experimental HHG above 3 eV. (ii) HHG yields become temperature-dependent due to phonon occupations, though in graphene this dependence is weak since phonon energy scales are dominated by zero-point motion. (iii) Optical phonons dephase interband coherences at a rate equivalent to T25.7 fs, substantially faster than e-e scattering, suggesting thermal phonons dominate electronic decoherence in strong fields. (iv) Phonons smoothen HHG ellipticity-dependent curves, yielding better agreement with experiments. Remarkably, all effects are timescale-independent, arising in the static picture of electron-phonon interactions, making results transferable to attosecond phenomena. Our results shed light on the dephasing time problem in HHG and the role of phonons on attosecond timescales, with implications for other systems and processes such as Floquet gaps and photocurrents in graphene.


关键词: high harmonic generation, graphene, electron-phonon interactions, optical phonons, dephasing, ultrafast dynamics


332. ❌ A Single Twist-Angle Selection Method for the Electronic Structure of Bilayer Materials

作者: Ryan A. Baker, William Z. Van Benschoten, James J. Shepherd 期刊/来源: arxiv 发布日期: 2026-04-25 arXiv链接: http://arxiv.org/abs/2604.23405v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究双层材料的电子结构,提出了一种单扭角选择方法(sfTA变体),属于计算化学/凝聚态物理领域,与关键词中的大模型、深度学习、AI技术完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文提出并测试了两种基于结构因子扭角平均(sfTA)的变体方法,用于高效计算双层材料的结合相关能,其中结合sfTA方法通过误差抵消获得了最准确的能量。
摘要翻译

结构因子扭转平均(structure factor twist averaging, sfTA)是一种较新的方法,已被证明能够以较低的计算成本再现体相体系的扭转平均(twist-averaged, TA)CCSD能量。在本工作中,我们将该方法扩展为两种变体形式以处理低维材料:配对sfTA(paired sfTA)和结合sfTA(binding sfTA)。这些变体影响了sfTA协议中使用的扭转角,以及特殊扭转角的选择方式——即通过使用结合结构因子(binding structure factor)进行选择。这些改进旨在将结合相互作用纳入sfTA中的扭转角选择算法。我们在多种双层体系上对这两种变体进行了测试,并将所得的结合关联能与原始sfTA结果进行了比较。结果表明,这两种变体能够产生接近TA的结果,其中结合sfTA给出的能量最为精确。我们还利用测试体系的等高线图证明,这些改进很可能是由误差抵消引起的。


摘要 (Abstract)

Structure factor twist averaging (sfTA) is a newer method that has been shown to reproduce twist-averaged (TA) CCSD energies for bulk systems at a low computational cost. In this work, we extend this method for the treatment of low-dimensional materials in the form of two variants: paired sfTA and binding sfTA. These variants affect which twist angles are used in the sfTA protocol, as well as how the special twist angle is selected, namely by using the binding structure factor. These changes are meant to incorporate the binding interaction into the twist-angle selection algorithm within sfTA. Both variants are tested on a variety of bilayer systems, and the resulting binding correlation energies are compared to original sfTA results. We show that the variants are able to produce results approaching TA, with binding sfTA producing the most accurate energies. We also use contour plots of the test systems to show that these improvements are most likely caused by a cancellation of errors.


关键词: structure factor twist averaging, bilayer materials, binding correlation energy, coupled cluster, twist-angle selection, low-dimensional materials, electronic structure


333. ❌ Effects of Porous Media Properties and Flow Environment on Drug Release from Porous Implants

作者: Pawan Kumar Pandey, KVS Chaithanya, Prateek K. Jha 期刊/来源: arxiv 发布日期: 2026-04-25 arXiv链接: http://arxiv.org/abs/2604.23191v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究多孔植入物中药物释放的数值模拟,涉及流体力学和传质过程,与所有列出的关键词(大模型、深度学习、AI技术等)完全无关。论文未提及任何机器学习或人工智能方法,因此所有关键词评分为0。


!!! tip deepseek-chat TL;DR

该论文通过数值模拟研究了多孔介质特性和流动环境对药物填充多孔植入物中药物释放行为的影响,发现高雷诺数下后期释放速率常数增加且植入物工作时间延长。
摘要翻译

载药多孔植入物(Drug-Filled Porous Implants, DFPIs)是一种以可控且持续的方式向靶向部位递送药物的创新解决方案。为优化其在不同生理条件下的性能,理解流体流动与多孔介质特性对药物释放过程的影响至关重要。本研究通过数值方法探究了多种流动条件及其对DFPI药物释放的影响。将DFPI建模为均质饱和多孔介质,其多孔结构内的流动采用Forchheimer扩展达西定律(Forchheimer-extended Darcy law)进行模拟。DFPI内部的药物扩散及其在周围通道中的传输则采用稀释物质输运方法进行仿真。研究结果揭示了流动条件与多孔介质特性对植入物药物释放曲线及通道内药物可用性的影响。通过将释放过程建模为具有时变速率常数的表观一级动力学过程,分析了药物释放行为的变化。值得注意的是,结果强调了特定条件下(尤其在高雷诺数时)DFPI药物释放后期速率常数增大,同时确保植入物具有更长的运行时间。这些发现表明,开发能够以更贴合应用特定需求的方式递送药物的智能DFPI设计具有潜在可行性。


摘要 (Abstract)

Drug-Filled Porous Implants (DFPIs) are an innovative solution for delivering drugs in a controlled and sustained manner to target sites. To optimize their performance across various physiological conditions, it is essential to understand how fluid flow and porous media properties influence the drug release process. In this work, we numerically investigate a wide range of flow conditions and their effects on drug release from DFPI. The DFPI is modeled as a homogeneous, saturated porous medium, with flow through the porous structure modeled using the Forchheimer-extended Darcy law. Drug diffusion within the DFPI and its transport through the surrounding channel are simulated using a diluted species transport approach. The results reveal the impact of flow conditions and porous media characteristics on the drug release profile of the implant and drug availability within the channel. The variations in drug release behavior are analyzed by modeling the release as an apparent first-order process with a time-dependent rate constant. Notably, the results highlight specific conditions under which the rate constant increases during the later stages of drug release from the DFPI, particularly at high Reynolds numbers, while also ensuring a prolonged operational time period of the implant. These findings suggest the potential for developing intelligent DFPI designs capable of delivering drugs in a manner more attuned to the specific needs of the application.


关键词: Drug-Filled Porous Implants, drug release, porous media, Forchheimer-extended Darcy law, numerical simulation, Reynolds number, controlled release


334. ❌ Design Principles for Enhanced Quantum Transport with Site-Dependent Noise

作者: Maggie Lawrence, Elise Wang, Dvira Segal 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.23005v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究量子传输中的环境噪声辅助传输,涉及量子物理和开放系统,与给定的关键词(大模型、深度学习、AI等)完全无关。所有关键词相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文通过允许位点依赖的退相干来优化环境噪声,从而增强一维晶格中的稳态量子传输,发现空间结构噪声比均匀噪声更有效。
摘要翻译

环境噪声可以增强输运,这一效应被称为环境噪声辅助的量子输运。大多数理论研究侧重于在空间均匀的系统-环境耦合条件下优化系统参数。然而,本文中我们通过允许依赖于位点的退相干,直接对环境噪声本身进行优化。我们研究了具有斜坡势或无序能量景观的一维晶格中的稳态输运,同时考虑了短程和长程相干隧穿。在无环境效应的情况下,热力学极限下这些系统会因相消干涉而呈现局域化,从而抑制输运。利用林德布拉德主方程框架,我们实现了局部退相干的优化,以最大化稳态粒子流。我们发现,对于斜坡势,短程隧穿倾向于在交替位点上进行选择性退相干,而长程隧穿则受益于随注入位点距离增加而增强的退相干分布。在能量无序系统中,强失谐位点在短程隧穿下需要增强局部退相干以促进输运。在所有情况下,我们发现位点优化的退相干比均匀退相干能实现更高的输运效率,并且伴随稳态空间离域性的增强。我们的结果为相干动力学与环境噪声之间的相互作用提供了微观层面的理解。退相干在局部展宽能级,有助于克服失谐和相消干涉。更广泛地说,我们确立了空间结构化的环境噪声作为控制开放系统中量子输运和态相干性的一种策略。


摘要 (Abstract)

Environmental noise can enhance transport, an effect known as environmental noise-assisted quantum transport. Most theoretical studies focus on optimizing system parameters under spatially uniform system-environment coupling. Here, instead, we optimize the environmental noise itself by allowing for site-dependent dephasing. We investigate steady-state transport in one-dimensional lattices with either ramped or disordered energy landscapes, considering both short- and long-range coherent tunneling. In the absence of environmental effects, in the thermodynamic limit these systems can exhibit localization, and thus suppressed transport, arising from destructive interference. Using a Lindblad master equation framework, we implement local dephasing optimized to maximize steady-state population flux. We find that for ramp potentials, short-range tunneling favors selective dephasing on alternating sites, whereas long-range tunneling benefits from a dephasing profile that increases with distance from the injection site. In energetically disordered systems, strongly detuned sites require enhanced local dephasing under short-range tunneling to facilitate transport. In all cases, we find that site-optimized dephasing allows higher transport efficiency than uniform dephasing, and it is accompanied by increased spatial delocalization of the steady state. Our results provide microscopic insight into the interplay between coherent dynamics and environmental noise. Dephasing broadens energy levels locally, helping to overcome detuning and destructive interference. More generally, we establish spatially-structured environmental noise as a strategy for controlling both quantum transport and state coherence in open systems.


关键词: quantum transport, site-dependent noise, dephasing, Lindblad master equation, localization, open quantum systems


335. ❌ Chirality Transfer to the Centrosymmetric Magnetic Sublattice in the Hybrid Perovskite (R)-/(S)-3-Fluoropyrrolidinium Copper(II) Chloride

作者: Zheng Zhang, Mingyu Xu, Jose L. Gonzalez Jimenez, Stephen Zhang, Weiwei Xie, Xianghan Xu, Daniel B. Straus 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22952v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 论文研究的是手性有机-无机杂化钙钛矿材料中的手性传递和磁有序,属于材料科学和凝聚态物理领域,与关键词中的大模型、深度学习、AI技术等完全无关。所有关键词评分均为0。


!!! tip deepseek-chat TL;DR

该论文报道了一种新型二维手性金属卤化物材料,通过引入手性有机阳离子实现了中心对称无机亚晶格中的手性磁有序,并观察到场致磁手性效应。
摘要翻译

将手性有机阳离子引入有机-无机杂化材料已被证明能够使无机亚晶格表现出手性光学性质。我们报道了一种新型二维磁性(S=1/2)手性金属卤化物材料,(R)-和(S)-$(C_4H_9FN)_2CuCl_4$(其中$(C_4H_9FN)^+$为3-氟吡咯烷鎓),该材料由Cu-Cl无机层与$(C_4H_9FN)^+$有机阳离子交替堆叠而成。尽管无机亚晶格本身在结构上具有中心对称性,但手性$(C_4H_9FN)^+$有机阳离子的存在诱导了手性磁有序的形成。我们还报道了含有等量(R)-和(S)-阳离子的外消旋变体,该变体未显示出手性磁有序的证据。当垂直于无机Cu-Cl层传播方向测量磁化率时,在手性和外消旋材料中均观察到奈尔温度$T_N = 2.23~K$处的反铁磁相变,且比热容测量结果支持该磁相变的存在。通过在手性变体中观测到的二阶磁电效应,证实了场致磁手性的存在,而外消旋材料未检测到磁电信号,表明其缺乏磁手性。我们的研究结果表明,通过将手性阳离子引入有机-无机杂化磁性材料,可以制备出具有手性磁有序的材料,这为设计兼具手性磁性及其他源于结构手性的理想光学与电学特性的定制化材料提供了可能。


摘要 (Abstract)

Incorporating chiral organic cations into organic-inorganic hybrid materials has been shown to enable the inorganic sublattice to display chiroptical properties. We report a new two-dimensional magnetic (S=1/2) chiral metal halide material, (R)- and (S)-$(C_4H_9FN)_2CuCl_4$ (where $(C_4H_9FN)^+$ is 3-fluoropyrrolidinium), which consists of Cu-Cl inorganic layers separated by $(C_4H_9FN)^+$ organic cations. The presence of the chiral $(C_4H_9FN)^+$ organic cation induces formation of chiral magnetic order, even though the inorganic sublattice itself is structurally centrosymmetric. We also report the racemic variant, containing an equal amount of (R)- and (S)- cations, which shows no evidence of chiral magnetic order. When the magnetic susceptibility is measured perpendicular to inorganic Cu-Cl layer propagation direction, an antiferromagnetic phase transition at Néel temperature $T_N = 2.23~K$ is observed in both the chiral and racemic materials, and the existence of the magnetic phase transition is supported by specific heat capacity measurements. Field-induced magnetic chirality is observed through the existence of a second-order magnetoelectric effect in the chiral variant, while no magnetoelectric signal is observed for the racemic material, indicating the absence of magnetic chirality. Our findings demonstrate that materials exhibiting chiral magnetic order can be created through the incorporation of a chiral cation into an organic-inorganic hybrid magnetic material, potentially allowing for the design of tailored materials that combine chiral magnetism with other desirable optical and electronic properties that come from structural chirality.


关键词: chirality, magnetic order, hybrid perovskite, organic-inorganic, magnetoelectric effect, antiferromagnetic


336. ❌ Charge order, domain order, ideal mixing and absence of demixing in 2D binary mixtures of alcohols

作者: Lydia Chelli, Aurélien Perera 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22936v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文研究的是二维醇类混合物的电荷序、域序和理想混合,属于经典分子动力学模拟,完全不涉及大模型、深度学习或AI技术。所有关键词均与论文内容无关,因此所有评分为0。


!!! tip deepseek-chat TL;DR

该论文通过计算机模拟研究二维醇类混合物的微观结构,发现短链和长链醇混合良好,且理想性与微相分离在极性头聚集体中竞争,揭示了电荷序在局部结构中的关键作用。
摘要翻译

通过计算机模拟研究了二维、基于格点的醇类二元混合物,重点关注理想混合、局部聚集及混溶趋势。选取了四个代表性体系:甲醇/乙醇、丁醇/戊醇、甲醇/戊醇和甲醇/辛醇。这些模型保留了化学特异性,同时能够探究维度约束并揭示非平凡微观结构。观察到两个意外结果:第一,短链与长链醇的混合物呈现良好混合状态,而非其三维对应体系中出现的宏观相分离;第二,理想性与微观相分离在链状极性头聚集体内相互竞争。这些行为无法仅用二维增强涨落解释,反而表明电荷有序化在塑造局部结构中起关键作用。通过快照、位点/位点分布函数、结构因子及Kirkwood-Buff积分,分析了浓度涨落与微观异质聚集之间的相互作用。特别地,分析揭示出长程关联部分的畴关联具有引人注目的非自平均行为,这与真实体系中的发现类似,表明缔合分子混合物不受常规涨落支配。


摘要 (Abstract)

Binary mixtures of two dimensional, site-based models of alcohols are investigated by computer simulations, with a focus on ideal mixing, local clustering and miscibility trends. Four representative systems are considered: methanol/ethanol, butanol/pentanol, methanol/pentanol, and methanol/octanol. The models retain chemical specificity, while allowing to investigate dimensional constraints and uncover non/trivial micro/structurations. Two unexpected results are observed. First, mixtures of short and long alcohols are well mixed, instead of the macroscopic phase separation found in their three-dimensional counterparts. Second, ideality and micro phase separation compete within the chain like polar head aggregates. These behaviors cannot be explained solely by enhanced fluctuations in two dimensions, and instead point to a key role of charge ordering in shaping the local structure. The resulting interplay between concentration fluctuations and micro heterogeneous aggregation is analyzed through snapshots, site/site distribution functions, structure factors and Kirkwood Buff integrals. In particular, the analysis reveals that the domain correlations in the long range part of the correlations have an intriguing non self averaging behaviour, similar to that found in the real systems, indicating that mixtures of associating molecules are not ruled by conventional fluctuations.


关键词: binary mixtures, alcohols, charge order, domain order, ideal mixing, micro phase separation, Kirkwood-Buff integrals, computer simulations


337. ❌ How the Hahn-Banach Theorem Sheds Bright Light on Fundamental Questions in Classical Thermodynamics

作者: Martin Feinberg, Richard B. Lavine 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22717v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 论文主题为热力学第二定律与Hahn-Banach定理的数学联系,完全不涉及大模型、深度学习或任何AI技术。所有关键词均与论文内容无关,因此所有评分均为0。


!!! tip deepseek-chat TL;DR

该论文利用Hahn-Banach定理从热力学第二定律推导出熵和温度函数的存在性,并讨论了唯一性条件,属于纯数学与热力学交叉领域,与AI无关。
摘要翻译

哈恩-巴拿赫定理(Hahn-Banach Theorem)作为现代泛函分析的基石,与热力学第二定律(Second Law of Thermodynamics)有着天然的联系。基于开尔文-普朗克表述(Kelvin-Planck version)的第二定律,哈恩-巴拿赫定理能够直接且同时导出局部材料状态的熵(entropy)与热力学温度(thermodynamic-temperature)函数,使得特定材料可能经历的任何过程均满足克劳修斯-杜海姆不等式(Clausius-Duhem inequality)。对于此类函数的存在性,完全无需将其定义域限制于平衡状态。然而,哈恩-巴拿赫定理也表明,若要在整个状态空间域上实现此类函数对的唯一性,则每个状态都必须经由可逆过程(reversible process)到达。本文综述旨在帮助热力学学者与数学家理解哈恩-巴拿赫定理与第二定律之间引人注目的相互作用。


摘要 (Abstract)

The Hahn-Banach Theorem, a cornerstone of modern functional analysis, is a natural companion of the Second Law of Thermodynamics. From a Kelvin-Planck version of the Second Law, the Hahn-Banach Theorem delivers, immediately and simultaneously, entropy and thermodynamic-temperature functions of the local material state such that the Clausius-Duhem inequality is satisfied for every process a particular material might admit. For \emph{existence} of such functions there is no need at all to require that their domain be restricted to states of equilibrium. However, the Hahn-Banach Theorem also indicates that for \emph{uniqueness} of such a pair of functions across the entire state-space domain, every state must be visited by a reversible process. This review is intended to help make accessible to both thermodynamics scholars and mathematicians the remarkable interplay of the Hahn-Banach Theorem and the Second Law.


关键词: Hahn-Banach Theorem, Second Law of Thermodynamics, entropy, thermodynamic temperature, Clausius-Duhem inequality, reversible process, state-space domain


338. ❌ Pressure-Temperature Phase Diagram and $λ$-Transition in Liquid Sulfur

作者: Sonia Salomoni, Frédéric Datchi, A. Marco Saitta, Arthur France-Lanord 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22696v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.05.0/100.0

评分理由: 论文使用机器学习势函数进行分子动力学模拟,研究液态硫的λ相变,属于AI for Science(计算化学/材料科学)领域,但与LLM、深度学习技术原理创新无关。因此仅’AI for Science’关键词得5分,其余均为0分。


!!! tip deepseek-chat TL;DR

该论文利用机器学习势函数驱动的分子动力学模拟,揭示了液态硫中λ相变(温度诱导聚合)的微观机制,并构建了直至中等压力的相图。
摘要翻译

利用机器学习原子间势驱动的分子动力学模拟,我们在低至中等压力下研究了硫的λ转变——一种温度诱导的聚合反应。在环境压力下,我们捕捉到结晶态环八硫熔化为由分子环构成的液体。在此液体内,非S₈环的浓度随温度升高而增加;我们表明这些分子充当反应中心,最终引发聚合反应。我们重现了λ转变的关键实验特征,包括热容的急剧增加以及转变温度对加热速率的显著依赖性。在此基础上,我们重建了直至中等压力的聚合相图。我们的结果表明,聚合温度随压力升高而适度降低,最终在临界点处与熔融线合并。超过该临界点后,我们提供了聚合反应从晶相中出现的直接证据。通过分析升温轨迹,我们观察到非S₈环、开链以及保留晶相排列特征的扩展聚合物结构的形成;进一步加热系统会导致无序性通过熔融占据主导地位。因此,聚合反应在熔融之前略微启动。总体而言,我们的发现为整个硫相图中的λ转变提供了微观图像。


摘要 (Abstract)

Using molecular dynamics simulations driven by a machine-learned interatomic potential, we investigate at low to intermediate pressures the $λ$-transition of sulfur, a temperature-induced polymerization. At ambient pressure, we capture the melting of crystalline cyclo-octasulfur into a liquid of molecular rings. Within this liquid, the concentration of non-S$_8$ rings increases with temperature; we show that these molecules act as reactive centers, which eventually trigger polymerization. We reproduce key experimental signatures of the $λ$-transition, including the sharp increase in heat capacity and the pronounced dependence of the transition temperature on the heating rate. Building on this, we reconstruct a phase diagram of polymerization up to intermediate pressures. Our results reveal a moderate decrease of the polymerization temperature with pressure, culminating with its merging with the melting line at a critical point. Beyond this point, we provide direct evidence of polymerization emerging from the crystalline phase. By analyzing temperature-ramp trajectories, we observe the formation of non-S$_8$ rings, open chains, and extended polymeric structures which retain features of the crystalline arrangement; further heating the system leads to disorder taking over through melting. Polymerization is therefore initiated slightly before melting. Altogether, our findings provide a microscopic picture of the $λ$-transition throughout the sulfur phase diagram.


关键词: machine-learned interatomic potential, molecular dynamics, λ-transition, polymerization, sulfur, phase diagram, melting


339. ❌ Unveiling the Molecular Driving Forces of Pollutant Extraction by Hydrophobic Eutectic Solvents

作者: S. Gomez, U. Ali, A. Muroni, A. Mele, M. E. Di Pietro, T. Giovannini 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22674v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.08.0/100.0

评分理由: 论文研究疏水性低共熔溶剂(HES)提取污染物的分子驱动力,属于计算化学和绿色化学领域,不涉及大模型或深度学习。唯一相关的关键词是’AI for Science’,但论文未使用AI方法,仅采用分子动力学和量子化学计算,因此相关度较低,给予8分。其他关键词均不相关,得0分。


!!! tip deepseek-chat TL;DR

该论文通过多尺度模拟揭示了疏水性低共熔溶剂提取双酚A的分子机制,发现协同氢键与色散/极化作用是选择性的关键。
摘要翻译

疏水性低共熔溶剂(HES)正逐渐成为从水中提取分子污染物的传统有机溶剂的可持续替代品。然而,其选择性仍未被充分理解,这阻碍了低共熔溶剂超越经验成功之外的预测性设计。在此,我们提出了一种多尺度策略,以合理化并预测溶质在HES中的分配。以三辛基氧化膦(TOPO):薄荷醇中的双酚A(BPA)作为原型体系,我们将单相和双相分子动力学与主导溶剂化基序的量子能量分解相结合。我们的方法不仅捕捉到了实验测量的BPA在HES相中的自发迁移和热力学稳定化,还识别出了选择性的微观起源:在疏水性低共熔微环境中,协同氢键与强色散和极化效应相耦合。我们工作流程的稳健性为绿色和可持续应用的HES配方的预测性计算机筛选与设计铺平了道路。


摘要 (Abstract)

Hydrophobic eutectic solvents (HES) are emerging as sustainable alternatives to conventional organic solvents for the extraction of molecular pollutants from water. Yet, their selectivity remains poorly understood, hindering the predictive design of eutectic solvents beyond empirical success. Here, we present a multiscale strategy to rationalize and predict solute partitioning in HES. Focusing on bisphenol A (BPA) in trioctylphosphine oxide (TOPO):menthol as a prototypical system, we combine monophasic and biphasic molecular dynamics with quantum energy decomposition of dominant solvation motifs. Our methodology captures the experimentally measured BPA spontaneous migration and thermodynamic stabilization in the HES phase but also identifies the microscopic origin of selectivity: cooperative hydrogen bonding couples to strong dispersion and polarization in the hydrophobic eutectic microenvironment. The robustness of our workflow paves the way for the predictive in-silico screening and design of HES formulations for green and sustainable applications.


关键词: Hydrophobic eutectic solvents, molecular dynamics, quantum energy decomposition, bisphenol A, selectivity, solvation motifs


340. ❌ DeepHartree: A Poisson-Coupled Neural Field for Scalable Density Functional Theory

作者: Jiankun Wu, Jinming Fan, Chao Qian, Shaodong Zhou 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22669v2

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.010.0/100.0

评分理由: 论文主要关注密度泛函理论(DFT)的加速,使用E(3)-等变神经网络和泊松方程耦合,属于AI for Science领域,与LLM、MoE、SLM等大模型技术无关。唯一相关的关键词是’AI for Science’,评分为10,因为论文核心是机器学习加速DFT计算。其他关键词均不相关,评分为0。


!!! tip deepseek-chat TL;DR

DeepHartree通过泊松耦合神经场加速密度泛函理论,实现近线性缩放,并在小分子训练后零样本迁移至大体系,减少SCF迭代达40.6%。
摘要翻译

从头计算在大体系中的应用面临根本性瓶颈,其根源在于求解自洽场(SCF)方程时计算量随体系规模呈陡峭增长。尽管机器学习有望加速这一过程,但现有方法常牺牲物理严谨性,或依赖基组且缺乏可迁移性。为此,我们提出DeepHartree——一种泊松耦合神经场,用于加速线性组合原子轨道(LCAO)密度泛函理论(DFT)。通过将E(3)等变神经网络与泊松方程经由自动微分耦合,并利用delta学习缓解核奇异性,DeepHartree能够同时预测相互自洽的实空间电子密度与哈特里势。该方法以GPU加速的近线性$\mathcal{O}(N)$数值推理替代$\mathcal{O}(N^4)$解析积分,从而破解了库仑瓶颈。仅基于小分子训练的DeepHartree通过两级可迁移性实现可扩展的密度泛函理论:在SCF收敛加速方面,它对不同基组、泛函及多达168个原子的体系展现出稳健的零样本迁移能力;在预测其他密度相关物理量时,它既保留了对小分子的零样本能力,又可通过高效的小样本微调实现对更大体系的精确预测。我们的模型通过高保真初始密度矩阵将标准SCF协议的迭代次数减少高达40.6%,其严格的远程渐近行为更可在网格评估前提供零成本的物理不确定性度量。通过将深度学习植根于泊松耦合神经场,DeepHartree将诸如近耦合簇动态红外模拟等高需求任务加速数个数量级,为密度泛函理论建立了一种可扩展的范式。


摘要 (Abstract)

Ab initio calculations are fundamentally bottlenecked for large systems by the steep computational scaling of solving self-consistent field (SCF) equations. While machine learning offers potential accelerations, existing methods often compromise physical rigor or rely on basis-dependent, non-transferable representations. Here, we introduce DeepHartree, a Poisson-coupled neural field that accelerates linear combination of atomic orbitals (LCAO) density functional theory (DFT). By coupling an E(3)-equivariant neural network with the Poisson equation through automatic differentiation and mitigating nuclear singularities via delta-learning, DeepHartree simultaneously predicts mutually consistent real-space electron densities and Hartree potentials. This resolves the Coulomb bottleneck by substituting $\mathcal{O}(N^4)$ analytical integrals with GPU-accelerated, near-linear $\mathcal{O}(N)$ numerical inference. Trained solely on small molecules, DeepHartree enables scalable density functional theory through a two-level transferability: for SCF convergence acceleration, it achieves robust zero-shot transferability across diverse basis sets, functionals, and systems up to 168 atoms; for predicting other density-related physical quantities, it retains zero-shot capability on small molecules while enabling precise predictions for larger systems via efficient few-shot fine-tuning. Our model accelerates standard SCF protocols by reducing iterations by up to 40.6% via high-fidelity initial density matrices, and its rigorous long-range asymptotics provide a zero-cost physical uncertainty metric prior to grid evaluation. By grounding deep learning in Poisson-coupled neural fields, DeepHartree accelerates demanding tasks – such as near-coupled-cluster dynamic infrared simulations – by orders of magnitude, establishing a scalable paradigm for density functional theory.


关键词: Density Functional Theory, Neural Field, Poisson Equation, E(3)-equivariant Neural Network, Delta-learning, Transferability, Self-consistent Field


341. ❌ Dynamic Moiré Potentials and Robust Wigner Crystallization in Large-Scale Twisted Transition Metal Dichalcogenides

作者: Yifan Ke, Chuanjing Zeng, Xinming Qin, Wei-Lin Tu, Wei Hu, Jinglong Yang 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22343v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.010.0/100.0

评分理由: 论文主要研究扭曲双层过渡金属二硫属化物中的动态莫尔势和维格纳结晶,使用了基于机器学习的DeePMD和DeepH框架,属于AI for Science领域,与LLM等大模型技术无关。因此,仅’AI for Science’关键词得高分,其余为0分。


!!! tip deepseek-chat TL;DR

该论文开发了一个结合机器学习和第一性原理计算的工作流,研究大尺度扭曲双层WS2中的动态莫尔势和强关联电子态,揭示了晶格振动对莫尔势和维格纳结晶的影响。
摘要翻译

理解大尺度莫尔超晶格体系的动力学演化,对于连接理论预测与实验观测至关重要。本文开发了一种基于机器学习的工作流程,将DeePMD和DeepH框架与第一性原理计算相结合,以高效研究含有超过3000个原子的实验相关莫尔超胞中,扭曲双层过渡金属二硫族化物(TMDs)的时变结构与电子响应。以二硫化钨($\mathrm{WS_2}$)为代表体系,我们展示了低温晶格振动与弛豫会加深莫尔势阱、收窄最低导带,并促进强局域电子态的形成。基于包含这些动力学效应的密度泛函理论(DFT)导出的莫尔势,密度矩阵重正化群(DMRG)模拟揭示了稳健的维格纳结晶以及一种Kagome图案的三电子态,这与近期实验观测结果一致。我们的工作流程为探索超越静态构型的大尺度莫尔超胞提供了一条实用路径,并为扭曲二维材料中晶格动力学、电子局域化以及涌现关联态之间的相互作用提供了新见解。


摘要 (Abstract)

Understanding the dynamical evolution of large-scale moiré systems is crucial for connecting theoretical predictions with experimental observations. Here we develop a machine-learning-based workflow, integrating DeePMD and DeepH frameworks with first-principles calculations, to efficiently investigate time-dependent structural and electronic responses in twisted bilayer transition metal dichalcogenides (TMDs) with experimentally relevant moiré supercells containing over 3000 atoms. Using $\mathrm{WS_2}$ as a representative system, we show that low-temperature lattice vibrations and relaxation deepen the moiré potential wells, narrow the lowest conduction band, and facilitate the formation of strongly localized electronic states. Based on DFT-derived moiré potentials that incorporate these dynamical effects, density-matrix-renormalization-group (DMRG) simulations reveal robust Wigner crystallization and a kagomé-patterned three-electron state, consistent with recent experimental observations. Our workflow provides a practical route for exploring large moiré supercells beyond static configurations and offers new insight into the interplay between lattice dynamics, electronic localization, and emergent correlated states in twisted two-dimensional materials.


关键词: twisted bilayer TMDs, moiré potentials, Wigner crystallization, machine learning, DeePMD, DeepH, DMRG, first-principles calculations


342. ❌ Performance of Quadrupole Mass Filter with Tapered and Flared Geometry

作者: Anushree Dutta, Pintu Mandal, Nabanita Deb 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22263v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究四极杆质量滤光器(QMF)的锥形和喇叭形几何结构对其性能的影响,属于质谱分析仪器领域,与大型语言模型、深度学习、人工智能等关键词完全无关。所有关键词相关度均为0分。


!!! tip deepseek-chat TL;DR

该论文通过模拟和理论分析,研究了四极杆质量滤光器在锥形和喇叭形几何偏差下的分辨率和传输特性,发现微小倾斜会导致分辨率下降。
摘要翻译

四极质量过滤器(QMF)的性能对理想电极几何结构的偏差高度敏感。本研究探讨了圆柱形电极杆微小向内和向外倾斜对QMF分辨率和传输特性的影响。此类几何扰动会在径向约束势中引入轴向变化,导致马修参数沿离子轨迹发生变化。为研究这一效应,采用具有轴向变化马修参数的龙格-库塔(RK45)方法计算了离子稳定性图。修正后的稳定区域会根据电极杆倾斜程度和性质发生偏移和收缩。沿轴向分析了高阶场分量的演化,特别是十二极项。利用SIMION进行离子轨迹模拟,以评估第一稳定工作区内QMF传输特性的相应变化。在固定工作条件下的模拟表明,小倾斜角度下存在传输与分辨率的权衡,导致分辨率提升;而在恒定峰值传输分析中,即使与平行构型存在微小偏差也会导致分辨率下降。这些结果凸显了微小几何缺陷在QMF运行中的关键作用,并为改进质量过滤器性能的容差限度和设计优化提供了见解。


摘要 (Abstract)

The performance of a quadrupole mass filter (QMF) is highly sensitive to deviations from ideal electrode geometry. In this work, we investigate the effect of small inward and outward tilting of cylindrical rods on the resolution and transmission characteristics of a QMF. Such geometric perturbations introduce an axial variation in the radial confinement potential, resulting in Mathieu parameters that vary along the ion trajectory. To examine this effect, the ion stability diagram is computed using a Runge Kutta (RK45) method with axially-varying Mathieu parameters. The modified stability region exhibits shift and contraction depending on the magnitude and nature of rod inclination. The evolution of higher order field components, particularly the dodecapole term, is analyzed along the axial direction. Ion trajectory simulations are performed using SIMION to evaluate the corresponding changes in QMF transmission characteristics in the first stability zone of operation. While simulations at fixed operating conditions indicate a transmission resolution trade off at small tilting angles leading to resolution enhancement, analysis at constant peak transmission reveals that even slight deviations from the parallel configuration lead to a degradation in resolution. These results highlight the critical role of minute geometric imperfections in QMF operation and provide insights into tolerance limits and design optimization for improved mass filter performance.


关键词: Quadrupole Mass Filter, Tapered Geometry, Flared Geometry, Ion Trajectory Simulation, Mathieu Parameters, Resolution, Transmission, SIMION


343. ❌ Dynamically Corrected Bethe-Salpeter Equation Solver for Self-consistent $GW$ Reference on the Matsubara Frequency Axis

作者: Ming Wen, Gaurav Harsha, Dominika Zgid 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22187v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models0.00.0/100.0
Mixture of Experts0.00.0/100.0
Small Language Models0.00.0/100.0
Scaling Laws0.00.0/100.0
Pre-training0.00.0/100.0
Post-training0.00.0/100.0
Instruction Tuning0.00.0/100.0
RLHF0.00.0/100.0
PEFT0.00.0/100.0
Retrieval-Augmented Generation0.00.0/100.0
Context Window Extension0.00.0/100.0
KV Cache Compression0.00.0/100.0
Chain of Thought0.00.0/100.0
System 2 Thinking0.00.0/100.0
Monte Carlo Tree Search0.00.0/100.0
Self-Correction0.00.0/100.0
LLM Agents0.00.0/100.0
Tool Use0.00.0/100.0
Multi-agent Systems0.00.0/100.0
Quantization0.00.0/100.0
Speculative Decoding0.00.0/100.0
Hallucination Mitigation0.00.0/100.0
Mechanistic Interpretability0.00.0/100.0
World Models0.00.0/100.0
Model Merging0.00.0/100.0
In-context Learning0.00.0/100.0
AI for Science0.00.0/100.0

评分理由: 该论文研究的是量子化学中的Bethe-Salpeter方程求解器,基于自洽GW方法,属于计算化学/物理领域,与LLM、深度学习或大模型技术完全无关。所有关键词均不相关,因此评分为0。


!!! tip deepseek-chat TL;DR

该论文提出了一种基于自洽GW参考的动态校正Bethe-Salpeter方程求解器,用于准确计算小分子的激发能。
摘要翻译

我们提出了一种基于马祖巴频率轴上自洽$GW$参考的Bethe-Salpeter方程(BSE)求解器,记为BSE@sc$GW$。与单次$GW$方法相比,自洽$GW$起点提供了稳健的准粒子描述,并降低了对初始平均场参考的敏感性。我们进一步通过等离激元极点模型对静态Casida公式引入了动力学修正。该方案在保留有效本征值问题高效性的同时,纳入了简单的动力学屏蔽效应。由此得到的动力学修正BSE@sc$GW$方法,对于小分子的单重态和三重态激发,其激发能与基于高级波函数的基准结果高度吻合。总体而言,动态BSE@sc$GW$方法的准确性源于良好收敛的单粒子参考与频率相关屏蔽效应的结合。


摘要 (Abstract)

We present a Bethe-Salpeter equation (BSE) solver based on a self-consistent $GW$ reference evaluated on the Matsubara frequency axis, referred to as BSE@sc$GW$. The self-consistent $GW$ starting point provides a robust quasiparticle description and reduces sensitivity to the initial mean-field reference compared to one-shot $GW$-based approaches. We further introduce a dynamical correction to the static Casida formulation via a plasmon-pole model. This scheme incorporates simple dynamical screening effects while retaining the efficiency of an effective eigenvalue problem. The resulting dynamically corrected BSE@sc$GW$ yields excitation energies in close agreement with high-level wavefunction-based benchmarks for both singlet and triplet excitations of small molecules. Overall, the accuracy of the dynamic BSE@sc$GW$ approach arises from the combination of a well-converged single-particle reference and the inclusion of frequency-dependent screening effects.


关键词: Bethe-Salpeter equation, self-consistent GW, dynamical correction, excitation energies, plasmon-pole model, Matsubara frequency


344. ❌ Optical Lineshape Models and the Generalized Einstein Relation between Absorption and Stimulated Emission

作者: Aman K. Agrawal, Jisu Ryu, David M. Jonas 期刊/来源: arxiv 发布日期: 2026-04-24 arXiv链接: http://arxiv.org/abs/2604.22173v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究光学谱线形状模型,涉及量子力学和光谱学,与所有列出的关键词(大模型、深度学习、AI等)完全无关。没有匹配任何关键词。


!!! tip deepseek-chat TL;DR

该论文研究了光学谱线形状模型,并验证了量子布朗振子模型满足广义爱因斯坦关系,与AI或大模型无关。
摘要翻译

近日,Ryu等人将爱因斯坦关于两个量子能级间吸收、受激发射和自发发射的三个系数,推广至两个展宽谱带间的四个光谱。这些光谱在热平衡状态下满足广义爱因斯坦关系;爱因斯坦关系作为线光谱的近似而获得。本文应用吸收与受激发射偶极强度光谱之间的广义爱因斯坦关系来研究光学线形模型。布洛赫模型、随机模型以及半经典布朗振子模型的线形不满足广义爱因斯坦关系,因此未能与普朗克黑体辐射实现细致平衡。量子布朗振子模型描述了一个与量子谐振子热库双线性耦合的简谐量子振动,该热库产生阻尼和随机力。两态量子布朗振子线形模型提供了两个位移相同但其他性质相同的简谐势能面之间跃迁的线形,这两个势能面上的同一量子振动与同一量子谐振子热库耦合。利用量子布朗振子模型计算了欠阻尼、临界阻尼和过阻尼情况下的吸收与受激发射线形。热能和重组能各自从远小于到远大于振动能量量子进行变化。所有量子布朗振子线形在计算数值精度内(14至30位有效数字)均满足广义爱因斯坦关系,表明该线形模型与细致平衡兼容。本文还给出了基于这些线形表示的电偶极跃迁截面的公式。


摘要 (Abstract)

Recently, Ryu et al. generalized Einstein’s three coefficients for absorption, stimulated emission, and spontaneous emission between two quantum levels to a set of four spectra between two broadened bands. The spectra obey generalized Einstein relationships at thermal equilibrium; Einstein’s relations are obtained as an approximation for line spectra. Here, the generalized Einstein relation between absorption and stimulated emission dipole-strength spectra is applied to investigate optical lineshape models. Lineshapes for the Bloch model, the stochastic model, and the semi-classical Brownian oscillator model do not obey the generalized Einstein relation and therefore fail to satisfy detailed balance with Planck blackbody radiation. The quantum Brownian oscillator model treats a harmonic quantum vibration that is bi-linearly coupled to a thermal bath of quantum harmonic oscillators which generate damping and a random force. The two-state quantum Brownian oscillator lineshape model provides lineshapes for transitions between two displaced, but otherwise identical, harmonic potential energy surfaces on which the same quantum vibration is coupled to the same thermal bath of quantum harmonic oscillators. The absorption and stimulated emission lineshapes were calculated using the quantum Brownian oscillator model in under-damped, critically damped, and over-damped cases. The thermal and reorganization energy were each varied from much less to greater than the vibrational quantum of energy. All quantum Brownian oscillator lineshapes obey the generalized Einstein relation within the numerical precision of the calculation (14 to 30 digits), suggesting this lineshape model is compatible with detailed balance. The formula giving the electric-dipole transition cross-section in terms of these lineshapes is presented.


关键词: optical lineshape, generalized Einstein relation, absorption, stimulated emission, quantum Brownian oscillator, detailed balance, Planck blackbody radiation


345. ❌ Plasmon-Exciton Coupling and Dephasing in Hybrid Au Nanostructure/J-Aggregate Systems

作者: Janak Bhandari, Robert Catuto, Zhumin Zhang, Bradley D. Smith, Hsing-Ta Chen, Gregory V. Hartland 期刊/来源: arxiv 发布日期: 2026-04-23 arXiv链接: http://arxiv.org/abs/2604.22094v1

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究金纳米结构与J-聚集体的等离子激元-激子耦合及退相,属于纳米光子学和凝聚态物理领域,与关键词中的大模型、深度学习、AI等完全无关。所有关键词相关度均为0。


!!! tip deepseek-chat TL;DR

该论文通过泄漏辐射显微镜研究了金纳米结构中传播的表面等离子体激元与花青染料J-聚集体的激子跃迁之间的耦合,观测到约30 meV的Rabi分裂,并发现耦合态寿命因能量耗散到J-聚集体的暗态而显著缩短。
摘要翻译

利用泄漏辐射显微镜研究了金纳米结构中传播的表面等离极化激元(SPPs)与花菁染料J-聚集体激子跃迁之间的耦合。纳米结构的实空间图像给出了泄漏SPP模式的传播长度,而傅里叶空间图像则提供了其色散曲线。当结构涂覆J-聚集体后,色散曲线显示出避免交叉现象,拉比分裂约为30 meV。通过将测得的传播长度与从色散曲线获得的群速度相结合,计算了耦合态寿命。寿命从裸金纳米结构的约50飞秒,下降至耦合J-聚集体/金纳米结构系统在避免交叉区域的约10飞秒。对耦合系统的解析Holstein-Tavis-Cummings模型计算和有限元模拟表明,寿命的下降主要归因于能量耗散至与J-聚集体相关的暗态。


摘要 (Abstract)

The coupling between propagating surface plasmon polaritons (SPPs) in Au nanostructures and the exciton transitions of cyanine dye J-aggregates has been examined using leakage radiation microscopy. Real space images of the nanostructures give the propagation lengths of the leaky SPP modes, and Fourier space images yield their dispersion curves. The dispersion curves show an avoided crossing when the structures are coated with J-aggregates, with a Rabi splitting of approximately 30 meV. The lifetimes of the coupled states were calculated by combining the measured propagation lengths with the group velocities obtained from the dispersion curves. The lifetimes decrease from ~50 fs for the bare Au nanostructures, to ~10 fs in the avoided crossing region for the coupled J-aggregate/Au nanostructure system. Analytical Holstein-Tavis-Cummings model calculations and finite element simulations of the coupled system show that the decrease in lifetime is primarily due to energy dissipation into dark states associated with the J-aggregates.


关键词: plasmon-exciton coupling, J-aggregates, surface plasmon polaritons, leakage radiation microscopy, Rabi splitting, dephasing, dark states, Holstein-Tavis-Cummings model


346. ❌ Distinct Structural Dynamics of the Semiquinone State Define a Signalling Pathway in Avian Cryptochrome

作者: Monika Kish, Suchitra Pradhan, Jessica L. Ramsay, Paloma Munguía Salazar, Jonathan Phillips, Daniel R. Kattnig 期刊/来源: arxiv 发布日期: 2026-04-21 arXiv链接: http://arxiv.org/abs/2604.19579v3

评分: 0.0 / 26.6 ❌

评分详情
关键词权重相关度得分
Large Language Models OR LLMs OR Foundation Models0.00.0/100.0
Mixture of Experts OR MoE OR Sparse Models0.00.0/100.0
Small Language Models OR SLMs OR On-device AI0.00.0/100.0
Scaling Laws AND Data Quality0.00.0/100.0
Pre-training OR Continual Pre-training OR Domain Adaptation0.00.0/100.0
Post-training OR Supervised Fine-tuning OR SFT0.00.0/100.0
Instruction Tuning OR Alignment OR Value Alignment0.00.0/100.0
RLHF OR RLAIF OR Direct Preference Optimization OR DPO0.00.0/100.0
PEFT OR LoRA OR Parameter-efficient Fine-tuning0.00.0/100.0
Retrieval-Augmented Generation OR RAG OR Retrieval-Generation0.00.0/100.0
Context Window Extension OR Long Context LLMs0.00.0/100.0
KV Cache Compression OR Linear Attention OR FlashAttention0.00.0/100.0
Chain of Thought OR CoT Reasoning OR Multi-step Reasoning0.00.0/100.0
System 2 Thinking OR Slow Thinking OR In-depth Reasoning0.00.0/100.0
Monte Carlo Tree Search OR MCTS AND LLM0.00.0/100.0
Self-Correction OR Self-Improvement OR Self-Reflection0.00.0/100.0
LLM Agents OR Autonomous Agents OR Agentic Workflow0.00.0/100.0
Tool Use OR Function Calling OR API Tool Use0.00.0/100.0
Multi-agent Systems OR Agent Coordination0.00.0/100.0
Quantization OR Model Compression OR Low-bit Weights0.00.0/100.0
Speculative Decoding OR Inference Acceleration0.00.0/100.0
Hallucination Mitigation OR Factuality OR Truthfulness0.00.0/100.0
Mechanistic Interpretability OR Explainable AI0.00.0/100.0
World Models AND General World Models0.00.0/100.0
Model Merging OR Model Soups OR Weight Averaging0.00.0/100.0
In-context Learning OR Many-shot Learning0.00.0/100.0
AI for Science OR Bioinformatics OR Cheminformatics0.00.0/100.0

评分理由: 该论文研究鸟类隐花色素蛋白的光诱导结构动力学,属于生物物理和结构生物学领域,完全不涉及大模型、深度学习或任何AI技术。所有关键词均与论文内容无关,因此每项评分为0。


!!! tip deepseek-chat TL;DR

该论文通过氢氘交换质谱揭示了欧洲知更鸟隐花色素4a在光循环中半醌态独特的结构动力学,为动物磁感应中的信号传导提供了直接生物物理证据。
摘要翻译

夜间迁徙鸣禽的光依赖性磁罗盘被广泛认为依赖于视网膜隐花色素内的自由基对机制。然而,连接微秒级量子自旋动力学与细胞信号传导所需的长寿命、全局蛋白质构象变化之间的机制鸿沟仍然是一个艰巨的挑战。在此,我们应用氧化还原态分辨的氢/氘交换质谱(HDX-MS)来绘制欧亚鸲隐花色素4a(ErCry4a)在其光循环中的构象图谱。我们揭示,光化学还原驱动了关键功能节点上稳健的别构结构转变,包括磷酸结合环(PBL)、突起环(PL)、FAD近端螺旋α17以及C端α22/α23网络。至关重要的是,我们分离了瞬态半醌(假定的信号传导物种)的结构指纹。半醌并非作为线性的结构过渡阶梯,而是表现出一种独特的、非单调的构象特征,其特征是PBL和PL的瞬态失稳,与完全还原状态下观察到的全局刚性化形成鲜明对比。这些发现确立了半醌作为一种结构独特且功能胜任的生物实体。我们的结果为一种专门的、高保真度的结构信号传导级联提供了直接的生物物理学证据,详细阐述了局域量子级光化学如何转化为动物导航所需的精确构象动态。


摘要 (Abstract)

The light-dependent magnetic compass of night-migratory songbirds is widely hypothesized to rely on the radical pair mechanism within retinal cryptochrome. However, bridging the mechanistic gap between microsecond quantum spin dynamics and the long-lived, global protein conformational changes required for cellular signalling remains a formidable challenge. Here, we apply redox state-resolved hydrogen/deuterium-exchange mass spectrometry (HDX-MS) to map the conformational landscape of European robin cryptochrome 4a (ErCry4a) across its photocycle. We reveal that photochemical reduction drives robust, allosteric structural transitions across key functional nodes, including the phosphate-binding loop (PBL), protrusion loop (PL), FAD-proximal helix α17, and the C-terminal α22/α23 network. Crucially, we isolate the structural fingerprint of the transient semiquinone, the presumed signalling species. Rather than acting as a linear structural stepping-stone, the semiquinone exhibits a distinct, non-monotonic conformational signature characterized by a transient destabilization of the PBL and PL, contrasting sharply with the global rigidification observed in the fully reduced state. These findings establish the semiquinone as a structurally unique and functionally competent biological entity. Our results provide direct biophysical evidence for a dedicated, high-fidelity structural signalling cascade, detailing how localized quantum-level photochemistry is translated into the precise conformational dynamics required for animal navigation.


关键词: Cryptochrome, Radical Pair Mechanism, Hydrogen/Deuterium Exchange Mass Spectrometry, Semiquinone, Structural Dynamics, Magnetic Compass, Signalling Pathway


Token 消耗统计

  • 总计: 913,541 tokens(输入 625,719 / 输出 287,822)