🤖 AI 资讯

· · ↗
← 返回列表

Text Corpora as Concept Fields: Providing Explainable Groundedness

arXiv cs.AI2026-11-04 05:00:00大模型,AI应用,Meta,搜索RAG,强化学习,向量数据库,论文原文 ↗

arXiv:2605.05103v4 Announce Type: replace-cross

Abstract: We introduce the \textbf{Concept Field} of a text corpus: a local drift field with pointwise uncertainty, estimated in sentence-embedding space from the deltas between consecutive sentences. Given a candidate sentence transition, we score its agreement with the field by $\zeta$, the mean absolute z-distance between the observed delta and the field's local statistical estimate, giving a quantitative measure of groundedness. The score is model agnostic and corpus-attributable, providing traces to corpus semantics either supporting or refuting groundedness. We drive the computation with the introduction of a \textbf{Vector Sequence Database (VSDB)} that stores embeddings together with sequence-position and next-delta metadata. We demonstrate this approach on two large-scale settings: groundedness detection over the U.S. Code of Federal Regulations, and ungroundedness (novelty) detection over Project Gutenberg, where we show Concept Fields achieve strong selective classification performance under a grounded / ungrounded / unsure triage policy. Unlike retrieval-centric baselines, the resulting coverage-risk behavior shows similar empirical coverage-performance trends in the two evaluated domains. Concept Fields provide a fast, lightweight, and interpretable signal for groundedness, complementary to LLM-as-judge and white-box detectors.