跳到主要内容
Octopus Research Institute
TR-2026-0030技术报告同行评审: 未经同行评审证据强度: 实验性状态: 已发布

The epistemic guard: a hard gate against confident-wrong answers

Ran Tao (Octoryn Research)

本文未经同行评审。请将其视为工作文档,而非经验证的结果。

摘要

A design discipline, not an experiment: an in-loop epistemic gate that resolves every agent answer to one of three verdicts — confident (grounded in available evidence/state), abstain (insufficient evidence), or external-truth-required (verified outside the system). By construction, a stale or retracted belief can never be served as confident and an over-privileged skill step is denied before any side effect; unknowns route to ask, not guess. The clarify, skill, and state runtimes inherit it. No measurements: efficacy is asserted by construction, not yet validated.

本 Research Object 以其原始语言(英文)发表。

1. Contribution / Thesis

Claimed. This note specifies a design discipline — an in-loop epistemic gate — under which every agent answer resolves to exactly one of three verdicts: confident (grounded in available evidence/state), abstain (insufficient evidence), or external-truth-required (must be verified outside the system). The structural intent is that a stale or retracted belief (sourced from the state runtime) can never be served as confident, and a skill step requesting privilege beyond its governance grant is denied pre-dispatch (before any side effect). The gate is described as type-level: an unknown is routed to "ask" rather than to a guess. The thesis is that the clarify, skill, and state runtimes inherit this single discipline, so "does not confidently lie" is intended as a structural property rather than a prompt instruction.

NOT claimed. This note presents no measurements — no hardware benchmark, no software versions, no oracle/baseline, no parity numbers, no throughput, and no benchmark. It is a design/architecture description, not an empirical evaluation and not a novel algorithm. It does not demonstrate that groundedness detection is correct for arbitrary open-domain claims, does not prove that "confident" answers are factually correct, and does not quantify a false-confident rate against any test set. The altitude is honest: this is an architectural specification of a guard, whose efficacy is asserted by construction and not yet validated by recorded experiment.

2. Design

The guard sits in the agent loop and assigns every candidate answer one of three verdicts:

VerdictConditionAction
confidentGrounded in available evidence/stateServed
abstainInsufficient evidence to answerWithhold; surface "unknown"
external-truth-requiredTruth must be checked outside the systemDefer to external verification

Composition rules as specified:

  • A stale or retracted belief (sourced from the state runtime) is structurally barred from the confident verdict — intended as zero false-confident, with no dispatches acting on such beliefs.
  • A skill step over-privileged beyond its governance grant is denied pre-dispatch, so no side effect occurs.
  • An unknown is typed so that the system asks rather than guesses.

The same gate is inherited by the clarify, skill, and state runtimes, which is the mechanism by which the "doesn't confidently lie" property is meant to hold across the stack.

3. Evidence / Status

This is a design specification at prototype/description altitude. The source note records the gate's intended verdicts and composition rules but contains no experimental results, no negative controls, and no measured false-confident rate. Accordingly there is no results table and no ablation table — fabricating either would misrepresent the record. The carried experimental evidence level is not supported by any measurement in the source; see Limitations. The status of the "zero-false-confident" property is asserted-by-construction, not measured.

4. Limitations

As a harsh reviewer would note:

  • No empirical data whatsoever. The note contains zero measurements, so none of its quantitative-sounding phrasing ("zero false-confident", "zero dispatches", "zero side-effects") is backed by a recorded experiment. These are design targets, not results.
  • Evidence level overclaims. The metadata marks this as experimental, but the body is a design description with no experiment. This should be read as a design/architecture note; the label is retained per instruction but is flagged here as not yet earned.
  • Groundedness is the hard part and is unspecified. The note asserts a confident verdict requires being "grounded in available evidence/state" but does not define how groundedness is detected. For arbitrary open-domain claims this detection is unsolved; the guard's guarantee is only as strong as that (undescribed) detector.
  • Confident is not the same as correct. Even when the gate emits confident, no claim is made that the answer is factually true — only that the system did not judge the evidence insufficient. A wrong-but-grounded answer is not excluded.
  • No adversarial / failure-case analysis. There is no description of how stale-belief detection, privilege-grant checking, or the ask-on-unknown routing behave under adversarial inputs or partial state.
  • Scope. Applies only where evidence/state grounding is checkable; it offers no open-domain factuality guarantee beyond the available evidence/state.

5. Provenance / Relation

  • Type: Technical Report / Note. Track: Runtime Systems.
  • Relation: The discipline is inherited by the clarify, skill, and state runtimes; this note is the shared specification those runtimes reference for the "does not confidently lie" property.
  • Platform: Apple Silicon (M-series) workstation.
  • Build: standard release build/test via the project toolchain.
  • Sovereignty: no third-party ML framework is used (native vendor linear-algebra primitives only).
  • Commit / run commands: not recorded in source notes (this is a design note, not a code artifact).
  • Oracle / baseline / versions: not recorded in source notes (no experiment was run).

声明边界

作者对范围的明确界定——本工作证明了什么、未证明什么——沿用自 Octoryn Research 的发表模型。

证明

  • Specifies an in-loop gate design resolving every answer to confident / abstain / external-truth-required, with stale or retracted beliefs barred by construction from the confident verdict and over-privileged skill steps denied before any side effect.
  • States the guard is type-level (an unknown routes to ask, not guess) and is the shared discipline inherited by the clarify, skill, and state runtimes.

未证明

  • That groundedness detection is correct for arbitrary open-domain claims.
  • That confident answers are factually correct — only that the system abstains when it judges the evidence insufficient.
  • Any quantitative false-confident rate, dispatch count, or side-effect count: the note contains no measurements, so the zero claims are design targets, not recorded results.
  • That the carried experimental evidence level is earned — no experiment is described in the source.

适用于

  • Gating agent answers and skill dispatches in settings where evidence or state grounding can be checked.

不适用于

  • Open-domain factuality guarantees beyond the available evidence or state.
  • Any setting requiring empirical validation — this is a design specification, not a measured benchmark.

作者

  • Ran Tao — 调查研究, 写作

引用本文

引用格式

Tao, R., Octoryn Research. (2026). The epistemic guard: a hard gate against confident-wrong answers (TR-2026-0030). Octopus Research Institute.

BibTeX

@techreport{oritr20260030,
  title       = {The epistemic guard: a hard gate against confident-wrong answers},
  author      = {Tao, Ran and {Octoryn Research}},
  institution = {Octopus Research Institute},
  year        = {2026},
  note        = {Permanent ID TR-2026-0030. Not peer reviewed.}
}

披露

资助
硬件与基础设施由 Octoryn / Octopus Core Pty Ltd 提供。
利益冲突
Octoryn 提供商业推理与治理工具;相关发现独立报告。