Skip to content

ams-calibration: decide AMS's HumanOverrideEvent vocabulary for eligibility exclusions (+ confirmed-signal generalization) #8542

Description

@JSONbored

Problem

Epic #8107's core open design question, now unblocked (#8082 closed 2026-07-23). AMS records fired events for its four eligibility-exclusion reasons (recordEligibilityExclusionSignals, packages/loopover-miner/lib/discover-cli.ts — real runs only), but recordHumanOverride has zero call sites in the miner package: the adapter implements it (signal-tracking-store.ts:95) and nothing calls it. Without override ground truth, AMS's exclusion rules can never be precision-scored or backtested — the corpus stays 100% undecided forever. packages/loopover-miner/docs/ams-signal-tracking-design.md documents this gap with two proposed mechanisms: an operator discover mark-eligible override command, or a profile-diff signal (a later profile re-extraction contradicting the exclusion). ORB faced the analogous question in #8106 (positive-confirmation design); its answer may or may not generalize to AMS's action shape (a candidate being excluded from discovery, vs a PR being blocked).

Requirements

Deliverables

Links & Resources

Boundaries

Decision + doc + follow-up filing only; no capture code lands under this issue.

maintainer-only — calibration-vocabulary authority; the wiring may become contributor work per the decision.

Metadata

Metadata

Assignees

Labels

maintainer-onlyOwner-only work — yields no Gittensor points.roadmapOn the Wave-2 agent-layer roadmap board (project 9)

Projects

Status
Todo

Relationships

None yet

Development

No branches or pull requests

Issue actions