test: add canonical operation-aware conformance - #62
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add canonical end-to-end conformance coverage for the operation-aware authorization path in
basis-core.This PR executes all five canonical
basis-schemasv0.2.2 compatibility scenarios through the realOperationAwareEnforcementPointand verifies exact agreement across the kernel-owned result artifacts:OperationAwareDecisionResponseEvaluationTraceAuditEvidenceThe work completes the canonical-conformance milestone after the required evidence-provenance reconciliation was completed and the corrected v0.2.2 compatibility snapshot was vendored.
Canonical scenarios
The test suite covers:
allow-basicdeny-precedencedefault-denynot-applicableinvalid-policy-bundleEach scenario is loaded from the active immutable
basis-schemasv0.2.2 snapshot and evaluated using the real typed request, policy, engine, enforcement, trace, response, and audit paths.Coverage
Allow basic
Verifies:
Deny precedence
Verifies:
Default deny
Verifies:
not_matched;Not applicable
Verifies:
NOT_APPLICABLE;Invalid policy bundle
Verifies:
policy_validation_failure;Execution-path integrity
The tests use the real:
The conformance test does not:
model_construct();basis-coreto generate gateway-owned artifacts.GatewayAuditEventremains outside the kernel’s direct conformance boundary.Evidence-provenance semantics
The canonical tests confirm the reconciled behavior now implemented across the ecosystem:
PolicyBundleexists, includingNOT_APPLICABLEand typed semantic validation failures.Changes
tests/operation_aware/test_canonical_vectors.py.No production code, fixtures, snapshot helpers, dependencies, or package metadata were changed.
Validation
16 passed300 passed3098 passed, 86 skipped3930 passed, 86 skippedruff check .: passedruff format --check src tests: passedmypy src: passedgit diff --check: passedFollow-Up
After this PR merges, the canonical operation-aware conformance milestone is complete.
The next sequenced roadmap item is PR 38.