python-math #20: feat(delphi): acceptance canonicalization — suppress cross-engine ordering artifacts in certify comparer - #2648
Draft
jucor wants to merge 1 commit into
Draft
Conversation
This was referenced Jul 22, 2026
Draft
Draft
Draft
Draft
jucor
changed the title
jucor
changed the title
jucor
changed the title
jucor
changed the title
This was referenced Jul 27, 2026
Draft
python-math #43: docs(delphi): s7 goal state + journal — mode collapse executed, battery 20/20
#2672
Draft
Draft
Draft
This was referenced Jul 28, 2026
Draft
jucor
changed the title
3 tasks
… cross-engine ordering artifacts in certify comparer ## What Teaches the certify comparer to canonicalize both engines' result blobs before comparing, so pure ORDERING differences stop counting as divergences. ## Array-order canonicalization Clojure emits tids (comment ids) and in-conv (the participants admitted to clustering) — and everything positionally aligned to them: pca center / comps rows / comment arrays, base-clusters columns — in hash/insertion order; Python emits them sorted. Both blobs are internally consistent, so cross-engine array order is not a semantic divergence. `canonicalize_blob()` (`crosslang.py`) normalizes both sides inside `project_acceptance`: - tids sorted, with the tid-aligned pca arrays re-indexed alongside; - in-conv / mod-in / mod-out / meta-tids sorted when they are lists (None passes through); - base-clusters columns re-indexed by sorted id, members sorted; - group-clusters sorted by id, members sorted. `votes-base` is deliberately NOT permuted — it is already sort-by-`:id`-aligned on both engines by construction (conversation.clj:593). This kills ~850 of the ~1030 step-0 battery divergences as ordering artifacts; the residual real roots (sign convention, votes-base shape, emission gaps) are ledgered in `docs/divergences.json`. ## PCA component-sign canonicalization Also canonicalizes run-arbitrary PCA COMPONENT SIGNS: Clojure's first-tick power iteration has no start vectors, so its unseeded initialization flips component signs between ITS OWN runs (observed on a vw single-cut re-record: comps[1] and base-clusters.y negated versus the prior recording). Each component's sign is fixed deterministically (the max-|entry| coefficient made positive, evaluated after tid alignment), and every component-aligned array flips with it (comps row, comment-projection row, base-clusters x/y, group-clusters center[k]); `pca.center` is a data mean and never flips. An inconsistent flip (y negated without comps[1]) still diverges. commit-id:d1ae732b
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Teaches the certify comparer to canonicalize both engines' result blobs before comparing, so pure ORDERING differences stop counting as divergences.
Array-order canonicalization
Clojure emits tids (comment ids) and in-conv (the participants admitted to clustering) — and everything positionally aligned to them: pca center / comps rows / comment arrays, base-clusters columns — in hash/insertion order; Python emits them sorted. Both blobs are internally consistent, so cross-engine array order is not a semantic divergence.
canonicalize_blob()(crosslang.py) normalizes both sides insideproject_acceptance:votes-baseis deliberately NOT permuted — it is already sort-by-:id-aligned on both engines by construction (conversation.clj:593).This kills ~850 of the ~1030 step-0 battery divergences as ordering artifacts; the residual real roots (sign convention, votes-base shape, emission gaps) are ledgered in
docs/divergences.json.PCA component-sign canonicalization
Also canonicalizes run-arbitrary PCA COMPONENT SIGNS: Clojure's first-tick power iteration has no start vectors, so its unseeded initialization flips component signs between ITS OWN runs (observed on a vw single-cut re-record: comps[1] and base-clusters.y negated versus the prior recording). Each component's sign is fixed deterministically (the max-|entry| coefficient made positive, evaluated after tid alignment), and every component-aligned array flips with it (comps row, comment-projection row, base-clusters x/y, group-clusters center[k]);
pca.centeris a data mean and never flips. An inconsistent flip (y negated without comps[1]) still diverges.commit-id:d1ae732b
Stack: