Expand AMC23 with source-cited self-contained problems - #6
Open
taivu1998 wants to merge 1 commit into
Open
Conversation
taivu1998
changed the title
taivu1998
marked this pull request as ready for review
July 6, 2026 08:03
taivu1998
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Expand Evalchemy's vendored AMC23 data from 40 to 49 rows by adding nine 2023 AMC 12A/12B problems whose question text is self-contained without a diagram. MAA defines AMC 12 as two 25-question versions, and the AoPS 2023 archives enumerate problems 1-25 for both forms. Compared with those references, the 40-row Hugging Face source used by the existing benchmark omits ten competition problems.
Keep 2023 AMC 12A Problem 15 excluded because its setup depends on its diagram. Each added row retains a direct AoPS problem URL, and the data-integrity test pins the resulting 49-row composition, the one expected gap, the added answers, and answer consistency for choice-based rows.
Sources
zwhe99/amc23is the 40-row Hugging Face source referenced by the existing Evalchemy benchmark.