Skip to content

Fix AIME25 local problem statement typos - #3

Open
taivu1998 wants to merge 1 commit into
marin-community:mainfrom
taivu1998:tdv/aime25-source-fixes
Open

Fix AIME25 local problem statement typos#3
taivu1998 wants to merge 1 commit into
marin-community:mainfrom
taivu1998:tdv/aime25-source-fixes

Conversation

@taivu1998

@taivu1998 taivu1998 commented Jul 6, 2026

Copy link
Copy Markdown

Summary

This PR fixes six statement errors in Evalchemy's checked-in AIME25 JSONL dataset:

  • I-3: fixes the malformed singlescoop phrase.
  • I-14: replaces the undefined angle condition with the intended two-angle condition.
  • II-3: restores the missing count for blue sides in the square-coloring constraint.
  • II-6: corrects the equal-area triangle label from DCF to DGF.
  • II-7: fixes the least-common-multiple wording from singular to plural.
  • II-15: restores the positive-real domain and minimizer wording.

The row order and answer keys are unchanged.

Motivation

The affected statements were malformed, ambiguous, or mathematically different from the corresponding public AIME 2025 references. The changes are limited to those statement fragments.

Citation references

MathArena/aime_2025 identifies itself as a 30-row AIME 2025 dataset with problem, answer, and problem_idx fields. Its dataset card says the questions were sourced from the AIME 2025 competition, converted to LaTeX, and verified. It supports the benchmark-level provenance and answer-sequence comparison below.

The statement-level corrections are supported by the cited AoPS contest-page revisions:

Evalchemy row Correction Reference
I-3 single scoop, not singlescoop 2025 AIME I, Problem 3
I-14 \angle B=\angle E=60^\circ 2025 AIME I, Problem 14
II-3 Each square has 2 red sides and 2 blue sides 2025 AIME II, Problem 3
II-6 The equal-area triangle is \triangle DGF 2025 AIME II, Problem 6
II-7 The least common multiple is taken over the subset's elements 2025 AIME II, Problem 7
II-15 The function is defined over positive reals and attains its minimum at exactly two positive real values of x 2025 AIME II, Problem 15

MathArena is not used as the sole statement-level authority. For example, its I-3 row still contains singlescoop; the AoPS problem page supports that correction.

Validation

  • Parsed eval/chat_benchmarks/AIME25/data/aime25.json as JSONL and confirmed it still contains 30 rows.
  • Confirmed the answer sequence is unchanged, including final row II-15 with answer 240.
  • Compared the updated local answer sequence against MathArena/aime_2025; there were no answer mismatches.
  • Audited all 30 AIME25 answers independently with algebraic, combinatorial, geometric, or exact computational checks.
  • Ran git diff --check.

Source limitation

I did not find a public MAA-hosted 2025 AIME problem-and-answer source during this review. The statement citations above therefore use the public AoPS contest pages, and the dataset/answer comparison uses MathArena.

@taivu1998
taivu1998 marked this pull request as ready for review July 6, 2026 04:01
@taivu1998

Copy link
Copy Markdown
Author

Added a Citation references section to the PR description. It cites MathArena for the 30-row benchmark provenance and answer-sequence comparison, and stable AoPS page revisions for each of the six statement-level corrections. The description also calls out that MathArena still contains the I-3 singlescoop typo and that I did not find a public MAA-hosted 2025 problem-and-answer source.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants