Skip to content

2025-09 progress #407

@Matistjati

Description

@Matistjati

I think it's high time we start implementing the new format.

This was based off asking claude to generate a list of differences and what is currently implemented. I cut out a lot of noise. So I might have missed something.

Changes needed to be 2025-09-compliant

problem.yaml

  • Change 2023-07 to 2025-09
  • rights_owner required if license is not unknown or public domain; must not be set for public domain. Defaults to credits.authorssource (2025-09 specifies fallback chain more precisely)
  • Implement constants and constant variants

Input Visualizer/generators

  • I think we don't have to do anything here? Double-check this assumption. (Of course, typo checking still applies here)

Problem Statements


Included Files

  • include/default/ directory for language-agnostic included files (legacy only had per-language include/<language>/)
  • Code limit checked before copying included files

Test Data

  • test_group.yaml
  • <testcase>.yaml
  • New test data structure
  • Forbid graders from 2025-09
  • Implement new score aggregation system (score_multiplier.txt, new keys, etc.)
  • New extensions .in.statement, .out, etc. Also hints
  • .files directory

Input Validators

  • New input validator input (validating args, .files)

Submissions


Working directory

  • Implement new working directory contents

Output Validator

  • Double-check default validator is compatible with the spec w.r.t. whitespaces (LF, CR, HT, VT)

Submit-answer


Static Validators

  • Are we happy with the spec?
  • Create some testing problem packages
  • Figure out non-specced implementation details
  • Implement

Output Visualizer

  • Are we happy with the spec?
  • Create some testing problem packages
  • Decide how/when they are run.
  • Implement.

Multi-pass

  • Verify current implementation

Miscellaneous

  • Floats. They are now explicitly specified. We might already be compliant, but check.
  • File size recommendation: no file should exceed 100 MiB
  • attachments/templates/ subdirectory for code templates per language
  • Check for typo'd directories. Warnings for directories that no longer exist in new version (Warn for typo'd folders #399)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions