Skip to content

Conversation

@VisLab
Copy link
Member

@VisLab VisLab commented Dec 30, 2025

No description provided.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a categorical_limit parameter to the TabularSummary class to limit the number of unique values stored for categorical columns. This is useful for columns with high cardinality where tracking all unique values would be memory-intensive.

Key changes:

  • Added categorical_limit parameter to control the maximum number of unique categorical values stored per column
  • Introduced categorical_counts tracking to maintain statistics even for columns that exceed the limit
  • Updated summary output to include categorical counts and the limit value

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
hed/tools/analysis/tabular_summary.py Core implementation: adds categorical_limit parameter, categorical_counts tracking, and enforcement logic
tests/tools/analysis/test_tabular_summary.py Comprehensive test coverage for the new categorical_limit feature including constructor, enforcement, summary output, and merging behavior
docs/conf.py Version bump from 0.8.0 to 0.8.1
.github/workflows/links.yaml Standardized sphinx-build command to not require cd
.github/workflows/docs.yaml Standardized sphinx-build command to not require cd

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@VisLab VisLab merged commit d3898ac into hed-standard:main Dec 30, 2025
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant