Skip to content

Conversation

@alexfurmenkov
Copy link
Collaborator

No description provided.

@alexfurmenkov alexfurmenkov changed the title add filetype option to validate data directory 1442: add filetype option to validate type of data Dec 15, 2025
core.py Outdated
help=f"Path to directory containing data files ({VALIDATION_FORMATS_MESSAGE})",
)
@click.option(
"-filetype",
Copy link
Collaborator

@RamilCDISC RamilCDISC Dec 15, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please make this similar to other flags. full name with '--' and a short with '-'. You can use '-f' and '--filetype'

Copy link
Collaborator

@RamilCDISC RamilCDISC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PR adds a few flag that lets you control which files engine works on in the selected dataset folder. Not specifying this flag results in previous behaviour of engine.

The validation was done by:

  1. Reviewing the PR for any unwanted code or logic.
  2. Reviewing the PR in accordance with AC.
  3. Ensuring all unit and regression tests pass.
  4. Ensuring all related testing is updated and new tests are added.
  5. Running engine locally for manual validation.
  6. Verifying the edge case of empty directory.
  7. Verifying the edge case of multiple -ft flags.
  8. Verifying edge case of invalid file type.

@RamilCDISC RamilCDISC merged commit 1a9d045 into main Dec 18, 2025
16 of 17 checks passed
@RamilCDISC RamilCDISC deleted the 1442-add-cli-filetype-option branch December 18, 2025 20:35
@mhungria
Copy link

mhungria commented Jan 6, 2026

@alexfurmenkov , @RamilCDISC , thanks for adding the --filetype flag.

I'm testing the last release v0.14.1 on a linux box and so far it works fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Request to add a CLI option to filter the filetype of files to process

4 participants