Skip to content

Conversation

@anna-tran
Copy link
Contributor

What this PR does:
Updates the compactor cleaner to delete all partition visit markers only after the partition group info file is deleted. This aligns with the original logic prior to the 2-phase partition compaction job cleanup introduced in this PR #7130.

  • If the partition group file was deleted, the cleaner proceeds to deleting all completed partition visit markers
  • In case the compactor shut down right after the partition info file was deleted, another compactor cleaner can still delete the partition visit markers if it sees that the partition group file no longer exists (making all existing visit markers invalid)

Which issue(s) this PR fixes:
Fixes #7257

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

… deleted

Signed-off-by: Anna Tran <trananna@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Double compaction for completed partitioning job

1 participant