Skip to content

docs(influxdb3-enterprise): rename PachaTree partitions to shards #7189

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
alamb wants to merge 1 commit into
base: master
Choose a base branch
from
Open

docs(influxdb3-enterprise): rename PachaTree partitions to shards #7189

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion content/influxdb3/enterprise/performance-preview/configure.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -289,7 +289,7 @@

| Option | Description | Default |
|:-------|:------------|:--------|
| `--pt-partition-count` | Target number of partitions per compaction window. | `1` |
| `--pt-shard-count` | Target number of shards per compaction window. | `1` |
Copy link
Copy Markdown
Contributor Author

@alamb alamb May 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changed in this PR

| `--pt-compactor-input-size-budget` | Maximum total input bytes across all active compaction jobs. Acts as an admission control budget for the compactor scheduler. | 50% of system memory at startup |
| `--pt-final-compaction-age` | Age threshold for final compaction. When all L1-L3 run sets in a window are older than this, a final compaction merges everything into L4. | `72h` |
| `--pt-compactor-cleanup-cooldown` | Cooldown after checkpoint publish before replaced files can be cleaned up. | `10min` |
Expand Down Expand Up @@ -464,4 +464,4 @@
| `--bucket` | Object store bucket name (for `s3`, `gcs`, `azure`). |
| `--dry-run` | Preview mode--list files that would be deleted without making changes. |
| `--yes` | Skip the confirmation prompt. |
| `--ignore-running` | Proceed even if nodes appear to be running. **Warning:** may cause data inconsistency if nodes are actively writing. |

Check notice on line 467 in content/influxdb3/enterprise/performance-preview/configure.md

View workflow job for this annotation

GitHub Actions / Vale style check

write-good.E-Prime 

Try to avoid using 'are'.

Check notice on line 467 in content/influxdb3/enterprise/performance-preview/configure.md

View workflow job for this annotation

GitHub Actions / Vale style check

write-good.E-Prime 

Try to avoid using 'be'.
12 changes: 6 additions & 6 deletions content/influxdb3/enterprise/performance-preview/monitor.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,23 +33,23 @@ you can query with SQL.

### system.pt_ingest_wal

View WAL files and their partitions:
View WAL files and their shards:

```sql
SELECT * FROM system.pt_ingest_wal;
```

Example output:

| wal_file_id | partition_id | database_id | table_id | min_time | max_time | row_count | size_bytes |
|:------------|:-------------|:------------|:---------|:---------|:---------|:----------|:-----------|
| wal_001 | p_1 | db_1 | t_1 | 2024-01-01T00:00:00Z | 2024-01-01T00:10:00Z | 50000 | 2456789 |
| wal_002 | p_1 | db_1 | t_1 | 2024-01-01T00:10:00Z | 2024-01-01T00:20:00Z | 48000 | 2345678 |
| wal_file_id | shard_start_time | shard_duration_seconds | min_time | max_time | row_count | size_bytes |
Copy link
Copy Markdown
Contributor Author

@alamb alamb May 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The field names are actually shard_start_time and shard_duration_seconds

https://github.com/influxdata/influxdb_pro/blob/9fa4194e28533e8f60874fc81676344676ff1b16/ent/influxdb3_system_tables/src/pt_ingest_wal.rs#L124-L129

|:------------|:-----------------|:-----------------------|:---------|:---------|:----------|:-----------|
| wal_001 | 2024-01-01T00:00:00Z | 86400 | 2024-01-01T00:00:00Z | 2024-01-01T00:10:00Z | 50000 | 2456789 |
| wal_002 | 2024-01-01T00:00:00Z | 86400 | 2024-01-01T00:10:00Z | 2024-01-01T00:20:00Z | 48000 | 2345678 |

Use this table to monitor:

- **WAL accumulation**: Track the number and size of unmerged WAL files
- **Partition distribution**: See how data is distributed across partitions
- **Shard distribution**: See how data is distributed across shards
Copy link
Copy Markdown
Contributor Author

@alamb alamb May 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think @pauldix mentioned that the WAL is no longer partitioned/sharded. Maybe we should rename these fields 🤔

- **Time coverage**: Verify data time ranges

#### Monitor WAL backlog
Expand Down
Loading