Skip to content

docs(fundamentals): add Architecture and Database pages [main]#21500

Open
bloxster wants to merge 2 commits into
mainfrom
docs/architecture-database-main-2026-05-28
Open

docs(fundamentals): add Architecture and Database pages [main]#21500
bloxster wants to merge 2 commits into
mainfrom
docs/architecture-database-main-2026-05-28

Conversation

@bloxster
Copy link
Copy Markdown
Collaborator

@bloxster bloxster commented May 28, 2026

Summary

main twin of #21494. Same two new pages:

  • /fundamentals/architecture — staged sync, modular processes, storage split, embedded Caplin, flat-KV state. Mermaid component diagram.
  • /fundamentals/database — datadir layout, MDBX engine, snapshots, per-transaction history granularity, mainnet sizing, tuning flags, safe-to-delete table.

Stacked on #21496

Base is docs/prose-audit-main-2026-05-28 so links can target the renamed Prune Modes page. GitHub auto-retargets to main once #21496 merges.

Verification

  • npm run build passes with onBrokenLinks/onBrokenAnchors: 'throw'
  • docs-site / build (incl. llms verification) ✓ pass
  • llms.txt and llms-full.txt regenerated

Notes

  • Sourced from the Improving-public-docs spec and the README.md "Datadir structure" / "Erigon3 datadir size" / "Modularity" sections.
  • Adds @docusaurus/theme-mermaid@^3.10.0 (used by the architecture diagram).

@bloxster bloxster changed the base branch from main to docs/prose-audit-main-2026-05-28 May 28, 2026 18:43
@bloxster bloxster marked this pull request as ready for review May 28, 2026 19:12
Base automatically changed from docs/prose-audit-main-2026-05-28 to main May 29, 2026 07:04
Bloxster and others added 2 commits May 29, 2026 09:58
Closes two of the largest content gaps identified in the
[Improving-public-docs](https://github.com/erigontech/erigon-documents/blob/master/public-docs/Improving-public-docs.md)
spec: the high-level Architecture overview and the deep-dive
Database / datadir page.

New pages:
- `/fundamentals/architecture` (sidebar_position 3)
  - At-a-glance ASCII component diagram
  - Staged Sync pipeline + Erigon 3 consolidation notes
  - Modular processes (Sentry/Downloader/Execution/RPC Daemon/TxPool/Caplin)
  - Storage model split (chaindata vs snapshots)
  - Embedded Caplin consensus layer
  - Flat KV state model + RPC-latency rationale
  - Prune-modes vs sync-modes clarification

- `/fundamentals/database` (sidebar_position 15)
  - Datadir directory tree with role per folder
  - MDBX engine properties (no compaction, mmap reads, single-writer)
  - Immutable .seg snapshots + BitTorrent distribution
  - Per-transaction history granularity
  - Real Nov-2024 mainnet + bor-mainnet sizing numbers
  - Why chaindata/ stays small (and is recoverable from snapshots)
  - Tuning flags (--batchSize, --db.size.limit, --db.read.concurrency)
  - Safe-to-delete subdirectories table

Cross-links: both pages link to each other plus existing pages
(Modules, Caplin, Optimizing Storage, Hardware Requirements, Sync Modes).
No content duplication with Optimizing Storage — that page covers
multi-disk tiering recipes, these pages cover concepts.

Sources: erigontech/erigon README "Datadir structure", "Erigon3 datadir
size", "Erigon3 changes from Erigon2", "Modularity", "More Efficient
State Storage" sections.

llms.txt and llms-full.txt (both static/ and root copies) regenerated.

Build: `pnpm run build` passes with onBrokenLinks/onBrokenAnchors: 'throw'.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
…nnet sizing

- Architecture page: ASCII component diagram → Mermaid flowchart
- Database page: remove Polygon (bor-mainnet) disk-size block; we no
  longer maintain that chain
- Add @docusaurus/theme-mermaid@^3.10.0 and enable mermaid in config
- Regenerate llms-full.txt

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@bloxster bloxster force-pushed the docs/architecture-database-main-2026-05-28 branch from 38658a6 to c6c18da Compare May 29, 2026 08:08
@bloxster bloxster added the docs label May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants