Skip to content

Add Conduit to Web Crawling section#2957

Open
bkauto3 wants to merge 1 commit intovinta:masterfrom
bkauto3:add-conduit
Open

Add Conduit to Web Crawling section#2957
bkauto3 wants to merge 1 commit intovinta:masterfrom
bkauto3:add-conduit

Conversation

@bkauto3
Copy link

@bkauto3 bkauto3 commented Mar 11, 2026

Summary

Add Conduit to the Web Crawling section.

Conduit is a free, MIT-licensed headless browser for Python that adds cryptographic audit trails to browser automation and web crawling:

  • SHA-256 hash chain linking every action into a tamper-evident log
  • Ed25519 digital signatures for proof of session integrity
  • Self-verifiable proof bundles exportable as JSON for independent verification
  • BFS crawler with robots.txt compliance and budget enforcement
  • MCP server for AI agent integration (Claude, GPT, etc.)
  • Built on Patchright (stealth Playwright fork) for reliable modern web automation

Install: pip install conduit-browser

Hidden Gem Justification

Conduit solves a problem no other Python browser automation tool addresses: cryptographic proof of what happened during a browser session. Every action is SHA-256 hash-chained and Ed25519 signed, producing self-verifiable proof bundles that anyone can independently verify without trusting the tool or operator.

This is uniquely valuable for:

  • AI agent accountability (proving what autonomous agents did)
  • Compliance auditing of automated browser workflows
  • Digital forensics involving web-based activity

No other tool in the Web Crawling section (or on PyPI) provides tamper-evident, cryptographically signed browser session logs.

Note: This list already includes browser-use for AI browser automation. Conduit serves a different purpose -- it focuses on cryptographic accountability and tamper-evident proof for browser sessions, rather than making websites accessible for AI agents.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants