Skip to content

Conversation

@allierc
Copy link
Collaborator

@allierc allierc commented Dec 22, 2025

Implements an iterative exploration framework where an LLM proposes parameter mutations guided by UCB tree search to map GNN training landscapes.

Architecture

External (Python)          LLM
─────────────────          ───
UCB computation     →      Reads ucb_scores.txt
Metrics evaluation  →      Reads analysis results  
                    ←      Appends analysis.log
                    ←      Rewrites memory.md
                    ←      Proposes mutation
                    ←      (Optional) Edits protocol

Components

  • experiment.md: Protocol definition with self-modifiable exploration rules
  • analysis.log: Full iteration history (append-only)
  • memory.md: LLM-maintained compressed knowledge
  • ucb_scores.txt: External tree structure with node selection

Exploration Strategies

Strategy Trigger Action
exploit default Mutate highest UCB node
failure-probe 3+ successes Find failure boundary
explore plateau Branch to distant node
robustness-test good config Verify reproducibility
recombine 2+ distant successes Merge best parameters

Key Features

  • Self-modifying protocol: LLM can edit exploration rules mid-search
  • Two-tier memory: Raw log + compressed working memory
  • Block structure: 24 iterations per simulation regime

@allierc allierc merged commit 85f7baf into main Dec 22, 2025
1 check failed
@allierc allierc deleted the ca/Claude branch December 22, 2025 18:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants