[WIP] Add experiment logging support for BrainTrust

[ankrgyl]

No description provided.

[ankrgyl]

Cool, the change looks pretty clean to me.

Is the idea that we'll "subscribe" to test emitter events and then send braintrust log statements as they occur?

We are in the middle of adding more granular profiling to BrainTrust btw, via an idea called "spans".

Not strictly necessary to include in the MVP, but if it's possible to emit an event each time a node executes for each test case, we can incrementally log span progress to BrainTrust, and then you'd be able to see performance metrics across the whole execution tree.

[ankrgyl]

is this the WIP section?

[ankrgyl]

Do these need to be extracted? Can they just be re-exported?

[abrenneke]

Not strictly necessary to include in the MVP, but if it's possible to emit an event each time a node executes for each test case, we can incrementally log span progress to BrainTrust, and then you'd be able to see performance metrics across the whole execution tree.

Ah yeah I can just pipe in the events from the graph execution!