AsyncEngine Dev Collab

[johnnygreco]

Priority Level

High

Task Summary

Start development on a dev branch called jena/dev/async-engine, which we will use to collaborate on the implementation of the new async backend. We will develop on this branch in parallel with main. In the end, the goal is to build an async engine that can live next to our current engine, which we will likely phase out over time.

Let's create sub-issues off this task as we carve out work to be done.

Why jena? That's because @johnnygreco @eric-tramel @nabinchha @andreatgretel will be working on this of course.

[johnnygreco]

Just created our dev branch: https://github.com/NVIDIA-NeMo/DataDesigner/tree/jena/dev/async-engine

[andreatgretel]

Maybe a good opportunity to try out the /plans idea? I.e., add a file where we design a plan to be followed by Claude.

[johnnygreco]

Maybe a good opportunity to try out the /plans idea? I.e., add a file where we design a plan to be followed by Claude.

Yes – I thought the same thing! I'll draft up something for just one piece (the execution graph) as an experiment.