Description
The current test suite has the following gaps:
- Incomplete unit test coverage – Core components lack sufficient unit tests.
- Integration tests are missing or disabled – Notably, integration tests involving the sandbox module were previously disabled due to extremely slow startup time of real sandbox environments (e.g., Docker-based executors).
- No mock abstraction for sandbox client – This forces tests to either skip sandbox logic or rely on slow, flaky real environments.
Current Impact
- Low confidence in code changes
- CI pipelines skip critical integration paths
- Hard to validate new features end-to-end
Proposed Solution
-
Introduce a Mock Sandbox Client
-
Re-enable and Expand Integration Tests
-
Improve Unit Test Coverage
-
CI/CD Integration
Benefits
- Fast, reliable CI feedback loop
- Higher confidence code changes
- Easier contribution from external developers
- Foundation for testing advanced features (multi-sandbox, etc.)