feat: axum server with OGX-backed agentic loop and state hydration#30
Draft
franciscojavierarceo wants to merge 2 commits into
Draft
feat: axum server with OGX-backed agentic loop and state hydration#30franciscojavierarceo wants to merge 2 commits into
franciscojavierarceo wants to merge 2 commits into
Conversation
…d state hydration Drop the Praxis filter architecture in favor of a plain axum HTTP server. The gateway now supports three capabilities: - Reverse proxy to vLLM with streaming and auth injection - State hydration via previous_response_id (fetches history from OGx) - Agentic loop with file_search tool execution via OGx vector stores The store backend is trait-based (ResponseStore, VectorSearch) with OGx as the first implementation, allowing other backends to be plugged in. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Add an integration test that runs against a real OGx instance to verify state hydration end-to-end. The test creates a response in OGx, sends a follow-up request through the gateway with previous_response_id, and verifies vLLM receives the hydrated conversation history. - tests/integration/run.sh: starts OGx, runs tests, tears down - tests/integration/ogx-config.yaml: minimal OGx config (SQLite only) - tests/integration_test.rs: Rust integration test (skips if OGX_BASE_URL unset) - Makefile: add integration-test target - CI: add integration job that installs OGx via pip Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Collaborator
|
@franciscojavierarceo could you please follow the same design as #28. agentic-core would not fully in rust native with standard rust package it handles response store and conversation as well. maybe rebase with #29 and implement part of |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ResponseStore,VectorSearch) with OGx as first implementationprevious_response_idis setfile_searchtool calls via OGx vector store API, feed results back to vLLM, loop until final responseTest plan
cargo test): 7 proxy, 4 agentic loop, 2 state hydration, 2 config unit testscargo clippy --all-targets -- -D warningscleancargo fmt -- --checkclean🤖 Generated with Claude Code