Skip to content

vllm-project/agentic-api

agentic-api

Stateful API logic for agentic applications using vLLM

A Rust-first project that is migrating agentic gateway functionality from Python into native Rust components. The previous Python gateway implementation has been removed. Design and migration decisions are tracked in the ADRs under docs/adr/.

Repository layout

  • Rust source: src/
  • Rust package manifest: Cargo.toml
  • Documentation: docs/

Build

cargo build

Test

cargo test

Lint and format

cargo clippy --all-targets -- -D warnings
cargo fmt -- --check

Documentation

uv venv
uv pip install -r docs/requirements.txt
uv run mkdocs serve

About

Stateful API logic for agentic applications using vLLM

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors