Skip to content

Python: Foundry Evals integration for Python #4750

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
alliscode wants to merge 11 commits into
base: main
Choose a base branch
from
+7,604 −26
Draft

Python: Foundry Evals integration for Python #4750

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
db05e3a
Foundry Evals integration for Python
Mar 17, 2026
39415c2
fix: resolve mypy redundant-cast errors while keeping pyright happy
Mar 20, 2026
5dccdc2
fix: CI failures — pyupgrade, evaluator overloads, sample API, reset …
Mar 20, 2026
c4c6632
fix: skip gRPC-dependent observability test
Mar 23, 2026
b4f23a0
fix: add nosec B101 for bandit assert check
Mar 23, 2026
959e51d
style: align eval samples with repo conventions
Mar 23, 2026
e740f43
Address PR review feedback: async fixes, sample bugs, deprecation war…
Mar 23, 2026
564b8a2
Add test coverage for review feedback items
Mar 23, 2026
aca368f
Fix ruff ISC004 lint error and apply formatter
Mar 23, 2026
375dcba
Remove core type changes (extracted to fix/workflow-stale-session bra…
Mar 23, 2026
39e7dfb
Address PR review round 2: bugs, tests, and architecture
Mar 23, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions python/packages/azure-ai/agent_framework_azure_ai/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,11 @@
AzureAIInferenceEmbeddingSettings,
RawAzureAIInferenceEmbeddingClient,
)
from ._foundry_evals import (
FoundryEvals,
evaluate_foundry_target,
evaluate_traces,
)
from ._foundry_memory_provider import FoundryMemoryProvider
from ._project_provider import AzureAIProjectAgentProvider
from ._shared import AzureAISettings
Expand All @@ -31,8 +36,11 @@
"AzureAIProjectAgentOptions",
"AzureAIProjectAgentProvider",
"AzureAISettings",
"FoundryEvals",
"FoundryMemoryProvider",
"RawAzureAIClient",
"RawAzureAIInferenceEmbeddingClient",
"__version__",
"evaluate_foundry_target",
"evaluate_traces",
]
Loading
Loading