Meta-harness optimization loop wired onto Islo sandboxes. POC: 0/5→5/5 in four proposer steps. Built on islo.dev.
-
Updated
May 5, 2026 - HTML
#
agent-eval
Here are 11 public repositories matching this topic...
Project page for Meta-harness on Islo (POC). https://zozo123.github.io/meta-harness-on-islo-page/
-
Updated
May 5, 2026 - JavaScript
AI-operated company. Building agent-friend: universal tool adapter for AI agents. @tool → OpenAI, Claude, Gemini, MCP. Live 24/7 on Twitch.
python twitch structured-logging interactive-cli exponential-backoff human-in-the-loop zero-dependencies open-startup ai-agent autonomous-ai building-in-public llm-tools agent-security mcp-security personal-ai-agent agent-eval agent-friend
-
Updated
Mar 26, 2026 - Python
Scenario Testing for AI Agents
-
Updated
Apr 24, 2026 - Python
A reasoning benchmark runner for comparing LLMs as OpenClaw agents use them. 52 prompts, 3 eval sets, 11 traps, LLM-as-judge, tier-based leaderboard.
-
Updated
Apr 11, 2026 - Python
Trace-first evaluation harness for deciding whether AI agents deserve more tokens, permissions, and trust
-
Updated
May 7, 2026 - Python
Agent and LLM evaluation harness — golden datasets, multi-scorer execution, regression detection across model versions, cost-quality leaderboards, and CI gates for model promotion.
express typescript platform-engineering regression-detection ml-ops ai-platform ai-governance llm-eval agent-eval ci-gate
-
Updated
May 7, 2026 - TypeScript
Vendor-neutral research umbrella for measuring AI plugin, agent, and MCP server quality across CLI runtimes (Claude Code, Gemini CLI, Copilot CLI, Codex CLI).
mcp skill-discovery opentelemetry ai-evaluation gemini-cli claude-code plugin-testing cross-cli agent-eval invocation-rate
-
Updated
May 7, 2026
Binary-criteria evaluation harness for Claude skills with planned extension to plugins, agents, and MCP servers. Score every change yes/no across 7 layers — package integrity, trigger quality, functional quality, regression protection, baseline value, model variance, rollout safety. Never gradients.
mcp regression-testing skill-evaluation ai-evaluation llm-eval claude-code plugin-testing eval-harness agent-eval binary-criteria
-
Updated
May 7, 2026 - TypeScript
Score how similar N agent outputs are — exact match, Jaccard token overlap, divergence point, composite 0-1 score. Stdlib-only.
-
Updated
Apr 30, 2026 - Python
Lightweight CI-native regression and behavior-aware evaluation toolkit for black-box agent workflows.
-
Updated
Apr 10, 2026 - Python
Improve this page
Add a description, image, and links to the agent-eval topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the agent-eval topic, visit your repo's landing page and select "manage topics."