Skip to content

LongProbe v0.1.2#1

Open
mohsin1218 wants to merge 8 commits into
ENDEVSOLS:mainfrom
mohsin1218:main
Open

LongProbe v0.1.2#1
mohsin1218 wants to merge 8 commits into
ENDEVSOLS:mainfrom
mohsin1218:main

Conversation

@mohsin1218
Copy link
Copy Markdown

Key Additions & Enhancements:
🧪 Pytest Integration (@golden_check):

Introduced the @golden_check decorator for writing inline, sub-second RAG regression tests directly inside existing test suites.
Added configuration auto-discovery (longprobe.yaml) with support for session-level longprobe_adapter fixture overrides.
🔍 Retrieval Diagnostic Tool (longprobe explain):

Added a troubleshooting CLI command to analyze regressions.
Detects "interloper" chunks that pushed down expected content and runs extended searches to find exactly where missing chunks shifted in rank.
🖥️ Interactive Terminal Editor (longprobe edit):

Built a terminal-native, dual-pane Textual TUI to interactively manage golden questions.
Supports creating, deleting, and updating questions, tags, top_k, and match modes directly from the terminal (Ctrl+S, Ctrl+N, Ctrl+D).
📚 Enterprise-First Documentation:

Realigned guides to favor the production-grade HTTP Adapter as the default recommendation (supporting any API or LongTrainer backend).
Promoted Qdrant as the primary direct-database adapter example, moving ChromaDB to a local prototyping footnote.
📦 Release Packaging:

Added the [tui] optional dependency group to pyproject.toml.
Bumped package version to 0.1.2 across the entire codebase.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant