fix(rg): skip indexed prefilter for --no-unicode non-literal queries

[chaliy]

Motivation

• Indexed prefilter could return an incomplete candidate set for ASCII-mode searches when --no-unicode was combined with non-literal indexed queries (e.g. -F -w), causing false-negative search results.
• The root cause is that the indexed fast-path was only disabled for --no-unicode when fixed_strings was false, while -F -w produces a non-literal index query but still hit the indexed path.
• The index query type lacks an explicit Unicode/ASCII mode, so the safe fix is to avoid the indexed prefilter whenever ASCII semantics are required but the index query is not a pure literal.

Description

• Compute index_can_use_literal earlier and use it in the fast-path eligibility check inside try_indexed_search so the indexed prefilter is skipped when !opts.unicode && !index_can_use_literal (file: crates/bashkit/src/builtins/rg/mod.rs).
• Keep the existing SearchQuery usage but ensure the code does not trust indexed results for cases the index cannot faithfully represent under ASCII regex semantics.
• Add a regression test test_rg_indexed_search_skipped_for_no_unicode_non_literal_queries that exercises --no-unicode -F -w caf against an indexed provider that returns no candidates and asserts the final ASCII-mode matching still finds café (file: crates/bashkit/src/builtins/rg/mod.rs).

Testing

• Ran cargo test -p bashkit test_rg_indexed_search_skipped_for_no_unicode_non_literal_queries -- --nocapture and the test passed (ok).
• Ran the package test run during the change and observed no test failures in the bashkit test suite.

---

Codex Task

[cloudflare-workers-and-pages]

Deploying with    Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Preview URL	Updated (UTC)
✅ Deployment successful! View logs	bashkit	2fd17dd	Commit Preview URL	May 25 2026, 04:30 PM