chore: Dev merge to Main

[Shreyas-Microsoft]

Purpose

This pull request expands and improves the testing and CI infrastructure for both the backend API and the new processor component. It introduces new tests, updates dependencies, and enhances the GitHub Actions workflow to provide better coverage reporting and support for asynchronous tests.

CI/CD Workflow Improvements:

• Added src/processor/**/*.py and src/processor/pyproject.toml to the paths that trigger the test workflow, ensuring processor code changes are properly tested. [1] [2]
• Introduced a new processor_tests job in .github/workflows/test.yml to run tests and coverage for the processor, including logic to skip tests if no test files are found.
• Updated action versions for actions/checkout and actions/setup-python to v4 and v5 respectively for improved stability and compatibility.
• Enhanced test dependencies by adding pytest-asyncio to support async tests, and ensured it's included in both backend and processor test environments. [1] [2]
• Added coverage fail-under threshold (--cov-fail-under=82) and logic to prefix coverage XML filenames with repo-root paths for more accurate reporting in both backend and processor jobs. [1] [2]

Testing Enhancements:

• Added comprehensive new test modules for backend API:
  • test_application.py: Verifies application bootstrap, service registration, and router inclusion.
  • test_application_context_extra.py: Thoroughly tests service lifetimes, async/sync service registration, scoping, and shutdown logic in the application context.
  • test_app_configuration_helper.py: Tests Azure App Configuration helper initialization, environment variable population, and client delegation.

Backend and Infra Configuration:

• Updated backend API test dependencies to include pytest-asyncio and configured coverage to omit test files from reports.
• Minor infrastructure changes:
  • Updated Bicep template hash in infra/main.json and reordered dependencies for private DNS zones for clarity. [1] [2]
  • Removed enableAnalyticalStorage: true from Cosmos DB Bicep module to align with new requirements or defaults.

These changes collectively improve code quality, test coverage, and reliability of the CI pipeline for both backend and processor components.

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

What to Check

Verify that the following are valid

• ...

Other Information

[Copilot]

Pull request overview

Copilot reviewed 68 out of 79 changed files in this pull request and generated 2 comments.

Files not reviewed (2)

• src/frontend/package-lock.json: Language not supported
• src/processor/package-lock.json: Language not supported

Comments suppressed due to low confidence (2)

.github/workflows/test.yml:29

• Same as the push trigger: pull_request.paths should include src/backend-api/uv.lock and src/processor/uv.lock so dependency-only changes still execute the test workflow.

      - 'src/backend-api/**/*.py'
      - 'src/backend-api/pyproject.toml'
      - 'src/backend-api/pytest.ini'
      - 'src/processor/**/*.py'
      - 'src/processor/pyproject.toml'

.github/workflows/test.yml:132

• Same issue as the backend job: pip install -e . will likely fail for src/processor because its pyproject.toml also lacks [build-system] and there’s no setup.py. Use uv sync --frozen (as in the processor Dockerfile) or add a build backend to make editable installs valid.

        run: |
          python -m pip install --upgrade pip
          cd src/processor
          pip install -e .
          pip install pytest pytest-cov pytest-asyncio

[Copilot]

Pull request overview

Copilot reviewed 70 out of 81 changed files in this pull request and generated 1 comment.

Files not reviewed (2)

• src/frontend/package-lock.json: Language not supported
• src/processor/package-lock.json: Language not supported

Comments suppressed due to low confidence (1)

.github/workflows/test.yml:174

• Same issue in the processor coverage XML rewrite: if coverage filenames are already src/... (expected with --cov=src when running from src/processor), prefixing with src/processor/src/ yields src/processor/src/src/.... Prefer prefixing with src/processor/ for filenames that already begin with src/, and reserve src/processor/src/ only for bare module-relative filenames.

          python <<'PY'
          import xml.etree.ElementTree as ET
          path = "src/processor/reports/coverage.xml"
          prefix = "src/processor/src/"
          tree = ET.parse(path)
          root = tree.getroot()
          for cls in root.iter("class"):
              fname = cls.attrib.get("filename", "")
              if fname and not fname.startswith(prefix):
                  cls.attrib["filename"] = prefix + fname
          tree.write(path, xml_declaration=True, encoding="utf-8")