Skip to content

feat(toxgen): Generate TESTPATH for integrated test suites#4863

Merged
sentrivana merged 4 commits intomasterfrom
ivana/toxgen/testpath
Sep 25, 2025
Merged

feat(toxgen): Generate TESTPATH for integrated test suites#4863
sentrivana merged 4 commits intomasterfrom
ivana/toxgen/testpath

Conversation

@sentrivana
Copy link
Copy Markdown
Contributor

@sentrivana sentrivana commented Sep 25, 2025

Description

Make toxgen generate the TESTPATH env var for integrated test suites, removing a manual step when adding a new test suite.

Issues

Closes #4536

Reminders

@sentrivana sentrivana changed the title feat(toxgen): Generate TESTPATHs for integrated test suites feat(toxgen): Generate TESTPATH for integrated test suites Sep 25, 2025
@codecov
Copy link
Copy Markdown

codecov Bot commented Sep 25, 2025 •
edited
Loading

❌ 64 Tests Failed:

Tests completed Failed Passed Skipped
18524 64 18460 2505
View the top 3 failed test(s) by shortest run time 
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:32: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:34: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/_pytest/python.py:493: in importtestmodule
    mod = import_path(
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.8.18.../x64/lib/python3.8/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1014: in _gcd_import
    ???
<frozen importlib._bootstrap>:991: in _find_and_load
    ???
<frozen importlib._bootstrap>:975: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:671: in _load_unlocked
    ???
.tox/py3.8-aws_lambda/lib/python3.8.../_pytest/assertion/rewrite.py:185: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.11.13.../x64/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1204: in _gcd_import
    ???
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
.tox/py3.11-aws_lambda/lib/python3.11.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.13.7.../x64/lib/python3.13/importlib/__init__.py:88: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1387: in _gcd_import
    ???
<frozen importlib._bootstrap>:1360: in _find_and_load
    ???
<frozen importlib._bootstrap>:1331: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:935: in _load_unlocked
    ???
.tox/py3.13-aws_lambda/lib/python3.13.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.9.23.../x64/lib/python3.9/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1030: in _gcd_import
    ???
<frozen importlib._bootstrap>:1007: in _find_and_load
    ???
<frozen importlib._bootstrap>:986: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:680: in _load_unlocked
    ???
.tox/py3.9-aws_lambda/lib/python3.9.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:32: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:34: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_with_context
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.utils.test_contextvars::test_leaks[threads]
Stack Traces | 0.066s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly
tests.utils.test_contextvars::test_leaks[eventlet]
Stack Traces | 0.067s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly
tests.utils.test_contextvars::test_leaks[greenlet]
Stack Traces | 0.067s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@sentrivana sentrivana marked this pull request as ready for review September 25, 2025 08:46
@sentrivana sentrivana requested a review from a team as a code owner September 25, 2025 08:46
alexander-alderman-webb
alexander-alderman-webb approved these changes Sep 25, 2025
View reviewed changes
Comment thread tox.ini
Comment on lines +718 to +724
asgi: TESTPATH=tests/integrations/asgi
aws_lambda: TESTPATH=tests/integrations/aws_lambda
cloud_resource_context: TESTPATH=tests/integrations/cloud_resource_context
gcp: TESTPATH=tests/integrations/gcp
opentelemetry: TESTPATH=tests/integrations/opentelemetry
potel: TESTPATH=tests/integrations/opentelemetry
socket: TESTPATH=tests/integrations/socket
Copy link
Copy Markdown
Contributor

@alexander-alderman-webb alexander-alderman-webb Sep 25, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

I am wondering if we can auto-generate the TESTPATH for all integrations? The ones I have highlighted are still explicitly specified in tox.ninja.

Copy link
Copy Markdown
Contributor Author

@sentrivana sentrivana Sep 25, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Those are hardcoded since those are tests suites that are not managed by toxgen. But agree that it looks a bit strange. Added at least a small comment e1a547c to clarify the different treatment for future reference.

@sentrivana sentrivana enabled auto-merge (squash) September 25, 2025 10:22
@sentrivana sentrivana merged commit 3a43dc9 into master Sep 25, 2025
113 checks passed
@sentrivana sentrivana deleted the ivana/toxgen/testpath branch September 25, 2025 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@alexander-alderman-webb alexander-alderman-webb alexander-alderman-webb approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Make toxgen generate TESTPATH env var if missing

2 participants

@sentrivana @alexander-alderman-webb