Problem
The permutation test scenario in tests/scenarios/permutation_tests/ is too slow for CI (causes Ubuntu runners to timeout). It is currently skipped via @unittest.skip.
Required changes
-
Reduce execution time — The permutation test runs multiple vector backtests with shuffled data. Reduce the number of permutations, shorten the date range, and use faster indicator parameters to bring execution under 30 seconds.
-
Use only offline test data from tests/resources/test_data/ — All data sources must reference CSV files located in tests/resources/test_data/ (or its subdirectories). Tests should not depend on data files scattered across tests/resources/data/ or tests/resources/market_data_sources_for_testing/. This ensures tests are self-contained, reproducible, and don't break when external data files are reorganized.
Affected files
tests/scenarios/permutation_tests/test_permutation_test.py
Acceptance criteria
Problem
The permutation test scenario in
tests/scenarios/permutation_tests/is too slow for CI (causes Ubuntu runners to timeout). It is currently skipped via@unittest.skip.Required changes
Reduce execution time — The permutation test runs multiple vector backtests with shuffled data. Reduce the number of permutations, shorten the date range, and use faster indicator parameters to bring execution under 30 seconds.
Use only offline test data from
tests/resources/test_data/— All data sources must reference CSV files located intests/resources/test_data/(or its subdirectories). Tests should not depend on data files scattered acrosstests/resources/data/ortests/resources/market_data_sources_for_testing/. This ensures tests are self-contained, reproducible, and don't break when external data files are reorganized.Affected files
tests/scenarios/permutation_tests/test_permutation_test.pyAcceptance criteria
tests/resources/test_data/@unittest.skipdecorator once optimized