Skip to content

Comments

feat(data_collector): add JP (TSE Prime domestic stocks) support to Yahoo collector (1d)#2138

Open
kei-yamazaki wants to merge 1 commit intomicrosoft:mainfrom
kei-yamazaki:add-support-jp-region
Open

feat(data_collector): add JP (TSE Prime domestic stocks) support to Yahoo collector (1d)#2138
kei-yamazaki wants to merge 1 commit intomicrosoft:mainfrom
kei-yamazaki:add-support-jp-region

Conversation

@kei-yamazaki
Copy link
Contributor

Description

This PR adds JP support to Yahoo data collector for daily frequency (1d) with TSE Prime domestic stocks.
It introduces JP symbol loading from JPX, JP collector/normalizer classes, and explicit non-support errors for JP 1min.
It also updates related documentation and adds JP-focused tests.

Motivation and Context

JP was not supported in the Yahoo collector flow for daily data collection/normalization.
This change enables an official JP path and makes unsupported JP 1min behavior explicit.
Related issue: N/A

How Has This Been Tested?

  • Pass the test by running: pytest qlib/tests/test_all_pipeline.py under upper directory of qlib.
  • If you are adding a new feature, test on your own test scripts.

Executed tests (concise):

  • python -m pytest -q tests/test_yahoo_collector_jp.py (7 passed)
  • JP E2E (small scope with limit_nums=1):
    • download_data --region JP --interval 1d
    • normalize_data --region JP --interval 1d
    • normalize_data_1d_extend --region JP --interval 1d
    • update_data_to_bin --region JP --interval 1d --limit_nums 1
    • --region JP --interval 1min returns expected ValueError
  • Regression sanity:
    • normalize_data --region CN --interval 1d
    • normalize_data --region US --interval 1d
    • normalize_data --region BR --interval 1d

Screenshots of Test Results (if appropriate):

  1. Pipeline test:
    Not run for this PR.
  2. Your own tests:
    CLI outputs were verified for the commands listed above.

Types of changes

  • Fix bugs
  • Add new feature
  • Update documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant