-
Notifications
You must be signed in to change notification settings - Fork 5
Shorten time period for model used in paper notebook #535
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
|
Just add in the intro a note about the fact that the periods are shorter than what appears in the paper to speed up the notebook's computations. |
tlvu
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Rubber stamp for me. Did you test directly on CRIM pipeline because this notebook only fail on CRIM pipeline. The original version that was supposed to be too heavy was still passing on our Jenkins.
And this notebook did not change recently and was passing before on CRIM pipeline. Did you find out why suddenly it becomes "too heavy" since the newer RavenPy or RavenWPS refactoring with Pooch? Did we accidentally introduced a performance regression?
… pin blackdoc higher
|
Woo, all the unit test failed ! "tests/test_external_dataset_access.py::TestGet::test_get_CASPAR_dataset - ImportError: HTTPFileSystem requires "requests" and "aiohttp" to be installed" This must be existing before this change? |
There aren't any changes within RavenPy that would affect the running of this particular notebook.
I think what may have happened was that either a new release of |
Then either CRIM Jenkins got slower or this notebook hits our PAVICS prod for data and we are slower to respond over the network? It passes on our side because the data is "local", network round-trip is minimal. What kind of data is this notebook accessing on our PAVICS prod? Maybe some .ncml we recently changed? |
My money is on the throughput speed may be slower; Running the original example on my home workstation had some cells hanging for five to 10 minutes.
I don't think so. It's pulling CASPAR data that hasn't been touched in years. Has the THREDDS version or |
That's weird, I do not understand why Francis even mentionned
Not recently on our side. Oh but |
|
@fmigneault Can you verify that this branch is working better for your infra? I still have a handful of small documentation changes to make, but it should run without timing out now. |
|
@fmigneault I'll be merging this in an hour or so. LMK if you want more time to verify changes on CRIM infra. |
|
@Zeitsperre Sorry. I did not have enough time to look into it. Ok to have it merged. We'll see how the CI reacts using them. |
Pull Request Checklist:
number) and pull request (:pull:number) has been added.What kind of change does this PR introduce?
Perform_a_climate_change_impact_study_on_a_watershed.ipynbnotebookDoes this PR introduce a breaking change?
Not really.
Other information:
The model example is not as accurate now, seeing as the training period has been shortened from 10 years to 4 years. Unfortunately, if we want to run this notebook in our CI pipelines, we can't have notebook cells that might run for 10+ minutes. @huard Can you double-check that the outputs are still relatively accurate with this adjustment?