read timeout

[Respaired]

Hi. thanks for creating the local version of Jina reader.

unfortunately this crashes after scraping a few links and i have to manually restart the docker image to make it work.
Error fetching data for URL https:xxxxx.com/xxxx: HTTPConnectionPool(host='127.0.0.1', port=3000): Read timed out. (read timeout=10)

does anybody have any idea why this is happening and any solutions to fix this issue?

[tcluoct]

i also get this issue
could you fix this issue?

[Respaired]

It crashes only when the link is corrupted / broken.

The only solution I can think of is to add a condition before feeding it any links to ensure the link is not broken (for example only if it's returning a 200)