Skip to content

[3.13] gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555) #149513

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
miss-islington wants to merge 1 commit into from
+61 −17

gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)

351f205
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Closed

[3.13] gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555) #149513

gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)
351f205
Select commit
Loading
Failed to load commit list.
DO-NOT-MERGE / unresolved review
succeeded May 7, 2026 in 4s