Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

gh-141444: Doc: update urllib.robotparser example to use python.org robots.txt#141461

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Closed

Conversation

@PredictiveManish
Copy link

@PredictiveManishPredictiveManish commentedNov 12, 2025•
edited
Loading

Closes:#141444

gh-141444: UpdatedDoc/library/urllib.robotparser.rst to usehttps://www.python.org/robots.txt in the example so it reflects a live robots file. The snippet now shows the expected None values forrequest_rate andcrawl_delay, and demonstratescan_fetch() returning True for an allowed path and False for a disallowed one.

📚 Documentation preview 📚:https://cpython-previews--141461.org.readthedocs.build/

@python-cla-bot
Copy link

python-cla-botbot commentedNov 12, 2025•
edited
Loading

All commit authors signed the Contributor License Agreement.

CLA signed

@bedevere-appbedevere-appbot added awaiting review docsDocumentation in the Doc dir skip news labelsNov 12, 2025
@PredictiveManishPredictiveManish marked this pull request as draftNovember 12, 2025 11:03
@PredictiveManishPredictiveManish changed the titlegh-141444:gh-141444: Doc: update urllib.robotparser example to use python.org robots.txtNov 12, 2025
@PredictiveManishPredictiveManish marked this pull request as ready for reviewNovember 12, 2025 11:04
@serhiy-storchaka
Copy link
Member

I think that it would be better to find an example with non-None values.

0xjuL14 reacted with heart emoji

@StanFromIreland
Copy link
Member

StanFromIreland commentedNov 12, 2025•
edited
Loading

We could add an example tohttps://pythontest.net?

@PredictiveManish
Copy link
Author

We could add an example tohttps://pythontest.net?

Sorry, I didn't got the point

@PredictiveManishPredictiveManish closed this by deleting the head repositoryJan 20, 2026
kovan added a commit to kovan/cpython that referenced this pull requestFeb 3, 2026
Replace the defunct musi-cal.com URL with pythontest.net in theRobotFileParser documentation example. This uses CPython-controlledinfrastructure and provides non-None values for request_rate andcrawl_delay, addressing feedback from previous PRpython#141461.Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment

Reviewers

@berkerpeksagberkerpeksagAwaiting requested review from berkerpeksagberkerpeksag is a code owner

Assignees

No one assigned

Labels

awaiting reviewdocsDocumentation in the Doc dirskip news

Projects

Status: Todo

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Dead example URL in urlib.robotparser documentation

3 participants

@PredictiveManish@serhiy-storchaka@StanFromIreland
[8]ページ先頭
©2009-2026 Movatter.jp