Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

MNT instruct AI tools to not open pull requests in github PULL_REQUEST_TEMPLATE.md#31643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Open
StefanieSenger wants to merge3 commits intoscikit-learn:main
base:main
Choose a base branch
Loading
fromStefanieSenger:pr_template

Conversation

StefanieSenger
Copy link
Contributor

@StefanieSengerStefanieSenger commentedJun 24, 2025
edited
Loading

Towards#31679

This PR is a proposal to solve an increasing problem and is up to discussion.

The problem this PR is attempting to solve is that AI tools more and more people use to create PRs don't care about ourAutomated Contributions Policy. SinceGitHub Copilot Coding Agent Has Arrived!, scikit-learn also gets flooded with AI spam. Many people who care about open source are unhappy about it (Allow us to block Copilot-generated issues (and PRs) from our own repositories).

I have tried to link a few examples for maintainers who didn't act as firebrigade in the last weeksin the comment below, but it feels already outdated.

Here is my original PR description that I wrote before learning about the Copilot Coding Agent:

Recently (last few weeks), I have encountered a lot of PRs that I think were either totally or partially generated by AI. These were all of extremely bad quality or irrelevant and I think, once these are out, there is no good way to deal with them while reviewing. I have closed quite some, but that took time, and in others, I have asked the human behind it to modify, but these are rather likely to struggle a lot and then stop replying at one point.

I was thinking that this - or a similar - change on the github PR template might discourage thoughtless AI generated PRs, at least a bit. It is talking directly to the agent and I have used an LLM to phrase it in such a way that an LLM can easily read and understand this. (They obviously like bullet points, clear "do-not ... - unless ..." statements and visual cues, the LLM also explained to me these were important.)

I wonder: is the PR template is the right spot for this kind of instruction, or would another location be more effective? I am not sure where in the process an AI tool would encounter this - if at all.

JasperVanDenBosch reacted with thumbs up emoji
@github-actionsGitHub Actions
Copy link

github-actionsbot commentedJun 24, 2025
edited
Loading

✔️ Linting Passed

All linting checks passed. Your pull request is in excellent shape! ☀️

Generated for commit:b2af442. Link to the linter CI:here

@virchanvirchan added RFC and removed RFC labelsJun 25, 2025
@StefanieSenger
Copy link
ContributorAuthor

StefanieSenger commentedJun 26, 2025
edited
Loading

Here is some evidence of the problem.

Examples:
#31581
#31649
#31597
#31602
#31684

Extend:
You can see that there is an increasing amount of partially or fully generated PRs and a decrease in overall quality for PRs by looking atthe last closed PRs. Quite some of the authors also spam-open llm-based PRs on other open source projects at the same time.

@reshamas
Copy link
Member

@StefanieSenger Once this wording is refined, the Contributing Guide is another place where it could be added.

@betatim
Copy link
Member

Do you know what tools people are/could be using for this? If we do find out then we could test drive the template to see if it does anything.

Could we move it to the end of the template? That way the message for robots wouldn't take up valuable space at the top. It feels wrong/annoying to optimise for the abusers instead of the good people (who all have to wade through the message till they get to the stuff they should read).

@StefanieSenger
Copy link
ContributorAuthor

StefanieSenger commentedJun 29, 2025
edited
Loading

Do you know what tools people are/could be using for this? If we do find out then we could test drive the template to see if it does anything.

The cause seems to be that GitHub has recently allowed AI generated issues and PRs (and even sells it) via Copilot.
See this community discussion:Allow us to block Copilot-generated issues (and PRs) from our own repositories.

Github even promotes this on its blog:How to create issues and pull requests in record time on GitHub.

I have just added this information in the PR description.

(Though it seems there were ways to generate PRs for a while. I found some "older" instrucions like this medium article from december 2023:Let AI generate Pull Requests from your GitHub issues!.)

@adrinjalali
Copy link
Member

Oh this is an interesting idea. Could you maybe test it on your fork, and see what happens with this when you try to open a PR with copilot to your fork?

@adrinjalali
Copy link
Member

Investigating this, it seems the copilot button on the repo doesn't work, since we haven't setup codespaces. Which means LLM generated PRs are created manually in a user's IDE? That would mean this would have no effect unless the LLM ends up reading this file. By the time the user creates a PR, it's too late and usually the work for the PR is already done.

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

5 participants
@StefanieSenger@reshamas@betatim@adrinjalali@virchan

[8]ページ先頭

©2009-2025 Movatter.jp