Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

Add AI issue assessment workflow with github/ai-assessment-comment-labeler#1498

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
JoannaaKL merged 6 commits intomainfromcopilot/add-issue-analysing-workflow
Nov 28, 2025

Conversation

Copy link
Contributor

CopilotAI commentedNov 28, 2025•
edited
Loading

Closes:#667

Adds AI-powered issue assessment usinggithub/ai-assessment-comment-labeler to automatically analyze new issues.

Changes:

  • Added.github/workflows/ai-issue-assessment.yml — Workflow triggered on issues withbug label OR newly opened issues without any labels
  • Added.github/prompts/bug-report-review.prompt.yml — Prompt assessing bug report completeness (description, version, repro steps, expected vs actual, logs)
  • Added.github/prompts/default-issue-review.prompt.yml — Default prompt for unlabeled issues that analyzes issue type and completeness

Usage:

  • The workflow runs automatically when an issue is opened without labels
  • The workflow also runs when an issue receives thebug label
  • For bug reports: AI assesses completeness and adds labels likeai:bug-report-review:ready for review orai:bug-report-review:missing details
  • For unlabeled issues: AI categorizes the issue type (bug, feature request, question, etc.) and assesses clarity

Tradeoffs:

  • Runs on unlabeled issues andbug labeled issues to balance coverage with noise reduction per issue requirements
  • Two prompts: bug-specific assessment and a default general assessment for unlabeled issues
Original prompt

This section details on the original issue you should resolve

<issue_title>Addhttps://github.com/github/ai-assessment-comment-labeler</issue_title>
<issue_description>Add a workflow to automatically analyse new issues with:
https://github.com/github/ai-assessment-comment-labeler

Refer to the installer docs that describe in more details how to use this workflow:https://github.com/github/ai-issue-assessment-commenter-installer/blob/main/README.md

Make minimal changes, it's better to run it less often than to create noise. If you are unsure don't add anything.</issue_description>

Comments on the Issue (you are@copilot in this section)

💬 We'd love your input! Share your thoughts on Copilot coding agent in our2 minute survey.

…belerCo-authored-by: JoannaaKL <67866556+JoannaaKL@users.noreply.github.com>
CopilotAI changed the title[WIP] Add workflow to analyse new issues automaticallyAdd AI issue assessment workflow with github/ai-assessment-comment-labelerNov 28, 2025
CopilotAI requested a review fromJoannaaKLNovember 28, 2025 09:06
Copilot finished work on behalf ofJoannaaKLNovember 28, 2025 09:06
issue_body: ${{ github.event.issue.body }}
ai_review_label: 'triage-pending'
prompts_directory: '.github/prompts'
labels_to_prompts_mapping: 'bug,bug-report-review.prompt.yml'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

@copilot removebug-report-review.prompt.yml, this label doesn't exist

Copy link
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Removedbug-report-review.prompt.yml and the workflow file in705ca08.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Don't removebug-report-review.prompt.yml file!!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

@copilot Don't remove bug-report-review.prompt.yml file!!

Copy link
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Restoredbug-report-review.prompt.yml in0bfc619.


on:
issues:
types: [labeled]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

@copilot run this workflow on issues that have labelbug and issues that don't have any label

Copy link
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Updated workflow to trigger on issues withbug label OR newly opened issues without any labels in0bfc619.

Co-authored-by: JoannaaKL <67866556+JoannaaKL@users.noreply.github.com>
CopilotAI changed the titleAdd AI issue assessment workflow with github/ai-assessment-comment-labelerRemove AI issue assessment workflowNov 28, 2025
CopilotAI requested a review fromJoannaaKLNovember 28, 2025 09:14
Copilot finished work on behalf ofJoannaaKLNovember 28, 2025 09:14
Co-authored-by: JoannaaKL <67866556+JoannaaKL@users.noreply.github.com>
CopilotAI changed the titleRemove AI issue assessment workflowAdd AI issue assessment workflow with github/ai-assessment-comment-labelerNov 28, 2025
Copilot finished work on behalf ofJoannaaKLNovember 28, 2025 09:18
Copilot finished work on behalf ofJoannaaKLNovember 28, 2025 09:20
@JoannaaKLJoannaaKL marked this pull request as ready for reviewNovember 28, 2025 09:24
@JoannaaKLJoannaaKL requested a review froma team as acode ownerNovember 28, 2025 09:24
CopilotAI review requested due to automatic review settingsNovember 28, 2025 09:24
Copy link
Contributor

CopilotAI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Pull request overview

This PR adds automated AI-powered issue assessment using thegithub/ai-assessment-comment-labeler action to help triage new issues and bug reports.

Key changes:

  • Adds workflow that triggers on newly opened unlabeled issues and issues receiving the 'bug' label
  • Configures AI assessment to evaluate bug report completeness and suggest appropriate labels

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

FileDescription
.github/workflows/ai-issue-assessment.ymlDefines workflow triggered on issue opened/labeled events, runs AI assessment action with bug report prompt mapping
.github/prompts/bug-report-review.prompt.ymlConfigures AI prompt to assess bug reports for completeness (description, version, repro steps, expected behavior, logs) and provide one of three assessment levels

issue_number: ${{ github.event.issue.number }}
issue_body: ${{ github.event.issue.body }}
prompts_directory: '.github/prompts'
labels_to_prompts_mapping: 'bug,bug-report-review.prompt.yml'

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Thelabels_to_prompts_mapping parameter maps 'bug' label to 'bug-report-review.prompt.yml', but the workflow also runs for newly opened issues without any labels (line 10). For unlabeled issues, it's unclear which prompt will be used since there's no 'bug' label to match against.

Consider either:

  1. Adding a default prompt mapping for unlabeled issues
  2. Documenting that unlabeled issues won't be assessed (and updating the workflow condition to only run on labeled bugs)
  3. Verifying that the action handles this case appropriately with a fallback prompt
Suggested change
labels_to_prompts_mapping:'bug,bug-report-review.prompt.yml'
labels_to_prompts_mapping:'bug,bug-report-review.prompt.yml;default,default-issue-review.prompt.yml'

Copilot uses AI. Check for mistakes.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

@copilot butdefault-issue-review.prompt.yml doesn't exist, can you propose how it could look like?

Copy link
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Createddefault-issue-review.prompt.yml in5e1b41c. It analyzes new issues to determine their type (bug, feature request, question, etc.) and assesses whether they have enough information for maintainers to act on.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: JoannaaKL <67866556+JoannaaKL@users.noreply.github.com>
Copilot finished work on behalf ofJoannaaKLNovember 28, 2025 09:33
CopilotAI requested a review fromJoannaaKLNovember 28, 2025 09:33
Copy link
Collaborator

@SamMorrowDrumsSamMorrowDrums left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Let's try it! I hope it suggests to close all my issues labelling as "Won't-fix"

JoannaaKL reacted with heart emoji
@JoannaaKLJoannaaKL merged commit4d6d64e intomainNov 28, 2025
16 checks passed
@JoannaaKLJoannaaKL deleted the copilot/add-issue-analysing-workflow branchNovember 28, 2025 09:46
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment

Reviewers

Copilot code reviewCopilotCopilot left review comments

@SamMorrowDrumsSamMorrowDrumsSamMorrowDrums approved these changes

+1 more reviewer

@JoannaaKLJoannaaKLJoannaaKL approved these changes

Reviewers whose approvals may not affect merge requirements

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add https://github.com/github/ai-assessment-comment-labeler

3 participants

@SamMorrowDrums@JoannaaKL
[8]ページ先頭
©2009-2025 Movatter.jp