Skip to content

[AI Reviewer] Comments without a specific rule are sometimes posted #74223

Closed

Description

@adamgrzybowski

Context

We want the AI reviewer to stick to our defined rules and avoid posting more general or unrelated comments to reduce noise. Currently, it's not 100% enforced

This task will require researching and testing a more structured and consistent prompt that prevents Claude from posting comments that are outside the scope of the defined rules

Examples

Activity

  1. adamgrzybowski commented on Nov 12, 2025

    @adamgrzybowski
    ContributorAuthor

    I am linking this blog post as it may suggest the proper solution for our problem
    https://www.greptile.com/blog/make-llms-shut-up

  2. melvin-bot commented on Dec 12, 2025

    @melvin-bot

    This issue has not been updated in over 15 days. @adamgrzybowski eroding to Monthly issue.

    P.S. Is everyone reading this sure this is really a near-term priority? Be brave: if you disagree, go ahead and close it out. If someone disagrees, they'll reopen it, and if they don't: one less thing to do!

  3. adamgrzybowski commented on Dec 12, 2025

    @adamgrzybowski
    ContributorAuthor

    PR for this issue was merged two days ago

  4. added
    Awaiting PaymentAuto-added when associated PR is deployed to production
    and removed on Dec 16, 2025
  5. 2 remaining items

  6. melvin-bot commented on Dec 16, 2025

    @melvin-bot

    Reviewing label has been removed, please complete the "BugZero Checklist".

  7. melvin-bot commented on Dec 16, 2025

    @melvin-bot

    The solution for this issue has been 🚀 deployed to production 🚀 in version 9.2.78-8 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

    If no regressions arise, payment will be issued on 2025-12-23. 🎊

    For reference, here are some details about the assignees on this issue:

  8. melvin-bot commented on Dec 23, 2025

    @melvin-bot

    Skipping the payment summary for this issue since all the assignees are employees or vendors. If this is incorrect, please manually add the payment summary SO.

  9. changed the title [-][Due for payment 2025-12-23] [AI Reviewer] Comments without a specific rule are sometimes posted[/-] [+][[Due for payment 2025-12-23] []AI Reviewer] Comments without a specific rule are sometimes posted[/+] on Dec 24, 2025
  10. changed the title [-][[Due for payment 2025-12-23] []AI Reviewer] Comments without a specific rule are sometimes posted[/-] [+][AI Reviewer] Comments without a specific rule are sometimes posted[/+] on Dec 24, 2025
  11. melvin-bot commented on Dec 26, 2025

    @melvin-bot

    @adamgrzybowski Whoops! This issue is 2 days overdue. Let's get this updated quick!

  12. melvin-bot commented on Jan 1, 2026

    @melvin-bot

    @adamgrzybowski 8 days overdue is a lot. Should this be a Weekly issue? If so, feel free to change it!

  13. melvin-bot commented on Jan 5, 2026

    @melvin-bot

    @adamgrzybowski 12 days overdue now... This issue's end is nigh!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions