feat(review): use "Looks good to me" when no findings#2159
Conversation
E2E tests are runningAuthorization passed for this commit. See the E2E Tests workflow for results. |
…ctured empty block Closes #1499 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> Signed-off-by: Hector Martinez <hemartin@redhat.com>
48a2a4c to
4f6dbc3
Compare
Site previewPreview: https://b1b35a41-site.fullsend-ai.workers.dev Commit: |
|
🤖 Finished Review · ✅ Success · Started 8:56 AM UTC · Completed 9:05 AM UTC |
ReviewFindingsMedium
Low
Previous runReviewFindingsHigh
Medium
Low
Info
|
| @@ -710,7 +711,7 @@ The table below lists the **additional** required fields per action: | |||
|
|
|||
| | Outcome | Action | Required fields | | |||
| |-----------------|-------------------|-----------------------------------------------------------------------------------------------| | |||
There was a problem hiding this comment.
[high] api-contract
The updated table says body 'defaults to' a value, implying it is no longer required for approve actions. However, the JSON schema unconditionally requires body for approve actions with minLength: 1. The table column header says 'Required fields' but the new wording removes body from the required position and uses 'defaults to', which an LLM agent could interpret as body being optional — causing schema validation failure.
Suggested fix: Either update the schema to make body optional for approve, or reword the table to: 'body, head_sha; set body to "Looks good to me" when there are no findings' — keeping body clearly listed as required.
| entirely. If the only findings are medium/low/info, only show that | ||
| section. If there are no findings at all, state "No findings." in | ||
| place of the findings section. | ||
| section. If there are no findings at all, set the body to |
There was a problem hiding this comment.
[medium] internal-consistency
The formatting rules now say the body should be just 'Looks good to me' with no ## Review header. However, lines 650-660 require the head SHA to be embedded in a hidden HTML comment on the first line of the body. A body of just 'Looks good to me' would omit the SHA comment. The pre-fetch-prior-review.sh script extracts the SHA using the Head SHA: pattern — a body without this comment would cause SHA extraction to fail on re-reviews.
Suggested fix: Clarify that the no-findings body should still be prefixed with the hidden HTML comment containing the head SHA.
| @@ -710,7 +711,7 @@ The table below lists the **additional** required fields per action: | |||
|
|
|||
| | Outcome | Action | Required fields | | |||
| |-----------------|-------------------|-----------------------------------------------------------------------------------------------| | |||
There was a problem hiding this comment.
[low] pattern-inconsistency
The new table cell reorders fields so head_sha appears first without body, breaking the pattern where required fields are listed upfront in the 'Required fields' column.
| entirely. If the only findings are medium/low/info, only show that | ||
| section. If there are no findings at all, state "No findings." in | ||
| place of the findings section. | ||
| section. If there are no findings at all, set the body to |
There was a problem hiding this comment.
[info] scope-exceeded
Issue #1499 presents two options: skip comments entirely or shorten to LGTM. This PR implements option 2 without documenting why comment skipping was not chosen.
ben-alkov
left a comment
There was a problem hiding this comment.
The High [api-contract] and Medium [internal-consistency] findings need to be addressed.
…dings - Keep body as a required field for approve actions; reword to instruct agents to set body to "Looks good to me" (not treat it as optional) - Clarify that the hidden SHA HTML comment must prefix the body even in the no-findings case, preventing pre-fetch-prior-review.sh SHA extraction failure on re-reviews Signed-off-by: Hector Martinez <hemartin@redhat.com>
bbd1578 to
6b2c71f
Compare
|
🤖 Review · Started 6:22 AM UTC |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
🤖 Finished Review · ✅ Success · Started 6:22 AM UTC · Completed 6:33 AM UTC |
|
🤖 Finished Retro · ✅ Success · Started 1:07 PM UTC · Completed 1:14 PM UTC |
Retro: PR #2159 — feat(review): use "Looks good to me" when no findingsTimeline
AssessmentReview quality: strong. The review agent caught two legitimate bugs (api-contract, internal-consistency) that would have caused schema validation failures and SHA extraction breakage in production. The human reviewer (ben-alkov) validated these findings independently. Rework rate: 1 iteration. Author pushed one fix commit that resolved both High and Medium findings. Reasonable for the complexity. Remaining gap: The Early human approval: ifireball approved at 09:01, 4 minutes before the review agent found a High severity issue at 09:05. Existing issue #2099 proposes alerting when humans approve with unresolved Medium+ findings. ProposalsNo new proposals. The improvement areas identified are already covered by existing open issues: This PR is a good data point supporting the priority of both issues. |
Summary
## Review / ### Findings / No findings.block## Reviewheader and### Findingssection entirely in the zero-findings casebodydefaults to "Looks good to me" forapprovewith no findingsCloses #1499
Test plan
🤖 Generated with Claude Code