Repository navigation
Add portable plugin validation and harden Reddit gates - #1
Merged
Merged
Conversation
PalmPalm7
marked this pull request as ready for review
August 7, 2026 06:55
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
plugin.json.codex-pluginlayout and require every trackedSKILL.mdto live exactly one directory belowskills/skillsinstaller versionrequirementsdistinguish missing subreddits from partial/rate-limited endpoint failuresscoutcandidate overfetch so it does not exhaust the read budget before the required posting gatereddit-voiceREADME entry and a reproducible read-only tester pathis_robot_indexable, plus a corrected proof cardreddit-scouttest-report form that separates completed runs from failed attempts and enforces privacy/write-safety confirmationsWhy
The package needed to conform to the portable Agent Plugins v1 specification. A live GTM run also exposed two concrete failures:
scout,requirements ClaudeCodereportedsubreddit_not_foundeven though the actual Reddit responses were HTTP 429; that could encourage an agent to misread the destination or bypass the rule gatereddit-voice, but the repository README did not list or explain that skillThe review also found that
is_robot_indexable: falseproves Reddit marked the post ineligible for robot indexing, not that every possible search or AI system is technically unable to access it. The new wording stays within the measured evidence.Impact
Installed copies remain self-contained. Operators now get an explicit partial/full gate, current rule text, and rate-limit diagnostics instead of a false not-found result. Scout examines only the requested bounded candidate set. Testers can install the two read-only skills directly, submit one concrete rule match/mismatch without exposing session data, and the visibility proof no longer overstates what the field proves.
The compliance guard now checks every tracked package path after filesystem resolution, so a symlink cannot escape the plugin root. It rejects legacy manifests and nested
SKILL.mdfiles that portable clients would not discover as direct-child skills. It installs, validates, and exercises all five direct-child skills instead of sampling onlyreddit-post.Validation
skills@1.5.22: pinned.codex-pluginand nested trackedSKILL.mdnegative tests: rejected as expectednode --checkfor canonical and installed CLI copies: passgit diff --check: passnpx skills@1.5.22 addsmoke: all 5 installed skills contain their own CLI/reference and expose helprequirements ClaudeCode: all four endpoints HTTP 200,partial: false,post_gate_complete: trueis_robot_indexablesignalScout topical-fit regression fix
The search-share component previously treated incidental keyword-bearing posts as proof that an entire community was relevant. On the exact read-only TikTok developer-tool query, that ranked BestofRedditorUpdates first and recommended unrelated gaming, World of Warcraft, celebrity, and Black Friday communities.
Additional validation:
Telemetry integrity and independent evidence
Additional validation: