Skip to content

Add skill-validation workflow for structural checks on skills and agents#19668

Open
T-Gro wants to merge 2 commits intomainfrom
agentics/skill-validator
Open

Add skill-validation workflow for structural checks on skills and agents#19668
T-Gro wants to merge 2 commits intomainfrom
agentics/skill-validator

Conversation

@T-Gro
Copy link
Copy Markdown
Member

@T-Gro T-Gro commented Apr 30, 2026

Introduces the skill-validator as a CI check for PRs touching .github/skills/** or .github/agents/**. The validator is an AOT-compiled binary that performs structural static analysis — frontmatter, required fields, size warnings — on our 10 skills and 6 agents. No .NET SDK or secrets required.

Design choices

  • Path-filtered triggers — only fires on skill/agent changes or the workflow itself; 99%+ of PRs won't trigger this
  • Sparse checkout — only .github/skills and .github/agents
  • --allow-repo-traversal — our skills reference repo paths (src/Compiler/, tests/, docs/, etc.)
  • Nightly binary from dotnet/skills — picks up validation improvements automatically (can pin later if stability is a concern)
  • Concurrency group with cancel-in-progress to avoid wasting runners
  • contents: read only — no write permissions needed
  • Step summary with truncated output (200 lines) for easy diagnosis from the Actions UI

Testing

This workflow won't fire in this PR's CI because it doesn't exist on main yet. After merge, any PR touching .github/skills/** or .github/agents/** will trigger it. Can also be tested via workflow_dispatch.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@T-Gro T-Gro requested a review from a team as a code owner April 30, 2026 13:02
@T-Gro T-Gro added the NO_RELEASE_NOTES Label for pull requests which signals, that user opted-out of providing release notes label Apr 30, 2026
@T-Gro T-Gro requested a review from abonie April 30, 2026 13:02
@T-Gro T-Gro enabled auto-merge (squash) April 30, 2026 13:02
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

⚠️ Release notes required, but author opted out

Warning

Author opted out of release notes, check is disabled for this pull request.
cc @dotnet/fsharp-team-msft

- Rename .github/skills/expert-review/ to reviewing-compiler-prs/ to match
  frontmatter name (validator requires directory/name match)
- Add missing name field to agentic-workflows.agent.md frontmatter

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

NO_RELEASE_NOTES Label for pull requests which signals, that user opted-out of providing release notes

Projects

Status: New

Development

Successfully merging this pull request may close these issues.

1 participant