Skip to content

Add qa.yaml for Kiln QA - #960

Closed
chhhee10 wants to merge 1 commit into
mainfrom
kiln/qa-yaml
Closed

chhhee10 wants to merge 1 commit into
mainfrom
kiln/qa-yaml

Conversation

@chhhee10

@chhhee10 chhhee10 commented Oct 28, 2026 •

Copy link
Copy Markdown
Member

Adds qa.yaml so Kiln's QA agent knows how to test this repo. Kiln reads it from the default branch when the project is added (and from the task branch on each run).

What it does

  • Boot: bun install, build the CLI/worker/fixture, build failproofaid, start the dashboard dev server on :8020 for Playwright.
  • Checks: vitest unit + e2e, lint, tsc, cargo fmt/clippy/test, bun run build (the secret-free PR CI jobs).
  • cli: installs hooks from this checkout into a throwaway HOME, then pipes a PreToolUse payload through the installed hook: block-failproofai-commands must deny, ls must allow, then the same through a freshly started failproofaid (the path we tested end to end in Kiln).

Verified

  • Parses with Kiln's own parse_qa_yaml.
  • Run locally (x86): boot, lint, tsc, e2e (364 passed), build, cargo fmt/clippy, and the cli check all pass.

Not yet verified: a real run inside Kiln's arm64 worker container on the Mac mini. The first QA run on a task is that test; timeouts and resources are estimates.

Left to CI (needs secrets, Docker or cloud access) is listed in the header comment.

🤖 Generated with Claude Code

Hermes review

Field Value
Status Reviewing
Head d02af033648e
Updated 2026-10-28T17:21:45.696843069+00:00

Codex is reviewing the current revision in an isolated nested-container harness.

Tells Kiln's QA agent how to install, boot and test this repo in its
worker container: the secret-free parts of PR CI, sidecar services
in place of docker compose, and a running app to exercise.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks @chhhee10 for your contribution to Failproof AI! 🙌

We'd love to discuss your PR and welcome you to our community.

Discord: https://discord.befailproof.ai/
Reddit: https://www.reddit.com/r/failproofai/

@coderabbitai

coderabbitai Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Caution

Review failed

The pull request is closed.

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@chhhee10

Copy link
Copy Markdown
Member Author

Closing: qa.yaml will live on the Kiln host instead of in the repo.

@chhhee10 chhhee10 closed this Oct 28, 2026
@hermes-exosphere

Copy link
Copy Markdown
Contributor

Hermes

Status Reviewing
Verdict Not reviewed yet
Head d02af033648e
Rounds 0 of 5

No summary yet.

What this changes

No component map for this revision.

Rounds

No review has finished on this pull request yet.

Findings

Nothing raised yet.


@hermes-exosphere help lists every command. This comment is maintained in place — I rewrite it after each review rather than posting a new one.

@chhhee10
chhhee10 deleted the kiln/qa-yaml branch October 28, 2026 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants