Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Feb 3, 2026

Smoke test workflows have ambiguous playwright instructions that could lead agents to attempt installing playwright instead of using the provided MCP tools.

Changes

Updated playwright test instructions in 4 smoke workflows (smoke-codex, smoke-copilot, smoke-claude, smoke-opencode):

Before:

**Playwright Testing**: Use playwright to navigate to https://github.com...

After:

**Playwright Testing**: Use the playwright tools to navigate to https://github.com... (do NOT try to install playwright - use the provided MCP tools)

The workflows already have correct tools.playwright frontmatter configuration. This change only clarifies the prompt text to prevent agent confusion.

Original prompt

Review the prompts of the smoke-* agentic workflows that use playwright. They MUST use the playwright tools. They SHOULD NOT try to install playwright.


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

- Explicitly state "use the playwright tools" instead of "use playwright"
- Add warning not to try to install playwright
- Clarifies that agents should use the provided MCP tools

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Review prompts for smoke agentic workflows using Playwright Clarify playwright tool usage in smoke test workflows Feb 3, 2026
Copilot AI requested a review from pelikhan February 3, 2026 13:31
@pelikhan pelikhan marked this pull request as ready for review February 3, 2026 13:31
Copilot AI review requested due to automatic review settings February 3, 2026 13:31
@pelikhan pelikhan merged commit 5a9d4d6 into main Feb 3, 2026
1 check passed
@pelikhan pelikhan deleted the copilot/review-playwright-agentic-workflows branch February 3, 2026 13:31
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR clarifies playwright usage instructions in smoke test workflows to prevent AI agents from attempting to install playwright instead of using the provided MCP tools.

Changes:

  • Updated playwright test instructions in 4 smoke test workflows (smoke-codex, smoke-copilot, smoke-claude, smoke-opencode) to explicitly mention "playwright tools" and add a warning against installation attempts
  • Changed "Use playwright to navigate" to "Use the playwright tools to navigate" with parenthetical clarification "(do NOT try to install playwright - use the provided MCP tools)"

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
.github/workflows/smoke-opencode.md Updated playwright testing instruction to clarify tool usage and prevent installation attempts
.github/workflows/smoke-copilot.md Updated playwright testing instruction to clarify tool usage and prevent installation attempts
.github/workflows/smoke-codex.md Updated playwright testing instruction to clarify tool usage and prevent installation attempts
.github/workflows/smoke-claude.md Updated playwright testing instruction to clarify tool usage and prevent installation attempts

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants