Skip to content

fix(cli): add plan-gated property warnings to construct references#1266

Open
thebiglabasky wants to merge 2 commits intomainfrom
fix/skills-plan-gated-warnings
Open

fix(cli): add plan-gated property warnings to construct references#1266
thebiglabasky wants to merge 2 commits intomainfrom
fix/skills-plan-gated-warnings

Conversation

@thebiglabasky
Copy link
Contributor

Summary

Addresses the systematic issue where agents use retryStrategy, runParallel, and higher frequencies from example code without checking entitlements — the #1 cause of first-setup failures on Hobby plans.

Changes

6 configure references updated (URL, DNS, TCP, ICMP monitors + API checks + Browser checks):

  • Each now has a plan-gated properties warning before the example code
  • Warns to check entitlements matching the check type pattern (e.g. UPTIME_CHECKS_*)
  • Points to npx checkly skills manage for full reference

manage.md updated:

  • New "Applying entitlements to check configuration" section
  • Lookup table: retryStrategy / runParallel / frequency / locations / privateLocation mapped to entitlement key patterns
  • --search examples for narrowing 90+ entitlements to relevant ones
  • Clear instruction: omit disabled properties, Checkly applies safe defaults

Root cause

The example URL monitor (gen/resources/url-monitors/example-url-monitor.check.ts) uses RetryStrategyBuilder.linearStrategy and runParallel: true — both unavailable on Hobby. Agents copied the example verbatim. The warnings now appear right before the example in the rendered configure reference.

Test plan

  • npm run prepare generates all references correctly
  • No SKILL.md changes needed (manage group already has correct header)
  • 130 tests passing

🤖 Generated with Claude Code

thebiglabasky and others added 2 commits March 19, 2026 19:05
The #1 cause of first-setup failures: agents copy retryStrategy,
runParallel, and higher frequencies from example code without
checking entitlements.

- Every monitor/check configure reference now includes a plan-gated
  properties warning before the example code
- manage.md adds a lookup table mapping check properties to their
  entitlement key patterns with --search examples
- Agents are told to omit disabled properties (Checkly applies safe
  defaults) and share upgradeUrl when users need a feature

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
JSON output with --disabled, --type, or --search was returning a bare
entitlements array without locations, plan info, or upgrade URLs.
Now all JSON output includes the full plan context so agents always
have locations.all and upgrade URLs regardless of filters applied.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant