ci: get main green again under tree-sitter v0.26

[NullVoxPopuli-ai-agent]

Brings main back to a working state under the tree-sitter v0.26 toolchain that CI's floating tags now resolve to, fixes a couple of long-latent bugs in the Rust and Windows binding paths, and documents source-vs-generated files. PR #19 will need to rebase on this and drop its src/parser.c / grammar.json / etc. regen so it can stand as a clean scanner-only fix.

What's in here

1. ci: bump tree-sitter/setup-action/cli@v1 → @v2 — Action's v1 tag is frozen at a 2024 commit whose init script parses the stdout of tree-sitter init-config. Starting with tree-sitter CLI 0.26.2 that message moved to stderr (upstream fix). v1 was never advanced, so any run that resolves tree-sitter-ref: latest to ≥0.26.2 (currently v0.26.8) fails with line 2: : No such file or directory.

2. deps: move tree-sitter-javascript to runtime dependencies — grammar.js does require('tree-sitter-javascript/grammar') at generation time. parser-test-action@v2 installs only runtime deps (npm ci --omit dev --omit peer --omit optional), so this has to be in dependencies.

3. chore: regenerate parser with tree-sitter v0.26 — parser-test-action runs tree-sitter generate then git diff --exit-code -- parser.c. The artifacts on main were generated with an older CLI, so they didn't match. Regenerated with v0.26.7; grammar.js is unchanged.

4. docs: list auto-generated vs hand-written files in README — README was just badges; spell out what's produced by tree-sitter generate (don't edit) vs what's hand-maintained (scanner.c, queries, fixtures, bindings, etc).

5. build: replace pnpm-lock.yaml with package-lock.json — parser-test-action@v2 uses npm ci, which requires a package-lock.json. Consolidating on npm matches tree-sitter-typescript and avoids drift between two lockfiles.

6. build: include src/scanner.c in node binding sources — binding.gyp only listed parser.c, so on Windows MSVC the .node build failed with LNK2001 unresolved external symbol tree_sitter_glimmer_javascript_external_scanner_*. macOS/Linux had been tolerating the same gap.

7. rust: bump tree-sitter to 0.25 and adopt LanguageFn pattern — Cargo.toml was pinning tree-sitter = "~0.20.10", which only supports ABI 13; the regenerated parser declares LANGUAGE_VERSION 15, so the Rust binding test panicked with LanguageError { version: 15 }. Switched to tree-sitter-language = "0.1" for the runtime dep and tree-sitter = "0.25" as a dev-dep, with the LanguageFn::from_raw pattern used by tree-sitter-typescript. Also fixed the crate name (tree-sitter-glimmer-javascript, not the underscore form), bumped the version to match package.json, and added tree-sitter.json to the crate include list.

Verified locally

• cargo test — both unit and doctest pass against the regenerated parser
• npm ci --omit=dev followed by node-gyp postinstall — successfully compiles parser.o and scanner.o and links the .node binding

Test plan

• Test parser matrix passes on ubuntu / windows / macos-14
• cargo test step (Linux only) passes
• After merge, Fix ASI not firing before <template> in class bodies #19 rebases cleanly with src/parser.c, src/grammar.json, src/node-types.json, src/tree_sitter/* dropped (git checkout origin/main -- ...) and just keeps the scanner.c and corpus changes

🤖 Generated with Claude Code

[Copilot]

Pull request overview

Updates this grammar repo to work with the tree-sitter v0.26 toolchain (as used by CI), including regenerated parser artifacts, dependency/lockfile adjustments for parser-test-action@v2, Windows Node binding fixes, and updated documentation about generated vs hand-maintained files.

Changes:

• Update CI to use tree-sitter/setup-action/cli@v2 and regenerate src/ artifacts against the v0.26 generator output.
• Adjust Node/Rust packaging/build inputs (Node deps, binding.gyp sources, Rust LanguageFn pattern + deps).
• Replace pnpm-lock.yaml with package-lock.json and expand README documentation.

Reviewed changes

Copilot reviewed 10 out of 13 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
.github/workflows/ci.yml	Bumps setup action to @v2 so CI works with newer tree-sitter CLI behavior.
binding.gyp	Adds src/scanner.c to Node addon sources (fixes missing external scanner symbols on Windows).
bindings/rust/lib.rs	Switches Rust binding to LanguageFn constant API and updates docs/tests accordingly.
Cargo.toml	Updates Rust dependency strategy (runtime via tree-sitter-language, dev via tree-sitter).
package.json	Updates build script and moves tree-sitter-javascript to runtime deps to satisfy CI install behavior.
package-lock.json	New npm lockfile to support npm ci usage.
pnpm-lock.yaml	Removed as part of switching lockfile strategy.
README.md	Documents which files are generated vs hand-maintained.
src/grammar.json	Regenerated grammar JSON for the v0.26 generator output format.
src/node-types.json	Regenerated node-types, marking comment tokens as extra.
src/tree_sitter/array.h	Updated vendored runtime header (strict-aliasing related changes and MSVC pragmas).
src/tree_sitter/parser.h	Updated vendored runtime header for the newer ABI/layout.

Files not reviewed (1)

• pnpm-lock.yaml: Language not supported

Comments suppressed due to low confidence (1)

package.json:31

• This PR removes pnpm-lock.yaml in favor of package-lock.json, but the repo still contains GitHub workflows that run pnpm install --frozen-lockfile (e.g. .github/workflows/publish.yml, .github/workflows/plan-release.yml). Without a pnpm lockfile those workflows will fail. Update the workflows to use npm ci (or keep a pnpm lockfile) so release automation remains functional.

  "scripts": {
    "build": "tree-sitter generate",
    "build:local": "tree-sitter build -o parser/glimmer_javascript.so",
    "install": "node-gyp-build",
    "lint": "eslint common/define-grammar.js",
    "parse": "tree-sitter parse",
    "prebuildify": "prebuildify --napi --strip",
    "test": "tree-sitter test"

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.