Code-first agent build integration and the initial version of the TS agent templates #307

vigoo · 2025-07-30T17:49:22Z

Work in progress

Resolves golemcloud/golem#1831
Resolves golemcloud/golem#1840

A couple of things are not good enough for a final release, but I would deal with them separately from this PR:

Replaced the default TS template group to be the agent one, because the CLI only supports the one named default at the moment (even though it is prepared to support multiple template groups per language). So the only TS template available now is the new one.
There is a very hacky hardcoded check in the linker mock that prevents overriding some WASI resources with mocks (pollable and input-stream and output-stream). I could not figure out how to do it properly and my guess is that it will have to be done in the wasmtime fork because some things are not exposed. Also I noticed that wasmtime itself has a very similar function to mock unavailable imports but that does not work either (for multiple reasons, there is also an open ticket about it in wasmtime).
The TS agent component is "witless" but many things in golem-cli depends on resolved WIT packages. So the PR adds support for pointing to a WASM (in this case, the precompiled golem_agent.wasm as the source wit and with that things are working - more or less. The transformation from the "source wit" to the "generated wit dir" is turned off in this case and this definitely breaks all the dependency related golem-cli features. This will have to be solved, at least partially, to be able to link with the golem-ai components, but can be done separately.
No effort have been made to have "up-to-date checks" for the new special build steps

Testable with

golem app new 
-> give a name
-> select ts
-> give a package name like `my:agent`
golem app ts-npm-install
golem app build

Requires a new published version of the agent SDK (golemcloud/golem-agentic#12) to finish testing the wrapping steps because right now it fails on the agent type extraction due to the wrong golem:rpc version used in the last published SDK package.

...s/templates/ts/ts-agent-app-component-default/components-ts/component-name/rollup.config.mjs

golem-templates/templates/ts/ts-app-common/common-ts/golem.yaml

afsalthaj · 2025-07-30T23:15:38Z

After I change ts-user to use rollup (instead of tsup) let's have a quick catchup to align a few things

vigoo · 2025-08-01T15:39:28Z

Makefile.toml

 args = ["--interfaces", "127.0.0.1", "--port", "41357", "schema.golem.cloud"]
+
+## Agent template management
+[tasks.rebuild-ts-agent-template]


This is a manual step on purpose. We will run it whenever we want to update the "base wasm" for agents, and the compiled WASM itself is part of the template. There is no need to do this on every build.

vigoo · 2025-08-01T15:40:12Z

golem-cli/src/app/build/componentize.rs

-    Ok(result)
-}
-
-fn jco_async_export_args(


Removed support for componentize.js/jco completely, as wasm-rquickjs seems to work well

vigoo · 2025-08-01T15:40:45Z

golem-cli/src/model/agent/extraction.rs

                ComponentItem::Type(_) => {}
                ComponentItem::Resource(_resource) => {
-                    resources.entry((name, inner_name)).or_default();
+                    if &inner_name != "pollable"


The horrible hack mentioned in the PR description

vigoo · 2025-08-01T15:43:07Z

golem-templates/templates/ts/ts-agent-app-common/common-ts/rollup.config.component.mjs

+
+    const externalPackages = (id) => {
+        return (
+            id === "@afsalthaj/golem-ts-sdk" ||


TODO: replace with @golemcloud when published

published to golemcloud now.

@golemcloud/golem-ts-sdk@0.0.1-dev.3

Versions may keep getting updated, but ts-user is also updated with dev.3, the import statements changed after changing to golemcloud

vigoo · 2025-08-01T15:44:05Z

...ates/templates/ts/ts-agent-app-component-default/components-ts/component-name/.agent/main.ts

@@ -0,0 +1,15 @@
+import '../.metadata/metadata.index';


This file was generated build-time in Afsal's prototype but there is no need to do so, so I've just "hid it" in a different directory than src but it is just part of the template.

I didn't get you.

Why is generated file (the output of npm run build) part of the template even under hidden files?

npm run build for user code builds a ts under .generated folder in prototype and then it gets build to dist/index.mjs

If these are not used, then it won't work.

There is no npm run build just golem app build. Nothing was dynamic in that generated file, so it is no longer generated just part of the template.

vigoo · 2025-08-01T15:45:58Z

golem-templates/templates/ts/ts-agent-app-common/common-ts/golem.yaml

+
+templates:
+  ts:
+    build:


This is the TS agent build flow.

two calls to npx, first generated the type info, the second runs rollup to generate the bundled main.js

then we inject the main.js into pre-compiled golem_agent.wasm

then generate the static agent wrapper (this first extracts the agent types by instantiating the component and this is where we currently fail because of the old package version)

then compose with the generated wrapper to get the final component

noise64 · 2025-08-04T18:25:03Z

golem-cli --config-dir /tmp/.tmpDrVKuM app new test-app-name c go typescript rust
Assertion failed at golem-cli/tests/app/mod.rs:89:5:
assert!( outputs.success() )
with expansion:
false

status: exit status: 1
stdout: Selected profile: local
stdout: Created application directory: test-app-name
stdout: error: Template ts not found!

vigoo added 4 commits July 30, 2025 14:16

Custom build steps for agent wrapping

924e187

Updated to the latest wasm-rquickjs

33fe3da

Initial version of the prebuilt golem-agent WASM and the new templates

8fdb6a7

Merge branch 'main' into ts-agent-template

3883e65

afsalthaj reviewed Jul 30, 2025

View reviewed changes

...s/templates/ts/ts-agent-app-component-default/components-ts/component-name/rollup.config.mjs Outdated Show resolved Hide resolved

afsalthaj reviewed Jul 30, 2025

View reviewed changes

golem-templates/templates/ts/ts-app-common/common-ts/golem.yaml Outdated Show resolved Hide resolved

Make the agent template work

07feffc

vigoo commented Aug 1, 2025

View reviewed changes

vigoo added 2 commits August 3, 2025 07:23

Updated golem_agent.wasm

71f4873

Fixes

c426e31

vigoo marked this pull request as ready for review August 4, 2025 15:10

noise64 approved these changes Aug 4, 2025

View reviewed changes

afsalthaj approved these changes Aug 4, 2025

View reviewed changes

vigoo and others added 4 commits August 4, 2025 17:46

Renamed template directories to fix app new issue

ef6af38

Test fix

8305680

Fix

0716235

fix ts template filter

0c7231e

afsalthaj approved these changes Aug 5, 2025

View reviewed changes

noise64 added 2 commits August 5, 2025 11:27

synchronize js and ts package.json

28766c2

fix moonbit pkg name case

f9ada47

vigoo merged commit 62f3644 into main Aug 5, 2025
4 checks passed

vigoo deleted the ts-agent-template branch August 5, 2025 14:56

Code-first agent build integration and the initial version of the TS agent templates #307

Code-first agent build integration and the initial version of the TS agent templates #307

Uh oh!

Conversation

vigoo commented Jul 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

afsalthaj commented Jul 30, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

afsalthaj Aug 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

afsalthaj Aug 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

noise64 commented Aug 4, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

vigoo commented Jul 30, 2025 •

edited

Loading

afsalthaj Aug 3, 2025 •

edited

Loading

afsalthaj Aug 3, 2025 •

edited

Loading