Skip to content

Conversation

@pvkadam
Copy link
Contributor

@pvkadam pvkadam commented Nov 26, 2025

Description

Added Baseten plugin for LiveKit Agents, enabling integration with Baseten-hosted AI models. Provides LLM (via OpenAI-compatible API), streaming STT (with WebSocket and VAD), and TTS services for building voice AI applications in TypeScript/Node.js.

Changes Made

  • New Plugin: plugins/baseten/
    • llm.ts - LLM using Baseten's OpenAI-compatible endpoint
    • stt.ts - Streaming STT with WebSocket, VAD, and partial/final transcripts
    • tts.ts - Streaming TTS audio synthesis
    • types.ts - TypeScript interfaces for all options
    • index.ts - Plugin registration and exports
  • Test files, README, and documentation

Pre-Review Checklist

  • Build passes: All builds (lint, typecheck, tests) pass locally
  • AI-generated code reviewed: Removed unnecessary comments and ensured code quality
  • Changes explained: All changes are properly documented and justified above
  • Scope appropriate: All changes relate to the PR title, or explanations provided for why they're included
  • Video demo: A small video demo showing changes works as expected and did not break any existing functionality using Agent Playground (if applicable)

Testing

  • Automated tests added/updated (if applicable)
  • All tests pass
  • Make sure both restaurant_agent.ts and realtime_agent.ts work properly (for major changes)

Additional Notes


Note to reviewers: Please ensure the pre-review checklist is completed before starting your review.

@changeset-bot
Copy link

changeset-bot bot commented Nov 26, 2025

🦋 Changeset detected

Latest commit: 223b9f3

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
Name Type
@livekit/agents-plugin-baseten Patch
@livekit/agents Patch
@livekit/agents-plugin-anam Patch
@livekit/agents-plugin-bey Patch
@livekit/agents-plugin-cartesia Patch
@livekit/agents-plugin-deepgram Patch
@livekit/agents-plugin-elevenlabs Patch
@livekit/agents-plugin-google Patch
@livekit/agents-plugin-inworld Patch
@livekit/agents-plugin-livekit Patch
@livekit/agents-plugin-neuphonic Patch
@livekit/agents-plugin-openai Patch
@livekit/agents-plugin-resemble Patch
@livekit/agents-plugin-rime Patch
@livekit/agents-plugin-silero Patch
@livekit/agents-plugins-test Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@CLAassistant
Copy link

CLAassistant commented Nov 26, 2025

CLA assistant check
All committers have signed the CLA.

@toubatbrian
Copy link
Contributor

Hey @pvkadam, could you record a small demo showcasing the new plugin in agent playground? Thanks!

@pvkadam
Copy link
Contributor Author

pvkadam commented Dec 10, 2025

@toubatbrian Hi Brian, here is the demo video. Lmk if you need anything further!

GMT20251210-055953_Recording_2440x1156.mp4

Copy link
Contributor

@toubatbrian toubatbrian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added some comments related to task abort during interruption

@pvkadam
Copy link
Contributor Author

pvkadam commented Dec 11, 2025

@toubatbrian Addressed the review comments and verified the changes work in the playground.

@pvkadam pvkadam requested a review from toubatbrian December 11, 2025 06:26
Copy link
Contributor

@toubatbrian toubatbrian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG! One last thing: can you add a changeset with a patch bump on baseten plugin?

@toubatbrian toubatbrian merged commit 7708281 into livekit:main Dec 15, 2025
5 checks passed
@github-actions github-actions bot mentioned this pull request Dec 15, 2025
@jebentier
Copy link
Contributor

@toubatbrian Thank you for getting this reviewed and merged, I noticed that the @livekit/agents-plugin-baseten isn't releasing yet. Is there something else that we should do in order to get the package releasing for use?

@toubatbrian
Copy link
Contributor

Hey @jebentier, the issue might be that the package.json is marked as "private": true in the original PR, which causes both npm and Changesets to skip publishing it.

I'm currently on time off and don’t have my laptop with me. Could you help by making a quick PR to remove the private flag? I’ll take care of the remaining CI/CD steps.

Also, please ensure the package.json matches the structure of our other plugins (i.e., includes exports, require, type, etc.) so that module resolution and bundling behave consistently across environments.

Thanks a ton!

@jebentier
Copy link
Contributor

Hey @toubatbrian, thank you for taking time to respond while you're off. Here's the PR you requested. I've gone ahead and standardized the package.json and it's build process to match other packages in the plugins directory. Please let me know if there is anything else I can help with, and enjoy your holiday break.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants