Skip to content

feat(inception): add Inception Mercury 2 LLM plugin#5653

Open
joycech333 wants to merge 1 commit intolivekit:mainfrom
joycech333:feat/inception-llm-plugin
Open

feat(inception): add Inception Mercury 2 LLM plugin#5653
joycech333 wants to merge 1 commit intolivekit:mainfrom
joycech333:feat/inception-llm-plugin

Conversation

@joycech333
Copy link
Copy Markdown

@joycech333 joycech333 commented May 5, 2026

Adds livekit-plugins-inception with support for Inception's Mercury 2, a low latency diffusion reasoning model.

  • Extends the OpenAI-compatible base
  • reasoning_effort: controls depth of reasoning ("instant", "low", "medium", "high"); "instant" is Inception-specific
  • realtime: reduces wait time for first diffusion block (TTFT)

Example

from livekit.plugins.inception import LLM                                                                                                                                         
                                                                                                                                                                                  
agent = Agent(                                                                                                                                                                    
    llm=LLM(                                                                                                                                                                      
        model="mercury-2",                                                                                                                                                        
        reasoning_effort="low",                                                                                                                                                   
        realtime=True,                                                                                                                                                            
    ),                                                                                                                                                                            
    # ...                                                                                                                                                                         
)

Reads INCEPTION_API_KEY from env, or pass api_key= explicitly.

@CLAassistant
Copy link
Copy Markdown

CLAassistant commented May 5, 2026

CLA assistant check
All committers have signed the CLA.

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 2 additional findings.

Open in Devin Review

devin-ai-integration[bot]

This comment was marked as resolved.

@joycech333 joycech333 force-pushed the feat/inception-llm-plugin branch 2 times, most recently from 1d83764 to b2531fa Compare May 5, 2026 23:13
@joycech333 joycech333 force-pushed the feat/inception-llm-plugin branch from b2531fa to 8752e44 Compare May 5, 2026 23:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants