New LLM provider AWS bedrock - support converse and conversestream

[CsBigDataHub]

Happy new year,

These endpoints are different from openAI completion and openAI Response

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html
https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html

Also see this,
karthink/gptel#1200
https://github.com/karthink/gptel/blob/master/gptel-bedrock.el

They are multiple ways to authenticate, lets start up AWS_BEARER_TOKEN_BEDROCK, low hanging fruit for implementing this.

[ericdallo]

So this would be a new API for what providers? only for bedrock? I wonder if it's worth the complex addition vs what different models we would support that we don't support already

[CsBigDataHub]

The Converse and ConverseStream endpoints are specific to Amazon Bedrock.
Although LiteLLM supports the Bedrock Converse API for various model providers.

https://docs.litellm.ai/docs/bedrock_converse

I don't think this it is complex, we just expose a new provider. Let me create a draft PR, I have few constraints testing it due to my company proxy in front of bedrock access. I will make the PR available for review once I am able to test

[CsBigDataHub]

it is not about supporting new models but the provider, AWS bedrock like other LLM providers allows users to deploy models similar to Openrouter or Azure OpenAI in their infra.

[ericdallo]

Ok, I think it makes sense, but I have no way to test or maintain this feature, would you be willing to maintain it at least for some time?

I will take a look at the PR tomorrow

[CsBigDataHub]

Yes, as soon I can get it working through my company proxy.

[ricardosllm]

Any update on this @ericdallo @CsBigDataHub?

I would be open to test and maintain it too.

[ericdallo]

@ricardosllm I don't think @CsBigDataHub is working on that right now, but we could support a provider for that yes, I'm ok with that, feel free to follow other propviders standard and add support for it
c/c @zikajk

[CsBigDataHub]

#255

I need to sync latest changes. Bit busy right now. Will look in to it when I get time.

BTW, not using AWS bedrock anymore, I am happy to implement it but I need someone to test it.