[Feature Request]: LLM modularity & flexibility

[konabuta]

Scenario

Currently, Teams AI Library supports only Azure OpenAI, OpenAI, and Llama models. To enhance the modularity of our LLMs (as noted in the README.md), please consider adding flexibility in selecting which LLMs to use. We would like to use language specific LLMs with Teams AI Library.

Solution

For instance, it would be beneficial to support deployed models from the model catalog for Azure AI users and general APIs backed by vLLM for open-source users.

Additional Context

No response

[Prasad-MSFT]

@konabuta, thank you for your suggestion! To better achieve your requirements, we recommend submitting this feature request through the Teams Feedback Portal. This is the best way to ensure your idea is considered for future updates.