Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gemini Model Client in autogen-ext #3741

Open
ekzhu opened this issue Oct 10, 2024 · 3 comments
Open

Gemini Model Client in autogen-ext #3741

ekzhu opened this issue Oct 10, 2024 · 3 comments
Assignees
Milestone

Comments

@ekzhu
Copy link
Collaborator

ekzhu commented Oct 10, 2024

What feature would you like to be added?

Model client for Gemini mirroring the one in v0.2

Why is this needed?

Gemini is a notable provider

@rohanthacker
Copy link
Contributor

If possible, I can i work on this task.
As am in the process of implementing of the Azure Inference API as a ChatCompletionClient, but I believe this client requires some discussion and a little more though into how it is implement due to the large overlap with the OpenAIChatCompletionClient (Check #3902 for more info)

@ekzhu
Copy link
Collaborator Author

ekzhu commented Oct 25, 2024

@rohanthacker thanks I just assigned! Would be great if you can follow up with us about your plan.

@rohanthacker
Copy link
Contributor

rohanthacker commented Oct 31, 2024

@ekzhu My apologies for the delayed response. The plan I've thought of is as follows:

  1. First Implement the Gemini Client with google-generativeai package along with tests
    • This is so that I can get more familiar with the ChatCompletionsClient protocol and other aspects of the 0.4 APIs
  2. Introduce Vertex-AI support to the Gemini Client with the google-cloud-aiplatform package
  3. Once the above two are discussed and merged, I'll move on to Add the ability to use models deployed on Azure AI Studio #3902

At the moment I'm almost done with the Gemini client and will be opening a draft PR soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants