Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoGen Studio: Improve Gallery UX. #5047

Open
joslat opened this issue Jan 14, 2025 · 7 comments · Fixed by #5065
Open

AutoGen Studio: Improve Gallery UX. #5047

joslat opened this issue Jan 14, 2025 · 7 comments · Fixed by #5065
Labels
proj-studio Related to AutoGen Studio.

Comments

@joslat
Copy link

joslat commented Jan 14, 2025

What feature would you like to be added?

Make it easier to import, edit, customize items in a Gallery. Current UX only enables direct JSON editing.


AutoGen Studio: cannot create components/templates: models, agents, tools and teams.

In the previous version it was possible to create custom configured instances that could be reused (templates/components). On the new one I miss those features.

Why is this needed?

To be able to define reusable components. Also ideally there should be a publicly available library of those so that we can share through export and import them and enhance our experience greatly.

@LeonG7
Copy link

LeonG7 commented Jan 15, 2025

I got a same problem

@victordibia
Copy link
Collaborator

victordibia commented Jan 15, 2025

Thanks for the feedback.
The new design focuses on the team/workflow as the high level component.
It also supports re-use via the Gallery.

You can create a new gallery (import from a URL or paste it in), modify it to add teams, tools, models, termination conditions etc.
You can have multiple gallery items and set a default Gallery (items from the default Gallery show up in the build view). You set the default Gallery by clicking on the pin icon next to that gallery on hover

@joslat , @LeonG7 any chance you have tried the Gallery?
I agree that we could improve the UX here

Image

@LeonG7
Copy link

LeonG7 commented Jan 15, 2025

Thanks for the feedback.  感谢您的反馈。 The new design focuses on the team/workflow as the high level component.新设计将团队/工作流作为高级组件。 It also supports re-use via the Gallery.它还支持通过 Gallery 重复使用。

You can create a new gallery (import from a URL or paste it in), modify it to add teams, tools, models, termination conditions etc.您可以创建一个新的画廊(从 URL 导入或粘贴),对其进行修改以添加团队、工具、模型、终止条件等。 You can have multiple gallery items and set a default Gallery (items from the default Gallery show up in the build view). You set the default Gallery by clicking on the pin icon next to that gallery on hover您可以拥有多个库项并设置默认库默认库中的项显示在构建视图中)。您可以通过在悬停时单击该图库旁边的图钉图标来设置默认图库

@joslat , @LeonG7 any chance you have tried the Gallery?,您有机会尝试过 Gallery 吗? I agree that we could improve the UX here我同意我们可以在这里改进用户体验

Image

Does this mean that each gallery has its own configuration of models, agents, tools, terminations?
btw, Is gemini or any local model currently supported?

@rysweet rysweet added proj-studio Related to AutoGen Studio. and removed needs-triage labels Jan 15, 2025
@victordibia
Copy link
Collaborator

victordibia commented Jan 15, 2025

Does this mean that each gallery has its own configuration of models, agents, tools, terminations?

Yes, a Gallery is a collection of components.
The good thing about this is that you can import, download them, reuse and share them.
@joslat

btw, Is gemini or any local model currently supported?

Yes. Any model that has an OpenAI compliant API can be used . Gemini has an openai client. Please see the documentation here https://microsoft.github.io/autogen/dev/user-guide/autogenstudio-user-guide/faq.html#q-can-i-use-other-models-with-autogen-studio

You will need to update the model_client fields base_url, model, api_key, and model_capabilities


{
  "model": "gemini-1.5-flash",
  "model_type": "OpenAIChatCompletionClient",
  "base_url": "https://generativelanguage.googleapis.com/v1beta/openai/",
  "api_key": "GEMINI_API_KEY",
  "api_version": "1.0",
  "component_type": "model",
  "model_capabilities": {
    "vision": false,
    "function_calling": true,
    "json_output": false
  }
} 

@joslat
Copy link
Author

joslat commented Jan 15, 2025

I tried but no option to edit the components or add new ones, only way is to edit the code/Json directly right at the moment, or am I wrong?

@victordibia
Copy link
Collaborator

Yes.
We can rename this issue to focus on improving the UX for editing/updating Gallery.

@joslat
Copy link
Author

joslat commented Jan 15, 2025

I think that would make a lot of sense, @victordibia 💯
How about enabling importing and exporting those components too? Maybe through a central repository of "curated" components reviewed by the team to which everybody can contribute - this would grow very quickly and make AutoGen Studio very exciting as a "creativity space" to bring agents to life along agentic workflows ready to use...

@victordibia victordibia changed the title AutoGen Studio: cannot create components/templates: models, agents, tools and teams. AutoGen Studio: Improve Gallery UX. Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
proj-studio Related to AutoGen Studio.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants