Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better to support API invoking when using Serverless LLM #949

Open
samchen8008 opened this issue Feb 15, 2025 · 3 comments
Open

Better to support API invoking when using Serverless LLM #949

samchen8008 opened this issue Feb 15, 2025 · 3 comments
Labels
enhancement New feature or request GitLab linked linked to a GitLab task or issue.

Comments

@samchen8008
Copy link
Contributor

/kind feature

Describe the solution you'd like

  1. Login CSGHub and instantiate one serverless LLM like Deepseek
  2. There is one place in UI where I can see the API can invoke outside of CSGHub

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Links to the design documents or others:

@samchen8008
Copy link
Contributor Author

samchen8008 commented Feb 15, 2025

@KinglyWayne @chhao pls get this feature in next release backlog

@Rader Rader added the enhancement New feature or request label Feb 15, 2025
@jialudev
Copy link
Collaborator

/kind feature

Describe the solution you'd like

  1. Login CSGHub and instantiate one serverless LLM like Deepseek
  2. There is one place in UI where I can see the API can invoke outside of CSGHub

Anything else you would like to add: [Miscellaneous information that will assist in solving the issue.]

Links to the design documents or others:

Thank you for your suggestion. We will discuss and work on implementing this feature as soon as possible.

@jialudev jialudev added the GitLab linked linked to a GitLab task or issue. label Feb 17, 2025
@jialudev
Copy link
Collaborator

gitlab-issue-361

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request GitLab linked linked to a GitLab task or issue.
Projects
None yet
Development

No branches or pull requests

3 participants