Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] 模型通过什么什么服务商来访问应该可以自定义,而不是固定 #5407

Open
Ubivision opened this issue Sep 12, 2024 · 5 comments
Labels
bug Something isn't working

Comments

@Ubivision
Copy link

📦 部署方式

官方安装包

📌 软件版本

2.15.1

💻 系统环境

Windows, macOS

📌 系统版本

Sonama 14.5

🌐 浏览器

Chrome, Safari

📌 浏览器版本

safari17.5

🐛 问题描述

当自定义模型名称和已存在模型名称重复时,会强制使用模型列表中对应模型的 api 格式。比如我有自己的 oneapi 可以调用 cladue,但会被强制使用anthropic 的 api,导致 cladue 所有模型我都无法使用。

📷 复现步骤

No response

🚦 期望结果

模型可以自定义选择使用不同的模型服务商

📝 补充信息

No response

@Ubivision Ubivision added the bug Something isn't working label Sep 12, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Bug] The service provider through which the model is accessed should be customizable rather than fixed.

📦 Deployment method

Official installation package

📌 Software version

2.15.1

💻 System environment

Windows, macOS

📌 System version

Sonama 14.5

🌐 Browser

Chrome, Safari

📌 Browser version

safari17.5

🐛 Problem description

When the name of a custom model overlaps with an existing model name, the api format of the corresponding model in the model list will be forced to be used. For example, I have my own oneapi that can call cladue, but it will be forced to use anthropopic's api, resulting in that I cannot use all models of cladue.

📷 Steps to reproduce

No response

🚦 Expected results

Models can be customized and choose to use different model service providers

📝 Supplementary information

No response

@Kosette
Copy link
Contributor

Kosette commented Sep 12, 2024

如果想要通过 OpenAI 兼容的api调用模型,自定义模型名称应该为 <modelName>@OpenAI,比如claude-3-5-sonnet@OpenAI,同理如果调用claude兼容的api接口,则使用 <modelName>@Anthropic。详情参考置顶issue #5001

在使用对应的自定义模型前,需设置好相关的API_URL。

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


If you want to call the model through the OpenAI compatible API, the custom model name should be <modelName>@OpenAI, such as claude-3-5-sonnet@OpenAI. Similarly, if you call the claude compatible API interface, use <modelName>@Anthropic.

Before using the corresponding custom model, the relevant API_URL needs to be set.

@skymkmk
Copy link
Contributor

skymkmk commented Sep 15, 2024

请仔细阅读 #5001

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Please read #5001 carefully

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants