New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Support SmolLM series gguf #56

Closed

2 tasks done

Aisuko opened this issue Aug 18, 2024 · 1 comment · Fixed by #60

Closed

2 tasks done

[Feature]: Support SmolLM series gguf #56

Aisuko opened this issue Aug 18, 2024 · 1 comment · Fixed by #60

Assignees

Milestone

Member

Aisuko commented Aug 18, 2024 •

edited by cbh778899

Loading

Contact Details(optional)

No response

What feature are you requesting?

The model collection see https://huggingface.co/collections/aisuko/smollm-series-gguf-66bd9239399b14b08fedbe6f

Support model inference on CPU
Testing the performance(Concurrent Inference)

Accuracy isn't unnecessary in this task

Aisuko assigned cbh778899

Aisuko added this to the Week6 milestone

cbh778899 linked a pull request

that will close this issue

Merged

1 task

Collaborator

cbh778899 commented Aug 25, 2024

Done

cbh778899 closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment