Skip to content

Issues: ggerganov/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 5
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

294 Open 4,114 Closed
294 Open 4,114 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Feature Request: when llama.cpp can support convert qwen2.5 VL 7B/72B model to gguf? enhancement New feature or request
#11541 opened Jan 31, 2025 by sooit
4 tasks done
Misc. bug: llama-server ignores the stop parameter bug-unconfirmed
#11538 opened Jan 31, 2025 by matteoserva
@ochafik
1
core dumped on riscv
#11537 opened Jan 31, 2025 by Naveen7217
6
Feature Request: Prefix assistant answer enhancement New feature or request
#11536 opened Jan 31, 2025 by 99991
4 tasks done
Feature Request: MoE only load activated expert(s) to GPU while rest non-used experts are not loaded (to CPU/GPU) for DeekSeek-R1 Inference on consumer GPU enhancement New feature or request
#11532 opened Jan 30, 2025 by marvin-0042
4 tasks done
1
Feature Request: add --no-warmup to llama-qwen2vl-cli enhancement New feature or request
#11526 opened Jan 30, 2025 by fidecastro
4 tasks done
Virus detected in the release b4595 (llama-b4595-bin-win-cuda-cu12.4-x64.zip)
#11523 opened Jan 30, 2025 by manish-ahuja
2
Move gguf fuzzers to the llama.cpp repository enhancement New feature or request testing Everything test related
#11514 opened Jan 30, 2025 by slaren
2
Eval bug: -sm row performance on NVidia multy-gpu config is extremely low on the long contexts after b3990 bug-unconfirmed
#11510 opened Jan 30, 2025 by m-arbaro
1
Misc. bug: AMD Rcom command error only with cli tools bug-unconfirmed
#11509 opened Jan 30, 2025 by pcfreak30
13
Eval bug: Crash while loading Deepseek R1 in CUDA multi-node RPC setup. bug-unconfirmed
#11508 opened Jan 30, 2025 by ortegaalfredo
7
Feature Request: mixed ROCm+CUDA possible? enhancement New feature or request
#11506 opened Jan 30, 2025 by yshui
4 tasks done
9
Compile bug: Using the latest llama.cpp code in github, having trouble compiling with rocm-6.3.0 release. bug-unconfirmed
#11498 opened Jan 29, 2025 by rlee3030
Misc. bug: Converting sftensor model bug-unconfirmed
#11497 opened Jan 29, 2025 by DarkSorrow
Misc. bug: Vulkan is not optional at runtime bug-unconfirmed
#11493 opened Jan 29, 2025 by daym
Refactor: separation of llama.cpp from ggml. I.e. to build system packages for llama.cpp whisper.cpp stablediffusion.cpp and ggml
#11491 opened Jan 29, 2025 by haschka
1
Feature Request: Support for Deepseek Janus-Pro-7B & Janus-1.3B enhancement New feature or request
#11490 opened Jan 29, 2025 by YorkieDev
4 tasks done
Failed to try to quantize the model under Android termux proot
#11488 opened Jan 29, 2025 by mgxhhg
Feature Request: Qwen 2.5 VL enhancement New feature or request
#11483 opened Jan 29, 2025 by bold84
4 tasks done
3
The last working build of llama.cpp for Windows10 21H2 is 4179 bug-unconfirmed
#11479 opened Jan 29, 2025 by multimediaconverter
4
Compile bug: Why is my build keep on failing at the first step? bug-unconfirmed
#11478 opened Jan 29, 2025 by arunman1kandan
Eval bug: model is failing an assert error bug-unconfirmed
#11476 opened Jan 29, 2025 by ad-astra-video
Research: Benchmarking DeepSeek-R1 IQ1_S 1.58bit research 🔬
#11474 opened Jan 28, 2025 by loretoparisi
1 of 5 tasks
26
Feature Request: YuE (music gen) enhancement New feature or request
#11467 opened Jan 28, 2025 by henk717
4 tasks done
2
Misc. bug: I'm seeing gibberish output bug-unconfirmed
#11463 opened Jan 28, 2025 by drkameleon
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.