Discussions

• 1 You must be logged in to vote

  🙏

  How to use ggml_mul_mat?

  Ucag asked Oct 30, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I try to use ggml matmul together with pytorch. But I fail to use pytorch cudagraph to capture the matmul

  Eutenacity asked Oct 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Is there an easy way to port any PyTorch model into GGML?

  Connor56 started Sep 30, 2024 in General

  

  

  1
• 5 You must be logged in to vote

  💬

  When would you use ggml vs llama.cpp?

  lefnire started May 10, 2023 in General

  

  

  

  

  2
• 7 You must be logged in to vote

  🙌

  Huggingface GGUF Editor

  CISC started Sep 1, 2024 in Show and tell

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  low performance of a simple ggml_mul_mat between GGML_TYPE_F16 and GGML_TYPE_Q4_0

  Eutenacity asked Sep 19, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can it be generated into a computational graph, and the corresponding data can be loaded when the node is traversed during the calculation?

  coolling asked Sep 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  a dumb question about safety

  teathinker started Sep 8, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  ggml_init() return nullptr error

  walker-ai asked Sep 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  View with dynamic parameters

  matscalia asked Sep 3, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to implement this chunk op using ggml_view

  bssrdf asked Aug 20, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Should permutation by updating ne/nb in-place work?

  awgr asked Aug 2, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  C99 inference / training version?

  robrohan asked Aug 3, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Need help with training a simple network

  Alkamist started Jul 19, 2024 in General

  

  

  3
• 1 You must be logged in to vote

  🙏

  Printing Compute Graph to Validate Dependencies of Operations

  mjkpolo asked Jul 11, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  what is the purpose of ggml_half2 dm in quantization structure?

  PenutChen asked Jul 10, 2024 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Resources for porting models from other frameworks

  danemadsen asked Jul 2, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Using ggml as a dependency, how can I prevent ggml.dll from getting generated on Windows builds?

  balisujohn started Jul 4, 2024 in General · Closed

  

  

  8
• 1 You must be logged in to vote

  🙏

  Support for compute graph rewrite

  marty1885 asked Jun 28, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to get scale / delta from quantized file?

  infiniteloop97 asked Jun 17, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Intended functionality of gguf_init_from_buffer

  gartia started Jun 6, 2024 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  What is the best way to support 5d tensor (or even higher dimension)?

  randxie asked Jun 1, 2024 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Is it expected to work under Parallels Desktop?

  tleyden asked Jun 2, 2024 in Q&A · Unanswered

  

  

  0
• 6 You must be logged in to vote

  💬

  A simple example of using ggml-backend and ggml-alloc

  FSSRepo started Oct 9, 2023 in General

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  [Low Priority] Wonder why tensor scheme in gguf is an enum rather than a randomly selected 64bit (or a UUID)

  mofosyne asked May 20, 2024 in Q&A · Unanswered

  

  

  2