How to get scale / delta from quantized file? #863
Unanswered
infiniteloop97
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have created a quantized weights file from float32 .gguf file. I am try to read it using gguf reader but I am unable to find the deltas for the weight tensors? How can I extract that information from the quantized gguf file?
Beta Was this translation helpful? Give feedback.
All reactions