Expand description
Varbuilder for Loading gguf files
VarBuilder is a utility to store quantized tensors from a GGUF model file.
These tensors can be loaded from disk using from_gguf or from an in-memory
buffer using from_gguf_buffer.
Varbuilder for Loading gguf files
VarBuilder is a utility to store quantized tensors from a GGUF model file.
These tensors can be loaded from disk using from_gguf or from an in-memory
buffer using from_gguf_buffer.