GGUF

About

• A file format for storing models for inference with GGML and executors based on GGML.

Details

• A binary format
• Designed for fast loading and saving of models
• Designed for ease of reading.

Generation

• Converted from PyTorch to GGUF for use in GGML.

See also

• GGML | LLaMa.cpp