Model file formats: GGUF, safetensors, and more.
| Name | Role | Type | Exec | Languages | Score | Cold Start | Memory |
|---|---|---|---|---|---|---|---|
| GGUF GPT-Generated Unified Format for efficient LLM storage | Format | format | aot | Any | — | — | — |
| safetensors Safe and fast tensor serialization format by Hugging Face | Format | format | aot | Any | — | — | — |