Convert and Quantized of TinyLlama-1.1B-intermediate-step-1431k-3T using llama.cpp

Guide to replicate

Description

This is for my own experiment with Ollama, because Ollama usually put chat fine-tuning in their library. It would be hard to know if my fine-tuning LoRA Adapter works if I don't use base/pretrain model version

Ollama

Model Page https://ollama.com/pacozaa/tinyllama
ollama run pacozaa/tinyllama

Downloads last month: 17

GGUF

Model size

1.1B params

Architecture

llama

4-bit

32-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.