4 bits quantized GGUF weight of phi-3-mini-4k-instruct. Mlx compatible.

Official model: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf (not supported by mlx)

Please note that the official phi-3-mini-4k-instruct.gguf model is of llama-2 architecture as stated in the paper (https://huggingface.co/papers/2404.14219)

Downloads last month: 141

GGUF

Model size

3.82B params

Architecture

llama

4-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.