Casalioy/Janus-Pro-1B-q4-Casa_MLX

The Model was converted using the .safetensors model to MLX format from deepseek-ai/Janus-Pro-1B using mlx-lm version 0.21.1.

Use with mlx

Poritng VM capabilities to Apple Silicon pending. Find some guidance here: https://github.com/ml-explore/mlx-examples/blob/main/llms/README.md

from mlx_lm import load, generate

model, tokenizer = load("Casalioy/Janus-Pro-1B-q4-Casa_MLX")

prompt = "What's the meaning of Casalioy Collective?"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Log on Apple M4 Mac Mini 16GB

The Casalioy Collective is a fictional organization or entity that appears in various media, including books, movies, TV shows, and video games.<｜begin▁of▁sentence｜> It's a fictional group of individuals or characters who are part of a larger organization or movement. The name "Casalioy" is a combination of "Casual" and "Collective," which suggests a sense of unity and collective action.

The organization or group is often associated with themes of rebellion, revolution, or social change. It may be a symbol of a specific ideology, a movement, or a movement within a larger movement. The group's purpose or goals are not explicitly stated, but it may be involved in activities such as protests, activism, or advocacy for social or political causes.

In some cases, the Casalioy Collective may be a fictional organization created by a specific author, filmmaker, or creator. In other cases, it may be a real organization or movement that has been inspired by or is inspired by the fictional group.

If you're interested in learning more about the Casalioy Collective, you can explore the following:

* Books and TV shows: Look for books or TV shows that feature the Casalioy
==========
Prompt: 19 tokens, 326.052 tokens-per-sec
Generation: 256 tokens, 97.153 tokens-per-sec
Peak memory: 1.048 GB