不同型号的GPU能否运行qwen72b-int4

#11

by XCZDH - opened Mar 18, 2024

XCZDH

Mar 18, 2024

1张RTX5000ADA 32G+1张V100 32G能否运行该模型，如果能运行的话，速度会如何，毕竟RTX5000ADA比V100要快的多

Qwen org Apr 18, 2024

Unfortunately, not supported.

jklj077 changed discussion status to closed Apr 18, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment