ChatGLM2-6B-GGLM
Can be loaded and used by chatglm.cpp
Integrated with langchain framework in CustomLLM form
python chatglm_langchain.py
Prompt: 小明的妈妈有两个孩子，一个叫大明 另外一个叫什么？
小明的妈妈有两个孩子，一个叫大明，另外一个叫小明。
Use under the shell command line
chatglm -m ./models/chatglm2-6b-ggml.q8_0.bin -p 你好
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.