My-StockGPT-Stage1 (LoRA Adapter for ChatGLM2-6B)
中文:本仓库仅发布 LoRA 适配器(非整模型),在 THUDM/chatglm2-6b 上加载使用。
English: This repo provides a LoRA adapter (not a full model) for THUDM/chatglm2-6b.
Quick Start (Colab)
!pip -q install transformers peft sentencepiece accelerate huggingface_hub
from huggingface_hub import snapshot_download
from transformers import AutoTokenizer, AutoModel
from peft import PeftModel
import torch
local_dir = "/content/alphafin_model_data/stage1"
snapshot_download("JamesRU/My-StockGPT-Stage1", local_dir=local_dir, local_dir_use_symlinks=False, resume_download=True)
base_id = "THUDM/chatglm2-6b"
tokenizer = AutoTokenizer.from_pretrained(base_id, trust_remote_code=True)
base = AutoModel.from_pretrained(base_id, trust_remote_code=True)
if torch.cuda.is_available(): base = base.half().cuda()
base.eval()
model = PeftModel.from_pretrained(base, local_dir)
print(model.chat(tokenizer, "请用50字点评今日美股走势,并给一个风险提示。", history=[])[0])
- Downloads last month
- 10
Model tree for JamesRU/My-StockGPT-Stage1
Base model
zai-org/chatglm2-6b