My-StockGPT-Stage1 (LoRA Adapter for ChatGLM2-6B)

中文:本仓库仅发布 LoRA 适配器(非整模型),在 THUDM/chatglm2-6b 上加载使用。
English: This repo provides a LoRA adapter (not a full model) for THUDM/chatglm2-6b.

Quick Start (Colab)

!pip -q install transformers peft sentencepiece accelerate huggingface_hub
from huggingface_hub import snapshot_download
from transformers import AutoTokenizer, AutoModel
from peft import PeftModel
import torch

local_dir = "/content/alphafin_model_data/stage1"
snapshot_download("JamesRU/My-StockGPT-Stage1", local_dir=local_dir, local_dir_use_symlinks=False, resume_download=True)

base_id = "THUDM/chatglm2-6b"
tokenizer = AutoTokenizer.from_pretrained(base_id, trust_remote_code=True)
base = AutoModel.from_pretrained(base_id, trust_remote_code=True)
if torch.cuda.is_available(): base = base.half().cuda()
base.eval()

model = PeftModel.from_pretrained(base, local_dir)
print(model.chat(tokenizer, "请用50字点评今日美股走势,并给一个风险提示。", history=[])[0])
Downloads last month
10
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for JamesRU/My-StockGPT-Stage1

Adapter
(6)
this model