README.md

metadata

library_name: peft
base_model: THUDM/chatglm2-6b
pipeline_tag: text-generation
tags:
  - chatglm2
  - lora
  - peft
  - chinese
  - finance

My-StockGPT-Stage1 (LoRA Adapter for ChatGLM2-6B)

中文：本仓库仅发布 LoRA 适配器（非整模型），在 THUDM/chatglm2-6b 上加载使用。
English: This repo provides a LoRA adapter (not a full model) for THUDM/chatglm2-6b.

Quick Start (Colab)

!pip -q install transformers peft sentencepiece accelerate huggingface_hub
from huggingface_hub import snapshot_download
from transformers import AutoTokenizer, AutoModel
from peft import PeftModel
import torch

local_dir = "/content/alphafin_model_data/stage1"
snapshot_download("JamesRU/My-StockGPT-Stage1", local_dir=local_dir, local_dir_use_symlinks=False, resume_download=True)

base_id = "THUDM/chatglm2-6b"
tokenizer = AutoTokenizer.from_pretrained(base_id, trust_remote_code=True)
base = AutoModel.from_pretrained(base_id, trust_remote_code=True)
if torch.cuda.is_available(): base = base.half().cuda()
base.eval()

model = PeftModel.from_pretrained(base, local_dir)
print(model.chat(tokenizer, "请用50字点评今日美股走势，并给一个风险提示。", history=[])[0])