How can I restore and merge multiple safetensors files into one file for use?

#3
by joepepperszhl74 - opened

Thank you for your contribution and sharing. I saw that you uploaded multiple safetensors subpackages. How can I merge them? Are there any related tutorials or tools?
111.png

from transformers import AutoModel

model = AutoModel.from_pretrained("your-model-name")
model.save_pretrained(save_directory="./my_model", max_shard_size="10GB" )

Sign up or log in to comment