Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TencentARC
/
IBQ-Tokenizer-16384
like
1
Follow
ARC Lab, Tencent PCG
758
English
Autoregressive
Tokenizer
arxiv:
2412.02692
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
IBQ-Tokenizer-16384
888 MB
2 contributors
History:
4 commits
shifengyuan
Create config.json
ef22009
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
675 Bytes
Update README.md
11 months ago
config.json
Safe
35 Bytes
Create config.json
10 months ago
imagenet256_16384.ckpt
Safe
pickle
Detected Pickle imports (4)
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"torch.IntStorage"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
888 MB
xet
Upload imagenet256_16384.ckpt
11 months ago