openai_summarize_tldr_sft-dpo / special_tokens_map.json
quyanh's picture
Tokenizer - DPO LoRA checkpoint - step 100 (eval_loss: 0.6903)
e77ca98 verified
raw
history blame contribute delete
131 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}