magicslabnu/GERM-NT-2.5B-multi

Model Card for GERM-NT1

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• Developed by: Haozheng Luo, ChengHao Qiu
• License: MIT

Model Sources

• Repository: https://github.com/MAGICS-LAB/GERM
• Paper: https://arxiv.org/abs/2505.00598

Uses

Direct Use

from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("magicslabnu/GERM-NT-2.5B-multi", trust_remote_code=True)
model = AutoModelForMaskedLM.from_pretrained("magicslabnu/GERM-NT-2.5B-multi", trust_remote_code=True)

Training Details

Training Data

GLUE

BibTeX:

@misc{luo2025fastlowcostgenomicfoundation,
      title={Fast and Low-Cost Genomic Foundation Models via Outlier Removal}, 
      author={Haozheng Luo and Chenghao Qiu and Maojiang Su and Zhihan Zhou and Zoe Mehta and Guo Ye and Jerry Yao-Chieh Hu and Han Liu},
      year={2025},
      eprint={2505.00598},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2505.00598}, 
}