Paul Teiletche

• Here is (finally) the repo: https://github.com/illuin-tech/modernvbert
• We are working on the ONNX format, hopefully this week!

I should definitely have a look, I am not familiar with ONNX export! Have you tried?
(edit) I guess we should push the merged version first, it is on the roadmap let me tell you went it is done

Yes fully open source: models, datasets and codebase soon. The codebase will mostly contain the training configs. The trainers are already available as built on open-source projects:

• Modality alignment: fork from the m4 trainer
• Contrastive training: the colpali repo
• Evals: fork from mteb

Thanks! Unfortunately not for the moment, but let's see if someone can build one soon!