Models

open-sci/open-sci-ref-v0.01-1.7b-nemotron-cc-hq-1T-4096

2B • Updated Mar 22 • 2

open-sci/open-sci-1.7b-nemotron-cc-1T-oh-dcft

Feature Extraction • 2B • Updated Mar 22 • 1

open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000-lr0.006-2

0.1B • Updated Sep 26 • 219

open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000

0.1B • Updated Sep 26 • 2

open-sci/open-sci-ref-v0.01-0.13b-commoncorpus-300B-4096

0.1B • Updated Sep 26 • 187

open-sci/open-sci-ref-v0.01-0.13b-dclm-300B-4096-lr0.006-2

0.1B • Updated Sep 26 • 293

open-sci/open-sci-ref-v0.01-0.13b-dclm-300B-4096

0.1B • Updated Sep 26 • 236

open-sci/open-sci-ref-v0.01-0.13b-fineweb-edu-1.4t-300B-4096

0.1B • Updated Sep 26 • 294

open-sci/open-sci-ref-v0.01-0.13b-hplt-2.0-300B-4096

0.1B • Updated Sep 26 • 304

open-sci/open-sci-ref-v0.01-0.13b-nemotron-hq-300B-4096

0.1B • Updated Sep 26 • 256

open-sci/open-sci-ref-v0.01-0.13b-pile-300B-4096

0.1B • Updated Sep 26 • 324

open-sci/open-sci-ref-v0.01-0.13b-slimpajama-300B-4096

0.1B • Updated Sep 26 • 263

open-sci/open-sci-ref-v0.01-0.4b-c4-300B-4096-warmup25000

0.4B • Updated Sep 26 • 114

open-sci/open-sci-ref-v0.01-0.4b-c4-300B-4096-warmup25000-lr0.004-2

0.4B • Updated Sep 26 • 162

open-sci/open-sci-ref-v0.01-0.4b-commoncorpus-300B-4096

0.4B • Updated Sep 26 • 3

open-sci/open-sci-ref-v0.01-0.4b-dclm-300B-4096

0.4B • Updated Sep 26 • 295

open-sci/open-sci-ref-v0.01-0.4b-dclm-300B-4096-lr0.006-2

0.4B • Updated Sep 26 • 260

open-sci/open-sci-ref-v0.01-0.4b-fineweb-edu-1.4t-300B-4096

0.4B • Updated Sep 26 • 3

open-sci/open-sci-ref-v0.01-0.4b-hplt-2.0-300B-4096

0.4B • Updated Sep 26 • 289

open-sci/open-sci-ref-v0.01-0.4b-nemotron-hq-300B-4096

0.4B • Updated Sep 26 • 2

open-sci/open-sci-ref-v0.01-0.4b-pile-300B-4096

0.4B • Updated Sep 26 • 277

open-sci/open-sci-ref-v0.01-0.4b-slimpajama-300B-4096

0.4B • Updated Sep 26 • 290

open-sci/open-sci-ref-v0.01-1.3b-c4-300B-4096-warmup25000

2B • Updated Sep 26 • 1

open-sci/open-sci-ref-v0.01-1.3b-commoncorpus-300B-4096

1B • Updated Sep 26 • 2

open-sci/open-sci-ref-v0.01-1.3b-dclm-300B-4096

1B • Updated Sep 26 • 294

open-sci/open-sci-ref-v0.01-1.3b-fineweb-edu-1.4t-300B-4096

1B • Updated Sep 26 • 320

open-sci/open-sci-ref-v0.01-1.3b-hplt-2.0-300B-4096

1B • Updated Sep 26 • 2

open-sci/open-sci-ref-v0.01-1.3b-nemotron-hq-300B-4096

1B • Updated Sep 26 • 306

open-sci/open-sci-ref-v0.01-1.3b-pile-300B-4096

1B • Updated Sep 26 • 312

open-sci/open-sci-ref-v0.01-1.3b-slimpajama-300B-4096

1B • Updated Sep 26 • 252