metadata
license: other
license_name: modelcloud
license_link: LICENSE
language:
- en
base_model:
- marin-community/marin-32b-base
pipeline_tag: text-generation
tags:
- gptqmodel
- modelcloud
- chat
- marin
- instruct
- int4
- gptq
- 4bit
- w4a16
This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
| Metric | Marin |
|--------------------------------|----------|
| arc_challenge :: acc,none | 0.5725 |
| arc_challenge :: acc_norm,none | 0.6007 |
| mmlu_stem :: acc,none | 0.667 |