# open-sensations: Gemma results

Root adapter selected using validation only, before test evaluation. F1 is not accuracy.

| Arm | Validation micro F1 | Validation macro F1 | Test micro F1 | Test macro F1 | Threshold |
| --- | ---: | ---: | ---: | ---: | ---: |
| baseline | 0.7360 | 0.6793 | 0.8088 | 0.7197 | 0.50 |
| real-only | 0.7229 | 0.6766 | 0.7674 | 0.7257 | 0.40 |
| synthetic | 0.7317 | 0.6967 | 0.7821 | 0.7556 | 0.30 |

Selected: **synthetic**. Synthetic accepted: **True**.

## RoBERTa reference on the same held-out data

Micro F1: 0.5772; macro F1: 0.5530.
Different tokenizer/model size/precision/training budgets: practical comparison, not architecture-only ablation. These test results did not select an arm.

| Selected label | Precision | Recall | F1 | Support |
| --- | ---: | ---: | ---: | ---: |
| vision | 0.7917 | 1.0000 | 0.8837 | 38 |
| hearing | 0.3750 | 0.8571 | 0.5217 | 7 |
| smell | 1.0000 | 1.0000 | 1.0000 | 6 |
| taste | 1.0000 | 1.0000 | 1.0000 | 6 |
| touch | 0.5500 | 0.8462 | 0.6667 | 13 |
| interoception | 0.3333 | 0.7500 | 0.4615 | 4 |

Full experiment: 18.05 minutes. Peak PyTorch allocated GPU memory: 9.69 GiB; reserved: 9.90 GiB. These are not total process/system memory.

| Arm | Epoch | Mean training loss | Validation micro F1 | Validation macro F1 |
| --- | ---: | ---: | ---: | ---: |
| baseline | 1 | 0.79388 | 0.4956 | 0.2977 |
| baseline | 2 | 0.58331 | 0.5686 | 0.4946 |
| baseline | 3 | 0.50667 | 0.6914 | 0.6260 |
| baseline | 4 | 0.49347 | 0.7360 | 0.6793 |
| baseline | 5 | 0.48771 | 0.6818 | 0.6417 |
| baseline | 6 | 0.48051 | 0.6966 | 0.6637 |
| baseline | 7 | 0.47659 | 0.7006 | 0.6685 |
| baseline | 8 | 0.47428 | 0.7812 | 0.6731 |
| baseline | 9 | 0.47279 | 0.7383 | 0.6537 |
| baseline | 10 | 0.47260 | 0.6854 | 0.6438 |
| real-only | 1 | 0.49174 | 0.7229 | 0.6766 |
| synthetic | 1 | 0.44660 | 0.7317 | 0.6967 |