Personal Assistant Benchmark
š§
Scores a personal assistant by what it did on the device
None defined yet.
Same Output, Different Gold: Measuring How Reference Choice Moves a Multilingual Benchmark Score
SEABED: SouthEast Asian Benchmark for Evaluating Audio Reasoning