YAML Metadata Error:Invalid content in Eval Result file .eval_results/LFM3-1.7B.yaml

Check out the documentation for more information.

Show details
Task ID "hle" does not match any task in dataset "cais/hle". Available: none
LFM3-1.7B / .eval_results /LFM3-1.7B.yaml
mlabonne's picture SaylorTwift's picture
SaylorTwift HF Staff
Add evaluation results (#6)
ac2586a
Raw History Blame Contribute Delete
1.55 kB
- dataset:
id: harborframework/terminal-bench-2.1
task_id: terminalbench_2_1
value: 12.92
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
notes: "OpenCode agent, up to 100 turns."
- dataset:
id: SWE-bench/SWE-bench_Verified
task_id: swe_bench_%_resolved
value: 43.4
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
notes: "OpenCode agent, up to 250 turns."
- dataset:
id: SWE-bench/SWE-bench_Multilingual
task_id: swe_bench_multilingual_%_resolved
value: 23.0
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
notes: "OpenCode agent, up to 250 turns."
- dataset:
id: claw-eval/Claw-Eval
task_id: general
value: 51.4
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
- dataset:
id: Idavidrein/gpqa
task_id: diamond
value: 63.37
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
- dataset:
id: cais/hle
task_id: hle
value: 7.17
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"
notes: "No tools."
- dataset:
id: LiquidAI/ifstruct-v1.0
task_id: ifstruct_v1
value: 93.72
date: "2026-10-27"
source:
url: https://huggingface.co/LiquidAI/LFM3-1.7B
name: "LFM3-1.7B model card"