Ran

hf jobs uv run \
    --flavor a10g-large \
    --timeout 2h \
    --with "lighteval[vllm]@git+https://github.com/huggingface/lighteval,emoji" \
    --secrets HF_TOKEN \
    lighteval vllm "model_name=romain-fayoux/smollm3-dpo-aligned" \
    "lighteval|gsm8k|0|0,leaderboard|truthfulqa:mc|0|0,leaderboard|hellaswag|0|0,leaderboard|arc:challenge|0|0" \
    --push-to-hub --results-org romain-fayoux
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment