Sebastian Ruder

ruder's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored a paper 6 months ago

The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs

Paper • 2504.17768 • Published Apr 24 • 14

authored a paper about 1 year ago

M-RewardBench: Evaluating Reward Models in Multilingual Settings

Paper • 2410.15522 • Published Oct 20, 2024 • 12

authored 3 papers over 1 year ago

Aya 23: Open Weight Releases to Further Multilingual Progress

Paper • 2405.15032 • Published May 23, 2024 • 32

An overview of gradient descent optimization algorithms

Paper • 1609.04747 • Published Sep 15, 2016 • 1

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Paper • 2402.06619 • Published Feb 9, 2024 • 56

authored a paper almost 2 years ago

Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning

Paper • 2311.11077 • Published Nov 18, 2023 • 29

authored 2 papers over 2 years ago

AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages

Paper • 2305.06897 • Published May 11, 2023 • 9

PaLM 2 Technical Report

Paper • 2305.10403 • Published May 17, 2023 • 7