Attention Is All You Need
Paper
•
1706.03762
•
Published
•
96
Papers
Collection of useful papers.
-
-
LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 53 -
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Paper • 2101.03961 • Published • 13 -
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Training Verifiers to Solve Math Word Problems
Paper • 2110.14168 • Published • 4 -
RoFormer: Enhanced Transformer with Rotary Position Embedding
Paper • 2104.09864 • Published • 16 -
Sliding Window Attention Training for Efficient Large Language Models
Paper • 2502.18845 • Published • 1 -
Mixtral of Experts
Paper • 2401.04088 • Published • 160 -
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Paper • 2112.06905 • Published • 2 -
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper • 1701.06538 • Published • 7 -
Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models
Paper • 2305.14705 • Published -
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 6 -
Asynchronous Methods for Deep Reinforcement Learning
Paper • 1602.01783 • Published -
Reinforcement Learning from Human Feedback
Paper • 2504.12501 • Published • 4