Keyurjotaniya007's picture
Update README.md
00d72d5 verified
metadata
license: apache-2.0
datasets:
  - Helsinki-NLP/opus_books
language:
  - en
  - fr
metrics:
  - bleu
base_model:
  - Helsinki-NLP/opus-mt-fr-en
pipeline_tag: translation
tags:
  - generatedtext

Translation

This model is a fine-tuned version of Helsinki-NLP/opus-mt-en-fr on a opus books dataset. It achieves the following results on the evaluation set:

• Eval loss: 1.4366134405136108

• Eval bleu: 30.425091146533532

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-5

• train_batch_size: 16

• eval_batch_size: 32

• gradient_accumulation_steps=2

• seed: 42

• weight_decay=0.01

• lr_scheduler_type: linear

• warmup_ratio=0.1

• num_epochs: 4

• predict_with_generate: True

• fp16: True