output path: output/zeronlg-4langs-mt/evaluations_translate/en-fr
Creating model from output/zeronlg-4langs-mt/
Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
Loading source sentences (en) from data/annotations/flickr30k/en-fr/test.en
Loading target sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_en-fr.json
Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_en-fr.json
[test] [en -> fr] BLEU 22.030413156317323
Loading source sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
Loading target sentences (en) from data/annotations/flickr30k/en-fr/test.en
Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_fr-en.json
Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_fr-en.json
[test] [fr -> en] BLEU 24.59212796600962