output path: output/zeronlg-4langs-mt/evaluations_translate/de-fr
Creating model from output/zeronlg-4langs-mt/
Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
Loading source sentences (de) from data/annotations/flickr30k/de-fr/test.de
Loading target sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
Save translation results to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_de-fr.json
Save scores to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_de-fr.json
[test] [de -> fr] BLEU 16.665641493787597
Loading source sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
Loading target sentences (de) from data/annotations/flickr30k/de-fr/test.de
Save translation results to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_fr-de.json
Save scores to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_fr-de.json
[test] [fr -> de] BLEU 18.47518634776254