Hugging Face's logo

mrzaizai2k
/
my_fine_tuned_t5_small_model

Summarization
Transformers
TensorBoard
Safetensors
Vietnamese
mt5
text2text-generation
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Bảo Mai Chí commited on
Commit
43d3837
·
verified ·
1 Parent(s): b42a365

Model save

Browse files
Files changed (8) hide show
  1. README.md +23 -4
  2. generation_config.json +0 -1
  3. model.safetensors +1 -1
  4. runs/Jun09_18-27-42_DESKTOP-H2CRQMR/events.out.tfevents.1717932463.DESKTOP-H2CRQMR.655616.0 +3 -0
  5. runs/Jun09_18-29-20_DESKTOP-H2CRQMR/events.out.tfevents.1717932560.DESKTOP-H2CRQMR.655616.1 +3 -0
  6. runs/Jun09_18-30-46_DESKTOP-H2CRQMR/events.out.tfevents.1717932647.DESKTOP-H2CRQMR.656333.0 +3 -0
  7. runs/Jun09_18-31-55_DESKTOP-H2CRQMR/events.out.tfevents.1717932716.DESKTOP-H2CRQMR.656333.1 +3 -0
  8. training_args.bin +2 -2
README.md CHANGED
@@ -3,6 +3,8 @@ license: apache-2.0
3
  base_model: huggingface-course/mt5-finetuned-amazon-en-es
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: my_fine_tuned_t5_small_model
8
  results: []
@@ -14,6 +16,12 @@ should probably proofread and complete it, then remove this comment. -->
14
  # my_fine_tuned_t5_small_model
15
 
16
  This model is a fine-tuned version of [huggingface-course/mt5-finetuned-amazon-en-es](https://huggingface.co/huggingface-course/mt5-finetuned-amazon-en-es) on the None dataset.
 
 
 
 
 
 
17
 
18
  ## Model description
19
 
@@ -32,18 +40,29 @@ More information needed
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
- - learning_rate: 5.6e-05
36
- - train_batch_size: 16
37
- - eval_batch_size: 16
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - lr_scheduler_warmup_steps: 3000
42
  - num_epochs: 10
43
- - mixed_precision_training: Native AMP
44
 
45
  ### Training results
46
 
 
 
 
 
 
 
 
 
 
 
 
 
47
 
48
 
49
  ### Framework versions
 
3
  base_model: huggingface-course/mt5-finetuned-amazon-en-es
4
  tags:
5
  - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
  model-index:
9
  - name: my_fine_tuned_t5_small_model
10
  results: []
 
16
  # my_fine_tuned_t5_small_model
17
 
18
  This model is a fine-tuned version of [huggingface-course/mt5-finetuned-amazon-en-es](https://huggingface.co/huggingface-course/mt5-finetuned-amazon-en-es) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 2.1069
21
+ - Rouge1: 26.742
22
+ - Rouge2: 7.9622
23
+ - Rougel: 20.4423
24
+ - Rougelsum: 20.7426
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 0.001
44
+ - train_batch_size: 8
45
+ - eval_batch_size: 8
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 3000
50
  - num_epochs: 10
 
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
55
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|
56
+ | 4.428 | 1.0 | 13 | 2.8216 | 19.1382 | 5.389 | 15.1855 | 15.1893 |
57
+ | 4.299 | 2.0 | 26 | 2.6894 | 19.6236 | 5.4931 | 15.4001 | 15.5122 |
58
+ | 4.0999 | 3.0 | 39 | 2.5552 | 22.2435 | 6.6021 | 17.2465 | 17.4679 |
59
+ | 3.8541 | 4.0 | 52 | 2.4394 | 23.3478 | 7.1578 | 18.4112 | 18.6265 |
60
+ | 3.6964 | 5.0 | 65 | 2.3568 | 25.092 | 7.4595 | 19.3078 | 19.5198 |
61
+ | 3.5481 | 6.0 | 78 | 2.3018 | 26.0743 | 8.0058 | 19.9644 | 20.2044 |
62
+ | 3.2977 | 7.0 | 91 | 2.2207 | 26.8852 | 7.9185 | 20.5406 | 20.7554 |
63
+ | 3.2768 | 8.0 | 104 | 2.1832 | 26.3885 | 7.9643 | 20.3863 | 20.6338 |
64
+ | 3.2047 | 9.0 | 117 | 2.1403 | 26.598 | 7.883 | 20.3585 | 20.4868 |
65
+ | 3.0813 | 10.0 | 130 | 2.1069 | 26.742 | 7.9622 | 20.4423 | 20.7426 |
66
 
67
 
68
  ### Framework versions
generation_config.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "_from_model_config": true,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 1,
5
  "pad_token_id": 0,
 
1
  {
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbda38569c7a4ad70a93f9381de845b45326d5d63a27a817ffad980d3fb6ff2e
3
  size 1200729512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d93dfc96b25ee09f7a0e7b236ccc44842116cf0f100c9c83b893e307ff131a4f
3
  size 1200729512
runs/Jun09_18-27-42_DESKTOP-H2CRQMR/events.out.tfevents.1717932463.DESKTOP-H2CRQMR.655616.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf8c8f5231c9829277f6648fb9ca7a117b7804376e79fa910af86fd8009eef2a
3
+ size 5388
runs/Jun09_18-29-20_DESKTOP-H2CRQMR/events.out.tfevents.1717932560.DESKTOP-H2CRQMR.655616.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e1b6a71f2c99a28376ea6b6cc9c91bdd58175ddf5b89251e65873b15e8f5691
3
+ size 5386
runs/Jun09_18-30-46_DESKTOP-H2CRQMR/events.out.tfevents.1717932647.DESKTOP-H2CRQMR.656333.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcf66d5f82b895a315518ef891fed43410c44f6b7e261cebcdddc48d2468374c
3
+ size 5386
runs/Jun09_18-31-55_DESKTOP-H2CRQMR/events.out.tfevents.1717932716.DESKTOP-H2CRQMR.656333.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6335abc95ac22971e77c8f95c174abe1ea666bd0d775c2997932ac5444ed8d6c
3
+ size 12262
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9f6d6db3cd3db42dd2aaad9b2f7db0e8f4294a500500c16556c9e5e909d923ae
3
- size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4f764b68e8085c94a67bedbce7ce29455ec95bb48d7e34229c2fdcdcd1bd373
3
+ size 5240