Hugging Face's logo

Trong-Nghia
/
roberta-large-detect-dep-v2

Text Classification
Transformers
PyTorch
TensorBoard
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Trong-Nghia commited on
Commit
ef5cda6
·
1 Parent(s): 599e50a

End of training

Browse files
Files changed (3) hide show
  1. README.md +13 -10
  2. pytorch_model.bin +1 -1
  3. runs/Jul20_13-23-41_a6fc68dc1f11/events.out.tfevents.1689859773.a6fc68dc1f11.665.0 +2 -2
README.md CHANGED
@@ -1,5 +1,6 @@
1
  ---
2
  license: mit
 
3
  tags:
4
  - generated_from_trainer
5
  metrics:
@@ -17,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.8336
21
- - Accuracy: 0.718
22
- - F1: 0.7914
23
 
24
  ## Model description
25
 
@@ -39,25 +40,27 @@ More information needed
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 5e-06
42
- - train_batch_size: 4
43
- - eval_batch_size: 4
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - num_epochs: 3
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
53
- | 0.63 | 1.0 | 1502 | 0.5658 | 0.724 | 0.8006 |
54
- | 0.5902 | 2.0 | 3004 | 0.5994 | 0.724 | 0.7943 |
55
- | 0.5357 | 3.0 | 4506 | 0.8336 | 0.718 | 0.7914 |
 
 
56
 
57
 
58
  ### Framework versions
59
 
60
- - Transformers 4.30.2
61
  - Pytorch 2.0.1+cu118
62
  - Datasets 2.13.1
63
  - Tokenizers 0.13.3
 
1
  ---
2
  license: mit
3
+ base_model: roberta-large
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
18
 
19
  This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7719
22
+ - Accuracy: 0.691
23
+ - F1: 0.7625
24
 
25
  ## Model description
26
 
 
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5e-06
43
+ - train_batch_size: 8
44
+ - eval_batch_size: 8
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
+ - num_epochs: 5
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
54
+ | 0.6278 | 1.0 | 751 | 0.5546 | 0.763 | 0.8227 |
55
+ | 0.5472 | 2.0 | 1502 | 0.5449 | 0.743 | 0.8160 |
56
+ | 0.4787 | 3.0 | 2253 | 0.5744 | 0.72 | 0.7929 |
57
+ | 0.423 | 4.0 | 3004 | 0.7290 | 0.702 | 0.7799 |
58
+ | 0.3803 | 5.0 | 3755 | 0.7719 | 0.691 | 0.7625 |
59
 
60
 
61
  ### Framework versions
62
 
63
+ - Transformers 4.31.0
64
  - Pytorch 2.0.1+cu118
65
  - Datasets 2.13.1
66
  - Tokenizers 0.13.3
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a36eb43f5f87d6035e058336f7382eaeab5928cd132d66cb923486fbf94f47c7
3
  size 1421582769
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4850b7ef115e907823d4b34a4ceed51cd1135ec2924b9b9e923b141cc12de95
3
  size 1421582769
runs/Jul20_13-23-41_a6fc68dc1f11/events.out.tfevents.1689859773.a6fc68dc1f11.665.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:acdb08166921bab5225e895b7f1324c9c1f287178daca354e3a695731a300e44
3
- size 6725
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0ecca7b5eff7b2eaf37c364e894daf97551496453f036790abd2967a1102a6e
3
+ size 7448