Hugging Face's logo

kaixkhazaki
/
turkish-medical-question-answering

Question Answering
Transformers
Safetensors
Turkish
bert
Generated from Trainer
turkish
med
Inference Endpoints
Model card Files Community
kaixkhazaki commited on
Commit
dd8a859
·
verified ·
1 Parent(s): 2e15e24

Pushing of the new best model checkpoint

Browse files
Files changed (3) hide show
  1. README.md +88 -42
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -18,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [dbmdz/bert-base-turkish-cased](https://huggingface.co/dbmdz/bert-base-turkish-cased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.2864
22
- - Exact Match: 55.1899
23
- - F1: 75.1246
24
 
25
  ## Model description
26
 
@@ -52,45 +52,91 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Exact Match | F1 |
54
  |:-------------:|:------:|:----:|:---------------:|:-----------:|:-------:|
55
- | 5.9451 | 0.1166 | 50 | 5.9731 | 0.0 | 5.7871 |
56
- | 5.8483 | 0.2331 | 100 | 5.8315 | 0.0 | 5.9124 |
57
- | 5.6758 | 0.3497 | 150 | 5.6207 | 0.2519 | 6.2966 |
58
- | 5.4079 | 0.4662 | 200 | 5.3396 | 0.2584 | 6.1159 |
59
- | 5.1136 | 0.5828 | 250 | 5.0135 | 0.2755 | 7.7324 |
60
- | 4.7974 | 0.6993 | 300 | 4.6818 | 1.2531 | 9.4001 |
61
- | 4.4412 | 0.8159 | 350 | 4.3335 | 1.5656 | 10.9210 |
62
- | 4.1566 | 0.9324 | 400 | 3.8584 | 7.0281 | 22.6904 |
63
- | 3.599 | 1.0490 | 450 | 2.8534 | 23.4628 | 48.7349 |
64
- | 3.0347 | 1.1655 | 500 | 2.4007 | 28.9362 | 53.4749 |
65
- | 2.7626 | 1.2821 | 550 | 2.2064 | 33.4711 | 57.0427 |
66
- | 2.5741 | 1.3986 | 600 | 2.0689 | 37.3297 | 60.0019 |
67
- | 2.3917 | 1.5152 | 650 | 1.9761 | 38.6968 | 61.5842 |
68
- | 2.3607 | 1.6317 | 700 | 1.9137 | 41.5344 | 63.5713 |
69
- | 2.2972 | 1.7483 | 750 | 1.8294 | 44.0210 | 65.5393 |
70
- | 2.1214 | 1.8648 | 800 | 1.7721 | 44.7028 | 65.9376 |
71
- | 2.1775 | 1.9814 | 850 | 1.7058 | 46.1538 | 66.8453 |
72
- | 1.9282 | 2.0979 | 900 | 1.6579 | 46.7784 | 67.7813 |
73
- | 1.9428 | 2.2145 | 950 | 1.6366 | 46.8912 | 68.5467 |
74
- | 1.8639 | 2.3310 | 1000 | 1.5751 | 49.4819 | 70.2320 |
75
- | 1.8969 | 2.4476 | 1050 | 1.5519 | 48.9610 | 70.3424 |
76
- | 1.7348 | 2.5641 | 1100 | 1.5173 | 50.4505 | 71.1044 |
77
- | 1.7847 | 2.6807 | 1150 | 1.4999 | 50.5762 | 71.6186 |
78
- | 1.7822 | 2.7972 | 1200 | 1.4566 | 53.0691 | 72.0005 |
79
- | 1.7989 | 2.9138 | 1250 | 1.4300 | 51.6005 | 72.0121 |
80
- | 1.7683 | 3.0303 | 1300 | 1.4319 | 52.0305 | 72.2366 |
81
- | 1.5444 | 3.1469 | 1350 | 1.4277 | 51.7903 | 72.0603 |
82
- | 1.5121 | 3.2634 | 1400 | 1.3861 | 53.6122 | 73.3486 |
83
- | 1.6294 | 3.3800 | 1450 | 1.3830 | 52.6718 | 73.2456 |
84
- | 1.514 | 3.4965 | 1500 | 1.3456 | 53.7389 | 73.4757 |
85
- | 1.3778 | 3.6131 | 1550 | 1.3644 | 53.2319 | 73.5271 |
86
- | 1.4502 | 3.7296 | 1600 | 1.3491 | 53.6030 | 73.8642 |
87
- | 1.5388 | 3.8462 | 1650 | 1.3611 | 53.0380 | 73.1390 |
88
- | 1.5244 | 3.9627 | 1700 | 1.3143 | 53.3587 | 74.0002 |
89
- | 1.3127 | 4.0793 | 1750 | 1.3191 | 54.4767 | 74.6247 |
90
- | 1.3819 | 4.1958 | 1800 | 1.2864 | 55.1899 | 75.1246 |
91
- | 1.307 | 4.3124 | 1850 | 1.3762 | 54.1401 | 74.4158 |
92
- | 1.2792 | 4.4289 | 1900 | 1.3156 | 53.4943 | 75.0122 |
93
- | 1.289 | 4.5455 | 1950 | 1.2809 | 55.0063 | 74.6137 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
94
 
95
 
96
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [dbmdz/bert-base-turkish-cased](https://huggingface.co/dbmdz/bert-base-turkish-cased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.2814
22
+ - Exact Match: 52.7881
23
+ - F1: 76.1437
24
 
25
  ## Model description
26
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Exact Match | F1 |
54
  |:-------------:|:------:|:----:|:---------------:|:-----------:|:-------:|
55
+ | 5.9507 | 0.1166 | 50 | 5.9381 | 0.0 | 6.0684 |
56
+ | 5.8385 | 0.2331 | 100 | 5.7914 | 0.0 | 6.4166 |
57
+ | 5.6579 | 0.3497 | 150 | 5.5785 | 0.0 | 6.1711 |
58
+ | 5.3863 | 0.4662 | 200 | 5.3045 | 0.2012 | 6.2450 |
59
+ | 5.0968 | 0.5828 | 250 | 4.9885 | 0.5976 | 7.6302 |
60
+ | 4.7795 | 0.6993 | 300 | 4.6415 | 1.0941 | 8.9163 |
61
+ | 4.4223 | 0.8159 | 350 | 4.2947 | 1.6293 | 9.4547 |
62
+ | 4.1392 | 0.9324 | 400 | 3.9772 | 4.6748 | 14.3025 |
63
+ | 3.8572 | 1.0490 | 450 | 3.4575 | 12.5448 | 27.5850 |
64
+ | 3.3154 | 1.1655 | 500 | 2.5605 | 28.7234 | 51.4219 |
65
+ | 2.8303 | 1.2821 | 550 | 2.2085 | 35.0144 | 57.9319 |
66
+ | 2.5985 | 1.3986 | 600 | 2.0545 | 38.8122 | 61.8230 |
67
+ | 2.3931 | 1.5152 | 650 | 1.9646 | 38.8283 | 62.3091 |
68
+ | 2.3749 | 1.6317 | 700 | 1.8911 | 42.2311 | 64.3891 |
69
+ | 2.3268 | 1.7483 | 750 | 1.8363 | 42.9521 | 65.1745 |
70
+ | 2.1324 | 1.8648 | 800 | 1.7683 | 43.2540 | 66.5840 |
71
+ | 2.1652 | 1.9814 | 850 | 1.6980 | 45.5979 | 67.6440 |
72
+ | 1.9279 | 2.0979 | 900 | 1.6432 | 46.4935 | 68.1335 |
73
+ | 1.9351 | 2.2145 | 950 | 1.6031 | 46.7866 | 68.4213 |
74
+ | 1.8488 | 2.3310 | 1000 | 1.5765 | 48.7047 | 70.2017 |
75
+ | 1.8967 | 2.4476 | 1050 | 1.5462 | 47.9791 | 69.8952 |
76
+ | 1.7476 | 2.5641 | 1100 | 1.5040 | 49.2903 | 71.0521 |
77
+ | 1.7635 | 2.6807 | 1150 | 1.5197 | 49.2188 | 70.7629 |
78
+ | 1.7595 | 2.7972 | 1200 | 1.4790 | 49.8724 | 70.5285 |
79
+ | 1.7699 | 2.9138 | 1250 | 1.4283 | 52.5707 | 72.8425 |
80
+ | 1.7792 | 3.0303 | 1300 | 1.4246 | 50.5762 | 72.0336 |
81
+ | 1.5396 | 3.1469 | 1350 | 1.4117 | 52.6248 | 72.8936 |
82
+ | 1.5112 | 3.2634 | 1400 | 1.3938 | 53.1888 | 73.1075 |
83
+ | 1.5936 | 3.3800 | 1450 | 1.3805 | 53.8953 | 73.4629 |
84
+ | 1.4775 | 3.4965 | 1500 | 1.3522 | 53.5443 | 72.8847 |
85
+ | 1.3998 | 3.6131 | 1550 | 1.3730 | 52.9262 | 72.7934 |
86
+ | 1.4743 | 3.7296 | 1600 | 1.3593 | 53.2319 | 73.0427 |
87
+ | 1.572 | 3.8462 | 1650 | 1.3748 | 53.7484 | 73.1917 |
88
+ | 1.5321 | 3.9627 | 1700 | 1.3096 | 54.2929 | 72.9719 |
89
+ | 1.2849 | 4.0793 | 1750 | 1.3057 | 54.1823 | 73.5710 |
90
+ | 1.4073 | 4.1958 | 1800 | 1.2768 | 55.1072 | 73.9657 |
91
+ | 1.2894 | 4.3124 | 1850 | 1.3707 | 54.0984 | 73.5854 |
92
+ | 1.2771 | 4.4289 | 1900 | 1.3068 | 54.9686 | 74.2854 |
93
+ | 1.2683 | 4.5455 | 1950 | 1.2683 | 55.6818 | 74.6788 |
94
+ | 1.3432 | 4.6620 | 2000 | 1.2704 | 55.3866 | 74.1082 |
95
+ | 1.3052 | 4.7786 | 2050 | 1.2826 | 54.5570 | 73.9376 |
96
+ | 1.3458 | 4.8951 | 2100 | 1.2436 | 54.4304 | 74.1391 |
97
+ | 1.1832 | 5.0117 | 2150 | 1.2914 | 55.8081 | 74.5105 |
98
+ | 1.1964 | 5.1282 | 2200 | 1.2332 | 56.8182 | 75.6849 |
99
+ | 1.1179 | 5.2448 | 2250 | 1.2661 | 55.5273 | 74.5969 |
100
+ | 1.1602 | 5.3613 | 2300 | 1.2717 | 56.0203 | 75.5936 |
101
+ | 1.1314 | 5.4779 | 2350 | 1.2784 | 55.5133 | 75.2080 |
102
+ | 1.2153 | 5.5944 | 2400 | 1.2401 | 56.3682 | 75.6323 |
103
+ | 1.1613 | 5.7110 | 2450 | 1.2470 | 55.8081 | 75.5565 |
104
+ | 1.0839 | 5.8275 | 2500 | 1.2555 | 56.2108 | 75.3284 |
105
+ | 1.1208 | 5.9441 | 2550 | 1.2151 | 56.0606 | 75.3103 |
106
+ | 1.1018 | 6.0606 | 2600 | 1.2407 | 56.2814 | 75.4373 |
107
+ | 1.004 | 6.1772 | 2650 | 1.2561 | 56.1869 | 75.1453 |
108
+ | 1.0081 | 6.2937 | 2700 | 1.2708 | 56.3843 | 75.1235 |
109
+ | 1.0503 | 6.4103 | 2750 | 1.2398 | 56.4780 | 75.2607 |
110
+ | 1.1078 | 6.5268 | 2800 | 1.2424 | 56.1558 | 75.4293 |
111
+ | 1.0516 | 6.6434 | 2850 | 1.2425 | 57.0342 | 76.0343 |
112
+ | 1.0919 | 6.7599 | 2900 | 1.2361 | 56.5107 | 75.1984 |
113
+ | 1.0834 | 6.8765 | 2950 | 1.2307 | 56.6158 | 75.4564 |
114
+ | 1.0308 | 6.9930 | 3000 | 1.2331 | 55.9236 | 75.7649 |
115
+ | 0.9756 | 7.1096 | 3050 | 1.2354 | 56.9250 | 76.0355 |
116
+ | 0.9279 | 7.2261 | 3100 | 1.2538 | 56.4168 | 75.7899 |
117
+ | 0.9655 | 7.3427 | 3150 | 1.2458 | 56.4885 | 76.0547 |
118
+ | 0.9776 | 7.4592 | 3200 | 1.2351 | 57.0701 | 76.0798 |
119
+ | 0.925 | 7.5758 | 3250 | 1.2309 | 56.6158 | 75.7755 |
120
+ | 1.0088 | 7.6923 | 3300 | 1.2403 | 56.2897 | 75.7209 |
121
+ | 1.0534 | 7.8089 | 3350 | 1.2426 | 55.1592 | 75.2877 |
122
+ | 1.0021 | 7.9254 | 3400 | 1.2364 | 55.9645 | 75.4818 |
123
+ | 0.9248 | 8.0420 | 3450 | 1.2420 | 55.5838 | 75.7577 |
124
+ | 0.9077 | 8.1585 | 3500 | 1.2389 | 56.0051 | 75.6164 |
125
+ | 0.9882 | 8.2751 | 3550 | 1.2259 | 55.8228 | 75.5104 |
126
+ | 0.9151 | 8.3916 | 3600 | 1.2330 | 56.5272 | 76.1745 |
127
+ | 0.9682 | 8.5082 | 3650 | 1.2406 | 56.6372 | 75.9005 |
128
+ | 1.0271 | 8.6247 | 3700 | 1.2343 | 56.4557 | 75.7307 |
129
+ | 0.9019 | 8.7413 | 3750 | 1.2343 | 56.3291 | 75.8930 |
130
+ | 0.8673 | 8.8578 | 3800 | 1.2379 | 56.2183 | 75.9115 |
131
+ | 0.91 | 8.9744 | 3850 | 1.2421 | 56.0759 | 75.8580 |
132
+ | 0.8888 | 9.0909 | 3900 | 1.2399 | 56.2183 | 76.0760 |
133
+ | 0.874 | 9.2075 | 3950 | 1.2438 | 56.0203 | 75.8630 |
134
+ | 0.9676 | 9.3240 | 4000 | 1.2445 | 56.2738 | 76.0027 |
135
+ | 0.9712 | 9.4406 | 4050 | 1.2413 | 56.1470 | 76.0020 |
136
+ | 0.8792 | 9.5571 | 4100 | 1.2416 | 56.1470 | 75.9679 |
137
+ | 0.9358 | 9.6737 | 4150 | 1.2406 | 56.4005 | 75.9939 |
138
+ | 0.8496 | 9.7902 | 4200 | 1.2411 | 56.4005 | 76.0539 |
139
+ | 0.9618 | 9.9068 | 4250 | 1.2412 | 56.2738 | 76.0405 |
140
 
141
 
142
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bcf1e97fa80acd7e34110f7b2f17b6e5d5379d27f978a4ab8bd983bc57efe492
3
  size 440136504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:854f58d8aebc27d69745912eb6000d8bc63f9555aa51fbedf6bddef624a4275f
3
  size 440136504
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50dffc91e032cee9e5d4246dabf7dbb61430bf79c9d7fd4829fbf092223f251b
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70d66f62b4d6e54bd0c123be23b0774befb073da048ab8b608a9ad4115f54a9a
3
  size 5432