--- license: mit tags: - generated_from_trainer model-index: - name: BERiT_wl_custom_architecture_150_epochs results: [] --- # BERiT_wl_custom_architecture_150_epochs This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 6.1874 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0005 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 150 ### Training results | Training Loss | Epoch | Step | Validation Loss | |:-------------:|:------:|:------:|:---------------:| | 24.8046 | 0.19 | 500 | 12.7123 | | 11.0129 | 0.39 | 1000 | 9.6736 | | 8.9635 | 0.58 | 1500 | 8.4964 | | 8.0902 | 0.77 | 2000 | 7.8951 | | 7.9548 | 0.97 | 2500 | 7.8226 | | 7.6509 | 1.16 | 3000 | 7.7462 | | 7.6147 | 1.36 | 3500 | 7.6485 | | 7.5591 | 1.55 | 4000 | 7.6231 | | 7.5172 | 1.74 | 4500 | 7.6365 | | 7.4983 | 1.94 | 5000 | 7.4450 | | 7.4245 | 2.13 | 5500 | 7.4577 | | 7.2719 | 2.32 | 6000 | 7.3436 | | 7.3124 | 2.52 | 6500 | 7.3705 | | 7.2521 | 2.71 | 7000 | 7.3035 | | 7.2334 | 2.9 | 7500 | 7.3254 | | 7.2194 | 3.1 | 8000 | 7.2225 | | 7.1485 | 3.29 | 8500 | 7.1902 | | 7.1457 | 3.49 | 9000 | 7.2074 | | 7.0741 | 3.68 | 9500 | 7.1499 | | 7.0648 | 3.87 | 10000 | 7.1375 | | 7.1039 | 4.07 | 10500 | 7.0124 | | 7.063 | 4.26 | 11000 | 7.0609 | | 7.0149 | 4.45 | 11500 | 7.0481 | | 6.9925 | 4.65 | 12000 | 6.9921 | | 7.007 | 4.84 | 12500 | 6.9332 | | 6.9724 | 5.03 | 13000 | 6.9564 | | 6.9151 | 5.23 | 13500 | 6.9191 | | 6.9024 | 5.42 | 14000 | 6.9580 | | 6.9217 | 5.62 | 14500 | 6.9994 | | 6.8691 | 5.81 | 15000 | 6.8627 | | 6.9037 | 6.0 | 15500 | 6.9464 | | 6.9068 | 6.2 | 16000 | 6.8337 | | 6.8132 | 6.39 | 16500 | 6.9507 | | 6.879 | 6.58 | 17000 | 6.8269 | | 6.8611 | 6.78 | 17500 | 6.8231 | | 6.832 | 6.97 | 18000 | 6.8648 | | 6.888 | 7.16 | 18500 | 6.9218 | | 6.846 | 7.36 | 19000 | 6.8436 | | 6.8934 | 7.55 | 19500 | 6.8003 | | 6.8736 | 7.75 | 20000 | 6.7671 | | 6.8185 | 7.94 | 20500 | 6.7706 | | 6.8035 | 8.13 | 21000 | 6.7937 | | 6.8225 | 8.33 | 21500 | 6.7516 | | 6.7246 | 8.52 | 22000 | 6.7865 | | 6.8394 | 8.71 | 22500 | 6.7451 | | 6.8449 | 8.91 | 23000 | 6.7132 | | 6.8184 | 9.1 | 23500 | 6.7226 | | 6.7183 | 9.3 | 24000 | 6.7481 | | 6.7688 | 9.49 | 24500 | 6.8439 | | 6.8213 | 9.68 | 25000 | 6.7382 | | 6.8382 | 9.88 | 25500 | 6.7100 | | 6.8008 | 10.07 | 26000 | 6.7362 | | 6.7856 | 10.26 | 26500 | 6.7150 | | 6.7678 | 10.46 | 27000 | 6.6879 | | 6.7181 | 10.65 | 27500 | 6.6985 | | 6.7794 | 10.84 | 28000 | 6.7540 | | 6.793 | 11.04 | 28500 | 6.6759 | | 6.758 | 11.23 | 29000 | 6.8282 | | 6.7859 | 11.43 | 29500 | 6.7199 | | 6.7246 | 11.62 | 30000 | 6.7159 | | 6.7074 | 11.81 | 30500 | 6.6741 | | 6.7431 | 12.01 | 31000 | 6.5994 | | 6.7848 | 12.2 | 31500 | 6.7413 | | 6.6443 | 12.39 | 32000 | 6.7307 | | 6.713 | 12.59 | 32500 | 6.6367 | | 6.7182 | 12.78 | 33000 | 6.7215 | | 6.6531 | 12.97 | 33500 | 6.6576 | | 6.6817 | 13.17 | 34000 | 6.6298 | | 6.658 | 13.36 | 34500 | 6.6509 | | 6.6476 | 13.56 | 35000 | 6.6960 | | 6.7139 | 13.75 | 35500 | 6.6714 | | 6.7637 | 13.94 | 36000 | 6.6451 | | 6.6502 | 14.14 | 36500 | 6.6299 | | 6.6488 | 14.33 | 37000 | 6.5919 | | 6.6018 | 14.52 | 37500 | 6.6460 | | 6.6399 | 14.72 | 38000 | 6.5534 | | 6.6708 | 14.91 | 38500 | 6.5580 | | 6.618 | 15.1 | 39000 | 6.6200 | | 6.6335 | 15.3 | 39500 | 6.6398 | | 6.6793 | 15.49 | 40000 | 6.6470 | | 6.6304 | 15.69 | 40500 | 6.5910 | | 6.572 | 15.88 | 41000 | 6.6311 | | 6.5509 | 16.07 | 41500 | 6.5615 | | 6.5801 | 16.27 | 42000 | 6.6375 | | 6.5925 | 16.46 | 42500 | 6.5788 | | 6.6053 | 16.65 | 43000 | 6.5777 | | 6.574 | 16.85 | 43500 | 6.5225 | | 6.6412 | 17.04 | 44000 | 6.6745 | | 6.6383 | 17.23 | 44500 | 6.6072 | | 6.5596 | 17.43 | 45000 | 6.6791 | | 6.5853 | 17.62 | 45500 | 6.5915 | | 6.5862 | 17.82 | 46000 | 6.5101 | | 6.5739 | 18.01 | 46500 | 6.5603 | | 6.5988 | 18.2 | 47000 | 6.6307 | | 6.5824 | 18.4 | 47500 | 6.5721 | | 6.6016 | 18.59 | 48000 | 6.6443 | | 6.5254 | 18.78 | 48500 | 6.6235 | | 6.6509 | 18.98 | 49000 | 6.5812 | | 6.5534 | 19.17 | 49500 | 6.6311 | | 6.5439 | 19.36 | 50000 | 6.5190 | | 6.4958 | 19.56 | 50500 | 6.6022 | | 6.5812 | 19.75 | 51000 | 6.6042 | | 6.5624 | 19.95 | 51500 | 6.5598 | | 6.4915 | 20.14 | 52000 | 6.5793 | | 6.495 | 20.33 | 52500 | 6.4773 | | 6.579 | 20.53 | 53000 | 6.4957 | | 6.6115 | 20.72 | 53500 | 6.5144 | | 6.5592 | 20.91 | 54000 | 6.5099 | | 6.5474 | 21.11 | 54500 | 6.4373 | | 6.5568 | 21.3 | 55000 | 6.4581 | | 6.4647 | 21.49 | 55500 | 6.4053 | | 6.5423 | 21.69 | 56000 | 6.4721 | | 6.4784 | 21.88 | 56500 | 6.6378 | | 6.4668 | 22.08 | 57000 | 6.4698 | | 6.53 | 22.27 | 57500 | 6.3605 | | 6.5545 | 22.46 | 58000 | 6.4776 | | 6.5224 | 22.66 | 58500 | 6.5105 | | 6.5243 | 22.85 | 59000 | 6.4652 | | 6.5483 | 23.04 | 59500 | 6.5137 | | 6.4688 | 23.24 | 60000 | 6.3626 | | 6.4506 | 23.43 | 60500 | 6.5526 | | 6.4591 | 23.63 | 61000 | 6.5378 | | 6.5187 | 23.82 | 61500 | 6.4938 | | 6.5293 | 24.01 | 62000 | 6.5242 | | 6.4809 | 24.21 | 62500 | 6.3641 | | 6.4143 | 24.4 | 63000 | 6.5578 | | 6.4946 | 24.59 | 63500 | 6.5679 | | 6.4409 | 24.79 | 64000 | 6.5742 | | 6.5167 | 24.98 | 64500 | 6.4332 | | 6.4738 | 25.17 | 65000 | 6.4865 | | 6.479 | 25.37 | 65500 | 6.4287 | | 6.5774 | 25.56 | 66000 | 6.4854 | | 6.5448 | 25.76 | 66500 | 6.5641 | | 6.4514 | 25.95 | 67000 | 6.5859 | | 6.446 | 26.14 | 67500 | 6.5205 | | 6.5242 | 26.34 | 68000 | 6.3855 | | 6.3822 | 26.53 | 68500 | 6.5322 | | 6.4347 | 26.72 | 69000 | 6.4999 | | 6.4718 | 26.92 | 69500 | 6.5620 | | 6.4764 | 27.11 | 70000 | 6.4305 | | 6.4518 | 27.3 | 70500 | 6.5363 | | 6.4408 | 27.5 | 71000 | 6.5173 | | 6.5088 | 27.69 | 71500 | 6.5415 | | 6.4482 | 27.89 | 72000 | 6.4463 | | 6.4399 | 28.08 | 72500 | 6.6054 | | 6.4729 | 28.27 | 73000 | 6.3815 | | 6.4443 | 28.47 | 73500 | 6.4110 | | 6.3291 | 28.66 | 74000 | 6.5276 | | 6.5036 | 28.85 | 74500 | 6.4105 | | 6.3918 | 29.05 | 75000 | 6.3938 | | 6.4873 | 29.24 | 75500 | 6.5735 | | 6.4014 | 29.43 | 76000 | 6.5164 | | 6.432 | 29.63 | 76500 | 6.4788 | | 6.4125 | 29.82 | 77000 | 6.5010 | | 6.4635 | 30.02 | 77500 | 6.5212 | | 6.4787 | 30.21 | 78000 | 6.4719 | | 6.3789 | 30.4 | 78500 | 6.4668 | | 6.4376 | 30.6 | 79000 | 6.4990 | | 6.4255 | 30.79 | 79500 | 6.5125 | | 6.4482 | 30.98 | 80000 | 6.5029 | | 6.4854 | 31.18 | 80500 | 6.4148 | | 6.3694 | 31.37 | 81000 | 6.3913 | | 6.4794 | 31.56 | 81500 | 6.4093 | | 6.5298 | 31.76 | 82000 | 6.4897 | | 6.4557 | 31.95 | 82500 | 6.5037 | | 6.4667 | 32.15 | 83000 | 6.5143 | | 6.4302 | 32.34 | 83500 | 6.3899 | | 6.3902 | 32.53 | 84000 | 6.3984 | | 6.4345 | 32.73 | 84500 | 6.5251 | | 6.4463 | 32.92 | 85000 | 6.3555 | | 6.4069 | 33.11 | 85500 | 6.5103 | | 6.3956 | 33.31 | 86000 | 6.4315 | | 6.3726 | 33.5 | 86500 | 6.4607 | | 6.4322 | 33.69 | 87000 | 6.4607 | | 6.4396 | 33.89 | 87500 | 6.5517 | | 6.3791 | 34.08 | 88000 | 6.3945 | | 6.4187 | 34.28 | 88500 | 6.4253 | | 6.3014 | 34.47 | 89000 | 6.4347 | | 6.407 | 34.66 | 89500 | 6.3437 | | 6.3979 | 34.86 | 90000 | 6.4753 | | 6.3886 | 35.05 | 90500 | 6.4109 | | 6.4035 | 35.24 | 91000 | 6.4625 | | 6.3834 | 35.44 | 91500 | 6.2892 | | 6.483 | 35.63 | 92000 | 6.3512 | | 6.4095 | 35.82 | 92500 | 6.4270 | | 6.3819 | 36.02 | 93000 | 6.5161 | | 6.3699 | 36.21 | 93500 | 6.3608 | | 6.4221 | 36.41 | 94000 | 6.4575 | | 6.3719 | 36.6 | 94500 | 6.3277 | | 6.3649 | 36.79 | 95000 | 6.4155 | | 6.3472 | 36.99 | 95500 | 6.3126 | | 6.4035 | 37.18 | 96000 | 6.3849 | | 6.4118 | 37.37 | 96500 | 6.3637 | | 6.4002 | 37.57 | 97000 | 6.5024 | | 6.3689 | 37.76 | 97500 | 6.4493 | | 6.4304 | 37.96 | 98000 | 6.3921 | | 6.3789 | 38.15 | 98500 | 6.5012 | | 6.3972 | 38.34 | 99000 | 6.4389 | | 6.3478 | 38.54 | 99500 | 6.3466 | | 6.3232 | 38.73 | 100000 | 6.3382 | | 6.3631 | 38.92 | 100500 | 6.3558 | | 6.3657 | 39.12 | 101000 | 6.3970 | | 6.2932 | 39.31 | 101500 | 6.4777 | | 6.3664 | 39.5 | 102000 | 6.2743 | | 6.3362 | 39.7 | 102500 | 6.3683 | | 6.2768 | 39.89 | 103000 | 6.3196 | | 6.334 | 40.09 | 103500 | 6.3221 | | 6.3592 | 40.28 | 104000 | 6.4366 | | 6.3813 | 40.47 | 104500 | 6.3348 | | 6.3267 | 40.67 | 105000 | 6.4029 | | 6.3469 | 40.86 | 105500 | 6.4179 | | 6.3868 | 41.05 | 106000 | 6.4578 | | 6.3341 | 41.25 | 106500 | 6.2580 | | 6.2609 | 41.44 | 107000 | 6.3612 | | 6.389 | 41.63 | 107500 | 6.3980 | | 6.3666 | 41.83 | 108000 | 6.3497 | | 6.4192 | 42.02 | 108500 | 6.2666 | | 6.3131 | 42.22 | 109000 | 6.5009 | | 6.3601 | 42.41 | 109500 | 6.3073 | | 6.3056 | 42.6 | 110000 | 6.4017 | | 6.2856 | 42.8 | 110500 | 6.4237 | | 6.3414 | 42.99 | 111000 | 6.3046 | | 6.2585 | 43.18 | 111500 | 6.4079 | | 6.3364 | 43.38 | 112000 | 6.3337 | | 6.3018 | 43.57 | 112500 | 6.3583 | | 6.2755 | 43.76 | 113000 | 6.2363 | | 6.3035 | 43.96 | 113500 | 6.4418 | | 6.329 | 44.15 | 114000 | 6.3339 | | 6.3575 | 44.35 | 114500 | 6.2747 | | 6.2961 | 44.54 | 115000 | 6.3100 | | 6.3076 | 44.73 | 115500 | 6.2249 | | 6.2606 | 44.93 | 116000 | 6.4091 | | 6.3815 | 45.12 | 116500 | 6.3758 | | 6.2911 | 45.31 | 117000 | 6.4308 | | 6.3574 | 45.51 | 117500 | 6.3929 | | 6.3193 | 45.7 | 118000 | 6.3429 | | 6.2575 | 45.89 | 118500 | 6.4090 | | 6.3526 | 46.09 | 119000 | 6.3755 | | 6.3276 | 46.28 | 119500 | 6.2963 | | 6.312 | 46.48 | 120000 | 6.3950 | | 6.3039 | 46.67 | 120500 | 6.3574 | | 6.3238 | 46.86 | 121000 | 6.4058 | | 6.3289 | 47.06 | 121500 | 6.3378 | | 6.2875 | 47.25 | 122000 | 6.3826 | | 6.2757 | 47.44 | 122500 | 6.3762 | | 6.3295 | 47.64 | 123000 | 6.3390 | | 6.3808 | 47.83 | 123500 | 6.4283 | | 6.2946 | 48.02 | 124000 | 6.4961 | | 6.2336 | 48.22 | 124500 | 6.4333 | | 6.2962 | 48.41 | 125000 | 6.3670 | | 6.2817 | 48.61 | 125500 | 6.4529 | | 6.3436 | 48.8 | 126000 | 6.4104 | | 6.3781 | 48.99 | 126500 | 6.4424 | | 6.2011 | 49.19 | 127000 | 6.3477 | | 6.2685 | 49.38 | 127500 | 6.5722 | | 6.3064 | 49.57 | 128000 | 6.2416 | | 6.281 | 49.77 | 128500 | 6.2986 | | 6.2667 | 49.96 | 129000 | 6.5320 | | 6.2257 | 50.15 | 129500 | 6.3083 | | 6.3593 | 50.35 | 130000 | 6.2661 | | 6.2716 | 50.54 | 130500 | 6.4043 | | 6.3103 | 50.74 | 131000 | 6.2645 | | 6.3174 | 50.93 | 131500 | 6.3595 | | 6.2355 | 51.12 | 132000 | 6.5065 | | 6.2585 | 51.32 | 132500 | 6.3787 | | 6.2728 | 51.51 | 133000 | 6.4104 | | 6.2537 | 51.7 | 133500 | 6.3260 | | 6.2933 | 51.9 | 134000 | 6.3715 | | 6.1818 | 52.09 | 134500 | 6.2909 | | 6.2838 | 52.29 | 135000 | 6.3538 | | 6.233 | 52.48 | 135500 | 6.3544 | | 6.2805 | 52.67 | 136000 | 6.3863 | | 6.2157 | 52.87 | 136500 | 6.3701 | | 6.2898 | 53.06 | 137000 | 6.3410 | | 6.345 | 53.25 | 137500 | 6.3239 | | 6.2705 | 53.45 | 138000 | 6.4318 | | 6.2903 | 53.64 | 138500 | 6.2804 | | 6.263 | 53.83 | 139000 | 6.3537 | | 6.2182 | 54.03 | 139500 | 6.3480 | | 6.2744 | 54.22 | 140000 | 6.3195 | | 6.3152 | 54.42 | 140500 | 6.3934 | | 6.2659 | 54.61 | 141000 | 6.3332 | | 6.2617 | 54.8 | 141500 | 6.2579 | | 6.3094 | 55.0 | 142000 | 6.2328 | | 6.3308 | 55.19 | 142500 | 6.4148 | | 6.2936 | 55.38 | 143000 | 6.2176 | | 6.2945 | 55.58 | 143500 | 6.4020 | | 6.1785 | 55.77 | 144000 | 6.1351 | | 6.2737 | 55.96 | 144500 | 6.2304 | | 6.2682 | 56.16 | 145000 | 6.2812 | | 6.2155 | 56.35 | 145500 | 6.2700 | | 6.226 | 56.55 | 146000 | 6.2475 | | 6.2009 | 56.74 | 146500 | 6.3340 | | 6.2521 | 56.93 | 147000 | 6.3261 | | 6.1959 | 57.13 | 147500 | 6.3872 | | 6.2285 | 57.32 | 148000 | 6.3304 | | 6.2091 | 57.51 | 148500 | 6.3322 | | 6.239 | 57.71 | 149000 | 6.2846 | | 6.1941 | 57.9 | 149500 | 6.4017 | | 6.2541 | 58.09 | 150000 | 6.2042 | | 6.226 | 58.29 | 150500 | 6.3695 | | 6.2403 | 58.48 | 151000 | 6.3264 | | 6.2554 | 58.68 | 151500 | 6.2559 | | 6.3007 | 58.87 | 152000 | 6.3502 | | 6.2424 | 59.06 | 152500 | 6.3547 | | 6.2272 | 59.26 | 153000 | 6.4295 | | 6.1892 | 59.45 | 153500 | 6.6607 | | 6.2815 | 59.64 | 154000 | 6.3525 | | 6.2244 | 59.84 | 154500 | 6.3523 | | 6.2797 | 60.03 | 155000 | 6.3626 | | 6.2187 | 60.22 | 155500 | 6.4222 | | 6.2169 | 60.42 | 156000 | 6.3485 | | 6.2496 | 60.61 | 156500 | 6.3356 | | 6.1102 | 60.81 | 157000 | 6.3071 | | 6.3578 | 61.0 | 157500 | 6.3002 | | 6.2318 | 61.19 | 158000 | 6.4061 | | 6.2639 | 61.39 | 158500 | 6.3478 | | 6.2794 | 61.58 | 159000 | 6.2974 | | 6.2083 | 61.77 | 159500 | 6.3217 | | 6.2093 | 61.97 | 160000 | 6.3045 | | 6.1462 | 62.16 | 160500 | 6.1949 | | 6.3406 | 62.35 | 161000 | 6.4346 | | 6.2244 | 62.55 | 161500 | 6.3671 | | 6.1255 | 62.74 | 162000 | 6.2972 | | 6.1893 | 62.94 | 162500 | 6.4379 | | 6.3224 | 63.13 | 163000 | 6.3682 | | 6.1818 | 63.32 | 163500 | 6.4431 | | 6.2361 | 63.52 | 164000 | 6.3767 | | 6.244 | 63.71 | 164500 | 6.2516 | | 6.187 | 63.9 | 165000 | 6.3070 | | 6.1588 | 64.1 | 165500 | 6.4251 | | 6.1975 | 64.29 | 166000 | 6.2673 | | 6.2274 | 64.48 | 166500 | 6.3508 | | 6.2535 | 64.68 | 167000 | 6.4831 | | 6.2225 | 64.87 | 167500 | 6.3635 | | 6.2468 | 65.07 | 168000 | 6.2326 | | 6.2217 | 65.26 | 168500 | 6.4788 | | 6.2087 | 65.45 | 169000 | 6.3234 | | 6.2096 | 65.65 | 169500 | 6.2796 | | 6.2535 | 65.84 | 170000 | 6.4544 | | 6.2393 | 66.03 | 170500 | 6.4444 | | 6.1029 | 66.23 | 171000 | 6.3661 | | 6.2625 | 66.42 | 171500 | 6.3198 | | 6.2007 | 66.62 | 172000 | 6.2895 | | 6.2242 | 66.81 | 172500 | 6.3142 | | 6.1879 | 67.0 | 173000 | 6.2988 | | 6.2059 | 67.2 | 173500 | 6.3206 | | 6.1516 | 67.39 | 174000 | 6.3751 | | 6.1668 | 67.58 | 174500 | 6.4656 | | 6.2432 | 67.78 | 175000 | 6.3792 | | 6.2393 | 67.97 | 175500 | 6.2346 | | 6.1305 | 68.16 | 176000 | 6.3603 | | 6.178 | 68.36 | 176500 | 6.2234 | | 6.212 | 68.55 | 177000 | 6.4403 | | 6.2127 | 68.75 | 177500 | 6.5191 | | 6.2136 | 68.94 | 178000 | 6.2183 | | 6.2512 | 69.13 | 178500 | 6.3650 | | 6.1163 | 69.33 | 179000 | 6.5378 | | 6.1848 | 69.52 | 179500 | 6.4186 | | 6.1964 | 69.71 | 180000 | 6.2395 | | 6.1588 | 69.91 | 180500 | 6.5267 | | 6.1854 | 70.1 | 181000 | 6.3233 | | 6.1393 | 70.29 | 181500 | 6.3408 | | 6.2122 | 70.49 | 182000 | 6.3399 | | 6.222 | 70.68 | 182500 | 6.4418 | | 6.1902 | 70.88 | 183000 | 6.4005 | | 6.2175 | 71.07 | 183500 | 6.2667 | | 6.2296 | 71.26 | 184000 | 6.3934 | | 6.1185 | 71.46 | 184500 | 6.3090 | | 6.1187 | 71.65 | 185000 | 6.3091 | | 6.2343 | 71.84 | 185500 | 6.3387 | | 6.2313 | 72.04 | 186000 | 6.4123 | | 6.1379 | 72.23 | 186500 | 6.4942 | | 6.238 | 72.42 | 187000 | 6.3057 | | 6.1262 | 72.62 | 187500 | 6.4627 | | 6.1365 | 72.81 | 188000 | 6.2741 | | 6.1417 | 73.01 | 188500 | 6.3133 | | 6.149 | 73.2 | 189000 | 6.3316 | | 6.204 | 73.39 | 189500 | 6.3873 | | 6.2358 | 73.59 | 190000 | 6.2632 | | 6.16 | 73.78 | 190500 | 6.3650 | | 6.2077 | 73.97 | 191000 | 6.4518 | | 6.1722 | 74.17 | 191500 | 6.2005 | | 6.0955 | 74.36 | 192000 | 6.2851 | | 6.1319 | 74.55 | 192500 | 6.2528 | | 6.1369 | 74.75 | 193000 | 6.5142 | | 6.2238 | 74.94 | 193500 | 6.3739 | | 6.1216 | 75.14 | 194000 | 6.2585 | | 6.1693 | 75.33 | 194500 | 6.3033 | | 6.12 | 75.52 | 195000 | 6.3827 | | 6.2106 | 75.72 | 195500 | 6.2327 | | 6.2167 | 75.91 | 196000 | 6.2846 | | 6.1482 | 76.1 | 196500 | 6.4921 | | 6.1469 | 76.3 | 197000 | 6.3111 | | 6.1408 | 76.49 | 197500 | 6.3837 | | 6.1839 | 76.68 | 198000 | 6.2321 | | 6.2089 | 76.88 | 198500 | 6.3958 | | 6.105 | 77.07 | 199000 | 6.4688 | | 6.1359 | 77.27 | 199500 | 6.3164 | | 6.0968 | 77.46 | 200000 | 6.3570 | | 6.1781 | 77.65 | 200500 | 6.2488 | | 6.1875 | 77.85 | 201000 | 6.2816 | | 6.1976 | 78.04 | 201500 | 6.4296 | | 6.1707 | 78.23 | 202000 | 6.1862 | | 6.151 | 78.43 | 202500 | 6.3307 | | 6.1146 | 78.62 | 203000 | 6.3054 | | 6.1971 | 78.81 | 203500 | 6.3942 | | 6.2385 | 79.01 | 204000 | 6.2846 | | 6.1088 | 79.2 | 204500 | 6.5546 | | 6.1813 | 79.4 | 205000 | 6.4800 | | 6.2204 | 79.59 | 205500 | 6.3196 | | 6.1673 | 79.78 | 206000 | 6.4677 | | 6.2331 | 79.98 | 206500 | 6.2786 | | 6.0863 | 80.17 | 207000 | 6.3500 | | 6.1129 | 80.36 | 207500 | 6.2943 | | 6.158 | 80.56 | 208000 | 6.3409 | | 6.1544 | 80.75 | 208500 | 6.2672 | | 6.1335 | 80.95 | 209000 | 6.3621 | | 6.224 | 81.14 | 209500 | 6.3680 | | 6.0753 | 81.33 | 210000 | 6.1947 | | 6.1137 | 81.53 | 210500 | 6.4236 | | 6.1313 | 81.72 | 211000 | 6.2549 | | 6.2197 | 81.91 | 211500 | 6.2092 | | 6.1815 | 82.11 | 212000 | 6.3099 | | 6.0535 | 82.3 | 212500 | 6.4345 | | 6.1012 | 82.49 | 213000 | 6.2444 | | 6.1536 | 82.69 | 213500 | 6.4629 | | 6.1593 | 82.88 | 214000 | 6.2807 | | 6.1092 | 83.08 | 214500 | 6.3169 | | 6.1626 | 83.27 | 215000 | 6.1781 | | 6.1653 | 83.46 | 215500 | 6.3139 | | 6.2015 | 83.66 | 216000 | 6.4126 | | 6.1827 | 83.85 | 216500 | 6.3927 | | 6.1526 | 84.04 | 217000 | 6.2633 | | 6.1705 | 84.24 | 217500 | 6.4309 | | 6.0917 | 84.43 | 218000 | 6.4007 | | 6.1351 | 84.62 | 218500 | 6.2670 | | 6.0758 | 84.82 | 219000 | 6.4789 | | 6.0173 | 85.01 | 219500 | 6.3091 | | 6.1034 | 85.21 | 220000 | 6.3755 | | 6.1238 | 85.4 | 220500 | 6.6736 | | 6.1324 | 85.59 | 221000 | 6.3754 | | 6.1871 | 85.79 | 221500 | 6.2746 | | 6.1551 | 85.98 | 222000 | 6.4359 | | 6.2199 | 86.17 | 222500 | 6.2856 | | 6.1714 | 86.37 | 223000 | 6.1998 | | 6.0669 | 86.56 | 223500 | 6.4683 | | 6.1031 | 86.75 | 224000 | 6.1940 | | 6.1374 | 86.95 | 224500 | 6.4674 | | 6.1401 | 87.14 | 225000 | 6.3528 | | 6.1558 | 87.34 | 225500 | 6.4459 | | 6.0512 | 87.53 | 226000 | 6.1757 | | 6.1377 | 87.72 | 226500 | 6.2645 | | 6.1375 | 87.92 | 227000 | 6.2402 | | 6.0926 | 88.11 | 227500 | 6.3162 | | 6.0877 | 88.3 | 228000 | 6.3065 | | 6.0844 | 88.5 | 228500 | 6.4125 | | 6.0767 | 88.69 | 229000 | 6.4825 | | 6.191 | 88.88 | 229500 | 6.3003 | | 6.1155 | 89.08 | 230000 | 6.4964 | | 6.1384 | 89.27 | 230500 | 6.2906 | | 6.0938 | 89.47 | 231000 | 6.2359 | | 6.1078 | 89.66 | 231500 | 6.2931 | | 6.131 | 89.85 | 232000 | 6.4932 | | 6.0469 | 90.05 | 232500 | 6.3953 | | 6.0826 | 90.24 | 233000 | 6.2308 | | 6.1054 | 90.43 | 233500 | 6.4096 | | 6.128 | 90.63 | 234000 | 6.3669 | | 6.0942 | 90.82 | 234500 | 6.2291 | | 6.0902 | 91.01 | 235000 | 6.4129 | | 6.0365 | 91.21 | 235500 | 6.4048 | | 6.103 | 91.4 | 236000 | 6.3340 | | 6.1112 | 91.6 | 236500 | 6.5937 | | 6.1402 | 91.79 | 237000 | 6.3795 | | 6.1814 | 91.98 | 237500 | 6.4101 | | 6.0968 | 92.18 | 238000 | 6.3921 | | 6.0877 | 92.37 | 238500 | 6.2881 | | 6.1681 | 92.56 | 239000 | 6.3770 | | 6.0637 | 92.76 | 239500 | 6.3274 | | 6.0718 | 92.95 | 240000 | 6.3356 | | 6.1199 | 93.14 | 240500 | 6.2784 | | 6.0929 | 93.34 | 241000 | 6.4138 | | 6.1539 | 93.53 | 241500 | 6.2909 | | 6.1256 | 93.73 | 242000 | 6.2933 | | 6.1872 | 93.92 | 242500 | 6.2459 | | 6.1 | 94.11 | 243000 | 6.3982 | | 6.1501 | 94.31 | 243500 | 6.2645 | | 6.0529 | 94.5 | 244000 | 6.3445 | | 6.0918 | 94.69 | 244500 | 6.2230 | | 6.1225 | 94.89 | 245000 | 6.3748 | | 5.9916 | 95.08 | 245500 | 6.2621 | | 6.1878 | 95.27 | 246000 | 6.3305 | | 6.0875 | 95.47 | 246500 | 6.2892 | | 6.0954 | 95.66 | 247000 | 6.2581 | | 6.1167 | 95.86 | 247500 | 6.2420 | | 6.1107 | 96.05 | 248000 | 6.4639 | | 6.0755 | 96.24 | 248500 | 6.3044 | | 6.0976 | 96.44 | 249000 | 6.3260 | | 6.1027 | 96.63 | 249500 | 6.2483 | | 6.1056 | 96.82 | 250000 | 6.3190 | | 6.0187 | 97.02 | 250500 | 6.2452 | | 6.1126 | 97.21 | 251000 | 6.2942 | | 6.1266 | 97.41 | 251500 | 6.4213 | | 6.1217 | 97.6 | 252000 | 6.3464 | | 6.0499 | 97.79 | 252500 | 6.3229 | | 6.1124 | 97.99 | 253000 | 6.3027 | | 6.108 | 98.18 | 253500 | 6.4417 | | 6.0534 | 98.37 | 254000 | 6.3782 | | 6.0398 | 98.57 | 254500 | 6.3178 | | 6.047 | 98.76 | 255000 | 6.3298 | | 6.1422 | 98.95 | 255500 | 6.3007 | | 6.1034 | 99.15 | 256000 | 6.3839 | | 6.0293 | 99.34 | 256500 | 6.4343 | | 6.0068 | 99.54 | 257000 | 6.3719 | | 6.1498 | 99.73 | 257500 | 6.2130 | | 6.1296 | 99.92 | 258000 | 6.2153 | | 6.0647 | 100.12 | 258500 | 6.3747 | | 6.1241 | 100.31 | 259000 | 6.2765 | | 6.0512 | 100.5 | 259500 | 6.1901 | | 6.0628 | 100.7 | 260000 | 6.2999 | | 6.1612 | 100.89 | 260500 | 6.4049 | | 6.1089 | 101.08 | 261000 | 6.3761 | | 6.0248 | 101.28 | 261500 | 6.3189 | | 6.0749 | 101.47 | 262000 | 6.3750 | | 6.0599 | 101.67 | 262500 | 6.3957 | | 6.0651 | 101.86 | 263000 | 6.3435 | | 6.1145 | 102.05 | 263500 | 6.3425 | | 6.0432 | 102.25 | 264000 | 6.2033 | | 6.0281 | 102.44 | 264500 | 6.0788 | | 6.0403 | 102.63 | 265000 | 6.3782 | | 6.0782 | 102.83 | 265500 | 6.2826 | | 6.1114 | 103.02 | 266000 | 6.2191 | | 6.0744 | 103.21 | 266500 | 6.2138 | | 6.1456 | 103.41 | 267000 | 6.3423 | | 6.0652 | 103.6 | 267500 | 6.3511 | | 6.1563 | 103.8 | 268000 | 6.0975 | | 6.167 | 103.99 | 268500 | 6.3246 | | 6.0227 | 104.18 | 269000 | 6.4232 | | 6.0676 | 104.38 | 269500 | 6.6261 | | 6.0941 | 104.57 | 270000 | 6.2981 | | 6.0018 | 104.76 | 270500 | 6.3241 | | 6.052 | 104.96 | 271000 | 6.3419 | | 6.0276 | 105.15 | 271500 | 6.2942 | | 5.9867 | 105.34 | 272000 | 6.3718 | | 6.0223 | 105.54 | 272500 | 6.3350 | | 6.0527 | 105.73 | 273000 | 6.1741 | | 6.0598 | 105.93 | 273500 | 6.2026 | | 6.0823 | 106.12 | 274000 | 6.3846 | | 6.0429 | 106.31 | 274500 | 6.1483 | | 6.0723 | 106.51 | 275000 | 6.1797 | | 6.0744 | 106.7 | 275500 | 6.4179 | | 6.0975 | 106.89 | 276000 | 6.2767 | | 6.0867 | 107.09 | 276500 | 6.3929 | | 6.0149 | 107.28 | 277000 | 6.2163 | | 6.0958 | 107.47 | 277500 | 6.3619 | | 6.0795 | 107.67 | 278000 | 6.2430 | | 5.9994 | 107.86 | 278500 | 6.2854 | | 6.0246 | 108.06 | 279000 | 6.2356 | | 5.9845 | 108.25 | 279500 | 6.4934 | | 6.0587 | 108.44 | 280000 | 6.1357 | | 6.0536 | 108.64 | 280500 | 6.2619 | | 6.1245 | 108.83 | 281000 | 6.2436 | | 6.04 | 109.02 | 281500 | 6.2919 | | 6.0972 | 109.22 | 282000 | 6.2054 | | 6.0376 | 109.41 | 282500 | 6.3734 | | 6.0864 | 109.6 | 283000 | 6.3019 | | 5.9986 | 109.8 | 283500 | 6.1834 | | 6.0949 | 109.99 | 284000 | 6.3342 | | 6.0034 | 110.19 | 284500 | 6.2156 | | 6.016 | 110.38 | 285000 | 6.3797 | | 6.0444 | 110.57 | 285500 | 6.2416 | | 6.0143 | 110.77 | 286000 | 6.3332 | | 5.9775 | 110.96 | 286500 | 6.2513 | | 6.0207 | 111.15 | 287000 | 6.3844 | | 5.9872 | 111.35 | 287500 | 6.3577 | | 6.1172 | 111.54 | 288000 | 6.2747 | | 6.0457 | 111.74 | 288500 | 6.1936 | | 6.0373 | 111.93 | 289000 | 6.1718 | | 6.0713 | 112.12 | 289500 | 6.3335 | | 6.1118 | 112.32 | 290000 | 6.2619 | | 6.0094 | 112.51 | 290500 | 6.2070 | | 6.0613 | 112.7 | 291000 | 6.2200 | | 6.1184 | 112.9 | 291500 | 6.4332 | | 5.9915 | 113.09 | 292000 | 6.2745 | | 6.0551 | 113.28 | 292500 | 6.2810 | | 6.0033 | 113.48 | 293000 | 6.2718 | | 5.9226 | 113.67 | 293500 | 6.3007 | | 6.0805 | 113.87 | 294000 | 6.1925 | | 6.0287 | 114.06 | 294500 | 6.4383 | | 6.0515 | 114.25 | 295000 | 6.3062 | | 5.9819 | 114.45 | 295500 | 6.2525 | | 6.0159 | 114.64 | 296000 | 6.2048 | | 5.976 | 114.83 | 296500 | 6.3714 | | 6.1055 | 115.03 | 297000 | 6.1493 | | 6.0823 | 115.22 | 297500 | 6.2946 | | 5.9474 | 115.41 | 298000 | 6.2729 | | 6.0996 | 115.61 | 298500 | 6.2949 | | 6.0486 | 115.8 | 299000 | 6.2528 | | 6.0683 | 116.0 | 299500 | 6.1331 | | 6.0145 | 116.19 | 300000 | 6.3231 | | 5.9884 | 116.38 | 300500 | 6.2335 | | 6.0666 | 116.58 | 301000 | 6.1505 | | 6.068 | 116.77 | 301500 | 6.3078 | | 5.989 | 116.96 | 302000 | 6.3503 | | 5.9933 | 117.16 | 302500 | 6.2192 | | 5.9957 | 117.35 | 303000 | 6.4492 | | 6.0553 | 117.54 | 303500 | 6.2934 | | 6.0764 | 117.74 | 304000 | 6.2388 | | 6.1034 | 117.93 | 304500 | 6.3082 | | 6.0721 | 118.13 | 305000 | 6.1408 | | 5.9929 | 118.32 | 305500 | 6.3172 | | 5.9634 | 118.51 | 306000 | 6.1190 | | 6.0719 | 118.71 | 306500 | 6.1553 | | 6.1254 | 118.9 | 307000 | 6.3389 | | 5.986 | 119.09 | 307500 | 6.1912 | | 6.0306 | 119.29 | 308000 | 6.3616 | | 6.0372 | 119.48 | 308500 | 6.2718 | | 6.0292 | 119.67 | 309000 | 6.4873 | | 6.0608 | 119.87 | 309500 | 6.3311 | | 6.0595 | 120.06 | 310000 | 6.3818 | | 5.9674 | 120.26 | 310500 | 6.3674 | | 6.0378 | 120.45 | 311000 | 6.3055 | | 6.0668 | 120.64 | 311500 | 6.1886 | | 6.0235 | 120.84 | 312000 | 6.3711 | | 5.9634 | 121.03 | 312500 | 6.2133 | | 5.9416 | 121.22 | 313000 | 6.2171 | | 5.9672 | 121.42 | 313500 | 6.3439 | | 5.9954 | 121.61 | 314000 | 6.2243 | | 6.0735 | 121.8 | 314500 | 6.1662 | | 6.0652 | 122.0 | 315000 | 6.2343 | | 6.0415 | 122.19 | 315500 | 6.2711 | | 5.941 | 122.39 | 316000 | 6.2159 | | 6.0866 | 122.58 | 316500 | 6.1542 | | 6.1004 | 122.77 | 317000 | 6.3206 | | 6.0116 | 122.97 | 317500 | 6.3592 | | 6.052 | 123.16 | 318000 | 6.1616 | | 6.0093 | 123.35 | 318500 | 6.2311 | | 5.9723 | 123.55 | 319000 | 6.2176 | | 5.9651 | 123.74 | 319500 | 6.2870 | | 5.9994 | 123.93 | 320000 | 6.1601 | | 6.0534 | 124.13 | 320500 | 6.1234 | | 5.9759 | 124.32 | 321000 | 6.1133 | | 6.0716 | 124.52 | 321500 | 6.1318 | | 5.9999 | 124.71 | 322000 | 6.2723 | | 5.9449 | 124.9 | 322500 | 6.3393 | | 5.9497 | 125.1 | 323000 | 6.3490 | | 6.0081 | 125.29 | 323500 | 6.2434 | | 5.9899 | 125.48 | 324000 | 6.2355 | | 5.9943 | 125.68 | 324500 | 6.2021 | | 6.039 | 125.87 | 325000 | 6.2081 | | 5.971 | 126.07 | 325500 | 6.2518 | | 6.0113 | 126.26 | 326000 | 6.2984 | | 5.9926 | 126.45 | 326500 | 6.1162 | | 5.9795 | 126.65 | 327000 | 6.1953 | | 5.9839 | 126.84 | 327500 | 6.3870 | | 6.0708 | 127.03 | 328000 | 6.2780 | | 5.9934 | 127.23 | 328500 | 6.2218 | | 5.9169 | 127.42 | 329000 | 6.2205 | | 6.0101 | 127.61 | 329500 | 6.2630 | | 5.9775 | 127.81 | 330000 | 6.0953 | | 6.0563 | 128.0 | 330500 | 6.2625 | | 5.9326 | 128.2 | 331000 | 6.3160 | | 6.0056 | 128.39 | 331500 | 6.2531 | | 5.9701 | 128.58 | 332000 | 6.3291 | | 5.9928 | 128.78 | 332500 | 6.2678 | | 6.0317 | 128.97 | 333000 | 6.2241 | | 5.9644 | 129.16 | 333500 | 6.3432 | | 5.9619 | 129.36 | 334000 | 6.2009 | | 6.0502 | 129.55 | 334500 | 6.2666 | | 6.0493 | 129.74 | 335000 | 6.3265 | | 5.9662 | 129.94 | 335500 | 6.2069 | | 5.929 | 130.13 | 336000 | 6.3107 | | 5.8884 | 130.33 | 336500 | 6.2392 | | 6.0248 | 130.52 | 337000 | 6.3263 | | 5.9749 | 130.71 | 337500 | 6.2351 | | 6.0686 | 130.91 | 338000 | 6.1432 | | 5.979 | 131.1 | 338500 | 6.2057 | | 5.9756 | 131.29 | 339000 | 6.1497 | | 6.0542 | 131.49 | 339500 | 6.2669 | | 6.0454 | 131.68 | 340000 | 6.2311 | | 6.0368 | 131.87 | 340500 | 6.0745 | | 6.0784 | 132.07 | 341000 | 6.1181 | | 5.8907 | 132.26 | 341500 | 6.2473 | | 5.9635 | 132.46 | 342000 | 6.1953 | | 5.9559 | 132.65 | 342500 | 6.0708 | | 5.9116 | 132.84 | 343000 | 6.1112 | | 6.0154 | 133.04 | 343500 | 6.2833 | | 6.0474 | 133.23 | 344000 | 6.2091 | | 5.9661 | 133.42 | 344500 | 6.1129 | | 5.9438 | 133.62 | 345000 | 6.2510 | | 5.9498 | 133.81 | 345500 | 6.1699 | | 5.9987 | 134.0 | 346000 | 6.0196 | | 6.0424 | 134.2 | 346500 | 6.2066 | | 5.9929 | 134.39 | 347000 | 6.2394 | | 5.9699 | 134.59 | 347500 | 6.1630 | | 5.972 | 134.78 | 348000 | 6.3057 | | 5.8912 | 134.97 | 348500 | 6.2970 | | 5.9103 | 135.17 | 349000 | 6.3566 | | 6.0203 | 135.36 | 349500 | 6.2139 | | 5.9869 | 135.55 | 350000 | 6.0769 | | 5.9502 | 135.75 | 350500 | 6.0977 | | 6.0137 | 135.94 | 351000 | 6.1849 | | 5.9812 | 136.13 | 351500 | 6.1549 | | 5.9503 | 136.33 | 352000 | 6.2457 | | 5.9875 | 136.52 | 352500 | 6.2826 | | 5.9876 | 136.72 | 353000 | 6.3110 | | 6.042 | 136.91 | 353500 | 6.1327 | | 6.0329 | 137.1 | 354000 | 6.1691 | | 5.9558 | 137.3 | 354500 | 6.2415 | | 5.9064 | 137.49 | 355000 | 6.3041 | | 6.083 | 137.68 | 355500 | 6.2303 | | 6.0357 | 137.88 | 356000 | 6.1209 | | 6.0468 | 138.07 | 356500 | 6.1150 | | 5.964 | 138.26 | 357000 | 6.1214 | | 5.9884 | 138.46 | 357500 | 6.1821 | | 5.9335 | 138.65 | 358000 | 6.1667 | | 5.9968 | 138.85 | 358500 | 6.2252 | | 5.9721 | 139.04 | 359000 | 6.2437 | | 5.913 | 139.23 | 359500 | 6.2301 | | 5.9755 | 139.43 | 360000 | 6.1756 | | 5.9696 | 139.62 | 360500 | 6.1874 | | 6.0092 | 139.81 | 361000 | 6.0900 | | 5.9676 | 140.01 | 361500 | 6.1980 | | 5.9832 | 140.2 | 362000 | 6.1899 | | 5.9993 | 140.4 | 362500 | 6.1638 | | 5.9506 | 140.59 | 363000 | 6.1104 | | 6.0256 | 140.78 | 363500 | 6.1285 | | 6.0368 | 140.98 | 364000 | 6.1401 | | 5.9722 | 141.17 | 364500 | 6.2675 | | 5.9025 | 141.36 | 365000 | 6.2461 | | 6.0218 | 141.56 | 365500 | 6.1901 | | 6.0086 | 141.75 | 366000 | 6.0529 | | 5.9125 | 141.94 | 366500 | 6.1999 | | 5.9919 | 142.14 | 367000 | 6.0962 | | 6.0066 | 142.33 | 367500 | 6.2817 | | 5.9304 | 142.53 | 368000 | 6.1493 | | 5.9526 | 142.72 | 368500 | 6.2055 | | 6.039 | 142.91 | 369000 | 6.1313 | | 6.0084 | 143.11 | 369500 | 6.2798 | | 5.9637 | 143.3 | 370000 | 6.0965 | | 5.9513 | 143.49 | 370500 | 6.2137 | | 5.9422 | 143.69 | 371000 | 6.1663 | | 5.9425 | 143.88 | 371500 | 6.0414 | | 5.9642 | 144.07 | 372000 | 6.2704 | | 6.0213 | 144.27 | 372500 | 6.3381 | | 6.014 | 144.46 | 373000 | 6.2437 | | 5.9038 | 144.66 | 373500 | 6.1289 | | 5.96 | 144.85 | 374000 | 6.2737 | | 6.0191 | 145.04 | 374500 | 6.1252 | | 5.9451 | 145.24 | 375000 | 6.2172 | | 5.9917 | 145.43 | 375500 | 6.0619 | | 6.019 | 145.62 | 376000 | 6.1719 | | 5.9217 | 145.82 | 376500 | 6.1744 | | 5.9741 | 146.01 | 377000 | 6.3044 | | 5.951 | 146.2 | 377500 | 6.3080 | | 5.9659 | 146.4 | 378000 | 6.1352 | | 5.9307 | 146.59 | 378500 | 6.2410 | | 5.9273 | 146.79 | 379000 | 6.2210 | | 5.9551 | 146.98 | 379500 | 6.1247 | | 6.0192 | 147.17 | 380000 | 6.2649 | | 5.9587 | 147.37 | 380500 | 6.2528 | | 5.9878 | 147.56 | 381000 | 6.0906 | | 5.937 | 147.75 | 381500 | 6.3361 | | 6.0034 | 147.95 | 382000 | 6.1559 | | 5.9791 | 148.14 | 382500 | 6.2430 | | 5.8866 | 148.33 | 383000 | 6.1914 | | 5.9565 | 148.53 | 383500 | 6.1851 | | 5.9583 | 148.72 | 384000 | 6.1961 | | 5.9533 | 148.92 | 384500 | 6.2176 | | 6.0106 | 149.11 | 385000 | 6.2071 | | 5.9114 | 149.3 | 385500 | 6.1565 | | 5.9484 | 149.5 | 386000 | 6.1509 | | 5.9565 | 149.69 | 386500 | 6.1340 | | 6.0005 | 149.88 | 387000 | 6.1874 | ### Framework versions - Transformers 4.27.4 - Pytorch 1.13.1+cu116 - Datasets 2.11.0 - Tokenizers 0.13.2