--- license: apache-2.0 base_model: jeff31415/TinyLlama-1.1B-1T-OpenOrca tags: - generated_from_trainer model-index: - name: results results: [] --- # results This model is a fine-tuned version of [jeff31415/TinyLlama-1.1B-1T-OpenOrca](https://huggingface.co/jeff31415/TinyLlama-1.1B-1T-OpenOrca) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 1.1667 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 3e-07 - train_batch_size: 20 - eval_batch_size: 4 - seed: 42 - gradient_accumulation_steps: 2 - total_train_batch_size: 40 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 1 ### Training results | Training Loss | Epoch | Step | Validation Loss | |:-------------:|:-----:|:----:|:---------------:| | 2.6285 | 0.0 | 4 | 2.4698 | | 2.6222 | 0.0 | 8 | 2.4660 | | 2.6536 | 0.0 | 12 | 2.4604 | | 2.6785 | 0.01 | 16 | 2.4557 | | 2.6085 | 0.01 | 20 | 2.4515 | | 2.5907 | 0.01 | 24 | 2.4463 | | 2.5942 | 0.01 | 28 | 2.4415 | | 2.6101 | 0.01 | 32 | 2.4372 | | 2.5827 | 0.01 | 36 | 2.4327 | | 2.5729 | 0.02 | 40 | 2.4281 | | 2.5856 | 0.02 | 44 | 2.4231 | | 2.589 | 0.02 | 48 | 2.4186 | | 2.6483 | 0.02 | 52 | 2.4145 | | 2.517 | 0.02 | 56 | 2.4095 | | 2.5987 | 0.02 | 60 | 2.4050 | | 2.5489 | 0.03 | 64 | 2.4004 | | 2.5063 | 0.03 | 68 | 2.3965 | | 2.5867 | 0.03 | 72 | 2.3916 | | 2.544 | 0.03 | 76 | 2.3873 | | 2.5596 | 0.03 | 80 | 2.3828 | | 2.5744 | 0.03 | 84 | 2.3786 | | 2.5588 | 0.04 | 88 | 2.3742 | | 2.5579 | 0.04 | 92 | 2.3702 | | 2.5245 | 0.04 | 96 | 2.3660 | | 2.5132 | 0.04 | 100 | 2.3611 | | 2.5037 | 0.04 | 104 | 2.3570 | | 2.4727 | 0.04 | 108 | 2.3531 | | 2.4709 | 0.04 | 112 | 2.3488 | | 2.4711 | 0.05 | 116 | 2.3445 | | 2.5445 | 0.05 | 120 | 2.3402 | | 2.4994 | 0.05 | 124 | 2.3362 | | 2.5036 | 0.05 | 128 | 2.3319 | | 2.5525 | 0.05 | 132 | 2.3277 | | 2.5245 | 0.05 | 136 | 2.3241 | | 2.4946 | 0.06 | 140 | 2.3198 | | 2.5142 | 0.06 | 144 | 2.3153 | | 2.4639 | 0.06 | 148 | 2.3113 | | 2.4796 | 0.06 | 152 | 2.3070 | | 2.4529 | 0.06 | 156 | 2.3031 | | 2.4823 | 0.06 | 160 | 2.2993 | | 2.4439 | 0.07 | 164 | 2.2948 | | 2.4652 | 0.07 | 168 | 2.2909 | | 2.4574 | 0.07 | 172 | 2.2867 | | 2.4557 | 0.07 | 176 | 2.2830 | | 2.4462 | 0.07 | 180 | 2.2787 | | 2.3962 | 0.07 | 184 | 2.2745 | | 2.3666 | 0.08 | 188 | 2.2706 | | 2.5024 | 0.08 | 192 | 2.2670 | | 2.4419 | 0.08 | 196 | 2.2627 | | 2.4246 | 0.08 | 200 | 2.2584 | | 2.3853 | 0.08 | 204 | 2.2552 | | 2.4032 | 0.08 | 208 | 2.2511 | | 2.4444 | 0.08 | 212 | 2.2470 | | 2.2932 | 0.09 | 216 | 2.2428 | | 2.3929 | 0.09 | 220 | 2.2391 | | 2.4112 | 0.09 | 224 | 2.2350 | | 2.4191 | 0.09 | 228 | 2.2311 | | 2.4408 | 0.09 | 232 | 2.2272 | | 2.3884 | 0.09 | 236 | 2.2234 | | 2.3689 | 0.1 | 240 | 2.2196 | | 2.3689 | 0.1 | 244 | 2.2154 | | 2.3249 | 0.1 | 248 | 2.2114 | | 2.4286 | 0.1 | 252 | 2.2078 | | 2.3497 | 0.1 | 256 | 2.2039 | | 2.284 | 0.1 | 260 | 2.1999 | | 2.3333 | 0.11 | 264 | 2.1958 | | 2.3305 | 0.11 | 268 | 2.1921 | | 2.3465 | 0.11 | 272 | 2.1882 | | 2.3274 | 0.11 | 276 | 2.1841 | | 2.3641 | 0.11 | 280 | 2.1803 | | 2.3089 | 0.11 | 284 | 2.1763 | | 2.2645 | 0.12 | 288 | 2.1721 | | 2.3439 | 0.12 | 292 | 2.1687 | | 2.3285 | 0.12 | 296 | 2.1649 | | 2.3126 | 0.12 | 300 | 2.1604 | | 2.3356 | 0.12 | 304 | 2.1570 | | 2.3396 | 0.12 | 308 | 2.1527 | | 2.2972 | 0.12 | 312 | 2.1487 | | 2.3321 | 0.13 | 316 | 2.1450 | | 2.3348 | 0.13 | 320 | 2.1415 | | 2.2728 | 0.13 | 324 | 2.1374 | | 2.287 | 0.13 | 328 | 2.1334 | | 2.2474 | 0.13 | 332 | 2.1298 | | 2.3214 | 0.13 | 336 | 2.1264 | | 2.2725 | 0.14 | 340 | 2.1223 | | 2.3114 | 0.14 | 344 | 2.1183 | | 2.2333 | 0.14 | 348 | 2.1146 | | 2.2812 | 0.14 | 352 | 2.1107 | | 2.2454 | 0.14 | 356 | 2.1069 | | 2.2261 | 0.14 | 360 | 2.1032 | | 2.2841 | 0.15 | 364 | 2.0989 | | 2.2481 | 0.15 | 368 | 2.0952 | | 2.278 | 0.15 | 372 | 2.0912 | | 2.2765 | 0.15 | 376 | 2.0873 | | 2.2232 | 0.15 | 380 | 2.0833 | | 2.306 | 0.15 | 384 | 2.0795 | | 2.2126 | 0.16 | 388 | 2.0760 | | 2.2557 | 0.16 | 392 | 2.0721 | | 2.1988 | 0.16 | 396 | 2.0684 | | 2.1917 | 0.16 | 400 | 2.0639 | | 2.2479 | 0.16 | 404 | 2.0599 | | 2.1484 | 0.16 | 408 | 2.0558 | | 2.1886 | 0.16 | 412 | 2.0521 | | 2.2026 | 0.17 | 416 | 2.0482 | | 2.1572 | 0.17 | 420 | 2.0442 | | 2.1931 | 0.17 | 424 | 2.0400 | | 2.161 | 0.17 | 428 | 2.0365 | | 2.1115 | 0.17 | 432 | 2.0322 | | 2.173 | 0.17 | 436 | 2.0284 | | 2.1491 | 0.18 | 440 | 2.0247 | | 2.1716 | 0.18 | 444 | 2.0204 | | 2.2031 | 0.18 | 448 | 2.0165 | | 2.1466 | 0.18 | 452 | 2.0126 | | 2.1384 | 0.18 | 456 | 2.0088 | | 2.1824 | 0.18 | 460 | 2.0048 | | 2.1401 | 0.19 | 464 | 2.0006 | | 2.2086 | 0.19 | 468 | 1.9969 | | 2.1687 | 0.19 | 472 | 1.9926 | | 2.145 | 0.19 | 476 | 1.9888 | | 2.2007 | 0.19 | 480 | 1.9850 | | 2.1367 | 0.19 | 484 | 1.9808 | | 2.1291 | 0.2 | 488 | 1.9768 | | 2.1124 | 0.2 | 492 | 1.9729 | | 2.0738 | 0.2 | 496 | 1.9689 | | 2.1048 | 0.2 | 500 | 1.9646 | | 2.0995 | 0.2 | 504 | 1.9607 | | 2.0816 | 0.2 | 508 | 1.9568 | | 2.0969 | 0.2 | 512 | 1.9527 | | 2.1034 | 0.21 | 516 | 1.9484 | | 2.0654 | 0.21 | 520 | 1.9442 | | 2.1175 | 0.21 | 524 | 1.9404 | | 2.0829 | 0.21 | 528 | 1.9363 | | 2.0973 | 0.21 | 532 | 1.9322 | | 2.0439 | 0.21 | 536 | 1.9278 | | 2.0791 | 0.22 | 540 | 1.9239 | | 2.0988 | 0.22 | 544 | 1.9203 | | 2.0179 | 0.22 | 548 | 1.9160 | | 2.0452 | 0.22 | 552 | 1.9119 | | 1.9792 | 0.22 | 556 | 1.9079 | | 1.9862 | 0.22 | 560 | 1.9032 | | 2.0176 | 0.23 | 564 | 1.8994 | | 2.0066 | 0.23 | 568 | 1.8954 | | 2.0333 | 0.23 | 572 | 1.8914 | | 2.0316 | 0.23 | 576 | 1.8871 | | 2.0114 | 0.23 | 580 | 1.8828 | | 2.0093 | 0.23 | 584 | 1.8789 | | 1.9829 | 0.24 | 588 | 1.8749 | | 1.971 | 0.24 | 592 | 1.8706 | | 2.0188 | 0.24 | 596 | 1.8668 | | 2.0081 | 0.24 | 600 | 1.8628 | | 2.0014 | 0.24 | 604 | 1.8587 | | 1.9741 | 0.24 | 608 | 1.8544 | | 1.9828 | 0.24 | 612 | 1.8505 | | 1.9481 | 0.25 | 616 | 1.8463 | | 1.9584 | 0.25 | 620 | 1.8424 | | 1.9449 | 0.25 | 624 | 1.8381 | | 1.9753 | 0.25 | 628 | 1.8343 | | 2.0055 | 0.25 | 632 | 1.8300 | | 1.98 | 0.25 | 636 | 1.8261 | | 1.9757 | 0.26 | 640 | 1.8223 | | 1.9683 | 0.26 | 644 | 1.8182 | | 1.926 | 0.26 | 648 | 1.8141 | | 1.9454 | 0.26 | 652 | 1.8101 | | 1.9352 | 0.26 | 656 | 1.8059 | | 1.8816 | 0.26 | 660 | 1.8021 | | 1.9182 | 0.27 | 664 | 1.7980 | | 1.9659 | 0.27 | 668 | 1.7941 | | 1.8932 | 0.27 | 672 | 1.7901 | | 1.8608 | 0.27 | 676 | 1.7861 | | 1.941 | 0.27 | 680 | 1.7824 | | 1.8854 | 0.27 | 684 | 1.7785 | | 1.8912 | 0.28 | 688 | 1.7743 | | 1.8667 | 0.28 | 692 | 1.7707 | | 1.912 | 0.28 | 696 | 1.7666 | | 1.9009 | 0.28 | 700 | 1.7628 | | 1.906 | 0.28 | 704 | 1.7589 | | 1.8671 | 0.28 | 708 | 1.7550 | | 1.8609 | 0.28 | 712 | 1.7508 | | 1.8485 | 0.29 | 716 | 1.7469 | | 1.8334 | 0.29 | 720 | 1.7431 | | 1.8763 | 0.29 | 724 | 1.7392 | | 1.9005 | 0.29 | 728 | 1.7355 | | 1.8669 | 0.29 | 732 | 1.7315 | | 1.8984 | 0.29 | 736 | 1.7276 | | 1.8074 | 0.3 | 740 | 1.7241 | | 1.8614 | 0.3 | 744 | 1.7202 | | 1.8211 | 0.3 | 748 | 1.7165 | | 1.8553 | 0.3 | 752 | 1.7124 | | 1.7978 | 0.3 | 756 | 1.7085 | | 1.8203 | 0.3 | 760 | 1.7048 | | 1.8192 | 0.31 | 764 | 1.7010 | | 1.8532 | 0.31 | 768 | 1.6974 | | 1.8307 | 0.31 | 772 | 1.6935 | | 1.8207 | 0.31 | 776 | 1.6896 | | 1.7895 | 0.31 | 780 | 1.6858 | | 1.7976 | 0.31 | 784 | 1.6821 | | 1.814 | 0.32 | 788 | 1.6785 | | 1.7972 | 0.32 | 792 | 1.6748 | | 1.8258 | 0.32 | 796 | 1.6714 | | 1.79 | 0.32 | 800 | 1.6674 | | 1.802 | 0.32 | 804 | 1.6640 | | 1.7784 | 0.32 | 808 | 1.6603 | | 1.7671 | 0.32 | 812 | 1.6569 | | 1.7618 | 0.33 | 816 | 1.6535 | | 1.8207 | 0.33 | 820 | 1.6503 | | 1.7837 | 0.33 | 824 | 1.6467 | | 1.8066 | 0.33 | 828 | 1.6439 | | 1.7814 | 0.33 | 832 | 1.6407 | | 1.7244 | 0.33 | 836 | 1.6373 | | 1.7195 | 0.34 | 840 | 1.6342 | | 1.7524 | 0.34 | 844 | 1.6310 | | 1.7644 | 0.34 | 848 | 1.6279 | | 1.7171 | 0.34 | 852 | 1.6245 | | 1.7418 | 0.34 | 856 | 1.6212 | | 1.7337 | 0.34 | 860 | 1.6180 | | 1.7441 | 0.35 | 864 | 1.6148 | | 1.694 | 0.35 | 868 | 1.6115 | | 1.7601 | 0.35 | 872 | 1.6083 | | 1.7081 | 0.35 | 876 | 1.6050 | | 1.7101 | 0.35 | 880 | 1.6020 | | 1.7271 | 0.35 | 884 | 1.5990 | | 1.7402 | 0.36 | 888 | 1.5954 | | 1.7125 | 0.36 | 892 | 1.5922 | | 1.6949 | 0.36 | 896 | 1.5888 | | 1.7145 | 0.36 | 900 | 1.5858 | | 1.6665 | 0.36 | 904 | 1.5824 | | 1.6929 | 0.36 | 908 | 1.5796 | | 1.7068 | 0.36 | 912 | 1.5766 | | 1.6877 | 0.37 | 916 | 1.5734 | | 1.6718 | 0.37 | 920 | 1.5706 | | 1.6886 | 0.37 | 924 | 1.5676 | | 1.7459 | 0.37 | 928 | 1.5646 | | 1.6596 | 0.37 | 932 | 1.5617 | | 1.6689 | 0.37 | 936 | 1.5588 | | 1.6744 | 0.38 | 940 | 1.5561 | | 1.7009 | 0.38 | 944 | 1.5533 | | 1.6651 | 0.38 | 948 | 1.5505 | | 1.6821 | 0.38 | 952 | 1.5479 | | 1.6453 | 0.38 | 956 | 1.5453 | | 1.6624 | 0.38 | 960 | 1.5426 | | 1.6453 | 0.39 | 964 | 1.5402 | | 1.6451 | 0.39 | 968 | 1.5377 | | 1.6627 | 0.39 | 972 | 1.5353 | | 1.6423 | 0.39 | 976 | 1.5326 | | 1.652 | 0.39 | 980 | 1.5302 | | 1.6414 | 0.39 | 984 | 1.5278 | | 1.6107 | 0.4 | 988 | 1.5253 | | 1.6599 | 0.4 | 992 | 1.5225 | | 1.6326 | 0.4 | 996 | 1.5202 | | 1.6324 | 0.4 | 1000 | 1.5175 | | 1.5907 | 0.4 | 1004 | 1.5149 | | 1.6465 | 0.4 | 1008 | 1.5124 | | 1.6148 | 0.4 | 1012 | 1.5102 | | 1.6064 | 0.41 | 1016 | 1.5074 | | 1.6342 | 0.41 | 1020 | 1.5053 | | 1.605 | 0.41 | 1024 | 1.5025 | | 1.6121 | 0.41 | 1028 | 1.5003 | | 1.617 | 0.41 | 1032 | 1.4978 | | 1.5897 | 0.41 | 1036 | 1.4955 | | 1.6022 | 0.42 | 1040 | 1.4930 | | 1.5748 | 0.42 | 1044 | 1.4903 | | 1.5974 | 0.42 | 1048 | 1.4879 | | 1.6126 | 0.42 | 1052 | 1.4855 | | 1.6189 | 0.42 | 1056 | 1.4828 | | 1.5916 | 0.42 | 1060 | 1.4804 | | 1.5938 | 0.43 | 1064 | 1.4779 | | 1.6026 | 0.43 | 1068 | 1.4756 | | 1.5687 | 0.43 | 1072 | 1.4735 | | 1.5413 | 0.43 | 1076 | 1.4712 | | 1.5778 | 0.43 | 1080 | 1.4689 | | 1.5731 | 0.43 | 1084 | 1.4664 | | 1.5625 | 0.44 | 1088 | 1.4642 | | 1.55 | 0.44 | 1092 | 1.4621 | | 1.5852 | 0.44 | 1096 | 1.4599 | | 1.5614 | 0.44 | 1100 | 1.4579 | | 1.5619 | 0.44 | 1104 | 1.4560 | | 1.5658 | 0.44 | 1108 | 1.4542 | | 1.5699 | 0.44 | 1112 | 1.4521 | | 1.5738 | 0.45 | 1116 | 1.4502 | | 1.5823 | 0.45 | 1120 | 1.4481 | | 1.5425 | 0.45 | 1124 | 1.4459 | | 1.5604 | 0.45 | 1128 | 1.4438 | | 1.5562 | 0.45 | 1132 | 1.4420 | | 1.555 | 0.45 | 1136 | 1.4399 | | 1.5158 | 0.46 | 1140 | 1.4380 | | 1.5272 | 0.46 | 1144 | 1.4359 | | 1.5467 | 0.46 | 1148 | 1.4339 | | 1.5399 | 0.46 | 1152 | 1.4317 | | 1.5221 | 0.46 | 1156 | 1.4297 | | 1.5022 | 0.46 | 1160 | 1.4277 | | 1.5385 | 0.47 | 1164 | 1.4257 | | 1.5042 | 0.47 | 1168 | 1.4236 | | 1.5007 | 0.47 | 1172 | 1.4217 | | 1.5323 | 0.47 | 1176 | 1.4196 | | 1.5269 | 0.47 | 1180 | 1.4174 | | 1.5379 | 0.47 | 1184 | 1.4156 | | 1.522 | 0.48 | 1188 | 1.4137 | | 1.506 | 0.48 | 1192 | 1.4116 | | 1.4986 | 0.48 | 1196 | 1.4096 | | 1.4918 | 0.48 | 1200 | 1.4075 | | 1.5124 | 0.48 | 1204 | 1.4056 | | 1.4926 | 0.48 | 1208 | 1.4038 | | 1.5053 | 0.48 | 1212 | 1.4015 | | 1.5043 | 0.49 | 1216 | 1.3996 | | 1.5068 | 0.49 | 1220 | 1.3976 | | 1.5039 | 0.49 | 1224 | 1.3955 | | 1.4772 | 0.49 | 1228 | 1.3933 | | 1.4873 | 0.49 | 1232 | 1.3916 | | 1.4977 | 0.49 | 1236 | 1.3896 | | 1.5016 | 0.5 | 1240 | 1.3873 | | 1.495 | 0.5 | 1244 | 1.3854 | | 1.4803 | 0.5 | 1248 | 1.3835 | | 1.4842 | 0.5 | 1252 | 1.3816 | | 1.4762 | 0.5 | 1256 | 1.3799 | | 1.4859 | 0.5 | 1260 | 1.3781 | | 1.4948 | 0.51 | 1264 | 1.3764 | | 1.4851 | 0.51 | 1268 | 1.3743 | | 1.4749 | 0.51 | 1272 | 1.3724 | | 1.4594 | 0.51 | 1276 | 1.3709 | | 1.4517 | 0.51 | 1280 | 1.3692 | | 1.4239 | 0.51 | 1284 | 1.3673 | | 1.4775 | 0.52 | 1288 | 1.3657 | | 1.4483 | 0.52 | 1292 | 1.3643 | | 1.4688 | 0.52 | 1296 | 1.3624 | | 1.4566 | 0.52 | 1300 | 1.3608 | | 1.4592 | 0.52 | 1304 | 1.3592 | | 1.4505 | 0.52 | 1308 | 1.3573 | | 1.4304 | 0.52 | 1312 | 1.3557 | | 1.4691 | 0.53 | 1316 | 1.3541 | | 1.4423 | 0.53 | 1320 | 1.3522 | | 1.4301 | 0.53 | 1324 | 1.3508 | | 1.4422 | 0.53 | 1328 | 1.3491 | | 1.4577 | 0.53 | 1332 | 1.3475 | | 1.4541 | 0.53 | 1336 | 1.3458 | | 1.4246 | 0.54 | 1340 | 1.3440 | | 1.4507 | 0.54 | 1344 | 1.3424 | | 1.4312 | 0.54 | 1348 | 1.3408 | | 1.4394 | 0.54 | 1352 | 1.3392 | | 1.4271 | 0.54 | 1356 | 1.3374 | | 1.4081 | 0.54 | 1360 | 1.3357 | | 1.4314 | 0.55 | 1364 | 1.3339 | | 1.4359 | 0.55 | 1368 | 1.3326 | | 1.4381 | 0.55 | 1372 | 1.3308 | | 1.4219 | 0.55 | 1376 | 1.3294 | | 1.4669 | 0.55 | 1380 | 1.3279 | | 1.4163 | 0.55 | 1384 | 1.3260 | | 1.4153 | 0.56 | 1388 | 1.3242 | | 1.4506 | 0.56 | 1392 | 1.3230 | | 1.4229 | 0.56 | 1396 | 1.3213 | | 1.4218 | 0.56 | 1400 | 1.3196 | | 1.4185 | 0.56 | 1404 | 1.3181 | | 1.4283 | 0.56 | 1408 | 1.3164 | | 1.4202 | 0.56 | 1412 | 1.3148 | | 1.3736 | 0.57 | 1416 | 1.3131 | | 1.4332 | 0.57 | 1420 | 1.3116 | | 1.4287 | 0.57 | 1424 | 1.3099 | | 1.4175 | 0.57 | 1428 | 1.3081 | | 1.4152 | 0.57 | 1432 | 1.3066 | | 1.4036 | 0.57 | 1436 | 1.3054 | | 1.4033 | 0.58 | 1440 | 1.3038 | | 1.4095 | 0.58 | 1444 | 1.3023 | | 1.4129 | 0.58 | 1448 | 1.3008 | | 1.3838 | 0.58 | 1452 | 1.2995 | | 1.3939 | 0.58 | 1456 | 1.2980 | | 1.4023 | 0.58 | 1460 | 1.2964 | | 1.3751 | 0.59 | 1464 | 1.2953 | | 1.3657 | 0.59 | 1468 | 1.2935 | | 1.375 | 0.59 | 1472 | 1.2927 | | 1.3846 | 0.59 | 1476 | 1.2911 | | 1.4192 | 0.59 | 1480 | 1.2901 | | 1.3629 | 0.59 | 1484 | 1.2886 | | 1.3947 | 0.6 | 1488 | 1.2877 | | 1.3485 | 0.6 | 1492 | 1.2863 | | 1.405 | 0.6 | 1496 | 1.2850 | | 1.3758 | 0.6 | 1500 | 1.2841 | | 1.3832 | 0.6 | 1504 | 1.2828 | | 1.3314 | 0.6 | 1508 | 1.2814 | | 1.3458 | 0.6 | 1512 | 1.2800 | | 1.357 | 0.61 | 1516 | 1.2792 | | 1.3808 | 0.61 | 1520 | 1.2778 | | 1.3692 | 0.61 | 1524 | 1.2765 | | 1.3763 | 0.61 | 1528 | 1.2754 | | 1.3505 | 0.61 | 1532 | 1.2741 | | 1.3579 | 0.61 | 1536 | 1.2731 | | 1.3567 | 0.62 | 1540 | 1.2717 | | 1.3608 | 0.62 | 1544 | 1.2705 | | 1.3895 | 0.62 | 1548 | 1.2692 | | 1.3614 | 0.62 | 1552 | 1.2682 | | 1.3643 | 0.62 | 1556 | 1.2672 | | 1.3537 | 0.62 | 1560 | 1.2658 | | 1.3564 | 0.63 | 1564 | 1.2648 | | 1.3433 | 0.63 | 1568 | 1.2634 | | 1.3805 | 0.63 | 1572 | 1.2625 | | 1.3309 | 0.63 | 1576 | 1.2612 | | 1.3408 | 0.63 | 1580 | 1.2600 | | 1.3505 | 0.63 | 1584 | 1.2591 | | 1.355 | 0.64 | 1588 | 1.2582 | | 1.3426 | 0.64 | 1592 | 1.2570 | | 1.3476 | 0.64 | 1596 | 1.2556 | | 1.3448 | 0.64 | 1600 | 1.2546 | | 1.3702 | 0.64 | 1604 | 1.2532 | | 1.3198 | 0.64 | 1608 | 1.2522 | | 1.3565 | 0.64 | 1612 | 1.2511 | | 1.3496 | 0.65 | 1616 | 1.2499 | | 1.3346 | 0.65 | 1620 | 1.2490 | | 1.3097 | 0.65 | 1624 | 1.2477 | | 1.3224 | 0.65 | 1628 | 1.2468 | | 1.321 | 0.65 | 1632 | 1.2455 | | 1.3069 | 0.65 | 1636 | 1.2446 | | 1.3358 | 0.66 | 1640 | 1.2436 | | 1.3413 | 0.66 | 1644 | 1.2427 | | 1.3328 | 0.66 | 1648 | 1.2416 | | 1.341 | 0.66 | 1652 | 1.2406 | | 1.3022 | 0.66 | 1656 | 1.2396 | | 1.3309 | 0.66 | 1660 | 1.2386 | | 1.3099 | 0.67 | 1664 | 1.2377 | | 1.2979 | 0.67 | 1668 | 1.2368 | | 1.3219 | 0.67 | 1672 | 1.2358 | | 1.328 | 0.67 | 1676 | 1.2349 | | 1.3161 | 0.67 | 1680 | 1.2339 | | 1.3435 | 0.67 | 1684 | 1.2329 | | 1.3191 | 0.68 | 1688 | 1.2323 | | 1.3427 | 0.68 | 1692 | 1.2314 | | 1.3157 | 0.68 | 1696 | 1.2307 | | 1.31 | 0.68 | 1700 | 1.2298 | | 1.3418 | 0.68 | 1704 | 1.2287 | | 1.3051 | 0.68 | 1708 | 1.2280 | | 1.3453 | 0.68 | 1712 | 1.2271 | | 1.3146 | 0.69 | 1716 | 1.2261 | | 1.2961 | 0.69 | 1720 | 1.2255 | | 1.2989 | 0.69 | 1724 | 1.2248 | | 1.314 | 0.69 | 1728 | 1.2239 | | 1.3137 | 0.69 | 1732 | 1.2232 | | 1.323 | 0.69 | 1736 | 1.2221 | | 1.3194 | 0.7 | 1740 | 1.2216 | | 1.2857 | 0.7 | 1744 | 1.2206 | | 1.3101 | 0.7 | 1748 | 1.2199 | | 1.2962 | 0.7 | 1752 | 1.2194 | | 1.2927 | 0.7 | 1756 | 1.2186 | | 1.2728 | 0.7 | 1760 | 1.2179 | | 1.2903 | 0.71 | 1764 | 1.2170 | | 1.3108 | 0.71 | 1768 | 1.2164 | | 1.2899 | 0.71 | 1772 | 1.2156 | | 1.2996 | 0.71 | 1776 | 1.2149 | | 1.2865 | 0.71 | 1780 | 1.2141 | | 1.3004 | 0.71 | 1784 | 1.2135 | | 1.2916 | 0.72 | 1788 | 1.2128 | | 1.2975 | 0.72 | 1792 | 1.2119 | | 1.3071 | 0.72 | 1796 | 1.2114 | | 1.2793 | 0.72 | 1800 | 1.2106 | | 1.2755 | 0.72 | 1804 | 1.2098 | | 1.2968 | 0.72 | 1808 | 1.2093 | | 1.3226 | 0.72 | 1812 | 1.2085 | | 1.3117 | 0.73 | 1816 | 1.2079 | | 1.2957 | 0.73 | 1820 | 1.2073 | | 1.2885 | 0.73 | 1824 | 1.2066 | | 1.2731 | 0.73 | 1828 | 1.2057 | | 1.2821 | 0.73 | 1832 | 1.2051 | | 1.2944 | 0.73 | 1836 | 1.2045 | | 1.2768 | 0.74 | 1840 | 1.2040 | | 1.2917 | 0.74 | 1844 | 1.2034 | | 1.2935 | 0.74 | 1848 | 1.2027 | | 1.268 | 0.74 | 1852 | 1.2023 | | 1.2761 | 0.74 | 1856 | 1.2016 | | 1.3107 | 0.74 | 1860 | 1.2010 | | 1.2752 | 0.75 | 1864 | 1.2004 | | 1.2661 | 0.75 | 1868 | 1.1997 | | 1.2985 | 0.75 | 1872 | 1.1991 | | 1.2801 | 0.75 | 1876 | 1.1985 | | 1.2775 | 0.75 | 1880 | 1.1980 | | 1.2741 | 0.75 | 1884 | 1.1976 | | 1.2747 | 0.76 | 1888 | 1.1972 | | 1.2772 | 0.76 | 1892 | 1.1964 | | 1.2953 | 0.76 | 1896 | 1.1961 | | 1.3052 | 0.76 | 1900 | 1.1958 | | 1.2505 | 0.76 | 1904 | 1.1951 | | 1.3088 | 0.76 | 1908 | 1.1945 | | 1.2705 | 0.76 | 1912 | 1.1939 | | 1.2606 | 0.77 | 1916 | 1.1934 | | 1.2729 | 0.77 | 1920 | 1.1932 | | 1.2642 | 0.77 | 1924 | 1.1927 | | 1.2903 | 0.77 | 1928 | 1.1920 | | 1.2688 | 0.77 | 1932 | 1.1918 | | 1.2677 | 0.77 | 1936 | 1.1909 | | 1.2747 | 0.78 | 1940 | 1.1905 | | 1.2512 | 0.78 | 1944 | 1.1902 | | 1.2651 | 0.78 | 1948 | 1.1898 | | 1.2655 | 0.78 | 1952 | 1.1893 | | 1.2617 | 0.78 | 1956 | 1.1888 | | 1.2764 | 0.78 | 1960 | 1.1885 | | 1.2531 | 0.79 | 1964 | 1.1883 | | 1.2911 | 0.79 | 1968 | 1.1874 | | 1.2616 | 0.79 | 1972 | 1.1871 | | 1.2537 | 0.79 | 1976 | 1.1869 | | 1.2548 | 0.79 | 1980 | 1.1864 | | 1.2722 | 0.79 | 1984 | 1.1861 | | 1.2717 | 0.8 | 1988 | 1.1858 | | 1.281 | 0.8 | 1992 | 1.1854 | | 1.2766 | 0.8 | 1996 | 1.1850 | | 1.2962 | 0.8 | 2000 | 1.1846 | | 1.2732 | 0.8 | 2004 | 1.1842 | | 1.2588 | 0.8 | 2008 | 1.1838 | | 1.2651 | 0.8 | 2012 | 1.1836 | | 1.2755 | 0.81 | 2016 | 1.1833 | | 1.2513 | 0.81 | 2020 | 1.1828 | | 1.2645 | 0.81 | 2024 | 1.1824 | | 1.2593 | 0.81 | 2028 | 1.1819 | | 1.2947 | 0.81 | 2032 | 1.1818 | | 1.2599 | 0.81 | 2036 | 1.1813 | | 1.2094 | 0.82 | 2040 | 1.1809 | | 1.2707 | 0.82 | 2044 | 1.1807 | | 1.2653 | 0.82 | 2048 | 1.1803 | | 1.2637 | 0.82 | 2052 | 1.1799 | | 1.2708 | 0.82 | 2056 | 1.1799 | | 1.283 | 0.82 | 2060 | 1.1794 | | 1.2853 | 0.83 | 2064 | 1.1792 | | 1.2617 | 0.83 | 2068 | 1.1792 | | 1.2476 | 0.83 | 2072 | 1.1788 | | 1.2355 | 0.83 | 2076 | 1.1785 | | 1.2348 | 0.83 | 2080 | 1.1781 | | 1.2468 | 0.83 | 2084 | 1.1780 | | 1.2715 | 0.84 | 2088 | 1.1776 | | 1.2502 | 0.84 | 2092 | 1.1772 | | 1.284 | 0.84 | 2096 | 1.1771 | | 1.2417 | 0.84 | 2100 | 1.1768 | | 1.2516 | 0.84 | 2104 | 1.1766 | | 1.2748 | 0.84 | 2108 | 1.1763 | | 1.2744 | 0.84 | 2112 | 1.1762 | | 1.2551 | 0.85 | 2116 | 1.1757 | | 1.2687 | 0.85 | 2120 | 1.1755 | | 1.2575 | 0.85 | 2124 | 1.1754 | | 1.2501 | 0.85 | 2128 | 1.1749 | | 1.2728 | 0.85 | 2132 | 1.1751 | | 1.2411 | 0.85 | 2136 | 1.1750 | | 1.2505 | 0.86 | 2140 | 1.1744 | | 1.2363 | 0.86 | 2144 | 1.1743 | | 1.2408 | 0.86 | 2148 | 1.1741 | | 1.25 | 0.86 | 2152 | 1.1736 | | 1.2729 | 0.86 | 2156 | 1.1735 | | 1.2467 | 0.86 | 2160 | 1.1735 | | 1.2377 | 0.87 | 2164 | 1.1734 | | 1.2876 | 0.87 | 2168 | 1.1729 | | 1.255 | 0.87 | 2172 | 1.1728 | | 1.2471 | 0.87 | 2176 | 1.1724 | | 1.2641 | 0.87 | 2180 | 1.1726 | | 1.2594 | 0.87 | 2184 | 1.1722 | | 1.2803 | 0.88 | 2188 | 1.1719 | | 1.2404 | 0.88 | 2192 | 1.1718 | | 1.2538 | 0.88 | 2196 | 1.1718 | | 1.2423 | 0.88 | 2200 | 1.1716 | | 1.2344 | 0.88 | 2204 | 1.1713 | | 1.2646 | 0.88 | 2208 | 1.1711 | | 1.2501 | 0.88 | 2212 | 1.1712 | | 1.2455 | 0.89 | 2216 | 1.1709 | | 1.2588 | 0.89 | 2220 | 1.1705 | | 1.2629 | 0.89 | 2224 | 1.1706 | | 1.2572 | 0.89 | 2228 | 1.1706 | | 1.2625 | 0.89 | 2232 | 1.1704 | | 1.2479 | 0.89 | 2236 | 1.1700 | | 1.2698 | 0.9 | 2240 | 1.1701 | | 1.2619 | 0.9 | 2244 | 1.1699 | | 1.2455 | 0.9 | 2248 | 1.1696 | | 1.2523 | 0.9 | 2252 | 1.1696 | | 1.2695 | 0.9 | 2256 | 1.1692 | | 1.258 | 0.9 | 2260 | 1.1691 | | 1.2393 | 0.91 | 2264 | 1.1691 | | 1.2567 | 0.91 | 2268 | 1.1690 | | 1.2373 | 0.91 | 2272 | 1.1688 | | 1.2797 | 0.91 | 2276 | 1.1687 | | 1.2646 | 0.91 | 2280 | 1.1686 | | 1.2502 | 0.91 | 2284 | 1.1686 | | 1.2317 | 0.92 | 2288 | 1.1684 | | 1.2443 | 0.92 | 2292 | 1.1683 | | 1.2563 | 0.92 | 2296 | 1.1683 | | 1.2485 | 0.92 | 2300 | 1.1683 | | 1.2542 | 0.92 | 2304 | 1.1682 | | 1.2381 | 0.92 | 2308 | 1.1679 | | 1.2244 | 0.92 | 2312 | 1.1679 | | 1.2725 | 0.93 | 2316 | 1.1678 | | 1.2441 | 0.93 | 2320 | 1.1677 | | 1.2441 | 0.93 | 2324 | 1.1678 | | 1.2546 | 0.93 | 2328 | 1.1676 | | 1.2279 | 0.93 | 2332 | 1.1674 | | 1.2635 | 0.93 | 2336 | 1.1675 | | 1.2572 | 0.94 | 2340 | 1.1673 | | 1.2421 | 0.94 | 2344 | 1.1673 | | 1.2022 | 0.94 | 2348 | 1.1671 | | 1.2307 | 0.94 | 2352 | 1.1670 | | 1.2525 | 0.94 | 2356 | 1.1670 | | 1.2353 | 0.94 | 2360 | 1.1671 | | 1.25 | 0.95 | 2364 | 1.1672 | | 1.2493 | 0.95 | 2368 | 1.1670 | | 1.2453 | 0.95 | 2372 | 1.1670 | | 1.2714 | 0.95 | 2376 | 1.1669 | | 1.2435 | 0.95 | 2380 | 1.1668 | | 1.2518 | 0.95 | 2384 | 1.1668 | | 1.2594 | 0.96 | 2388 | 1.1669 | | 1.2149 | 0.96 | 2392 | 1.1670 | | 1.2676 | 0.96 | 2396 | 1.1667 | | 1.2337 | 0.96 | 2400 | 1.1669 | | 1.2329 | 0.96 | 2404 | 1.1666 | | 1.269 | 0.96 | 2408 | 1.1667 | | 1.2298 | 0.96 | 2412 | 1.1665 | | 1.2481 | 0.97 | 2416 | 1.1667 | | 1.2674 | 0.97 | 2420 | 1.1668 | | 1.2482 | 0.97 | 2424 | 1.1666 | | 1.2604 | 0.97 | 2428 | 1.1667 | | 1.2471 | 0.97 | 2432 | 1.1666 | | 1.2069 | 0.97 | 2436 | 1.1665 | | 1.2734 | 0.98 | 2440 | 1.1667 | | 1.239 | 0.98 | 2444 | 1.1666 | | 1.2245 | 0.98 | 2448 | 1.1664 | | 1.244 | 0.98 | 2452 | 1.1664 | | 1.2458 | 0.98 | 2456 | 1.1666 | | 1.2566 | 0.98 | 2460 | 1.1665 | | 1.2582 | 0.99 | 2464 | 1.1667 | | 1.2312 | 0.99 | 2468 | 1.1667 | | 1.229 | 0.99 | 2472 | 1.1666 | | 1.2186 | 0.99 | 2476 | 1.1667 | | 1.2423 | 0.99 | 2480 | 1.1665 | | 1.2465 | 0.99 | 2484 | 1.1665 | | 1.2332 | 1.0 | 2488 | 1.1663 | | 1.2466 | 1.0 | 2492 | 1.1665 | | 1.2308 | 1.0 | 2496 | 1.1665 | | 1.2435 | 1.0 | 2500 | 1.1667 | ### Framework versions - Transformers 4.36.0.dev0 - Pytorch 2.1.0+cu118 - Datasets 2.15.1.dev0 - Tokenizers 0.15.0