--- base_model: intfloat/multilingual-e5-base library_name: sentence-transformers pipeline_tag: sentence-similarity tags: - sentence-transformers - sentence-similarity - feature-extraction - generated_from_trainer - dataset_size:58620066 - loss:RZTKMatryoshka2dLoss widget: - source_sentence: 'query: чехол на самсунг а30' sentences: - 'passage: Ключниця Shvigel 13989 Коричнева' - 'passage: Ключниці кишенькові Handy Cover Гарантія 1 місяць Колір Рожевий Матеріал Шкіра Країна реєстрації бренда Україна Країна-виробник товару Україна Застібка Змійка Кріплення ключів Кільце' - 'passage: Защитный глянцевый чехол с рисунком для Samsung Galaxy А30 (2019) / A305 / А20 (2019) / A205 Планета' - source_sentence: 'query: мебель для кухни' sentences: - 'passage: Стілець для кухні та вітальні Примтекс Плюс 1022 black S-3120 Червоний (ordf)' - 'passage: Повітряні кульки Angel Gifts Гарантія 14 днів Кількість вантажних місць 1 Країна реєстрації бренда Китай Кількість предметів, шт 7 Країна-виробник товару Китай Вид Повітряні кулі Розмір 43 см Розмір 40 х 60 см Розмір 30 см Розмір 40 см Колір Різнобарвний Матеріал Фольгований поліетилен + латекс Свято День Святого Валентина Свято 8 березня Свято День народження Тип гарантійного талона Гарантія по чеку Можливість доставки Почтомати Форма Фігурна Особливості Фольговані Доставка Premium Доставка Доставка в магазини ROZETKA' - 'passage: Ключница кожаная женская Grande Pelle leather-11353 Красная' - source_sentence: 'query: мебель для кухни' sentences: - 'passage: Рідина для систем SCR дизельних двигунів (Евро 4,5,6) 1.5 л SHELL AdBLUE' - 'passage: Ключница Black Brier КЛ-5-17 Черная' - 'passage: Кухонний комплект Злата 2,6м Світ Меблів білий/артвуд світлий (без стільниці)' - source_sentence: 'query: вращающаяся подставка для торта' sentences: - 'passage: Штукатурка цементно-вапняна фасадна ПЦШ-017 СІРА ПОЛІПЛАСТ 25 кг' - 'passage: Подставка для работы с тортом вращающаяся 28 см Empire(GS - 840021006274)' - 'passage: Ключницы карманные Dr.Bond Для кого Для женщин Цвет Черный Материал Кожа Застежка Кнопки' - source_sentence: 'query: мебель для кухни' sentences: - 'passage: Ключниці кишенькові Karya Гарантія 14 днів Для кого Для жінок Колір Червоний Матеріал Шкіра Країна реєстрації бренда Туреччина Країна-виробник товару Туреччина' - 'passage: Ключница Traum 7203-10 Черная (4820007203107)' - 'passage: Кухня Эко модуль Вытяжка 600 Эверест Ясень Шимо Светлый 60х30х28 см' model-index: - name: SentenceTransformer based on intfloat/multilingual-e5-base results: - task: type: information-retrieval name: Information Retrieval dataset: name: bm full type: bm-full metrics: - type: dot_accuracy@1 value: 0.4827586206896552 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.6476293103448276 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.7359913793103449 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8173491379310345 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.4827586206896552 name: Dot Precision@1 - type: dot_precision@3 value: 0.4892241379310345 name: Dot Precision@3 - type: dot_precision@5 value: 0.4947198275862069 name: Dot Precision@5 - type: dot_precision@10 value: 0.4869612068965517 name: Dot Precision@10 - type: dot_recall@1 value: 0.01196127951053177 name: Dot Recall@1 - type: dot_recall@3 value: 0.03605252760852524 name: Dot Recall@3 - type: dot_recall@5 value: 0.06019059294068119 name: Dot Recall@5 - type: dot_recall@10 value: 0.11598568385490053 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.488283085678875 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.581799269636016 name: Dot Mrr@10 - type: dot_map@100 value: 0.3625151414171006 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core uk title type: core-uk-title metrics: - type: dot_accuracy@1 value: 0.6396303901437371 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8439425051334702 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9291581108829569 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9784394250513347 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6396303901437371 name: Dot Precision@1 - type: dot_precision@3 value: 0.6379192334017795 name: Dot Precision@3 - type: dot_precision@5 value: 0.628952772073922 name: Dot Precision@5 - type: dot_precision@10 value: 0.530082135523614 name: Dot Precision@10 - type: dot_recall@1 value: 0.06563353437372038 name: Dot Recall@1 - type: dot_recall@3 value: 0.1948624447816681 name: Dot Recall@3 - type: dot_recall@5 value: 0.3186099953448063 name: Dot Recall@5 - type: dot_recall@10 value: 0.524211399868937 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5917292045236857 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7568943319970016 name: Dot Mrr@10 - type: dot_map@100 value: 0.577288555105118 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core ru title type: core-ru-title metrics: - type: dot_accuracy@1 value: 0.6427104722792608 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8562628336755647 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9332648870636551 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9804928131416838 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6427104722792608 name: Dot Precision@1 - type: dot_precision@3 value: 0.6509240246406571 name: Dot Precision@3 - type: dot_precision@5 value: 0.6381930184804928 name: Dot Precision@5 - type: dot_precision@10 value: 0.5366529774127311 name: Dot Precision@10 - type: dot_recall@1 value: 0.06587922611068522 name: Dot Recall@1 - type: dot_recall@3 value: 0.19907130018858485 name: Dot Recall@3 - type: dot_recall@5 value: 0.32339221688780817 name: Dot Recall@5 - type: dot_recall@10 value: 0.530874137789979 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5993309407105045 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7613282650500315 name: Dot Mrr@10 - type: dot_map@100 value: 0.5856572456385178 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core uk options type: core-uk-options metrics: - type: dot_accuracy@1 value: 0.5236139630390144 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7833675564681725 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8716632443531828 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.944558521560575 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5236139630390144 name: Dot Precision@1 - type: dot_precision@3 value: 0.5355920602327173 name: Dot Precision@3 - type: dot_precision@5 value: 0.5262833675564682 name: Dot Precision@5 - type: dot_precision@10 value: 0.47987679671457906 name: Dot Precision@10 - type: dot_recall@1 value: 0.05249346074400429 name: Dot Recall@1 - type: dot_recall@3 value: 0.1611742944618292 name: Dot Recall@3 - type: dot_recall@5 value: 0.2624932479345754 name: Dot Recall@5 - type: dot_recall@10 value: 0.4720126343473064 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5186376976657447 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6671486424823181 name: Dot Mrr@10 - type: dot_map@100 value: 0.5240753568505577 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core ru options type: core-ru-options metrics: - type: dot_accuracy@1 value: 0.5297741273100616 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7864476386036962 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8706365503080082 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9496919917864476 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5297741273100616 name: Dot Precision@1 - type: dot_precision@3 value: 0.542778918548939 name: Dot Precision@3 - type: dot_precision@5 value: 0.5322381930184806 name: Dot Precision@5 - type: dot_precision@10 value: 0.48357289527720737 name: Dot Precision@10 - type: dot_recall@1 value: 0.053178864642356605 name: Dot Recall@1 - type: dot_recall@3 value: 0.16281660405195855 name: Dot Recall@3 - type: dot_recall@5 value: 0.2651694123105224 name: Dot Recall@5 - type: dot_recall@10 value: 0.47603763442406394 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5237397019255705 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6739529350412302 name: Dot Mrr@10 - type: dot_map@100 value: 0.5263587112126676 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: options uk title type: options-uk-title metrics: - type: dot_accuracy@1 value: 0.7394209354120267 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.9198218262806236 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9688195991091314 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9933184855233853 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.7394209354120267 name: Dot Precision@1 - type: dot_precision@3 value: 0.7319970304380105 name: Dot Precision@3 - type: dot_precision@5 value: 0.6993318485523385 name: Dot Precision@5 - type: dot_precision@10 value: 0.5371937639198219 name: Dot Precision@10 - type: dot_recall@1 value: 0.11383682513972047 name: Dot Recall@1 - type: dot_recall@3 value: 0.3360468348775698 name: Dot Recall@3 - type: dot_recall@5 value: 0.5288643675057929 name: Dot Recall@5 - type: dot_recall@10 value: 0.7693973621033755 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.7458399782711727 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.8359617492134195 name: Dot Mrr@10 - type: dot_map@100 value: 0.7239673528662353 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: options ru title type: options-ru-title metrics: - type: dot_accuracy@1 value: 0.7594654788418709 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.9287305122494433 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9755011135857461 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9933184855233853 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.7594654788418709 name: Dot Precision@1 - type: dot_precision@3 value: 0.7319970304380103 name: Dot Precision@3 - type: dot_precision@5 value: 0.7024498886414253 name: Dot Precision@5 - type: dot_precision@10 value: 0.5383073496659243 name: Dot Precision@10 - type: dot_recall@1 value: 0.11641928351282471 name: Dot Recall@1 - type: dot_recall@3 value: 0.3353919404030763 name: Dot Recall@3 - type: dot_recall@5 value: 0.5311560562674148 name: Dot Recall@5 - type: dot_recall@10 value: 0.7711852858846177 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.7484243182346944 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.8486831406653231 name: Dot Mrr@10 - type: dot_map@100 value: 0.7245632175079355 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: options uk options type: options-uk-options metrics: - type: dot_accuracy@1 value: 0.6458797327394209 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8485523385300668 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9042316258351893 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9532293986636972 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6458797327394209 name: Dot Precision@1 - type: dot_precision@3 value: 0.6325167037861915 name: Dot Precision@3 - type: dot_precision@5 value: 0.6075723830734967 name: Dot Precision@5 - type: dot_precision@10 value: 0.498663697104677 name: Dot Precision@10 - type: dot_recall@1 value: 0.09318157714594241 name: Dot Recall@1 - type: dot_recall@3 value: 0.27791846238394124 name: Dot Recall@3 - type: dot_recall@5 value: 0.44080793618655534 name: Dot Recall@5 - type: dot_recall@10 value: 0.6953837612523581 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.6603776998905829 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7570235443843463 name: Dot Mrr@10 - type: dot_map@100 value: 0.6386028228542846 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: options ru options type: options-ru-options metrics: - type: dot_accuracy@1 value: 0.6614699331848553 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8374164810690423 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.9064587973273942 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9443207126948775 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6614699331848553 name: Dot Precision@1 - type: dot_precision@3 value: 0.6250927988121753 name: Dot Precision@3 - type: dot_precision@5 value: 0.6075723830734966 name: Dot Precision@5 - type: dot_precision@10 value: 0.49643652561247215 name: Dot Precision@10 - type: dot_recall@1 value: 0.0981715018463348 name: Dot Recall@1 - type: dot_recall@3 value: 0.27430911083472326 name: Dot Recall@3 - type: dot_recall@5 value: 0.4410510610399252 name: Dot Recall@5 - type: dot_recall@10 value: 0.6957284425547232 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.6630836813451363 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.764538480574115 name: Dot Mrr@10 - type: dot_map@100 value: 0.6428702846826188 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms uk title type: rusisms-uk-title metrics: - type: dot_accuracy@1 value: 0.6126984126984127 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7714285714285715 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8412698412698413 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8952380952380953 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6126984126984127 name: Dot Precision@1 - type: dot_precision@3 value: 0.6412698412698413 name: Dot Precision@3 - type: dot_precision@5 value: 0.6419047619047619 name: Dot Precision@5 - type: dot_precision@10 value: 0.6133333333333333 name: Dot Precision@10 - type: dot_recall@1 value: 0.04115662469429067 name: Dot Recall@1 - type: dot_recall@3 value: 0.11610870769391896 name: Dot Recall@3 - type: dot_recall@5 value: 0.18272932988415247 name: Dot Recall@5 - type: dot_recall@10 value: 0.3066506749177295 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.6509535118240626 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7072247417485512 name: Dot Mrr@10 - type: dot_map@100 value: 0.578074929897279 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms ru title type: rusisms-ru-title metrics: - type: dot_accuracy@1 value: 0.6285714285714286 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7873015873015873 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8380952380952381 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8857142857142857 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6285714285714286 name: Dot Precision@1 - type: dot_precision@3 value: 0.653968253968254 name: Dot Precision@3 - type: dot_precision@5 value: 0.6425396825396825 name: Dot Precision@5 - type: dot_precision@10 value: 0.613968253968254 name: Dot Precision@10 - type: dot_recall@1 value: 0.04105120240841725 name: Dot Recall@1 - type: dot_recall@3 value: 0.11833399716558525 name: Dot Recall@3 - type: dot_recall@5 value: 0.1798950327281959 name: Dot Recall@5 - type: dot_recall@10 value: 0.30445937907171233 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.653377948809325 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7161098513479467 name: Dot Mrr@10 - type: dot_map@100 value: 0.5832421743206123 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms uk options type: rusisms-uk-options metrics: - type: dot_accuracy@1 value: 0.5079365079365079 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.6698412698412698 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.7206349206349206 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8063492063492064 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5079365079365079 name: Dot Precision@1 - type: dot_precision@3 value: 0.5291005291005292 name: Dot Precision@3 - type: dot_precision@5 value: 0.5244444444444444 name: Dot Precision@5 - type: dot_precision@10 value: 0.5161904761904763 name: Dot Precision@10 - type: dot_recall@1 value: 0.03812761613753296 name: Dot Recall@1 - type: dot_recall@3 value: 0.09585458914506449 name: Dot Recall@3 - type: dot_recall@5 value: 0.14535425244930936 name: Dot Recall@5 - type: dot_recall@10 value: 0.25808760386865054 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5477652929333332 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6046926177878558 name: Dot Mrr@10 - type: dot_map@100 value: 0.5094017339022535 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms ru options type: rusisms-ru-options metrics: - type: dot_accuracy@1 value: 0.5301587301587302 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.6888888888888889 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.7238095238095238 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8158730158730159 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5301587301587302 name: Dot Precision@1 - type: dot_precision@3 value: 0.544973544973545 name: Dot Precision@3 - type: dot_precision@5 value: 0.532063492063492 name: Dot Precision@5 - type: dot_precision@10 value: 0.52 name: Dot Precision@10 - type: dot_recall@1 value: 0.03705324868358231 name: Dot Recall@1 - type: dot_recall@3 value: 0.10066591339571287 name: Dot Recall@3 - type: dot_recall@5 value: 0.14399310107014857 name: Dot Recall@5 - type: dot_recall@10 value: 0.2552429072391238 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.553830560979967 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6194784580498864 name: Dot Mrr@10 - type: dot_map@100 value: 0.5140991489831742 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms_corrected uk title type: rusisms_corrected-uk-title metrics: - type: dot_accuracy@1 value: 0.7151898734177216 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8386075949367089 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8924050632911392 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.930379746835443 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.7151898734177216 name: Dot Precision@1 - type: dot_precision@3 value: 0.7225738396624471 name: Dot Precision@3 - type: dot_precision@5 value: 0.7145569620253165 name: Dot Precision@5 - type: dot_precision@10 value: 0.6708860759493671 name: Dot Precision@10 - type: dot_recall@1 value: 0.05229951549096141 name: Dot Recall@1 - type: dot_recall@3 value: 0.13628810263154228 name: Dot Recall@3 - type: dot_recall@5 value: 0.2094355626225765 name: Dot Recall@5 - type: dot_recall@10 value: 0.3450674119274602 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.7249288170932883 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7896486337150894 name: Dot Mrr@10 - type: dot_map@100 value: 0.6489892378490031 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms_corrected ru title type: rusisms_corrected-ru-title metrics: - type: dot_accuracy@1 value: 0.7088607594936709 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.8354430379746836 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8860759493670886 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9240506329113924 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.7088607594936709 name: Dot Precision@1 - type: dot_precision@3 value: 0.7183544303797469 name: Dot Precision@3 - type: dot_precision@5 value: 0.7132911392405064 name: Dot Precision@5 - type: dot_precision@10 value: 0.6693037974683544 name: Dot Precision@10 - type: dot_recall@1 value: 0.054619494579519506 name: Dot Recall@1 - type: dot_recall@3 value: 0.1336982729528888 name: Dot Recall@3 - type: dot_recall@5 value: 0.20932510368124374 name: Dot Recall@5 - type: dot_recall@10 value: 0.34684057776104554 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.7231182963024592 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.7835907675306409 name: Dot Mrr@10 - type: dot_map@100 value: 0.6508513938167568 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms_corrected uk options type: rusisms_corrected-uk-options metrics: - type: dot_accuracy@1 value: 0.5981012658227848 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7436708860759493 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8037974683544303 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8860759493670886 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5981012658227848 name: Dot Precision@1 - type: dot_precision@3 value: 0.6002109704641351 name: Dot Precision@3 - type: dot_precision@5 value: 0.5930379746835444 name: Dot Precision@5 - type: dot_precision@10 value: 0.5841772151898735 name: Dot Precision@10 - type: dot_recall@1 value: 0.049508481543291766 name: Dot Recall@1 - type: dot_recall@3 value: 0.11315434471011722 name: Dot Recall@3 - type: dot_recall@5 value: 0.16749351336905563 name: Dot Recall@5 - type: dot_recall@10 value: 0.3002699195756294 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.6256595239372265 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6844472071529034 name: Dot Mrr@10 - type: dot_map@100 value: 0.5872024224481405 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: rusisms_corrected ru options type: rusisms_corrected-ru-options metrics: - type: dot_accuracy@1 value: 0.6044303797468354 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.759493670886076 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.810126582278481 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.879746835443038 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.6044303797468354 name: Dot Precision@1 - type: dot_precision@3 value: 0.6086497890295358 name: Dot Precision@3 - type: dot_precision@5 value: 0.6056962025316456 name: Dot Precision@5 - type: dot_precision@10 value: 0.5892405063291138 name: Dot Precision@10 - type: dot_recall@1 value: 0.04461392111075665 name: Dot Recall@1 - type: dot_recall@3 value: 0.11387608742379286 name: Dot Recall@3 - type: dot_recall@5 value: 0.176458016456346 name: Dot Recall@5 - type: dot_recall@10 value: 0.3010663324138532 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.6303070174627994 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6942849608197708 name: Dot Mrr@10 - type: dot_map@100 value: 0.5880961781311048 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core_typos uk title type: core_typos-uk-title metrics: - type: dot_accuracy@1 value: 0.5441478439425051 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7679671457905544 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8439425051334702 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9065708418891171 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5441478439425051 name: Dot Precision@1 - type: dot_precision@3 value: 0.5420944558521561 name: Dot Precision@3 - type: dot_precision@5 value: 0.5262833675564682 name: Dot Precision@5 - type: dot_precision@10 value: 0.4450718685831622 name: Dot Precision@10 - type: dot_recall@1 value: 0.056110382149154946 name: Dot Recall@1 - type: dot_recall@3 value: 0.1664961752759192 name: Dot Recall@3 - type: dot_recall@5 value: 0.2676442430118901 name: Dot Recall@5 - type: dot_recall@10 value: 0.4414053568661613 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.4997363861493741 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.6683073400475865 name: Dot Mrr@10 - type: dot_map@100 value: 0.480769816046975 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core_typos ru title type: core_typos-ru-title metrics: - type: dot_accuracy@1 value: 0.5595482546201233 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.7618069815195072 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.8490759753593429 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.9075975359342916 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.5595482546201233 name: Dot Precision@1 - type: dot_precision@3 value: 0.5417522245037646 name: Dot Precision@3 - type: dot_precision@5 value: 0.5359342915811088 name: Dot Precision@5 - type: dot_precision@10 value: 0.45441478439425054 name: Dot Precision@10 - type: dot_recall@1 value: 0.05744649512088213 name: Dot Recall@1 - type: dot_recall@3 value: 0.16701602532092327 name: Dot Recall@3 - type: dot_recall@5 value: 0.2734833740865569 name: Dot Recall@5 - type: dot_recall@10 value: 0.45220967464444944 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.5093355196909074 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.677807926729898 name: Dot Mrr@10 - type: dot_map@100 value: 0.4874349469065539 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core_typos uk options type: core_typos-uk-options metrics: - type: dot_accuracy@1 value: 0.43018480492813144 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.6714579055441479 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.768993839835729 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.8613963039014374 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.43018480492813144 name: Dot Precision@1 - type: dot_precision@3 value: 0.4455852156057495 name: Dot Precision@3 - type: dot_precision@5 value: 0.435523613963039 name: Dot Precision@5 - type: dot_precision@10 value: 0.3972279260780287 name: Dot Precision@10 - type: dot_recall@1 value: 0.04330169200020632 name: Dot Recall@1 - type: dot_recall@3 value: 0.13518577622938052 name: Dot Recall@3 - type: dot_recall@5 value: 0.21866332490502075 name: Dot Recall@5 - type: dot_recall@10 value: 0.392688229437082 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.4298071307733926 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.5711397118737975 name: Dot Mrr@10 - type: dot_map@100 value: 0.42856816814675947 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: core_typos ru options type: core_typos-ru-options metrics: - type: dot_accuracy@1 value: 0.44455852156057496 name: Dot Accuracy@1 - type: dot_accuracy@3 value: 0.686858316221766 name: Dot Accuracy@3 - type: dot_accuracy@5 value: 0.7618069815195072 name: Dot Accuracy@5 - type: dot_accuracy@10 value: 0.864476386036961 name: Dot Accuracy@10 - type: dot_precision@1 value: 0.44455852156057496 name: Dot Precision@1 - type: dot_precision@3 value: 0.44490075290896636 name: Dot Precision@3 - type: dot_precision@5 value: 0.43490759753593433 name: Dot Precision@5 - type: dot_precision@10 value: 0.3975359342915811 name: Dot Precision@10 - type: dot_recall@1 value: 0.04479658044777624 name: Dot Recall@1 - type: dot_recall@3 value: 0.1347644607375553 name: Dot Recall@3 - type: dot_recall@5 value: 0.21857062953889264 name: Dot Recall@5 - type: dot_recall@10 value: 0.39287477086199757 name: Dot Recall@10 - type: dot_ndcg@10 value: 0.43174916334789476 name: Dot Ndcg@10 - type: dot_mrr@10 value: 0.5840165737753005 name: Dot Mrr@10 - type: dot_map@100 value: 0.42892229251421876 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'bm full matryoshka_dim 768 ' type: bm-full--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.4827586206896552 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.4827586206896552 name: Dot Precision@1 - type: dot_recall@1 value: 0.01196127951053177 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.4827586206896552 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.4827586206896552 name: Dot Mrr@1 - type: dot_map@100 value: 0.3625151414171006 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'bm full matryoshka_dim 512 ' type: bm-full--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.4870689655172414 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.4870689655172414 name: Dot Precision@1 - type: dot_recall@1 value: 0.011896454984463846 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.4870689655172414 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.4870689655172414 name: Dot Mrr@1 - type: dot_map@100 value: 0.35842482942717774 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'bm full matryoshka_dim 256 ' type: bm-full--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.4795258620689655 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.4795258620689655 name: Dot Precision@1 - type: dot_recall@1 value: 0.011663234566005438 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.4795258620689655 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.4795258620689655 name: Dot Mrr@1 - type: dot_map@100 value: 0.3474817245112194 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'bm full matryoshka_dim 128 ' type: bm-full--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.46282327586206895 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.46282327586206895 name: Dot Precision@1 - type: dot_recall@1 value: 0.01131212384281547 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.46282327586206895 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.46282327586206895 name: Dot Mrr@1 - type: dot_map@100 value: 0.3248272798879951 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk title matryoshka_dim 768 ' type: core-uk-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6396303901437371 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6396303901437371 name: Dot Precision@1 - type: dot_recall@1 value: 0.06563353437372038 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6396303901437371 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6396303901437371 name: Dot Mrr@1 - type: dot_map@100 value: 0.577288555105118 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk title matryoshka_dim 512 ' type: core-uk-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6406570841889117 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6406570841889117 name: Dot Precision@1 - type: dot_recall@1 value: 0.06587241823683423 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6406570841889117 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6406570841889117 name: Dot Mrr@1 - type: dot_map@100 value: 0.5752222679445229 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk title matryoshka_dim 256 ' type: core-uk-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6324435318275154 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6324435318275154 name: Dot Precision@1 - type: dot_recall@1 value: 0.06480127755644123 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6324435318275154 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6324435318275154 name: Dot Mrr@1 - type: dot_map@100 value: 0.5663053619932218 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk title matryoshka_dim 128 ' type: core-uk-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6149897330595483 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6149897330595483 name: Dot Precision@1 - type: dot_recall@1 value: 0.06264395322705504 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6149897330595483 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6149897330595483 name: Dot Mrr@1 - type: dot_map@100 value: 0.5484061365065558 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru title matryoshka_dim 768 ' type: core-ru-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6427104722792608 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6427104722792608 name: Dot Precision@1 - type: dot_recall@1 value: 0.06587922611068522 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6427104722792608 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6427104722792608 name: Dot Mrr@1 - type: dot_map@100 value: 0.5856572456385178 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru title matryoshka_dim 512 ' type: core-ru-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.648870636550308 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.648870636550308 name: Dot Precision@1 - type: dot_recall@1 value: 0.06610387027783451 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.648870636550308 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.648870636550308 name: Dot Mrr@1 - type: dot_map@100 value: 0.5830145398816737 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru title matryoshka_dim 256 ' type: core-ru-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6396303901437371 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6396303901437371 name: Dot Precision@1 - type: dot_recall@1 value: 0.06553455167720176 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6396303901437371 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6396303901437371 name: Dot Mrr@1 - type: dot_map@100 value: 0.5732896608635226 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru title matryoshka_dim 128 ' type: core-ru-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6232032854209446 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6232032854209446 name: Dot Precision@1 - type: dot_recall@1 value: 0.06354963466027605 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6232032854209446 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6232032854209446 name: Dot Mrr@1 - type: dot_map@100 value: 0.5559110730601244 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk options matryoshka_dim 768 ' type: core-uk-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5236139630390144 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5236139630390144 name: Dot Precision@1 - type: dot_recall@1 value: 0.05249346074400429 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5236139630390144 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5236139630390144 name: Dot Mrr@1 - type: dot_map@100 value: 0.5240753568505577 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk options matryoshka_dim 512 ' type: core-uk-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5225872689938398 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5225872689938398 name: Dot Precision@1 - type: dot_recall@1 value: 0.05238478506234274 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5225872689938398 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5225872689938398 name: Dot Mrr@1 - type: dot_map@100 value: 0.5236281189854084 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk options matryoshka_dim 256 ' type: core-uk-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5256673511293635 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5256673511293635 name: Dot Precision@1 - type: dot_recall@1 value: 0.052921410483465076 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5256673511293635 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5256673511293635 name: Dot Mrr@1 - type: dot_map@100 value: 0.5199763651753088 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core uk options matryoshka_dim 128 ' type: core-uk-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.5410677618069816 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5410677618069816 name: Dot Precision@1 - type: dot_recall@1 value: 0.05449566044067192 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5410677618069816 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5410677618069816 name: Dot Mrr@1 - type: dot_map@100 value: 0.5150247410636571 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru options matryoshka_dim 768 ' type: core-ru-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5297741273100616 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5297741273100616 name: Dot Precision@1 - type: dot_recall@1 value: 0.053178864642356605 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5297741273100616 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5297741273100616 name: Dot Mrr@1 - type: dot_map@100 value: 0.5263587112126676 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru options matryoshka_dim 512 ' type: core-ru-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5174537987679672 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5174537987679672 name: Dot Precision@1 - type: dot_recall@1 value: 0.052163426469653065 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5174537987679672 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5174537987679672 name: Dot Mrr@1 - type: dot_map@100 value: 0.5236838797988758 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru options matryoshka_dim 256 ' type: core-ru-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5318275154004107 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5318275154004107 name: Dot Precision@1 - type: dot_recall@1 value: 0.053104686026083536 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5318275154004107 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5318275154004107 name: Dot Mrr@1 - type: dot_map@100 value: 0.5209412403873032 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core ru options matryoshka_dim 128 ' type: core-ru-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.5379876796714579 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5379876796714579 name: Dot Precision@1 - type: dot_recall@1 value: 0.053966710018920436 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5379876796714579 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5379876796714579 name: Dot Mrr@1 - type: dot_map@100 value: 0.5133054014486105 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk title matryoshka_dim 768 ' type: options-uk-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.7394209354120267 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7394209354120267 name: Dot Precision@1 - type: dot_recall@1 value: 0.11383682513972047 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7394209354120267 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7394209354120267 name: Dot Mrr@1 - type: dot_map@100 value: 0.7239673528662353 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk title matryoshka_dim 512 ' type: options-uk-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.7238307349665924 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7238307349665924 name: Dot Precision@1 - type: dot_recall@1 value: 0.11181999762177937 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7238307349665924 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7238307349665924 name: Dot Mrr@1 - type: dot_map@100 value: 0.7104146712019577 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk title matryoshka_dim 256 ' type: options-uk-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.7171492204899778 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7171492204899778 name: Dot Precision@1 - type: dot_recall@1 value: 0.11083633021272221 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7171492204899778 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7171492204899778 name: Dot Mrr@1 - type: dot_map@100 value: 0.6883732565553049 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk title matryoshka_dim 128 ' type: options-uk-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.7082405345211581 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7082405345211581 name: Dot Precision@1 - type: dot_recall@1 value: 0.10982349746269568 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7082405345211581 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7082405345211581 name: Dot Mrr@1 - type: dot_map@100 value: 0.6672151382610533 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru title matryoshka_dim 768 ' type: options-ru-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.7594654788418709 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7594654788418709 name: Dot Precision@1 - type: dot_recall@1 value: 0.11641928351282471 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7594654788418709 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7594654788418709 name: Dot Mrr@1 - type: dot_map@100 value: 0.7245632175079355 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru title matryoshka_dim 512 ' type: options-ru-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.7438752783964365 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7438752783964365 name: Dot Precision@1 - type: dot_recall@1 value: 0.11443692412512012 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7438752783964365 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7438752783964365 name: Dot Mrr@1 - type: dot_map@100 value: 0.7136189111526942 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru title matryoshka_dim 256 ' type: options-ru-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.7371937639198218 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7371937639198218 name: Dot Precision@1 - type: dot_recall@1 value: 0.11332245458080649 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7371937639198218 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7371937639198218 name: Dot Mrr@1 - type: dot_map@100 value: 0.6892258048999176 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru title matryoshka_dim 128 ' type: options-ru-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.7238307349665924 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7238307349665924 name: Dot Precision@1 - type: dot_recall@1 value: 0.11152657661566348 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7238307349665924 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7238307349665924 name: Dot Mrr@1 - type: dot_map@100 value: 0.6687940992568223 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk options matryoshka_dim 768 ' type: options-uk-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6458797327394209 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6458797327394209 name: Dot Precision@1 - type: dot_recall@1 value: 0.09318157714594241 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6458797327394209 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6458797327394209 name: Dot Mrr@1 - type: dot_map@100 value: 0.6386028228542846 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk options matryoshka_dim 512 ' type: options-uk-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6414253897550112 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6414253897550112 name: Dot Precision@1 - type: dot_recall@1 value: 0.09289169133267129 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6414253897550112 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6414253897550112 name: Dot Mrr@1 - type: dot_map@100 value: 0.635382203667806 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk options matryoshka_dim 256 ' type: options-uk-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6169265033407573 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6169265033407573 name: Dot Precision@1 - type: dot_recall@1 value: 0.09079708957214525 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6169265033407573 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6169265033407573 name: Dot Mrr@1 - type: dot_map@100 value: 0.622935686512129 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options uk options matryoshka_dim 128 ' type: options-uk-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6458797327394209 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6458797327394209 name: Dot Precision@1 - type: dot_recall@1 value: 0.09452760182158845 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6458797327394209 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6458797327394209 name: Dot Mrr@1 - type: dot_map@100 value: 0.60965204111836 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru options matryoshka_dim 768 ' type: options-ru-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6614699331848553 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6614699331848553 name: Dot Precision@1 - type: dot_recall@1 value: 0.0981715018463348 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6614699331848553 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6614699331848553 name: Dot Mrr@1 - type: dot_map@100 value: 0.6428702846826188 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru options matryoshka_dim 512 ' type: options-ru-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6636971046770601 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6636971046770601 name: Dot Precision@1 - type: dot_recall@1 value: 0.09760675478938285 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6636971046770601 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6636971046770601 name: Dot Mrr@1 - type: dot_map@100 value: 0.6439239459906216 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru options matryoshka_dim 256 ' type: options-ru-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6391982182628062 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6391982182628062 name: Dot Precision@1 - type: dot_recall@1 value: 0.09542995979521592 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6391982182628062 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6391982182628062 name: Dot Mrr@1 - type: dot_map@100 value: 0.629344320618109 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'options ru options matryoshka_dim 128 ' type: options-ru-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6347438752783965 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6347438752783965 name: Dot Precision@1 - type: dot_recall@1 value: 0.09373041583509291 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6347438752783965 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6347438752783965 name: Dot Mrr@1 - type: dot_map@100 value: 0.6091667980283396 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk title matryoshka_dim 768 ' type: rusisms-uk-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6126984126984127 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6126984126984127 name: Dot Precision@1 - type: dot_recall@1 value: 0.04115662469429067 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6126984126984127 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6126984126984127 name: Dot Mrr@1 - type: dot_map@100 value: 0.578074929897279 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk title matryoshka_dim 512 ' type: rusisms-uk-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6158730158730159 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6158730158730159 name: Dot Precision@1 - type: dot_recall@1 value: 0.040352666747475584 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6158730158730159 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6158730158730159 name: Dot Mrr@1 - type: dot_map@100 value: 0.5704781509386151 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk title matryoshka_dim 256 ' type: rusisms-uk-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6285714285714286 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6285714285714286 name: Dot Precision@1 - type: dot_recall@1 value: 0.04056252873440021 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6285714285714286 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6285714285714286 name: Dot Mrr@1 - type: dot_map@100 value: 0.5604494626815789 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk title matryoshka_dim 128 ' type: rusisms-uk-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.5873015873015873 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5873015873015873 name: Dot Precision@1 - type: dot_recall@1 value: 0.03764504378610293 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5873015873015873 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5873015873015873 name: Dot Mrr@1 - type: dot_map@100 value: 0.5398720823741916 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru title matryoshka_dim 768 ' type: rusisms-ru-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6285714285714286 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6285714285714286 name: Dot Precision@1 - type: dot_recall@1 value: 0.04105120240841725 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6285714285714286 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6285714285714286 name: Dot Mrr@1 - type: dot_map@100 value: 0.5832421743206123 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru title matryoshka_dim 512 ' type: rusisms-ru-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6349206349206349 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6349206349206349 name: Dot Precision@1 - type: dot_recall@1 value: 0.0420941934514083 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6349206349206349 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6349206349206349 name: Dot Mrr@1 - type: dot_map@100 value: 0.5764220989315705 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru title matryoshka_dim 256 ' type: rusisms-ru-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6285714285714286 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6285714285714286 name: Dot Precision@1 - type: dot_recall@1 value: 0.04014059333664441 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6285714285714286 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6285714285714286 name: Dot Mrr@1 - type: dot_map@100 value: 0.566298254239877 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru title matryoshka_dim 128 ' type: rusisms-ru-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6158730158730159 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6158730158730159 name: Dot Precision@1 - type: dot_recall@1 value: 0.038870453261498454 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6158730158730159 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6158730158730159 name: Dot Mrr@1 - type: dot_map@100 value: 0.5445486400478832 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk options matryoshka_dim 768 ' type: rusisms-uk-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5079365079365079 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5079365079365079 name: Dot Precision@1 - type: dot_recall@1 value: 0.03812761613753296 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5079365079365079 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5079365079365079 name: Dot Mrr@1 - type: dot_map@100 value: 0.5094017339022535 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk options matryoshka_dim 512 ' type: rusisms-uk-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5206349206349207 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5206349206349207 name: Dot Precision@1 - type: dot_recall@1 value: 0.03991735604209552 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5206349206349207 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5206349206349207 name: Dot Mrr@1 - type: dot_map@100 value: 0.5105065328987617 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk options matryoshka_dim 256 ' type: rusisms-uk-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5206349206349207 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5206349206349207 name: Dot Precision@1 - type: dot_recall@1 value: 0.037370939101335474 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5206349206349207 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5206349206349207 name: Dot Mrr@1 - type: dot_map@100 value: 0.5046548365211337 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms uk options matryoshka_dim 128 ' type: rusisms-uk-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.4984126984126984 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.4984126984126984 name: Dot Precision@1 - type: dot_recall@1 value: 0.03562191745819187 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.4984126984126984 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.4984126984126984 name: Dot Mrr@1 - type: dot_map@100 value: 0.489772905412056 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru options matryoshka_dim 768 ' type: rusisms-ru-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5301587301587302 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5301587301587302 name: Dot Precision@1 - type: dot_recall@1 value: 0.03705324868358231 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5301587301587302 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5301587301587302 name: Dot Mrr@1 - type: dot_map@100 value: 0.5140991489831742 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru options matryoshka_dim 512 ' type: rusisms-ru-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5365079365079365 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5365079365079365 name: Dot Precision@1 - type: dot_recall@1 value: 0.038171520553733886 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5365079365079365 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5365079365079365 name: Dot Mrr@1 - type: dot_map@100 value: 0.5103479398858377 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru options matryoshka_dim 256 ' type: rusisms-ru-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5492063492063493 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5492063492063493 name: Dot Precision@1 - type: dot_recall@1 value: 0.040570041354933084 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5492063492063493 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5492063492063493 name: Dot Mrr@1 - type: dot_map@100 value: 0.5104878477703144 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms ru options matryoshka_dim 128 ' type: rusisms-ru-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.526984126984127 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.526984126984127 name: Dot Precision@1 - type: dot_recall@1 value: 0.037243305642727056 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.526984126984127 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.526984126984127 name: Dot Mrr@1 - type: dot_map@100 value: 0.49561770644701786 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk title matryoshka_dim 768 ' type: rusisms_corrected-uk-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.7151898734177216 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7151898734177216 name: Dot Precision@1 - type: dot_recall@1 value: 0.05229951549096141 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7151898734177216 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7151898734177216 name: Dot Mrr@1 - type: dot_map@100 value: 0.6489892378490031 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk title matryoshka_dim 512 ' type: rusisms_corrected-uk-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.7341772151898734 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7341772151898734 name: Dot Precision@1 - type: dot_recall@1 value: 0.05642593987055035 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7341772151898734 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7341772151898734 name: Dot Mrr@1 - type: dot_map@100 value: 0.6476330230514279 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk title matryoshka_dim 256 ' type: rusisms_corrected-uk-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.7373417721518988 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7373417721518988 name: Dot Precision@1 - type: dot_recall@1 value: 0.05366860446118454 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7373417721518988 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7373417721518988 name: Dot Mrr@1 - type: dot_map@100 value: 0.6396445127000805 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk title matryoshka_dim 128 ' type: rusisms_corrected-uk-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.7088607594936709 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7088607594936709 name: Dot Precision@1 - type: dot_recall@1 value: 0.05088288009256876 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7088607594936709 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7088607594936709 name: Dot Mrr@1 - type: dot_map@100 value: 0.6228545471540479 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru title matryoshka_dim 768 ' type: rusisms_corrected-ru-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.7088607594936709 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7088607594936709 name: Dot Precision@1 - type: dot_recall@1 value: 0.054619494579519506 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7088607594936709 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7088607594936709 name: Dot Mrr@1 - type: dot_map@100 value: 0.6508513938167568 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru title matryoshka_dim 512 ' type: rusisms_corrected-ru-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.7310126582278481 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7310126582278481 name: Dot Precision@1 - type: dot_recall@1 value: 0.055560607719386805 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7310126582278481 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7310126582278481 name: Dot Mrr@1 - type: dot_map@100 value: 0.6474909137910566 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru title matryoshka_dim 256 ' type: rusisms_corrected-ru-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.7373417721518988 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.7373417721518988 name: Dot Precision@1 - type: dot_recall@1 value: 0.0530718967134852 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.7373417721518988 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.7373417721518988 name: Dot Mrr@1 - type: dot_map@100 value: 0.6406904998316159 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru title matryoshka_dim 128 ' type: rusisms_corrected-ru-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.740506329113924 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.740506329113924 name: Dot Precision@1 - type: dot_recall@1 value: 0.05642954540791603 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.740506329113924 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.740506329113924 name: Dot Mrr@1 - type: dot_map@100 value: 0.6291481916987621 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk options matryoshka_dim 768 ' type: rusisms_corrected-uk-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5981012658227848 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5981012658227848 name: Dot Precision@1 - type: dot_recall@1 value: 0.049508481543291766 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5981012658227848 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5981012658227848 name: Dot Mrr@1 - type: dot_map@100 value: 0.5872024224481405 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk options matryoshka_dim 512 ' type: rusisms_corrected-uk-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6329113924050633 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6329113924050633 name: Dot Precision@1 - type: dot_recall@1 value: 0.05335169017497475 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6329113924050633 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6329113924050633 name: Dot Mrr@1 - type: dot_map@100 value: 0.5879304786019428 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk options matryoshka_dim 256 ' type: rusisms_corrected-uk-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6107594936708861 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6107594936708861 name: Dot Precision@1 - type: dot_recall@1 value: 0.049490701607051664 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6107594936708861 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6107594936708861 name: Dot Mrr@1 - type: dot_map@100 value: 0.5849371352598327 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected uk options matryoshka_dim 128 ' type: rusisms_corrected-uk-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6170886075949367 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6170886075949367 name: Dot Precision@1 - type: dot_recall@1 value: 0.045874774865780954 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6170886075949367 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6170886075949367 name: Dot Mrr@1 - type: dot_map@100 value: 0.5764316618592495 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru options matryoshka_dim 768 ' type: rusisms_corrected-ru-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.6044303797468354 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6044303797468354 name: Dot Precision@1 - type: dot_recall@1 value: 0.04461392111075665 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6044303797468354 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6044303797468354 name: Dot Mrr@1 - type: dot_map@100 value: 0.5880961781311048 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru options matryoshka_dim 512 ' type: rusisms_corrected-ru-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.6044303797468354 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6044303797468354 name: Dot Precision@1 - type: dot_recall@1 value: 0.04572733828430041 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6044303797468354 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6044303797468354 name: Dot Mrr@1 - type: dot_map@100 value: 0.586453798418227 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru options matryoshka_dim 256 ' type: rusisms_corrected-ru-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.6329113924050633 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6329113924050633 name: Dot Precision@1 - type: dot_recall@1 value: 0.045180216259829944 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6329113924050633 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6329113924050633 name: Dot Mrr@1 - type: dot_map@100 value: 0.5861453209430655 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'rusisms_corrected ru options matryoshka_dim 128 ' type: rusisms_corrected-ru-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.6265822784810127 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.6265822784810127 name: Dot Precision@1 - type: dot_recall@1 value: 0.04628088533386624 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.6265822784810127 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.6265822784810127 name: Dot Mrr@1 - type: dot_map@100 value: 0.5779403273255477 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk title matryoshka_dim 768 ' type: core_typos-uk-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5441478439425051 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5441478439425051 name: Dot Precision@1 - type: dot_recall@1 value: 0.056110382149154946 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5441478439425051 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5441478439425051 name: Dot Mrr@1 - type: dot_map@100 value: 0.480769816046975 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk title matryoshka_dim 512 ' type: core_typos-uk-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5492813141683778 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5492813141683778 name: Dot Precision@1 - type: dot_recall@1 value: 0.05626807053383331 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5492813141683778 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5492813141683778 name: Dot Mrr@1 - type: dot_map@100 value: 0.4783302092856933 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk title matryoshka_dim 256 ' type: core_typos-uk-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5308008213552361 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5308008213552361 name: Dot Precision@1 - type: dot_recall@1 value: 0.05433412152596233 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5308008213552361 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5308008213552361 name: Dot Mrr@1 - type: dot_map@100 value: 0.46618368961246337 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk title matryoshka_dim 128 ' type: core_typos-uk-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.5123203285420944 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5123203285420944 name: Dot Precision@1 - type: dot_recall@1 value: 0.05245570961161612 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5123203285420944 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5123203285420944 name: Dot Mrr@1 - type: dot_map@100 value: 0.44226507977696844 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru title matryoshka_dim 768 ' type: core_typos-ru-title--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.5595482546201233 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5595482546201233 name: Dot Precision@1 - type: dot_recall@1 value: 0.05744649512088213 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5595482546201233 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5595482546201233 name: Dot Mrr@1 - type: dot_map@100 value: 0.4874349469065539 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru title matryoshka_dim 512 ' type: core_typos-ru-title--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.5451745379876797 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5451745379876797 name: Dot Precision@1 - type: dot_recall@1 value: 0.05620993608597788 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5451745379876797 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5451745379876797 name: Dot Mrr@1 - type: dot_map@100 value: 0.48179945085007053 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru title matryoshka_dim 256 ' type: core_typos-ru-title--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.5318275154004107 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5318275154004107 name: Dot Precision@1 - type: dot_recall@1 value: 0.054473541198236206 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5318275154004107 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5318275154004107 name: Dot Mrr@1 - type: dot_map@100 value: 0.4692266363313306 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru title matryoshka_dim 128 ' type: core_typos-ru-title--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.5225872689938398 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.5225872689938398 name: Dot Precision@1 - type: dot_recall@1 value: 0.05359620013865696 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.5225872689938398 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.5225872689938398 name: Dot Mrr@1 - type: dot_map@100 value: 0.4451705643146633 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk options matryoshka_dim 768 ' type: core_typos-uk-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.43018480492813144 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.43018480492813144 name: Dot Precision@1 - type: dot_recall@1 value: 0.04330169200020632 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.43018480492813144 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.43018480492813144 name: Dot Mrr@1 - type: dot_map@100 value: 0.42856816814675947 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk options matryoshka_dim 512 ' type: core_typos-uk-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.419917864476386 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.419917864476386 name: Dot Precision@1 - type: dot_recall@1 value: 0.042235882951851066 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.419917864476386 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.419917864476386 name: Dot Mrr@1 - type: dot_map@100 value: 0.42366350694238186 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk options matryoshka_dim 256 ' type: core_typos-uk-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.42915811088295686 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.42915811088295686 name: Dot Precision@1 - type: dot_recall@1 value: 0.04352310958558693 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.42915811088295686 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.42915811088295686 name: Dot Mrr@1 - type: dot_map@100 value: 0.41901039848919813 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos uk options matryoshka_dim 128 ' type: core_typos-uk-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.42505133470225875 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.42505133470225875 name: Dot Precision@1 - type: dot_recall@1 value: 0.043236480440550985 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.42505133470225875 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.42505133470225875 name: Dot Mrr@1 - type: dot_map@100 value: 0.4046885891906333 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru options matryoshka_dim 768 ' type: core_typos-ru-options--matryoshka_dim-768-- metrics: - type: dot_accuracy@1 value: 0.44455852156057496 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.44455852156057496 name: Dot Precision@1 - type: dot_recall@1 value: 0.04479658044777624 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.44455852156057496 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.44455852156057496 name: Dot Mrr@1 - type: dot_map@100 value: 0.42892229251421876 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru options matryoshka_dim 512 ' type: core_typos-ru-options--matryoshka_dim-512-- metrics: - type: dot_accuracy@1 value: 0.42299794661190965 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.42299794661190965 name: Dot Precision@1 - type: dot_recall@1 value: 0.042604436939501555 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.42299794661190965 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.42299794661190965 name: Dot Mrr@1 - type: dot_map@100 value: 0.4243465119995708 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru options matryoshka_dim 256 ' type: core_typos-ru-options--matryoshka_dim-256-- metrics: - type: dot_accuracy@1 value: 0.4260780287474333 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.4260780287474333 name: Dot Precision@1 - type: dot_recall@1 value: 0.04284840741387426 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.4260780287474333 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.4260780287474333 name: Dot Mrr@1 - type: dot_map@100 value: 0.4187583987858516 name: Dot Map@100 - task: type: information-retrieval name: Information Retrieval dataset: name: 'core_typos ru options matryoshka_dim 128 ' type: core_typos-ru-options--matryoshka_dim-128-- metrics: - type: dot_accuracy@1 value: 0.446611909650924 name: Dot Accuracy@1 - type: dot_precision@1 value: 0.446611909650924 name: Dot Precision@1 - type: dot_recall@1 value: 0.04509914507725234 name: Dot Recall@1 - type: dot_ndcg@1 value: 0.446611909650924 name: Dot Ndcg@1 - type: dot_mrr@1 value: 0.446611909650924 name: Dot Mrr@1 - type: dot_map@100 value: 0.40468950392929137 name: Dot Map@100 --- # SentenceTransformer based on intfloat/multilingual-e5-base This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [intfloat/multilingual-e5-base](https://huggingface.co/intfloat/multilingual-e5-base) on the rozetka_positive_pairs dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. ## Model Details ### Model Description - **Model Type:** Sentence Transformer - **Base model:** [intfloat/multilingual-e5-base](https://huggingface.co/intfloat/multilingual-e5-base) - **Maximum Sequence Length:** 512 tokens - **Output Dimensionality:** 768 dimensions - **Similarity Function:** Dot Product - **Training Dataset:** - rozetka_positive_pairs ### Model Sources - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) ### Full Model Architecture ``` RZTKSentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: XLMRobertaModel (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Normalize() ) ``` ## Usage ### Direct Usage (Sentence Transformers) First install the Sentence Transformers library: ```bash pip install -U sentence-transformers ``` Then you can load this model and run inference. ```python from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("rztk/multilingual-e5-base-matryoshka2d-mnr-3") # Run inference sentences = [ 'query: мебель для кухни', 'passage: Кухня Эко модуль Вытяжка 600 Эверест Ясень Шимо Светлый 60х30х28 см', 'passage: Ключниці кишенькові Karya Гарантія 14 днів Для кого Для жінок Колір Червоний Матеріал Шкіра Країна реєстрації бренда Туреччина Країна-виробник товару Туреччина', ] embeddings = model.encode(sentences) print(embeddings.shape) # [3, 768] # Get the similarity scores for the embeddings similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] ``` ## Training Details ### Training Dataset #### rozetka_positive_pairs * Dataset: rozetka_positive_pairs * Size: 58,620,066 training samples * Columns: query and text * Approximate statistics based on the first 1000 samples: | | query | text | |:--------|:----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| | type | string | string | | details | | | * Samples: | query | text | |:-----------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | query: xsiomi 9c скло | passage: Защитные стекла Назначение Для мобильных телефонов Цвет Черный Теги Теги Наличие рамки C рамкой Форм-фактор Плоское Клеевой слой По всей поверхности | | query: xsiomi 9c скло | passage: Захисне скло Призначення Для мобільних телефонів Колір Чорний Теги Теги Наявність рамки З рамкою Форм-фактор Плоске Клейовий шар По всій поверхні | | query: xsiomi 9c скло | passage: Захисне скло Glass Full Glue для Xiaomi Redmi 9A/9C/10A (Чорний) | * Loss: sentence_transformers_training.model.matryoshka2d_loss.RZTKMatryoshka2dLoss with these parameters: ```json { "loss": "RZTKMultipleNegativesRankingLoss", "n_layers_per_step": 1, "last_layer_weight": 1.0, "prior_layers_weight": 1.0, "kl_div_weight": 1.0, "kl_temperature": 0.3, "matryoshka_dims": [ 768, 512, 256, 128 ], "matryoshka_weights": [ 1, 1, 1, 1 ], "n_dims_per_step": 1 } ``` ### Evaluation Dataset #### rozetka_positive_pairs * Dataset: rozetka_positive_pairs * Size: 1,903,728 evaluation samples * Columns: query and text * Approximate statistics based on the first 1000 samples: | | query | text | |:--------|:---------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------| | type | string | string | | details | | | * Samples: | query | text | |:--------------------------------------------|:------------------------------------------------------------------------| | query: создаем нейронную сеть | passage: Створюємо нейронну мережу | | query: создаем нейронную сеть | passage: Создаем нейронную сеть (1666498) | | query: создаем нейронную сеть | passage: Научная и техническая литература Переплет Мягкий | * Loss: sentence_transformers_training.model.matryoshka2d_loss.RZTKMatryoshka2dLoss with these parameters: ```json { "loss": "RZTKMultipleNegativesRankingLoss", "n_layers_per_step": 1, "last_layer_weight": 1.0, "prior_layers_weight": 1.0, "kl_div_weight": 1.0, "kl_temperature": 0.3, "matryoshka_dims": [ 768, 512, 256, 128 ], "matryoshka_weights": [ 1, 1, 1, 1 ], "n_dims_per_step": 1 } ``` ### Training Hyperparameters #### Non-Default Hyperparameters - `eval_strategy`: steps - `per_device_train_batch_size`: 88 - `per_device_eval_batch_size`: 88 - `learning_rate`: 2e-05 - `num_train_epochs`: 1.0 - `warmup_ratio`: 0.1 - `bf16`: True - `bf16_full_eval`: True - `tf32`: True - `dataloader_num_workers`: 8 - `load_best_model_at_end`: True - `optim`: adafactor - `push_to_hub`: True - `hub_model_id`: rztk/multilingual-e5-base-matryoshka2d-mnr-3 - `hub_private_repo`: True - `prompts`: {'query': 'query: ', 'text': 'passage: '} - `batch_sampler`: no_duplicates #### All Hyperparameters
Click to expand - `overwrite_output_dir`: False - `do_predict`: False - `eval_strategy`: steps - `prediction_loss_only`: True - `per_device_train_batch_size`: 88 - `per_device_eval_batch_size`: 88 - `per_gpu_train_batch_size`: None - `per_gpu_eval_batch_size`: None - `gradient_accumulation_steps`: 1 - `eval_accumulation_steps`: None - `torch_empty_cache_steps`: None - `learning_rate`: 2e-05 - `weight_decay`: 0.0 - `adam_beta1`: 0.9 - `adam_beta2`: 0.999 - `adam_epsilon`: 1e-08 - `max_grad_norm`: 1.0 - `num_train_epochs`: 1.0 - `max_steps`: -1 - `lr_scheduler_type`: linear - `lr_scheduler_kwargs`: {} - `warmup_ratio`: 0.1 - `warmup_steps`: 0 - `log_level`: passive - `log_level_replica`: warning - `log_on_each_node`: True - `logging_nan_inf_filter`: True - `save_safetensors`: True - `save_on_each_node`: False - `save_only_model`: False - `restore_callback_states_from_checkpoint`: False - `no_cuda`: False - `use_cpu`: False - `use_mps_device`: False - `seed`: 42 - `data_seed`: None - `jit_mode_eval`: False - `use_ipex`: False - `bf16`: True - `fp16`: False - `fp16_opt_level`: O1 - `half_precision_backend`: auto - `bf16_full_eval`: True - `fp16_full_eval`: False - `tf32`: True - `local_rank`: 0 - `ddp_backend`: None - `tpu_num_cores`: None - `tpu_metrics_debug`: False - `debug`: [] - `dataloader_drop_last`: True - `dataloader_num_workers`: 8 - `dataloader_prefetch_factor`: None - `past_index`: -1 - `disable_tqdm`: False - `remove_unused_columns`: True - `label_names`: None - `load_best_model_at_end`: True - `ignore_data_skip`: False - `fsdp`: [] - `fsdp_min_num_params`: 0 - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} - `fsdp_transformer_layer_cls_to_wrap`: None - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} - `deepspeed`: None - `label_smoothing_factor`: 0.0 - `optim`: adafactor - `optim_args`: None - `adafactor`: False - `group_by_length`: False - `length_column_name`: length - `ddp_find_unused_parameters`: None - `ddp_bucket_cap_mb`: None - `ddp_broadcast_buffers`: False - `dataloader_pin_memory`: True - `dataloader_persistent_workers`: False - `skip_memory_metrics`: True - `use_legacy_prediction_loop`: False - `push_to_hub`: True - `resume_from_checkpoint`: None - `hub_model_id`: rztk/multilingual-e5-base-matryoshka2d-mnr-3 - `hub_strategy`: every_save - `hub_private_repo`: True - `hub_always_push`: False - `gradient_checkpointing`: False - `gradient_checkpointing_kwargs`: None - `include_inputs_for_metrics`: False - `include_for_metrics`: [] - `eval_do_concat_batches`: True - `fp16_backend`: auto - `push_to_hub_model_id`: None - `push_to_hub_organization`: None - `mp_parameters`: - `auto_find_batch_size`: False - `full_determinism`: False - `torchdynamo`: None - `ray_scope`: last - `ddp_timeout`: 1800 - `torch_compile`: False - `torch_compile_backend`: None - `torch_compile_mode`: None - `dispatch_batches`: None - `split_batches`: None - `include_tokens_per_second`: False - `include_num_input_tokens_seen`: False - `neftune_noise_alpha`: None - `optim_target_modules`: None - `batch_eval_metrics`: False - `eval_on_start`: False - `use_liger_kernel`: False - `eval_use_gather_object`: False - `average_tokens_across_devices`: False - `prompts`: {'query': 'query: ', 'text': 'passage: '} - `batch_sampler`: no_duplicates - `multi_dataset_batch_sampler`: proportional - `ddp_static_graph`: False - `ddp_comm_hook`: bf16 - `gradient_as_bucket_view`: False - `num_proc`: 30
### Training Logs
Click to expand | Epoch | Step | Training Loss | Validation Loss | |:------:|:------:|:-------------:|:---------------:| | 0.0050 | 833 | 4.8404 | - | | 0.0100 | 1666 | 4.6439 | - | | 0.0150 | 2499 | 4.2238 | - | | 0.0200 | 3332 | 3.5445 | - | | 0.0250 | 4165 | 2.7514 | - | | 0.0300 | 4998 | 2.4037 | - | | 0.0350 | 5831 | 2.1916 | - | | 0.0400 | 6664 | 2.0938 | - | | 0.0450 | 7497 | 1.9268 | - | | 0.0500 | 8330 | 1.8671 | - | | 0.0550 | 9163 | 1.7069 | - | | 0.0600 | 9996 | 1.6419 | - | | 0.0650 | 10829 | 1.55 | - | | 0.0700 | 11662 | 1.5483 | - | | 0.0750 | 12495 | 1.5419 | - | | 0.0800 | 13328 | 1.3582 | - | | 0.0850 | 14161 | 1.3537 | - | | 0.0900 | 14994 | 1.3067 | - | | 0.0950 | 15827 | 1.2128 | - | | 0.1000 | 16654 | - | 1.0107 | | 0.1000 | 16660 | 1.2248 | - | | 0.1050 | 17493 | 1.1565 | - | | 0.1100 | 18326 | 1.1351 | - | | 0.1150 | 19159 | 1.0808 | - | | 0.1200 | 19992 | 1.0561 | - | | 0.1250 | 20825 | 1.078 | - | | 0.1301 | 21658 | 1.1413 | - | | 0.1351 | 22491 | 1.0446 | - | | 0.1401 | 23324 | 0.9986 | - | | 0.1451 | 24157 | 0.9668 | - | | 0.1501 | 24990 | 0.9753 | - | | 0.1551 | 25823 | 1.0031 | - | | 0.1601 | 26656 | 0.9688 | - | | 0.1651 | 27489 | 0.9262 | - | | 0.1701 | 28322 | 0.9702 | - | | 0.1751 | 29155 | 0.9082 | - | | 0.1801 | 29988 | 0.9264 | - | | 0.1851 | 30821 | 0.8526 | - | | 0.1901 | 31654 | 0.9667 | - | | 0.1951 | 32487 | 0.9421 | - | | 0.2000 | 33308 | - | 0.6416 | | 0.2001 | 33320 | 0.9216 | - | | 0.2051 | 34153 | 0.95 | - | | 0.2101 | 34986 | 0.8895 | - | | 0.2151 | 35819 | 0.8349 | - | | 0.2201 | 36652 | 0.8628 | - | | 0.2251 | 37485 | 0.8729 | - | | 0.2301 | 38318 | 0.9285 | - | | 0.2351 | 39151 | 0.8718 | - | | 0.2401 | 39984 | 0.8792 | - | | 0.2451 | 40817 | 0.8852 | - | | 0.2501 | 41650 | 0.877 | - | | 0.2551 | 42483 | 0.8325 | - | | 0.2601 | 43316 | 0.8446 | - | | 0.2651 | 44149 | 0.812 | - | | 0.2701 | 44982 | 0.8246 | - | | 0.2751 | 45815 | 0.8086 | - | | 0.2801 | 46648 | 0.8553 | - | | 0.2851 | 47481 | 0.8506 | - | | 0.2901 | 48314 | 0.834 | - | | 0.2951 | 49147 | 0.8313 | - | | 0.3000 | 49962 | - | 0.5377 | | 0.3001 | 49980 | 0.8376 | - | | 0.3051 | 50813 | 0.7836 | - | | 0.3101 | 51646 | 0.8089 | - | | 0.3151 | 52479 | 0.8065 | - | | 0.3201 | 53312 | 0.8284 | - | | 0.3251 | 54145 | 0.7959 | - | | 0.3301 | 54978 | 0.8332 | - | | 0.3351 | 55811 | 0.7924 | - | | 0.3401 | 56644 | 0.8171 | - | | 0.3451 | 57477 | 0.7924 | - | | 0.3501 | 58310 | 0.7977 | - | | 0.3551 | 59143 | 0.7729 | - | | 0.3601 | 59976 | 0.7617 | - | | 0.3651 | 60809 | 0.8211 | - | | 0.3701 | 61642 | 0.8497 | - | | 0.3751 | 62475 | 0.8218 | - | | 0.3802 | 63308 | 0.7846 | - | | 0.3852 | 64141 | 0.7876 | - | | 0.3902 | 64974 | 0.7912 | - | | 0.3952 | 65807 | 0.7977 | - | | 0.4000 | 66616 | - | 0.4974 | | 0.4002 | 66640 | 0.8096 | - | | 0.4052 | 67473 | 0.8356 | - | | 0.4102 | 68306 | 0.788 | - | | 0.4152 | 69139 | 0.7683 | - | | 0.4202 | 69972 | 0.7358 | - | | 0.4252 | 70805 | 0.7634 | - | | 0.4302 | 71638 | 0.7535 | - | | 0.4352 | 72471 | 0.756 | - | | 0.4402 | 73304 | 0.7633 | - | | 0.4452 | 74137 | 0.7509 | - | | 0.4502 | 74970 | 0.7547 | - | | 0.4552 | 75803 | 0.7539 | - | | 0.4602 | 76636 | 0.7608 | - | | 0.4652 | 77469 | 0.8262 | - | | 0.4702 | 78302 | 0.8076 | - | | 0.4752 | 79135 | 0.8179 | - | | 0.4802 | 79968 | 0.7709 | - | | 0.4852 | 80801 | 0.744 | - | | 0.4902 | 81634 | 0.7846 | - | | 0.4952 | 82467 | 0.7473 | - | | 0.5000 | 83270 | - | 0.4776 | | 0.5002 | 83300 | 0.7759 | - | | 0.5052 | 84133 | 0.755 | - | | 0.5102 | 84966 | 0.7308 | - | | 0.5152 | 85799 | 0.7256 | - | | 0.5202 | 86632 | 0.7703 | - | | 0.5252 | 87465 | 0.7823 | - | | 0.5302 | 88298 | 0.8109 | - | | 0.5352 | 89131 | 0.7795 | - | | 0.5402 | 89964 | 0.7833 | - | | 0.5452 | 90797 | 0.7752 | - | | 0.5502 | 91630 | 0.7975 | - | | 0.5552 | 92463 | 0.7863 | - | | 0.5602 | 93296 | 0.7337 | - | | 0.5652 | 94129 | 0.7755 | - | | 0.5702 | 94962 | 0.7928 | - | | 0.5752 | 95795 | 0.7604 | - | | 0.5802 | 96628 | 0.7983 | - | | 0.5852 | 97461 | 0.7665 | - | | 0.5902 | 98294 | 0.7749 | - | | 0.5952 | 99127 | 0.7838 | - | | 0.6000 | 99924 | - | 0.4669 | | 0.6002 | 99960 | 0.7727 | - | | 0.6052 | 100793 | 0.8049 | - | | 0.6102 | 101626 | 0.7857 | - | | 0.6152 | 102459 | 0.7622 | - | | 0.6202 | 103292 | 0.8117 | - | | 0.6252 | 104125 | 0.7711 | - | | 0.6302 | 104958 | 0.7892 | - | | 0.6353 | 105791 | 0.7938 | - | | 0.6403 | 106624 | 0.728 | - | | 0.6453 | 107457 | 0.7693 | - | | 0.6503 | 108290 | 0.7875 | - | | 0.6553 | 109123 | 0.7958 | - | | 0.6603 | 109956 | 0.749 | - | | 0.6653 | 110789 | 0.7788 | - | | 0.6703 | 111622 | 0.7614 | - | | 0.6753 | 112455 | 0.7577 | - | | 0.6803 | 113288 | 0.7805 | - | | 0.6853 | 114121 | 0.7677 | - | | 0.6903 | 114954 | 0.7458 | - | | 0.6953 | 115787 | 0.7962 | - | | 0.7000 | 116578 | - | 0.4641 | | 0.7003 | 116620 | 0.7275 | - | | 0.7053 | 117453 | 0.7778 | - | | 0.7103 | 118286 | 0.7885 | - | | 0.7153 | 119119 | 0.8046 | - | | 0.7203 | 119952 | 0.8222 | - | | 0.7253 | 120785 | 0.7714 | - | | 0.7303 | 121618 | 0.7983 | - | | 0.7353 | 122451 | 0.7359 | - | | 0.7403 | 123284 | 0.7618 | - | | 0.7453 | 124117 | 0.783 | - | | 0.7503 | 124950 | 0.763 | - | | 0.7553 | 125783 | 0.809 | - | | 0.7603 | 126616 | 0.794 | - | | 0.7653 | 127449 | 0.7366 | - | | 0.7703 | 128282 | 0.776 | - | | 0.7753 | 129115 | 0.8053 | - | | 0.7803 | 129948 | 0.7941 | - | | 0.7853 | 130781 | 0.7722 | - | | 0.7903 | 131614 | 0.7959 | - | | 0.7953 | 132447 | 0.8061 | - | | 0.8000 | 133232 | - | 0.4468 |
### Framework Versions - Python: 3.11.10 - Sentence Transformers: 3.3.0 - Transformers: 4.46.3 - PyTorch: 2.5.1+cu124 - Accelerate: 1.1.1 - Datasets: 3.1.0 - Tokenizers: 0.20.3 ## Citation ### BibTeX #### Sentence Transformers ```bibtex @inproceedings{reimers-2019-sentence-bert, title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", author = "Reimers, Nils and Gurevych, Iryna", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", month = "11", year = "2019", publisher = "Association for Computational Linguistics", url = "https://arxiv.org/abs/1908.10084", } ```