metadata
base_model: intfloat/multilingual-e5-base
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:58620066
- loss:RZTKMatryoshka2dLoss
widget:
- source_sentence: 'query: чехол на самсунг а30'
sentences:
- 'passage: Ключниця Shvigel 13989 Коричнева'
- >-
passage: Ключниці кишенькові Handy Cover Гарантія 1 місяць Колір Рожевий
Матеріал Шкіра Країна реєстрації бренда Україна Країна-виробник товару
Україна Застібка Змійка Кріплення ключів Кільце
- >-
passage: Защитный глянцевый чехол с рисунком для Samsung Galaxy А30
(2019) / A305 / А20 (2019) / A205 Планета
- source_sentence: 'query: мебель для кухни'
sentences:
- >-
passage: Стілець для кухні та вітальні Примтекс Плюс 1022 black S-3120
Червоний (ordf)
- >-
passage: Повітряні кульки Angel Gifts Гарантія 14 днів Кількість
вантажних місць 1 Країна реєстрації бренда Китай Кількість предметів, шт
7 Країна-виробник товару Китай Вид Повітряні кулі Розмір 43 см Розмір 40
х 60 см Розмір 30 см Розмір 40 см Колір Різнобарвний Матеріал
Фольгований поліетилен + латекс Свято День Святого Валентина Свято 8
березня Свято День народження Тип гарантійного талона Гарантія по чеку
Можливість доставки Почтомати Форма Фігурна Особливості Фольговані
Доставка Premium Доставка Доставка в магазини ROZETKA
- 'passage: Ключница кожаная женская Grande Pelle leather-11353 Красная'
- source_sentence: 'query: мебель для кухни'
sentences:
- >-
passage: Рідина для систем SCR дизельних двигунів (Евро 4,5,6) 1.5 л
SHELL AdBLUE
- 'passage: Ключница Black Brier КЛ-5-17 Черная'
- >-
passage: Кухонний комплект Злата 2,6м Світ Меблів білий/артвуд світлий
(без стільниці)
- source_sentence: 'query: вращающаяся подставка для торта'
sentences:
- >-
passage: Штукатурка цементно-вапняна фасадна ПЦШ-017 СІРА ПОЛІПЛАСТ 25
кг
- >-
passage: Подставка для работы с тортом вращающаяся 28 см Empire(GS -
840021006274)
- >-
passage: Ключницы карманные Dr.Bond Для кого Для женщин Цвет Черный
Материал Кожа Застежка Кнопки
- source_sentence: 'query: мебель для кухни'
sentences:
- >-
passage: Ключниці кишенькові Karya Гарантія 14 днів Для кого Для жінок
Колір Червоний Матеріал Шкіра Країна реєстрації бренда Туреччина
Країна-виробник товару Туреччина
- 'passage: Ключница Traum 7203-10 Черная (4820007203107)'
- >-
passage: Кухня Эко модуль Вытяжка 600 Эверест Ясень Шимо Светлый
60х30х28 см
model-index:
- name: SentenceTransformer based on intfloat/multilingual-e5-base
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: bm full
type: bm-full
metrics:
- type: dot_accuracy@1
value: 0.4827586206896552
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.6476293103448276
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.7359913793103449
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8173491379310345
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.4827586206896552
name: Dot Precision@1
- type: dot_precision@3
value: 0.4892241379310345
name: Dot Precision@3
- type: dot_precision@5
value: 0.4947198275862069
name: Dot Precision@5
- type: dot_precision@10
value: 0.4869612068965517
name: Dot Precision@10
- type: dot_recall@1
value: 0.01196127951053177
name: Dot Recall@1
- type: dot_recall@3
value: 0.03605252760852524
name: Dot Recall@3
- type: dot_recall@5
value: 0.06019059294068119
name: Dot Recall@5
- type: dot_recall@10
value: 0.11598568385490053
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.488283085678875
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.581799269636016
name: Dot Mrr@10
- type: dot_map@100
value: 0.3625151414171006
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core uk title
type: core-uk-title
metrics:
- type: dot_accuracy@1
value: 0.6396303901437371
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8439425051334702
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9291581108829569
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9784394250513347
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6396303901437371
name: Dot Precision@1
- type: dot_precision@3
value: 0.6379192334017795
name: Dot Precision@3
- type: dot_precision@5
value: 0.628952772073922
name: Dot Precision@5
- type: dot_precision@10
value: 0.530082135523614
name: Dot Precision@10
- type: dot_recall@1
value: 0.06563353437372038
name: Dot Recall@1
- type: dot_recall@3
value: 0.1948624447816681
name: Dot Recall@3
- type: dot_recall@5
value: 0.3186099953448063
name: Dot Recall@5
- type: dot_recall@10
value: 0.524211399868937
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5917292045236857
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7568943319970016
name: Dot Mrr@10
- type: dot_map@100
value: 0.577288555105118
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core ru title
type: core-ru-title
metrics:
- type: dot_accuracy@1
value: 0.6427104722792608
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8562628336755647
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9332648870636551
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9804928131416838
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6427104722792608
name: Dot Precision@1
- type: dot_precision@3
value: 0.6509240246406571
name: Dot Precision@3
- type: dot_precision@5
value: 0.6381930184804928
name: Dot Precision@5
- type: dot_precision@10
value: 0.5366529774127311
name: Dot Precision@10
- type: dot_recall@1
value: 0.06587922611068522
name: Dot Recall@1
- type: dot_recall@3
value: 0.19907130018858485
name: Dot Recall@3
- type: dot_recall@5
value: 0.32339221688780817
name: Dot Recall@5
- type: dot_recall@10
value: 0.530874137789979
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5993309407105045
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7613282650500315
name: Dot Mrr@10
- type: dot_map@100
value: 0.5856572456385178
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core uk options
type: core-uk-options
metrics:
- type: dot_accuracy@1
value: 0.5236139630390144
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7833675564681725
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8716632443531828
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.944558521560575
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5236139630390144
name: Dot Precision@1
- type: dot_precision@3
value: 0.5355920602327173
name: Dot Precision@3
- type: dot_precision@5
value: 0.5262833675564682
name: Dot Precision@5
- type: dot_precision@10
value: 0.47987679671457906
name: Dot Precision@10
- type: dot_recall@1
value: 0.05249346074400429
name: Dot Recall@1
- type: dot_recall@3
value: 0.1611742944618292
name: Dot Recall@3
- type: dot_recall@5
value: 0.2624932479345754
name: Dot Recall@5
- type: dot_recall@10
value: 0.4720126343473064
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5186376976657447
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6671486424823181
name: Dot Mrr@10
- type: dot_map@100
value: 0.5240753568505577
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core ru options
type: core-ru-options
metrics:
- type: dot_accuracy@1
value: 0.5297741273100616
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7864476386036962
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8706365503080082
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9496919917864476
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5297741273100616
name: Dot Precision@1
- type: dot_precision@3
value: 0.542778918548939
name: Dot Precision@3
- type: dot_precision@5
value: 0.5322381930184806
name: Dot Precision@5
- type: dot_precision@10
value: 0.48357289527720737
name: Dot Precision@10
- type: dot_recall@1
value: 0.053178864642356605
name: Dot Recall@1
- type: dot_recall@3
value: 0.16281660405195855
name: Dot Recall@3
- type: dot_recall@5
value: 0.2651694123105224
name: Dot Recall@5
- type: dot_recall@10
value: 0.47603763442406394
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5237397019255705
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6739529350412302
name: Dot Mrr@10
- type: dot_map@100
value: 0.5263587112126676
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: options uk title
type: options-uk-title
metrics:
- type: dot_accuracy@1
value: 0.7394209354120267
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.9198218262806236
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9688195991091314
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9933184855233853
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.7394209354120267
name: Dot Precision@1
- type: dot_precision@3
value: 0.7319970304380105
name: Dot Precision@3
- type: dot_precision@5
value: 0.6993318485523385
name: Dot Precision@5
- type: dot_precision@10
value: 0.5371937639198219
name: Dot Precision@10
- type: dot_recall@1
value: 0.11383682513972047
name: Dot Recall@1
- type: dot_recall@3
value: 0.3360468348775698
name: Dot Recall@3
- type: dot_recall@5
value: 0.5288643675057929
name: Dot Recall@5
- type: dot_recall@10
value: 0.7693973621033755
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.7458399782711727
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.8359617492134195
name: Dot Mrr@10
- type: dot_map@100
value: 0.7239673528662353
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: options ru title
type: options-ru-title
metrics:
- type: dot_accuracy@1
value: 0.7594654788418709
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.9287305122494433
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9755011135857461
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9933184855233853
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.7594654788418709
name: Dot Precision@1
- type: dot_precision@3
value: 0.7319970304380103
name: Dot Precision@3
- type: dot_precision@5
value: 0.7024498886414253
name: Dot Precision@5
- type: dot_precision@10
value: 0.5383073496659243
name: Dot Precision@10
- type: dot_recall@1
value: 0.11641928351282471
name: Dot Recall@1
- type: dot_recall@3
value: 0.3353919404030763
name: Dot Recall@3
- type: dot_recall@5
value: 0.5311560562674148
name: Dot Recall@5
- type: dot_recall@10
value: 0.7711852858846177
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.7484243182346944
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.8486831406653231
name: Dot Mrr@10
- type: dot_map@100
value: 0.7245632175079355
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: options uk options
type: options-uk-options
metrics:
- type: dot_accuracy@1
value: 0.6458797327394209
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8485523385300668
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9042316258351893
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9532293986636972
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6458797327394209
name: Dot Precision@1
- type: dot_precision@3
value: 0.6325167037861915
name: Dot Precision@3
- type: dot_precision@5
value: 0.6075723830734967
name: Dot Precision@5
- type: dot_precision@10
value: 0.498663697104677
name: Dot Precision@10
- type: dot_recall@1
value: 0.09318157714594241
name: Dot Recall@1
- type: dot_recall@3
value: 0.27791846238394124
name: Dot Recall@3
- type: dot_recall@5
value: 0.44080793618655534
name: Dot Recall@5
- type: dot_recall@10
value: 0.6953837612523581
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.6603776998905829
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7570235443843463
name: Dot Mrr@10
- type: dot_map@100
value: 0.6386028228542846
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: options ru options
type: options-ru-options
metrics:
- type: dot_accuracy@1
value: 0.6614699331848553
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8374164810690423
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.9064587973273942
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9443207126948775
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6614699331848553
name: Dot Precision@1
- type: dot_precision@3
value: 0.6250927988121753
name: Dot Precision@3
- type: dot_precision@5
value: 0.6075723830734966
name: Dot Precision@5
- type: dot_precision@10
value: 0.49643652561247215
name: Dot Precision@10
- type: dot_recall@1
value: 0.0981715018463348
name: Dot Recall@1
- type: dot_recall@3
value: 0.27430911083472326
name: Dot Recall@3
- type: dot_recall@5
value: 0.4410510610399252
name: Dot Recall@5
- type: dot_recall@10
value: 0.6957284425547232
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.6630836813451363
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.764538480574115
name: Dot Mrr@10
- type: dot_map@100
value: 0.6428702846826188
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms uk title
type: rusisms-uk-title
metrics:
- type: dot_accuracy@1
value: 0.6126984126984127
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7714285714285715
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8412698412698413
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8952380952380953
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6126984126984127
name: Dot Precision@1
- type: dot_precision@3
value: 0.6412698412698413
name: Dot Precision@3
- type: dot_precision@5
value: 0.6419047619047619
name: Dot Precision@5
- type: dot_precision@10
value: 0.6133333333333333
name: Dot Precision@10
- type: dot_recall@1
value: 0.04115662469429067
name: Dot Recall@1
- type: dot_recall@3
value: 0.11610870769391896
name: Dot Recall@3
- type: dot_recall@5
value: 0.18272932988415247
name: Dot Recall@5
- type: dot_recall@10
value: 0.3066506749177295
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.6509535118240626
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7072247417485512
name: Dot Mrr@10
- type: dot_map@100
value: 0.578074929897279
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms ru title
type: rusisms-ru-title
metrics:
- type: dot_accuracy@1
value: 0.6285714285714286
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7873015873015873
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8380952380952381
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8857142857142857
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6285714285714286
name: Dot Precision@1
- type: dot_precision@3
value: 0.653968253968254
name: Dot Precision@3
- type: dot_precision@5
value: 0.6425396825396825
name: Dot Precision@5
- type: dot_precision@10
value: 0.613968253968254
name: Dot Precision@10
- type: dot_recall@1
value: 0.04105120240841725
name: Dot Recall@1
- type: dot_recall@3
value: 0.11833399716558525
name: Dot Recall@3
- type: dot_recall@5
value: 0.1798950327281959
name: Dot Recall@5
- type: dot_recall@10
value: 0.30445937907171233
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.653377948809325
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7161098513479467
name: Dot Mrr@10
- type: dot_map@100
value: 0.5832421743206123
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms uk options
type: rusisms-uk-options
metrics:
- type: dot_accuracy@1
value: 0.5079365079365079
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.6698412698412698
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.7206349206349206
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8063492063492064
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5079365079365079
name: Dot Precision@1
- type: dot_precision@3
value: 0.5291005291005292
name: Dot Precision@3
- type: dot_precision@5
value: 0.5244444444444444
name: Dot Precision@5
- type: dot_precision@10
value: 0.5161904761904763
name: Dot Precision@10
- type: dot_recall@1
value: 0.03812761613753296
name: Dot Recall@1
- type: dot_recall@3
value: 0.09585458914506449
name: Dot Recall@3
- type: dot_recall@5
value: 0.14535425244930936
name: Dot Recall@5
- type: dot_recall@10
value: 0.25808760386865054
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5477652929333332
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6046926177878558
name: Dot Mrr@10
- type: dot_map@100
value: 0.5094017339022535
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms ru options
type: rusisms-ru-options
metrics:
- type: dot_accuracy@1
value: 0.5301587301587302
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.6888888888888889
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.7238095238095238
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8158730158730159
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5301587301587302
name: Dot Precision@1
- type: dot_precision@3
value: 0.544973544973545
name: Dot Precision@3
- type: dot_precision@5
value: 0.532063492063492
name: Dot Precision@5
- type: dot_precision@10
value: 0.52
name: Dot Precision@10
- type: dot_recall@1
value: 0.03705324868358231
name: Dot Recall@1
- type: dot_recall@3
value: 0.10066591339571287
name: Dot Recall@3
- type: dot_recall@5
value: 0.14399310107014857
name: Dot Recall@5
- type: dot_recall@10
value: 0.2552429072391238
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.553830560979967
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6194784580498864
name: Dot Mrr@10
- type: dot_map@100
value: 0.5140991489831742
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms_corrected uk title
type: rusisms_corrected-uk-title
metrics:
- type: dot_accuracy@1
value: 0.7151898734177216
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8386075949367089
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8924050632911392
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.930379746835443
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.7151898734177216
name: Dot Precision@1
- type: dot_precision@3
value: 0.7225738396624471
name: Dot Precision@3
- type: dot_precision@5
value: 0.7145569620253165
name: Dot Precision@5
- type: dot_precision@10
value: 0.6708860759493671
name: Dot Precision@10
- type: dot_recall@1
value: 0.05229951549096141
name: Dot Recall@1
- type: dot_recall@3
value: 0.13628810263154228
name: Dot Recall@3
- type: dot_recall@5
value: 0.2094355626225765
name: Dot Recall@5
- type: dot_recall@10
value: 0.3450674119274602
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.7249288170932883
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7896486337150894
name: Dot Mrr@10
- type: dot_map@100
value: 0.6489892378490031
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms_corrected ru title
type: rusisms_corrected-ru-title
metrics:
- type: dot_accuracy@1
value: 0.7088607594936709
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.8354430379746836
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8860759493670886
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9240506329113924
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.7088607594936709
name: Dot Precision@1
- type: dot_precision@3
value: 0.7183544303797469
name: Dot Precision@3
- type: dot_precision@5
value: 0.7132911392405064
name: Dot Precision@5
- type: dot_precision@10
value: 0.6693037974683544
name: Dot Precision@10
- type: dot_recall@1
value: 0.054619494579519506
name: Dot Recall@1
- type: dot_recall@3
value: 0.1336982729528888
name: Dot Recall@3
- type: dot_recall@5
value: 0.20932510368124374
name: Dot Recall@5
- type: dot_recall@10
value: 0.34684057776104554
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.7231182963024592
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.7835907675306409
name: Dot Mrr@10
- type: dot_map@100
value: 0.6508513938167568
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms_corrected uk options
type: rusisms_corrected-uk-options
metrics:
- type: dot_accuracy@1
value: 0.5981012658227848
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7436708860759493
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8037974683544303
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8860759493670886
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5981012658227848
name: Dot Precision@1
- type: dot_precision@3
value: 0.6002109704641351
name: Dot Precision@3
- type: dot_precision@5
value: 0.5930379746835444
name: Dot Precision@5
- type: dot_precision@10
value: 0.5841772151898735
name: Dot Precision@10
- type: dot_recall@1
value: 0.049508481543291766
name: Dot Recall@1
- type: dot_recall@3
value: 0.11315434471011722
name: Dot Recall@3
- type: dot_recall@5
value: 0.16749351336905563
name: Dot Recall@5
- type: dot_recall@10
value: 0.3002699195756294
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.6256595239372265
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6844472071529034
name: Dot Mrr@10
- type: dot_map@100
value: 0.5872024224481405
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: rusisms_corrected ru options
type: rusisms_corrected-ru-options
metrics:
- type: dot_accuracy@1
value: 0.6044303797468354
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.759493670886076
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.810126582278481
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.879746835443038
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.6044303797468354
name: Dot Precision@1
- type: dot_precision@3
value: 0.6086497890295358
name: Dot Precision@3
- type: dot_precision@5
value: 0.6056962025316456
name: Dot Precision@5
- type: dot_precision@10
value: 0.5892405063291138
name: Dot Precision@10
- type: dot_recall@1
value: 0.04461392111075665
name: Dot Recall@1
- type: dot_recall@3
value: 0.11387608742379286
name: Dot Recall@3
- type: dot_recall@5
value: 0.176458016456346
name: Dot Recall@5
- type: dot_recall@10
value: 0.3010663324138532
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.6303070174627994
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6942849608197708
name: Dot Mrr@10
- type: dot_map@100
value: 0.5880961781311048
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core_typos uk title
type: core_typos-uk-title
metrics:
- type: dot_accuracy@1
value: 0.5441478439425051
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7679671457905544
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8439425051334702
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9065708418891171
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5441478439425051
name: Dot Precision@1
- type: dot_precision@3
value: 0.5420944558521561
name: Dot Precision@3
- type: dot_precision@5
value: 0.5262833675564682
name: Dot Precision@5
- type: dot_precision@10
value: 0.4450718685831622
name: Dot Precision@10
- type: dot_recall@1
value: 0.056110382149154946
name: Dot Recall@1
- type: dot_recall@3
value: 0.1664961752759192
name: Dot Recall@3
- type: dot_recall@5
value: 0.2676442430118901
name: Dot Recall@5
- type: dot_recall@10
value: 0.4414053568661613
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.4997363861493741
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.6683073400475865
name: Dot Mrr@10
- type: dot_map@100
value: 0.480769816046975
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core_typos ru title
type: core_typos-ru-title
metrics:
- type: dot_accuracy@1
value: 0.5595482546201233
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.7618069815195072
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.8490759753593429
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.9075975359342916
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.5595482546201233
name: Dot Precision@1
- type: dot_precision@3
value: 0.5417522245037646
name: Dot Precision@3
- type: dot_precision@5
value: 0.5359342915811088
name: Dot Precision@5
- type: dot_precision@10
value: 0.45441478439425054
name: Dot Precision@10
- type: dot_recall@1
value: 0.05744649512088213
name: Dot Recall@1
- type: dot_recall@3
value: 0.16701602532092327
name: Dot Recall@3
- type: dot_recall@5
value: 0.2734833740865569
name: Dot Recall@5
- type: dot_recall@10
value: 0.45220967464444944
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5093355196909074
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.677807926729898
name: Dot Mrr@10
- type: dot_map@100
value: 0.4874349469065539
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core_typos uk options
type: core_typos-uk-options
metrics:
- type: dot_accuracy@1
value: 0.43018480492813144
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.6714579055441479
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.768993839835729
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.8613963039014374
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.43018480492813144
name: Dot Precision@1
- type: dot_precision@3
value: 0.4455852156057495
name: Dot Precision@3
- type: dot_precision@5
value: 0.435523613963039
name: Dot Precision@5
- type: dot_precision@10
value: 0.3972279260780287
name: Dot Precision@10
- type: dot_recall@1
value: 0.04330169200020632
name: Dot Recall@1
- type: dot_recall@3
value: 0.13518577622938052
name: Dot Recall@3
- type: dot_recall@5
value: 0.21866332490502075
name: Dot Recall@5
- type: dot_recall@10
value: 0.392688229437082
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.4298071307733926
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.5711397118737975
name: Dot Mrr@10
- type: dot_map@100
value: 0.42856816814675947
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: core_typos ru options
type: core_typos-ru-options
metrics:
- type: dot_accuracy@1
value: 0.44455852156057496
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.686858316221766
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.7618069815195072
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.864476386036961
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.44455852156057496
name: Dot Precision@1
- type: dot_precision@3
value: 0.44490075290896636
name: Dot Precision@3
- type: dot_precision@5
value: 0.43490759753593433
name: Dot Precision@5
- type: dot_precision@10
value: 0.3975359342915811
name: Dot Precision@10
- type: dot_recall@1
value: 0.04479658044777624
name: Dot Recall@1
- type: dot_recall@3
value: 0.1347644607375553
name: Dot Recall@3
- type: dot_recall@5
value: 0.21857062953889264
name: Dot Recall@5
- type: dot_recall@10
value: 0.39287477086199757
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.43174916334789476
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.5840165737753005
name: Dot Mrr@10
- type: dot_map@100
value: 0.42892229251421876
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'bm full matryoshka_dim 768 '
type: bm-full--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.4827586206896552
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.4827586206896552
name: Dot Precision@1
- type: dot_recall@1
value: 0.01196127951053177
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.4827586206896552
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.4827586206896552
name: Dot Mrr@1
- type: dot_map@100
value: 0.3625151414171006
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'bm full matryoshka_dim 512 '
type: bm-full--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.4870689655172414
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.4870689655172414
name: Dot Precision@1
- type: dot_recall@1
value: 0.011896454984463846
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.4870689655172414
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.4870689655172414
name: Dot Mrr@1
- type: dot_map@100
value: 0.35842482942717774
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'bm full matryoshka_dim 256 '
type: bm-full--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.4795258620689655
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.4795258620689655
name: Dot Precision@1
- type: dot_recall@1
value: 0.011663234566005438
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.4795258620689655
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.4795258620689655
name: Dot Mrr@1
- type: dot_map@100
value: 0.3474817245112194
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'bm full matryoshka_dim 128 '
type: bm-full--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.46282327586206895
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.46282327586206895
name: Dot Precision@1
- type: dot_recall@1
value: 0.01131212384281547
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.46282327586206895
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.46282327586206895
name: Dot Mrr@1
- type: dot_map@100
value: 0.3248272798879951
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk title matryoshka_dim 768 '
type: core-uk-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6396303901437371
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6396303901437371
name: Dot Precision@1
- type: dot_recall@1
value: 0.06563353437372038
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6396303901437371
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6396303901437371
name: Dot Mrr@1
- type: dot_map@100
value: 0.577288555105118
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk title matryoshka_dim 512 '
type: core-uk-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6406570841889117
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6406570841889117
name: Dot Precision@1
- type: dot_recall@1
value: 0.06587241823683423
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6406570841889117
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6406570841889117
name: Dot Mrr@1
- type: dot_map@100
value: 0.5752222679445229
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk title matryoshka_dim 256 '
type: core-uk-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6324435318275154
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6324435318275154
name: Dot Precision@1
- type: dot_recall@1
value: 0.06480127755644123
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6324435318275154
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6324435318275154
name: Dot Mrr@1
- type: dot_map@100
value: 0.5663053619932218
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk title matryoshka_dim 128 '
type: core-uk-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6149897330595483
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6149897330595483
name: Dot Precision@1
- type: dot_recall@1
value: 0.06264395322705504
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6149897330595483
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6149897330595483
name: Dot Mrr@1
- type: dot_map@100
value: 0.5484061365065558
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru title matryoshka_dim 768 '
type: core-ru-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6427104722792608
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6427104722792608
name: Dot Precision@1
- type: dot_recall@1
value: 0.06587922611068522
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6427104722792608
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6427104722792608
name: Dot Mrr@1
- type: dot_map@100
value: 0.5856572456385178
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru title matryoshka_dim 512 '
type: core-ru-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.648870636550308
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.648870636550308
name: Dot Precision@1
- type: dot_recall@1
value: 0.06610387027783451
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.648870636550308
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.648870636550308
name: Dot Mrr@1
- type: dot_map@100
value: 0.5830145398816737
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru title matryoshka_dim 256 '
type: core-ru-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6396303901437371
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6396303901437371
name: Dot Precision@1
- type: dot_recall@1
value: 0.06553455167720176
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6396303901437371
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6396303901437371
name: Dot Mrr@1
- type: dot_map@100
value: 0.5732896608635226
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru title matryoshka_dim 128 '
type: core-ru-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6232032854209446
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6232032854209446
name: Dot Precision@1
- type: dot_recall@1
value: 0.06354963466027605
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6232032854209446
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6232032854209446
name: Dot Mrr@1
- type: dot_map@100
value: 0.5559110730601244
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk options matryoshka_dim 768 '
type: core-uk-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5236139630390144
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5236139630390144
name: Dot Precision@1
- type: dot_recall@1
value: 0.05249346074400429
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5236139630390144
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5236139630390144
name: Dot Mrr@1
- type: dot_map@100
value: 0.5240753568505577
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk options matryoshka_dim 512 '
type: core-uk-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5225872689938398
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5225872689938398
name: Dot Precision@1
- type: dot_recall@1
value: 0.05238478506234274
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5225872689938398
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5225872689938398
name: Dot Mrr@1
- type: dot_map@100
value: 0.5236281189854084
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk options matryoshka_dim 256 '
type: core-uk-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5256673511293635
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5256673511293635
name: Dot Precision@1
- type: dot_recall@1
value: 0.052921410483465076
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5256673511293635
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5256673511293635
name: Dot Mrr@1
- type: dot_map@100
value: 0.5199763651753088
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core uk options matryoshka_dim 128 '
type: core-uk-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.5410677618069816
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5410677618069816
name: Dot Precision@1
- type: dot_recall@1
value: 0.05449566044067192
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5410677618069816
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5410677618069816
name: Dot Mrr@1
- type: dot_map@100
value: 0.5150247410636571
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru options matryoshka_dim 768 '
type: core-ru-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5297741273100616
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5297741273100616
name: Dot Precision@1
- type: dot_recall@1
value: 0.053178864642356605
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5297741273100616
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5297741273100616
name: Dot Mrr@1
- type: dot_map@100
value: 0.5263587112126676
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru options matryoshka_dim 512 '
type: core-ru-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5174537987679672
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5174537987679672
name: Dot Precision@1
- type: dot_recall@1
value: 0.052163426469653065
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5174537987679672
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5174537987679672
name: Dot Mrr@1
- type: dot_map@100
value: 0.5236838797988758
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru options matryoshka_dim 256 '
type: core-ru-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5318275154004107
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5318275154004107
name: Dot Precision@1
- type: dot_recall@1
value: 0.053104686026083536
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5318275154004107
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5318275154004107
name: Dot Mrr@1
- type: dot_map@100
value: 0.5209412403873032
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core ru options matryoshka_dim 128 '
type: core-ru-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.5379876796714579
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5379876796714579
name: Dot Precision@1
- type: dot_recall@1
value: 0.053966710018920436
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5379876796714579
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5379876796714579
name: Dot Mrr@1
- type: dot_map@100
value: 0.5133054014486105
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk title matryoshka_dim 768 '
type: options-uk-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.7394209354120267
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7394209354120267
name: Dot Precision@1
- type: dot_recall@1
value: 0.11383682513972047
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7394209354120267
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7394209354120267
name: Dot Mrr@1
- type: dot_map@100
value: 0.7239673528662353
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk title matryoshka_dim 512 '
type: options-uk-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.7238307349665924
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7238307349665924
name: Dot Precision@1
- type: dot_recall@1
value: 0.11181999762177937
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7238307349665924
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7238307349665924
name: Dot Mrr@1
- type: dot_map@100
value: 0.7104146712019577
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk title matryoshka_dim 256 '
type: options-uk-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.7171492204899778
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7171492204899778
name: Dot Precision@1
- type: dot_recall@1
value: 0.11083633021272221
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7171492204899778
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7171492204899778
name: Dot Mrr@1
- type: dot_map@100
value: 0.6883732565553049
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk title matryoshka_dim 128 '
type: options-uk-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.7082405345211581
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7082405345211581
name: Dot Precision@1
- type: dot_recall@1
value: 0.10982349746269568
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7082405345211581
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7082405345211581
name: Dot Mrr@1
- type: dot_map@100
value: 0.6672151382610533
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru title matryoshka_dim 768 '
type: options-ru-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.7594654788418709
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7594654788418709
name: Dot Precision@1
- type: dot_recall@1
value: 0.11641928351282471
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7594654788418709
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7594654788418709
name: Dot Mrr@1
- type: dot_map@100
value: 0.7245632175079355
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru title matryoshka_dim 512 '
type: options-ru-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.7438752783964365
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7438752783964365
name: Dot Precision@1
- type: dot_recall@1
value: 0.11443692412512012
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7438752783964365
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7438752783964365
name: Dot Mrr@1
- type: dot_map@100
value: 0.7136189111526942
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru title matryoshka_dim 256 '
type: options-ru-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.7371937639198218
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7371937639198218
name: Dot Precision@1
- type: dot_recall@1
value: 0.11332245458080649
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7371937639198218
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7371937639198218
name: Dot Mrr@1
- type: dot_map@100
value: 0.6892258048999176
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru title matryoshka_dim 128 '
type: options-ru-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.7238307349665924
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7238307349665924
name: Dot Precision@1
- type: dot_recall@1
value: 0.11152657661566348
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7238307349665924
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7238307349665924
name: Dot Mrr@1
- type: dot_map@100
value: 0.6687940992568223
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk options matryoshka_dim 768 '
type: options-uk-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6458797327394209
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6458797327394209
name: Dot Precision@1
- type: dot_recall@1
value: 0.09318157714594241
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6458797327394209
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6458797327394209
name: Dot Mrr@1
- type: dot_map@100
value: 0.6386028228542846
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk options matryoshka_dim 512 '
type: options-uk-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6414253897550112
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6414253897550112
name: Dot Precision@1
- type: dot_recall@1
value: 0.09289169133267129
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6414253897550112
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6414253897550112
name: Dot Mrr@1
- type: dot_map@100
value: 0.635382203667806
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk options matryoshka_dim 256 '
type: options-uk-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6169265033407573
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6169265033407573
name: Dot Precision@1
- type: dot_recall@1
value: 0.09079708957214525
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6169265033407573
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6169265033407573
name: Dot Mrr@1
- type: dot_map@100
value: 0.622935686512129
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options uk options matryoshka_dim 128 '
type: options-uk-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6458797327394209
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6458797327394209
name: Dot Precision@1
- type: dot_recall@1
value: 0.09452760182158845
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6458797327394209
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6458797327394209
name: Dot Mrr@1
- type: dot_map@100
value: 0.60965204111836
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru options matryoshka_dim 768 '
type: options-ru-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6614699331848553
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6614699331848553
name: Dot Precision@1
- type: dot_recall@1
value: 0.0981715018463348
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6614699331848553
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6614699331848553
name: Dot Mrr@1
- type: dot_map@100
value: 0.6428702846826188
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru options matryoshka_dim 512 '
type: options-ru-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6636971046770601
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6636971046770601
name: Dot Precision@1
- type: dot_recall@1
value: 0.09760675478938285
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6636971046770601
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6636971046770601
name: Dot Mrr@1
- type: dot_map@100
value: 0.6439239459906216
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru options matryoshka_dim 256 '
type: options-ru-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6391982182628062
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6391982182628062
name: Dot Precision@1
- type: dot_recall@1
value: 0.09542995979521592
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6391982182628062
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6391982182628062
name: Dot Mrr@1
- type: dot_map@100
value: 0.629344320618109
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'options ru options matryoshka_dim 128 '
type: options-ru-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6347438752783965
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6347438752783965
name: Dot Precision@1
- type: dot_recall@1
value: 0.09373041583509291
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6347438752783965
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6347438752783965
name: Dot Mrr@1
- type: dot_map@100
value: 0.6091667980283396
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk title matryoshka_dim 768 '
type: rusisms-uk-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6126984126984127
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6126984126984127
name: Dot Precision@1
- type: dot_recall@1
value: 0.04115662469429067
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6126984126984127
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6126984126984127
name: Dot Mrr@1
- type: dot_map@100
value: 0.578074929897279
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk title matryoshka_dim 512 '
type: rusisms-uk-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6158730158730159
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6158730158730159
name: Dot Precision@1
- type: dot_recall@1
value: 0.040352666747475584
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6158730158730159
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6158730158730159
name: Dot Mrr@1
- type: dot_map@100
value: 0.5704781509386151
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk title matryoshka_dim 256 '
type: rusisms-uk-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6285714285714286
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6285714285714286
name: Dot Precision@1
- type: dot_recall@1
value: 0.04056252873440021
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6285714285714286
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6285714285714286
name: Dot Mrr@1
- type: dot_map@100
value: 0.5604494626815789
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk title matryoshka_dim 128 '
type: rusisms-uk-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.5873015873015873
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5873015873015873
name: Dot Precision@1
- type: dot_recall@1
value: 0.03764504378610293
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5873015873015873
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5873015873015873
name: Dot Mrr@1
- type: dot_map@100
value: 0.5398720823741916
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru title matryoshka_dim 768 '
type: rusisms-ru-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6285714285714286
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6285714285714286
name: Dot Precision@1
- type: dot_recall@1
value: 0.04105120240841725
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6285714285714286
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6285714285714286
name: Dot Mrr@1
- type: dot_map@100
value: 0.5832421743206123
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru title matryoshka_dim 512 '
type: rusisms-ru-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6349206349206349
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6349206349206349
name: Dot Precision@1
- type: dot_recall@1
value: 0.0420941934514083
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6349206349206349
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6349206349206349
name: Dot Mrr@1
- type: dot_map@100
value: 0.5764220989315705
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru title matryoshka_dim 256 '
type: rusisms-ru-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6285714285714286
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6285714285714286
name: Dot Precision@1
- type: dot_recall@1
value: 0.04014059333664441
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6285714285714286
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6285714285714286
name: Dot Mrr@1
- type: dot_map@100
value: 0.566298254239877
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru title matryoshka_dim 128 '
type: rusisms-ru-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6158730158730159
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6158730158730159
name: Dot Precision@1
- type: dot_recall@1
value: 0.038870453261498454
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6158730158730159
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6158730158730159
name: Dot Mrr@1
- type: dot_map@100
value: 0.5445486400478832
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk options matryoshka_dim 768 '
type: rusisms-uk-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5079365079365079
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5079365079365079
name: Dot Precision@1
- type: dot_recall@1
value: 0.03812761613753296
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5079365079365079
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5079365079365079
name: Dot Mrr@1
- type: dot_map@100
value: 0.5094017339022535
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk options matryoshka_dim 512 '
type: rusisms-uk-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5206349206349207
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5206349206349207
name: Dot Precision@1
- type: dot_recall@1
value: 0.03991735604209552
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5206349206349207
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5206349206349207
name: Dot Mrr@1
- type: dot_map@100
value: 0.5105065328987617
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk options matryoshka_dim 256 '
type: rusisms-uk-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5206349206349207
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5206349206349207
name: Dot Precision@1
- type: dot_recall@1
value: 0.037370939101335474
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5206349206349207
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5206349206349207
name: Dot Mrr@1
- type: dot_map@100
value: 0.5046548365211337
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms uk options matryoshka_dim 128 '
type: rusisms-uk-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.4984126984126984
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.4984126984126984
name: Dot Precision@1
- type: dot_recall@1
value: 0.03562191745819187
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.4984126984126984
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.4984126984126984
name: Dot Mrr@1
- type: dot_map@100
value: 0.489772905412056
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru options matryoshka_dim 768 '
type: rusisms-ru-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5301587301587302
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5301587301587302
name: Dot Precision@1
- type: dot_recall@1
value: 0.03705324868358231
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5301587301587302
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5301587301587302
name: Dot Mrr@1
- type: dot_map@100
value: 0.5140991489831742
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru options matryoshka_dim 512 '
type: rusisms-ru-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5365079365079365
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5365079365079365
name: Dot Precision@1
- type: dot_recall@1
value: 0.038171520553733886
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5365079365079365
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5365079365079365
name: Dot Mrr@1
- type: dot_map@100
value: 0.5103479398858377
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru options matryoshka_dim 256 '
type: rusisms-ru-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5492063492063493
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5492063492063493
name: Dot Precision@1
- type: dot_recall@1
value: 0.040570041354933084
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5492063492063493
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5492063492063493
name: Dot Mrr@1
- type: dot_map@100
value: 0.5104878477703144
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms ru options matryoshka_dim 128 '
type: rusisms-ru-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.526984126984127
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.526984126984127
name: Dot Precision@1
- type: dot_recall@1
value: 0.037243305642727056
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.526984126984127
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.526984126984127
name: Dot Mrr@1
- type: dot_map@100
value: 0.49561770644701786
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk title matryoshka_dim 768 '
type: rusisms_corrected-uk-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.7151898734177216
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7151898734177216
name: Dot Precision@1
- type: dot_recall@1
value: 0.05229951549096141
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7151898734177216
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7151898734177216
name: Dot Mrr@1
- type: dot_map@100
value: 0.6489892378490031
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk title matryoshka_dim 512 '
type: rusisms_corrected-uk-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.7341772151898734
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7341772151898734
name: Dot Precision@1
- type: dot_recall@1
value: 0.05642593987055035
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7341772151898734
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7341772151898734
name: Dot Mrr@1
- type: dot_map@100
value: 0.6476330230514279
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk title matryoshka_dim 256 '
type: rusisms_corrected-uk-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.7373417721518988
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7373417721518988
name: Dot Precision@1
- type: dot_recall@1
value: 0.05366860446118454
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7373417721518988
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7373417721518988
name: Dot Mrr@1
- type: dot_map@100
value: 0.6396445127000805
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk title matryoshka_dim 128 '
type: rusisms_corrected-uk-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.7088607594936709
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7088607594936709
name: Dot Precision@1
- type: dot_recall@1
value: 0.05088288009256876
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7088607594936709
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7088607594936709
name: Dot Mrr@1
- type: dot_map@100
value: 0.6228545471540479
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru title matryoshka_dim 768 '
type: rusisms_corrected-ru-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.7088607594936709
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7088607594936709
name: Dot Precision@1
- type: dot_recall@1
value: 0.054619494579519506
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7088607594936709
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7088607594936709
name: Dot Mrr@1
- type: dot_map@100
value: 0.6508513938167568
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru title matryoshka_dim 512 '
type: rusisms_corrected-ru-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.7310126582278481
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7310126582278481
name: Dot Precision@1
- type: dot_recall@1
value: 0.055560607719386805
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7310126582278481
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7310126582278481
name: Dot Mrr@1
- type: dot_map@100
value: 0.6474909137910566
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru title matryoshka_dim 256 '
type: rusisms_corrected-ru-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.7373417721518988
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.7373417721518988
name: Dot Precision@1
- type: dot_recall@1
value: 0.0530718967134852
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.7373417721518988
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.7373417721518988
name: Dot Mrr@1
- type: dot_map@100
value: 0.6406904998316159
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru title matryoshka_dim 128 '
type: rusisms_corrected-ru-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.740506329113924
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.740506329113924
name: Dot Precision@1
- type: dot_recall@1
value: 0.05642954540791603
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.740506329113924
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.740506329113924
name: Dot Mrr@1
- type: dot_map@100
value: 0.6291481916987621
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk options matryoshka_dim 768 '
type: rusisms_corrected-uk-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5981012658227848
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5981012658227848
name: Dot Precision@1
- type: dot_recall@1
value: 0.049508481543291766
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5981012658227848
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5981012658227848
name: Dot Mrr@1
- type: dot_map@100
value: 0.5872024224481405
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk options matryoshka_dim 512 '
type: rusisms_corrected-uk-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6329113924050633
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6329113924050633
name: Dot Precision@1
- type: dot_recall@1
value: 0.05335169017497475
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6329113924050633
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6329113924050633
name: Dot Mrr@1
- type: dot_map@100
value: 0.5879304786019428
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk options matryoshka_dim 256 '
type: rusisms_corrected-uk-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6107594936708861
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6107594936708861
name: Dot Precision@1
- type: dot_recall@1
value: 0.049490701607051664
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6107594936708861
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6107594936708861
name: Dot Mrr@1
- type: dot_map@100
value: 0.5849371352598327
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected uk options matryoshka_dim 128 '
type: rusisms_corrected-uk-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6170886075949367
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6170886075949367
name: Dot Precision@1
- type: dot_recall@1
value: 0.045874774865780954
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6170886075949367
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6170886075949367
name: Dot Mrr@1
- type: dot_map@100
value: 0.5764316618592495
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru options matryoshka_dim 768 '
type: rusisms_corrected-ru-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.6044303797468354
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6044303797468354
name: Dot Precision@1
- type: dot_recall@1
value: 0.04461392111075665
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6044303797468354
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6044303797468354
name: Dot Mrr@1
- type: dot_map@100
value: 0.5880961781311048
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru options matryoshka_dim 512 '
type: rusisms_corrected-ru-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.6044303797468354
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6044303797468354
name: Dot Precision@1
- type: dot_recall@1
value: 0.04572733828430041
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6044303797468354
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6044303797468354
name: Dot Mrr@1
- type: dot_map@100
value: 0.586453798418227
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru options matryoshka_dim 256 '
type: rusisms_corrected-ru-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.6329113924050633
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6329113924050633
name: Dot Precision@1
- type: dot_recall@1
value: 0.045180216259829944
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6329113924050633
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6329113924050633
name: Dot Mrr@1
- type: dot_map@100
value: 0.5861453209430655
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'rusisms_corrected ru options matryoshka_dim 128 '
type: rusisms_corrected-ru-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.6265822784810127
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.6265822784810127
name: Dot Precision@1
- type: dot_recall@1
value: 0.04628088533386624
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.6265822784810127
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.6265822784810127
name: Dot Mrr@1
- type: dot_map@100
value: 0.5779403273255477
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk title matryoshka_dim 768 '
type: core_typos-uk-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5441478439425051
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5441478439425051
name: Dot Precision@1
- type: dot_recall@1
value: 0.056110382149154946
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5441478439425051
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5441478439425051
name: Dot Mrr@1
- type: dot_map@100
value: 0.480769816046975
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk title matryoshka_dim 512 '
type: core_typos-uk-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5492813141683778
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5492813141683778
name: Dot Precision@1
- type: dot_recall@1
value: 0.05626807053383331
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5492813141683778
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5492813141683778
name: Dot Mrr@1
- type: dot_map@100
value: 0.4783302092856933
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk title matryoshka_dim 256 '
type: core_typos-uk-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5308008213552361
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5308008213552361
name: Dot Precision@1
- type: dot_recall@1
value: 0.05433412152596233
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5308008213552361
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5308008213552361
name: Dot Mrr@1
- type: dot_map@100
value: 0.46618368961246337
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk title matryoshka_dim 128 '
type: core_typos-uk-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.5123203285420944
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5123203285420944
name: Dot Precision@1
- type: dot_recall@1
value: 0.05245570961161612
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5123203285420944
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5123203285420944
name: Dot Mrr@1
- type: dot_map@100
value: 0.44226507977696844
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru title matryoshka_dim 768 '
type: core_typos-ru-title--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.5595482546201233
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5595482546201233
name: Dot Precision@1
- type: dot_recall@1
value: 0.05744649512088213
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5595482546201233
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5595482546201233
name: Dot Mrr@1
- type: dot_map@100
value: 0.4874349469065539
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru title matryoshka_dim 512 '
type: core_typos-ru-title--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.5451745379876797
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5451745379876797
name: Dot Precision@1
- type: dot_recall@1
value: 0.05620993608597788
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5451745379876797
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5451745379876797
name: Dot Mrr@1
- type: dot_map@100
value: 0.48179945085007053
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru title matryoshka_dim 256 '
type: core_typos-ru-title--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.5318275154004107
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5318275154004107
name: Dot Precision@1
- type: dot_recall@1
value: 0.054473541198236206
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5318275154004107
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5318275154004107
name: Dot Mrr@1
- type: dot_map@100
value: 0.4692266363313306
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru title matryoshka_dim 128 '
type: core_typos-ru-title--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.5225872689938398
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.5225872689938398
name: Dot Precision@1
- type: dot_recall@1
value: 0.05359620013865696
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.5225872689938398
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.5225872689938398
name: Dot Mrr@1
- type: dot_map@100
value: 0.4451705643146633
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk options matryoshka_dim 768 '
type: core_typos-uk-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.43018480492813144
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.43018480492813144
name: Dot Precision@1
- type: dot_recall@1
value: 0.04330169200020632
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.43018480492813144
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.43018480492813144
name: Dot Mrr@1
- type: dot_map@100
value: 0.42856816814675947
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk options matryoshka_dim 512 '
type: core_typos-uk-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.419917864476386
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.419917864476386
name: Dot Precision@1
- type: dot_recall@1
value: 0.042235882951851066
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.419917864476386
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.419917864476386
name: Dot Mrr@1
- type: dot_map@100
value: 0.42366350694238186
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk options matryoshka_dim 256 '
type: core_typos-uk-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.42915811088295686
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.42915811088295686
name: Dot Precision@1
- type: dot_recall@1
value: 0.04352310958558693
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.42915811088295686
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.42915811088295686
name: Dot Mrr@1
- type: dot_map@100
value: 0.41901039848919813
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos uk options matryoshka_dim 128 '
type: core_typos-uk-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.42505133470225875
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.42505133470225875
name: Dot Precision@1
- type: dot_recall@1
value: 0.043236480440550985
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.42505133470225875
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.42505133470225875
name: Dot Mrr@1
- type: dot_map@100
value: 0.4046885891906333
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru options matryoshka_dim 768 '
type: core_typos-ru-options--matryoshka_dim-768--
metrics:
- type: dot_accuracy@1
value: 0.44455852156057496
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.44455852156057496
name: Dot Precision@1
- type: dot_recall@1
value: 0.04479658044777624
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.44455852156057496
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.44455852156057496
name: Dot Mrr@1
- type: dot_map@100
value: 0.42892229251421876
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru options matryoshka_dim 512 '
type: core_typos-ru-options--matryoshka_dim-512--
metrics:
- type: dot_accuracy@1
value: 0.42299794661190965
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.42299794661190965
name: Dot Precision@1
- type: dot_recall@1
value: 0.042604436939501555
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.42299794661190965
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.42299794661190965
name: Dot Mrr@1
- type: dot_map@100
value: 0.4243465119995708
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru options matryoshka_dim 256 '
type: core_typos-ru-options--matryoshka_dim-256--
metrics:
- type: dot_accuracy@1
value: 0.4260780287474333
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.4260780287474333
name: Dot Precision@1
- type: dot_recall@1
value: 0.04284840741387426
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.4260780287474333
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.4260780287474333
name: Dot Mrr@1
- type: dot_map@100
value: 0.4187583987858516
name: Dot Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: 'core_typos ru options matryoshka_dim 128 '
type: core_typos-ru-options--matryoshka_dim-128--
metrics:
- type: dot_accuracy@1
value: 0.446611909650924
name: Dot Accuracy@1
- type: dot_precision@1
value: 0.446611909650924
name: Dot Precision@1
- type: dot_recall@1
value: 0.04509914507725234
name: Dot Recall@1
- type: dot_ndcg@1
value: 0.446611909650924
name: Dot Ndcg@1
- type: dot_mrr@1
value: 0.446611909650924
name: Dot Mrr@1
- type: dot_map@100
value: 0.40468950392929137
name: Dot Map@100
SentenceTransformer based on intfloat/multilingual-e5-base
This is a sentence-transformers model finetuned from intfloat/multilingual-e5-base on the rozetka_positive_pairs dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: intfloat/multilingual-e5-base
- Maximum Sequence Length: 512 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Dot Product
- Training Dataset:
- rozetka_positive_pairs
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
RZTKSentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: XLMRobertaModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("rztk/multilingual-e5-base-matryoshka2d-mnr-3")
# Run inference
sentences = [
'query: мебель для кухни',
'passage: Кухня Эко модуль Вытяжка 600 Эверест Ясень Шимо Светлый 60х30х28 см',
'passage: Ключниці кишенькові Karya Гарантія 14 днів Для кого Для жінок Колір Червоний Матеріал Шкіра Країна реєстрації бренда Туреччина Країна-виробник товару Туреччина',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Training Details
Training Dataset
rozetka_positive_pairs
- Dataset: rozetka_positive_pairs
- Size: 58,620,066 training samples
- Columns:
queryandtext - Approximate statistics based on the first 1000 samples:
query text type string string details - min: 6 tokens
- mean: 11.27 tokens
- max: 30 tokens
- min: 11 tokens
- mean: 59.47 tokens
- max: 512 tokens
- Samples:
query text query: xsiomi 9c склоpassage: Защитные стекла Назначение Для мобильных телефонов Цвет Черный Теги Теги Наличие рамки C рамкой Форм-фактор Плоское Клеевой слой По всей поверхностиquery: xsiomi 9c склоpassage: Захисне скло Призначення Для мобільних телефонів Колір Чорний Теги Теги Наявність рамки З рамкою Форм-фактор Плоске Клейовий шар По всій поверхніquery: xsiomi 9c склоpassage: Захисне скло Glass Full Glue для Xiaomi Redmi 9A/9C/10A (Чорний) - Loss:
sentence_transformers_training.model.matryoshka2d_loss.RZTKMatryoshka2dLosswith these parameters:{ "loss": "RZTKMultipleNegativesRankingLoss", "n_layers_per_step": 1, "last_layer_weight": 1.0, "prior_layers_weight": 1.0, "kl_div_weight": 1.0, "kl_temperature": 0.3, "matryoshka_dims": [ 768, 512, 256, 128 ], "matryoshka_weights": [ 1, 1, 1, 1 ], "n_dims_per_step": 1 }
Evaluation Dataset
rozetka_positive_pairs
- Dataset: rozetka_positive_pairs
- Size: 1,903,728 evaluation samples
- Columns:
queryandtext - Approximate statistics based on the first 1000 samples:
query text type string string details - min: 6 tokens
- mean: 8.36 tokens
- max: 16 tokens
- min: 8 tokens
- mean: 45.68 tokens
- max: 365 tokens
- Samples:
query text query: создаем нейронную сетьpassage: Створюємо нейронну мережуquery: создаем нейронную сетьpassage: Создаем нейронную сеть (1666498)query: создаем нейронную сетьpassage: Научная и техническая литература Переплет Мягкий - Loss:
sentence_transformers_training.model.matryoshka2d_loss.RZTKMatryoshka2dLosswith these parameters:{ "loss": "RZTKMultipleNegativesRankingLoss", "n_layers_per_step": 1, "last_layer_weight": 1.0, "prior_layers_weight": 1.0, "kl_div_weight": 1.0, "kl_temperature": 0.3, "matryoshka_dims": [ 768, 512, 256, 128 ], "matryoshka_weights": [ 1, 1, 1, 1 ], "n_dims_per_step": 1 }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: stepsper_device_train_batch_size: 88per_device_eval_batch_size: 88learning_rate: 2e-05num_train_epochs: 1.0warmup_ratio: 0.1bf16: Truebf16_full_eval: Truetf32: Truedataloader_num_workers: 8load_best_model_at_end: Trueoptim: adafactorpush_to_hub: Truehub_model_id: rztk/multilingual-e5-base-matryoshka2d-mnr-3hub_private_repo: Trueprompts: {'query': 'query: ', 'text': 'passage: '}batch_sampler: no_duplicates
All Hyperparameters
Click to expand
overwrite_output_dir: Falsedo_predict: Falseeval_strategy: stepsprediction_loss_only: Trueper_device_train_batch_size: 88per_device_eval_batch_size: 88per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 1.0max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Truefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Truefp16_full_eval: Falsetf32: Truelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Truedataloader_num_workers: 8dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adafactoroptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Trueresume_from_checkpoint: Nonehub_model_id: rztk/multilingual-e5-base-matryoshka2d-mnr-3hub_strategy: every_savehub_private_repo: Truehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseeval_use_gather_object: Falseaverage_tokens_across_devices: Falseprompts: {'query': 'query: ', 'text': 'passage: '}batch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportionalddp_static_graph: Falseddp_comm_hook: bf16gradient_as_bucket_view: Falsenum_proc: 30
Training Logs
Click to expand
| Epoch | Step | Training Loss | Validation Loss |
|---|---|---|---|
| 0.0050 | 833 | 4.8404 | - |
| 0.0100 | 1666 | 4.6439 | - |
| 0.0150 | 2499 | 4.2238 | - |
| 0.0200 | 3332 | 3.5445 | - |
| 0.0250 | 4165 | 2.7514 | - |
| 0.0300 | 4998 | 2.4037 | - |
| 0.0350 | 5831 | 2.1916 | - |
| 0.0400 | 6664 | 2.0938 | - |
| 0.0450 | 7497 | 1.9268 | - |
| 0.0500 | 8330 | 1.8671 | - |
| 0.0550 | 9163 | 1.7069 | - |
| 0.0600 | 9996 | 1.6419 | - |
| 0.0650 | 10829 | 1.55 | - |
| 0.0700 | 11662 | 1.5483 | - |
| 0.0750 | 12495 | 1.5419 | - |
| 0.0800 | 13328 | 1.3582 | - |
| 0.0850 | 14161 | 1.3537 | - |
| 0.0900 | 14994 | 1.3067 | - |
| 0.0950 | 15827 | 1.2128 | - |
| 0.1000 | 16654 | - | 1.0107 |
| 0.1000 | 16660 | 1.2248 | - |
| 0.1050 | 17493 | 1.1565 | - |
| 0.1100 | 18326 | 1.1351 | - |
| 0.1150 | 19159 | 1.0808 | - |
| 0.1200 | 19992 | 1.0561 | - |
| 0.1250 | 20825 | 1.078 | - |
| 0.1301 | 21658 | 1.1413 | - |
| 0.1351 | 22491 | 1.0446 | - |
| 0.1401 | 23324 | 0.9986 | - |
| 0.1451 | 24157 | 0.9668 | - |
| 0.1501 | 24990 | 0.9753 | - |
| 0.1551 | 25823 | 1.0031 | - |
| 0.1601 | 26656 | 0.9688 | - |
| 0.1651 | 27489 | 0.9262 | - |
| 0.1701 | 28322 | 0.9702 | - |
| 0.1751 | 29155 | 0.9082 | - |
| 0.1801 | 29988 | 0.9264 | - |
| 0.1851 | 30821 | 0.8526 | - |
| 0.1901 | 31654 | 0.9667 | - |
| 0.1951 | 32487 | 0.9421 | - |
| 0.2000 | 33308 | - | 0.6416 |
| 0.2001 | 33320 | 0.9216 | - |
| 0.2051 | 34153 | 0.95 | - |
| 0.2101 | 34986 | 0.8895 | - |
| 0.2151 | 35819 | 0.8349 | - |
| 0.2201 | 36652 | 0.8628 | - |
| 0.2251 | 37485 | 0.8729 | - |
| 0.2301 | 38318 | 0.9285 | - |
| 0.2351 | 39151 | 0.8718 | - |
| 0.2401 | 39984 | 0.8792 | - |
| 0.2451 | 40817 | 0.8852 | - |
| 0.2501 | 41650 | 0.877 | - |
| 0.2551 | 42483 | 0.8325 | - |
| 0.2601 | 43316 | 0.8446 | - |
| 0.2651 | 44149 | 0.812 | - |
| 0.2701 | 44982 | 0.8246 | - |
| 0.2751 | 45815 | 0.8086 | - |
| 0.2801 | 46648 | 0.8553 | - |
| 0.2851 | 47481 | 0.8506 | - |
| 0.2901 | 48314 | 0.834 | - |
| 0.2951 | 49147 | 0.8313 | - |
| 0.3000 | 49962 | - | 0.5377 |
| 0.3001 | 49980 | 0.8376 | - |
| 0.3051 | 50813 | 0.7836 | - |
| 0.3101 | 51646 | 0.8089 | - |
| 0.3151 | 52479 | 0.8065 | - |
| 0.3201 | 53312 | 0.8284 | - |
| 0.3251 | 54145 | 0.7959 | - |
| 0.3301 | 54978 | 0.8332 | - |
| 0.3351 | 55811 | 0.7924 | - |
| 0.3401 | 56644 | 0.8171 | - |
| 0.3451 | 57477 | 0.7924 | - |
| 0.3501 | 58310 | 0.7977 | - |
| 0.3551 | 59143 | 0.7729 | - |
| 0.3601 | 59976 | 0.7617 | - |
| 0.3651 | 60809 | 0.8211 | - |
| 0.3701 | 61642 | 0.8497 | - |
| 0.3751 | 62475 | 0.8218 | - |
| 0.3802 | 63308 | 0.7846 | - |
| 0.3852 | 64141 | 0.7876 | - |
| 0.3902 | 64974 | 0.7912 | - |
| 0.3952 | 65807 | 0.7977 | - |
| 0.4000 | 66616 | - | 0.4974 |
| 0.4002 | 66640 | 0.8096 | - |
| 0.4052 | 67473 | 0.8356 | - |
| 0.4102 | 68306 | 0.788 | - |
| 0.4152 | 69139 | 0.7683 | - |
| 0.4202 | 69972 | 0.7358 | - |
| 0.4252 | 70805 | 0.7634 | - |
| 0.4302 | 71638 | 0.7535 | - |
| 0.4352 | 72471 | 0.756 | - |
| 0.4402 | 73304 | 0.7633 | - |
| 0.4452 | 74137 | 0.7509 | - |
| 0.4502 | 74970 | 0.7547 | - |
| 0.4552 | 75803 | 0.7539 | - |
| 0.4602 | 76636 | 0.7608 | - |
| 0.4652 | 77469 | 0.8262 | - |
| 0.4702 | 78302 | 0.8076 | - |
| 0.4752 | 79135 | 0.8179 | - |
| 0.4802 | 79968 | 0.7709 | - |
| 0.4852 | 80801 | 0.744 | - |
| 0.4902 | 81634 | 0.7846 | - |
| 0.4952 | 82467 | 0.7473 | - |
| 0.5000 | 83270 | - | 0.4776 |
| 0.5002 | 83300 | 0.7759 | - |
| 0.5052 | 84133 | 0.755 | - |
| 0.5102 | 84966 | 0.7308 | - |
| 0.5152 | 85799 | 0.7256 | - |
| 0.5202 | 86632 | 0.7703 | - |
| 0.5252 | 87465 | 0.7823 | - |
| 0.5302 | 88298 | 0.8109 | - |
| 0.5352 | 89131 | 0.7795 | - |
| 0.5402 | 89964 | 0.7833 | - |
| 0.5452 | 90797 | 0.7752 | - |
| 0.5502 | 91630 | 0.7975 | - |
| 0.5552 | 92463 | 0.7863 | - |
| 0.5602 | 93296 | 0.7337 | - |
| 0.5652 | 94129 | 0.7755 | - |
| 0.5702 | 94962 | 0.7928 | - |
| 0.5752 | 95795 | 0.7604 | - |
| 0.5802 | 96628 | 0.7983 | - |
| 0.5852 | 97461 | 0.7665 | - |
| 0.5902 | 98294 | 0.7749 | - |
| 0.5952 | 99127 | 0.7838 | - |
| 0.6000 | 99924 | - | 0.4669 |
| 0.6002 | 99960 | 0.7727 | - |
| 0.6052 | 100793 | 0.8049 | - |
| 0.6102 | 101626 | 0.7857 | - |
| 0.6152 | 102459 | 0.7622 | - |
| 0.6202 | 103292 | 0.8117 | - |
| 0.6252 | 104125 | 0.7711 | - |
| 0.6302 | 104958 | 0.7892 | - |
| 0.6353 | 105791 | 0.7938 | - |
| 0.6403 | 106624 | 0.728 | - |
| 0.6453 | 107457 | 0.7693 | - |
| 0.6503 | 108290 | 0.7875 | - |
| 0.6553 | 109123 | 0.7958 | - |
| 0.6603 | 109956 | 0.749 | - |
| 0.6653 | 110789 | 0.7788 | - |
| 0.6703 | 111622 | 0.7614 | - |
| 0.6753 | 112455 | 0.7577 | - |
| 0.6803 | 113288 | 0.7805 | - |
| 0.6853 | 114121 | 0.7677 | - |
| 0.6903 | 114954 | 0.7458 | - |
| 0.6953 | 115787 | 0.7962 | - |
| 0.7000 | 116578 | - | 0.4641 |
| 0.7003 | 116620 | 0.7275 | - |
| 0.7053 | 117453 | 0.7778 | - |
| 0.7103 | 118286 | 0.7885 | - |
| 0.7153 | 119119 | 0.8046 | - |
| 0.7203 | 119952 | 0.8222 | - |
| 0.7253 | 120785 | 0.7714 | - |
| 0.7303 | 121618 | 0.7983 | - |
| 0.7353 | 122451 | 0.7359 | - |
| 0.7403 | 123284 | 0.7618 | - |
| 0.7453 | 124117 | 0.783 | - |
| 0.7503 | 124950 | 0.763 | - |
| 0.7553 | 125783 | 0.809 | - |
| 0.7603 | 126616 | 0.794 | - |
| 0.7653 | 127449 | 0.7366 | - |
| 0.7703 | 128282 | 0.776 | - |
| 0.7753 | 129115 | 0.8053 | - |
| 0.7803 | 129948 | 0.7941 | - |
| 0.7853 | 130781 | 0.7722 | - |
| 0.7903 | 131614 | 0.7959 | - |
| 0.7953 | 132447 | 0.8061 | - |
| 0.8000 | 133232 | - | 0.4468 |
Framework Versions
- Python: 3.11.10
- Sentence Transformers: 3.3.0
- Transformers: 4.46.3
- PyTorch: 2.5.1+cu124
- Accelerate: 1.1.1
- Datasets: 3.1.0
- Tokenizers: 0.20.3
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}