This looks amazing, the optimizations are very welcome to anyone using fine-tuned encoders.
However, it's disappointing to see it's been only trained with English text with no mention to multilingual benchmarks or a multilingual version in the plans.
