Encoders experience a renaissance since the introduction of ModernBERT, which is one of the most downloaded models every month on HuggingFace. mmBERT is a multilingual version, supports 8K context and over 1800 languages due to its training on 3T tokens.
Specs
Params140M
LicenseMIT
Adoption · Hugging Face
RAM score
Relative Adoption Metric not applicable.
Hugging Face Downloads
97K
last 30d
373.4K
all time
HF Likes
107
Relative Adoption Metric not applicable.
Related Models
