Encoders experience a renaissance since the introduction of ModernBERT, which is one of the most downloaded models every month on HuggingFace. mmBERT is a multilingual version, supports 8K context and over 1800 languages due to its training on 3T tokens.
Specs
Params140M
LicenseMIT
Adoption · Hugging Face
RAM score
Relative Adoption Metric not applicable.
Hugging Face Downloads
92.6K
last 30d
366.5K
all time
HF Likes
107
Relative Adoption Metric not applicable.
Related Models
