Encoders experience a renaissance since the introduction of ModernBERT, which is one of the most downloaded models every month on HuggingFace. mmBERT is a multilingual version, supports 8K context and over 1800 languages due to its training on 3T tokens.
Specs
Params140M
LicenseMIT
Adoption · Hugging Face
RAM score
Relative Adoption Metric not applicable.
Hugging Face Downloads
50.6K
last 30d
254.4K
all time
HF Likes
82
Relative Adoption Metric not applicable.
Related Models
