A new MoE model series from Microsoft. It has some architecture tweaks, such as SparseMixer-v2, but it isn't clear what the differentiator is (like Phi).
Adoption · Hugging Face
RAM score
Relative Adoption Metric not applicable.
Hugging Face Downloads
428
last 30d
75.9K
all time
HF Likes
201
Relative Adoption Metric not applicable.
Related Models