After our coverage of the initial release, LMArena (which now formed a company and has a new look, accessible here) announced they will update their policies and released a comparison HF space. They also brought the regular instruct version of Llama 4 Maverick into the Arena. While the experimental version from META scored an Elo of 1417, the instruct version scored only 1271, landing it on place 35 (24 with style control). However, this should not be seen as yet another dunk on Llama 4 - we found the regular version more pleasant to use compared to the experimental version deployed by META. The chat version (over)uses emojis and likes to please the user by saying its question is interesting. The comparison HF space is really interesting, as it also gives a glimpse into the questions (LMArena) users care about.
Relative Adoption Metric contextualizes downloads against the model's size bucket.
Explore other models with behavioral similarity to Llama 4 Scout Instruct.


