Llama-3.1-Tulu-3.1-8B

Ai2 released an updated version of Tülu. Trained on the same data as the previous version, but with GRPO (instead of PPO), the same algorithm used by R1. This results in better performance across the board, most notably in math benchmarks. It also is evidence against the argument that GRPO is "poor man's PPO". Full reasoning models from Ai2 are still "coming soon."