A looped transformer that rivals much larger models. However, due to the looping, it is rather slow, which calls into question its utility compared with a larger model.
Specs
Params4B total (3B non-embedding)
LicenseApache-2.0
Adoption · Hugging Face
RAM score
—
Hugging Face Downloads
33K
last 30d
33K
all time
HF Likes
647
Relative Adoption Metric contextualizes downloads against the model's size bucket.
Related Models
