An uncensored version of Trinity Nano. The blog goes into great detail about the reward design to achieve this.
Specs
Params6B
LicenseApache-2.0
Tags
modelsmodels/llmsmultilingualartifacts/22
Related Models
An uncensored version of Trinity Nano. The blog goes into great detail about the reward design to achieve this.