Baidu (ERNIE)

An OCR model for long documents, released under MIT.

An 8B DiT by Baidu, released under Apache 2.0.

There have been a lot of great OCR models lately. This one is from Baidu and is licensed under Apache 2.0.

A vision version of ERNIE.

A Llama3.1 finetune by Baidu for OCR tasks.

Baidu continues to release open models. This one is their first open reasoning model, supporting 128,000 tokens as context. Furthermore, they go a step towards the community, releasing weights directly usable in transformers (and thus, vLLM etc.). Previously, they split the model for both PyTorch and PaddlePaddle, which, while usable, added a lot of clutter. The benchmarks are also impressive for its size.

Baidu followed up on their promise to release their flagship model, ERNIE, in various sizes, both dense and MoE. The models are licensed under Apache 2.0. However, the model got mixed reactions on social media, with some people being surprised with the quality, while others are disappointed with its performance on tasks outside of usual benchmarks.