infgrad

A novel embedding model for long documents, based on ModernBERT but distilled from a bigger, Mistral-based embedding model. It can be used to output the global [CLS] embedding of the document, the averaged embeddings of the document, or multiple vectors representing the chunks.