Alternatives and similar repositories for ofen:

Users that are interested in ofen are comparing it to the libraries listed below

• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆17Updated last year
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆130Updated 4 months ago
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆22Updated last month
• huggingface / ember
  ANE accelerated embedding models!
  ☆16Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆56Updated 2 weeks ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 9 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 10 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• mixedbread-ai / python-sdk
  mixedbread ai python sdk
  ☆12Updated 9 months ago
• Snowflake-Labs / arctic-embed
  ☆67Updated 4 months ago
• chandar-lab / NeoBERT
  ☆46Updated last month
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 6 months ago
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆174Updated 7 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆68Updated last week
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆45Updated last week
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆19Updated last month
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆23Updated 6 months ago
• hyparam / hyllama
  llama.cpp gguf file parser for javascript
  ☆34Updated 4 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• Knowledgator / TurboT5
  Truly flash T5 realization!
  ☆64Updated 11 months ago
• cccntu / LoRAnanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆18Updated 2 years ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated last month
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 5 months ago
• liujch1998 / infini-gram
  ☆33Updated 2 weeks ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated last year
• catid / lllm
  Latent Large Language Models
  ☆17Updated 8 months ago
• AnswerDotAI / fastkmeans
  ☆32Updated this week
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• LAGoM-NLP / transtokenizer
  ☆44Updated 3 months ago