Alternatives and similar repositories for ofen:

Users that are interested in ofen are comparing it to the libraries listed below

• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆15Updated last year
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆19Updated last week
• huggingface / ember
  ANE accelerated embedding models!
  ☆17Updated 3 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆126Updated 3 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 2 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 8 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 7 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 9 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆173Updated 6 months ago
• mixedbread-ai / python-sdk
  mixedbread ai python sdk
  ☆11Updated 8 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆50Updated 3 weeks ago
• chandar-lab / NeoBERT
  ☆43Updated last month
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated last month
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆36Updated last month
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆15Updated 4 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆19Updated 5 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 7 months ago
• apehex / tokun
  Tokun to can tokens
  ☆16Updated last month
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆66Updated this week
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆34Updated 2 years ago
• kenhktsui / anyclassifier
  One Line To Build Zero-Data Classifiers in Minutes
  ☆36Updated 6 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated 11 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆19Updated last week
• nisten / grokadamw
  new optimizer
  ☆19Updated 7 months ago
• Knowledgator / TurboT5
  Truly flash T5 realization!
  ☆64Updated 10 months ago