jxmorris12 / embzipLinks
lossily compress representation vectors using product quantization
☆59Updated 3 months ago
Alternatives and similar repositories for embzip
Users that are interested in embzip are comparing it to the libraries listed below
Sorting:
- An introduction to LLM Sampling☆79Updated last year
- ☆53Updated last year
- Python library to use Pleias-RAG models☆68Updated 9 months ago
- look how they massacred my boy☆63Updated last year
- ☆40Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆61Updated 9 months ago
- utilities for loading and running text embeddings with onnx☆45Updated 5 months ago
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆102Updated 6 months ago
- NLP with Rust for Python 🦀🐍☆71Updated 8 months ago
- Simple GRPO scripts and configurations.☆59Updated last year
- ☆67Updated 8 months ago
- ☆39Updated 6 months ago
- ☆91Updated 7 months ago
- ☆93Updated last month
- code for training & evaluating Contextual Document Embedding models☆202Updated 8 months ago
- Storing long contexts in tiny caches with self-study☆236Updated 2 months ago
- Pre-train Static Word Embeddings☆94Updated 5 months ago
- ☆105Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 4 months ago
- Training code for Sparse Autoencoders on Embedding models☆39Updated 11 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last month
- Datamodels for hugging face tokenizers☆87Updated last week
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆56Updated 5 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆103Updated 2 years ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆77Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated last year
- ☆45Updated 2 years ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆76Updated 2 weeks ago
- Latent Large Language Models☆19Updated last year