huggingface / text-embeddings-inference
A blazing fast inference solution for text embeddings models
☆2,599Updated this week
Related projects: ⓘ
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆2,817Updated 2 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,080Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆5,121Updated this week
- Tools for merging pretrained large language models.☆4,501Updated this week
- MTEB: Massive Text Embedding Benchmark☆1,798Updated this week
- To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x com…☆4,435Updated 3 weeks ago
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆1,371Updated this week
- Efficient Retrieval Augmentation and Generation Framework☆1,255Updated last week
- Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines☆6,560Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆1,890Updated last week
- Robust recipes to align language models with human and AI preferences☆4,481Updated 3 weeks ago
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆2,878Updated 2 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,396Updated this week
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆4,326Updated last month
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,698Updated 7 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆3,484Updated this week
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,792Updated 7 months ago
- Large Language Model Text Generation Inference☆8,762Updated this week
- Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip☆1,261Updated 2 weeks ago
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,835Updated 3 weeks ago
- A unified evaluation framework for large language models☆2,375Updated last week
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆4,113Updated this week
- Chat language model that can use tools and interpret the results☆1,358Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆1,935Updated last week
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆1,747Updated 3 months ago
- A framework for few-shot evaluation of language models.☆6,426Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,671Updated last month
- Go ahead and axolotl questions☆7,554Updated this week
- LLM training code for Databricks foundation models☆3,964Updated this week
- prompt2model - Generate Deployable Models from Natural Language Instructions☆1,943Updated 3 months ago