puppetm4st3r / baai_m3_simple_serverLinks
This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking tasks using the BAAI M3 multilingual model.
☆70Updated last year
Alternatives and similar repositories for baai_m3_simple_server
Users that are interested in baai_m3_simple_server are comparing it to the libraries listed below
Sorting:
- Code for explaining and evaluating late chunking (chunked pooling)☆452Updated 9 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆160Updated last year
- ☆237Updated 4 months ago
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆864Updated 3 weeks ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆430Updated last year
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆377Updated last month
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆25Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆510Updated 2 years ago
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆291Updated 3 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated last year
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆244Updated 2 weeks ago
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆504Updated 9 months ago
- ☆318Updated last year
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆240Updated last year
- ☆194Updated 3 weeks ago
- ☆66Updated last year
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆67Updated last year
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆539Updated this week
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆243Updated 2 months ago
- ☆507Updated last year
- ☆267Updated 2 years ago
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆156Updated 2 months ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆77Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆371Updated 2 weeks ago
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆57Updated 6 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆228Updated last week
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆397Updated last year
- HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels☆555Updated 10 months ago
- Guideline following Large Language Model for Information Extraction☆402Updated 11 months ago