puppetm4st3r / baai_m3_simple_server
This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking tasks using the BAAI M3 multilingual model.
☆63Updated 10 months ago
Alternatives and similar repositories for baai_m3_simple_server:
Users that are interested in baai_m3_simple_server are comparing it to the libraries listed below
- Open Source Text Embedding Models with OpenAI Compatible API☆150Updated 8 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆355Updated 3 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆272Updated this week
- ☆215Updated 3 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆160Updated 6 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆84Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated 9 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆419Updated this week
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆67Updated last year
- ☆310Updated last year
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆228Updated 7 months ago
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆282Updated last week
- Fine-Tuning Embedding for RAG with Synthetic Data☆489Updated last year
- AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆133Updated 3 months ago
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆152Updated last year
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆59Updated 5 months ago
- ☆60Updated 11 months ago
- Local LLM ReAct Agent with Guidance☆158Updated last year
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆173Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆132Updated 3 months ago
- A Python library to chunk/group your texts based on semantic similarity.☆94Updated 8 months ago
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆364Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆41Updated 8 months ago
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆82Updated 2 months ago
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆142Updated 2 weeks ago
- A library to extract the main content from html. Developed for information on LLM and for feeding data into LangChain and LlamaIndex.☆37Updated 10 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆105Updated 6 months ago
- ☆255Updated last year
- Guideline following Large Language Model for Information Extraction☆358Updated 5 months ago
- Object Detection Model for Scanned Documents☆90Updated 3 weeks ago