A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
☆46Sep 26, 2024Updated 2 years ago
Alternatives and similar repositories for embed
Users that are interested in embed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,987Updated this week
- ☆16Dec 16, 2024Updated last year
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆52Aug 18, 2024Updated 2 years ago
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆35Aug 28, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Apr 26, 2025Updated last year
- Multilingual Entity Linking model by BELA model☆12Jul 20, 2023Updated 3 years ago
- AI Companion for Obsidian and llama.cpp☆11Jan 27, 2025Updated last year
- code for training and using chess embeddings models☆14Jun 9, 2024Updated 2 years ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Mar 2, 2024Updated 2 years ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆86Oct 29, 2024Updated 2 years ago
- ☆13Feb 22, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Attend - to what matters.☆16Feb 22, 2025Updated last year
- C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…☆24Mar 4, 2024Updated 2 years ago
- Cuda implemenation of flash-kmeans, 2x faster☆23May 8, 2026Updated 6 months ago
- utilities for loading and running text embeddings with onnx☆46Aug 16, 2025Updated last year
- One Line To Build Zero-Data Classifiers in Minutes☆64Sep 25, 2024Updated 2 years ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆71Aug 21, 2024Updated 2 years ago
- *high-load* benchmarking tool☆22Updated this week
- Code for training CamemBERTa, a French language model based on DeBERTa V3. Development is done here https://gitlab.inria.fr/almanach/Came…☆14Nov 18, 2024Updated 2 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆105Oct 28, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆68Sep 29, 2026Updated last month
- Simple LLM inference server☆20Jun 13, 2024Updated 2 years ago
- GitAra 🦜🎸: A small function-calling git agent you can run locally☆29Jul 22, 2026Updated 3 months ago
- [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models☆23Apr 1, 2025Updated last year
- Neural Search☆371Mar 11, 2025Updated last year
- Dual accelerometer driver and tablet-mode detection service for Chuwi MiniBook X (N150!)☆11May 12, 2025Updated last year
- Code for boomerang distillation enables zero-shot model size interpolation.☆24Oct 14, 2026Updated last month
- ☆22Oct 14, 2024Updated 2 years ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Large-scale LLM inference engine☆1,912Updated this week
- LLM inference in C/C++☆30Sep 25, 2026Updated last month
- Yaraa (Yet Another Rag Automation Attempt) is a library that tackles the boring aspects of managing Rag pipelines, so you don't have to.☆25Sep 5, 2024Updated 2 years ago
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated 2 years ago
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated 2 years ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆107May 31, 2026Updated 5 months ago
- Python Bootcamp Materials☆11Dec 1, 2021Updated 4 years ago
Are these results useful?