A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
☆48Sep 26, 2024Updated last year
Alternatives and similar repositories for embed
Users that are interested in embed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Dec 16, 2024Updated last year
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,888Mar 24, 2026Updated 3 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in LLMs through Translation-Assisted Chain-of-Thought Processes☆14Jul 1, 2025Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆89Jul 13, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Multilingual Entity Linking model by BELA model☆12Jul 20, 2023Updated 3 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Mar 2, 2024Updated 2 years ago
- utilities for loading and running text embeddings with onnx☆46Aug 16, 2025Updated 11 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆86Oct 29, 2024Updated last year
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆23Oct 6, 2023Updated 2 years ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated 10 months ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Aug 18, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- One Line To Build Zero-Data Classifiers in Minutes☆65Sep 25, 2024Updated last year
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆19Jun 28, 2026Updated 3 weeks ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆69Aug 21, 2024Updated last year
- Using modal.com to process FineWeb-edu data☆20Apr 11, 2026Updated 3 months ago
- ☆13Feb 22, 2024Updated 2 years ago
- 249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer a…☆19May 22, 2026Updated last month
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆36Aug 28, 2024Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆105Oct 28, 2025Updated 8 months ago
- ☆15Dec 21, 2025Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models☆19Apr 1, 2025Updated last year
- LLM shell and document interogator☆14Jul 24, 2023Updated 2 years ago
- Bamboo-7B Large Language Model☆95Mar 28, 2024Updated 2 years ago
- Get more done with LLMs☆13Jan 19, 2024Updated 2 years ago
- ☆69May 26, 2024Updated 2 years ago
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated 2 years ago
- Code for boomerang distillation enables zero-shot model size interpolation.☆22Jul 10, 2026Updated last week
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆57Feb 10, 2025Updated last year
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆106May 31, 2026Updated last month
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated last year
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆17Updated this week
- Multi-Agent Reinforcement Learning Environment for the card game SkyJo, compatible with PettingZoo and RLLIB☆16Feb 21, 2026Updated 4 months ago
- Automated LLM novelist☆46Apr 11, 2024Updated 2 years ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆25Mar 6, 2025Updated last year
- Large-scale LLM inference engine☆1,801Updated this week