Alternatives and similar repositories for aici

Users that are interested in aici are comparing it to the libraries listed below

• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,473Updated 2 weeks ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,644Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,943Updated last week
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆682Updated 9 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,985Updated last week
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,553Updated 3 weeks ago
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆963Updated last year
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,671Updated this week
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,051Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,111Updated 2 months ago
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,737Updated last year
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆1,007Updated this week
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,404Updated 5 months ago
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,985Updated 9 months ago
• jafioti / luminal
  Deep learning at the speed of light.
  ☆1,673Updated this week
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆696Updated 6 months ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,666Updated this week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,479Updated 6 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆764Updated this week
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆1,734Updated this week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,614Updated 3 weeks ago
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,349Updated this week
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,442Updated 2 months ago
• andrewnguonly / Lumos
  A RAG LLM co-pilot for browsing the web, powered by local LLMs
  ☆1,510Updated 4 months ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,050Updated last year
• AutoCodeRoverSG / auto-code-rover
  A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-be…
  ☆2,938Updated last month
• Codium-ai / AlphaCodium
  Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""
  ☆3,825Updated 6 months ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆1,011Updated last month
• mistralai / mistral-finetune
  ☆2,952Updated 8 months ago
• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆2,427Updated this week