Alternatives and similar repositories for aici:

Users that are interested in aici are comparing it to the libraries listed below

• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,386Updated 2 months ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,027Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,889Updated 10 months ago
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,632Updated 2 weeks ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,425Updated this week
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,656Updated 9 months ago
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,684Updated last year
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,802Updated 8 months ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,314Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,015Updated last month
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆987Updated this week
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,398Updated 4 months ago
• andrewnguonly / Lumos
  A RAG LLM co-pilot for browsing the web, powered by local LLMs
  ☆1,501Updated 2 months ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆1,000Updated 2 months ago
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,566Updated this week
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆683Updated 7 months ago
• mistralai / mistral-common
  ☆712Updated 3 weeks ago
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆854Updated last year
• facebookresearch / llm-transparency-tool
  LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …
  ☆816Updated 4 months ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,414Updated last week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,466Updated 5 months ago
• e2b-dev / code-interpreter
  Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
  ☆1,662Updated last week
• BoundaryML / baml
  The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)
  ☆2,878Updated this week
• mistralai / mistral-finetune
  ☆2,912Updated 7 months ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,531Updated this week
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆979Updated 10 months ago
• microsoft / Llama-2-Onnx
  ☆1,025Updated last year
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,435Updated 2 weeks ago
• a16z-infra / llm-app-stack
  ☆1,156Updated 8 months ago
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,538Updated this week