Alternatives and similar repositories for llm-engine:

Users that are interested in llm-engine are comparing it to the libraries listed below

• ray-project / ray-llm
  RayLLM - LLMs on Ray
  ☆1,254Updated 8 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆687Updated 10 months ago
• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆641Updated last year
• srush / MiniChain
  A tiny library for coding with large language models.
  ☆1,223Updated 7 months ago
• HazyResearch / manifest
  Prompt programming with FMs.
  ☆440Updated 6 months ago
• langchain-ai / auto-evaluator
  ☆756Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆705Updated last year
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,038Updated 11 months ago
• redotvideo / haven
  LLM fine-tuning and eval
  ☆344Updated 10 months ago
• oughtinc / ice
  Interactive Composition Explorer: a debugger for compositional language model programs
  ☆543Updated last month
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆506Updated last year
• getmetal / motorhead
  🧠 Motorhead is a memory and information retrieval server for LLMs.
  ☆865Updated 3 months ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆400Updated 9 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,358Updated last week
• dust-tt / dust
  Custom AI assistant platform to speed up your work.
  ☆1,031Updated this week
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆999Updated 4 months ago
• HazyResearch / evaporate
  This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…
  ☆486Updated 10 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆590Updated 9 months ago
• rogeriochaves / langstream
  Build robust LLM applications with true composability 🔗
  ☆415Updated last year
• philschmid / easyllm
  ☆446Updated last year
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆584Updated last year
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆912Updated 3 months ago
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆557Updated this week
• pchunduri6 / rag-demystified
  An LLM-powered advanced RAG pipeline built from scratch
  ☆827Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆567Updated 5 months ago
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆393Updated last month
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆483Updated last year
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,842Updated last year
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year