Alternatives and similar repositories for llm-engine:

Users that are interested in llm-engine are comparing it to the libraries listed below

• ray-project / ray-llm
  RayLLM - LLMs on Ray
  ☆1,257Updated 8 months ago
• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆641Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆687Updated 10 months ago
• ray-project / llmperf-leaderboard
  ☆448Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆567Updated 5 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆705Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆495Updated last year
• abacaj / mpt-30B-inference
  Run inference on MPT-30B using CPU
  ☆575Updated last year
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆506Updated last year
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,067Updated last year
• apoorvumang / prompt-lookup-decoding
  ☆502Updated 5 months ago
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,842Updated last year
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆913Updated 3 months ago
• redotvideo / haven
  LLM fine-tuning and eval
  ☆344Updated 11 months ago
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,038Updated 11 months ago
• HazyResearch / manifest
  Prompt programming with FMs.
  ☆440Updated 6 months ago
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆393Updated last month
• rogeriochaves / langstream
  Build robust LLM applications with true composability 🔗
  ☆415Updated last year
• danielgross / LlamaAcademy
  A school for camelids
  ☆1,210Updated last year
• HazyResearch / evaporate
  This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…
  ☆486Updated 10 months ago
• sdan / vlite
  fast vector database made in numpy
  ☆751Updated 9 months ago
• getmetal / motorhead
  🧠 Motorhead is a memory and information retrieval server for LLMs.
  ☆865Updated 3 months ago
• HazyResearch / meerkat
  Creative interactive views of any dataset.
  ☆835Updated last month
• philschmid / easyllm
  ☆446Updated last year
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,518Updated this week
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,028Updated 9 months ago
• srush / MiniChain
  A tiny library for coding with large language models.
  ☆1,223Updated 7 months ago
• langchain-ai / auto-evaluator
  ☆756Updated last year