Alternatives and similar repositories for llm-engine

Users that are interested in llm-engine are comparing it to the libraries listed below

• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆658Updated last year
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,261Updated 3 months ago
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆398Updated 3 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆327Updated 10 months ago
• srush / MiniChain
  A tiny library for coding with large language models.
  ☆1,232Updated 11 months ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆415Updated last year
• redotvideo / haven
  LLM fine-tuning and eval
  ☆346Updated last year
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆1,016Updated 3 months ago
• ray-project / llmperf-leaderboard
  ☆462Updated last year
• run-llama / llama-lab
  ☆1,486Updated last year
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆511Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆714Updated last year
• SkunkworksAI / hydra-moe
  ☆415Updated last year
• philschmid / easyllm
  ☆455Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆698Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• langchain-ai / auto-evaluator
  ☆766Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,073Updated 2 years ago
• abacaj / mpt-30B-inference
  Run inference on MPT-30B using CPU
  ☆575Updated last year
• varunshenoy / super-json-mode
  Low latency JSON generation using LLMs ⚡️
  ☆399Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆500Updated last year
• HazyResearch / meerkat
  Creative interactive views of any dataset.
  ☆841Updated 5 months ago
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆336Updated 7 months ago
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆683Updated 10 months ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆1,018Updated last month
• kagisearch / pyllms
  Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), w…
  ☆777Updated last month
• mistralai-sf24 / hackathon
  ☆447Updated last year
• freddyaboulton / gradio-tools
  ☆596Updated 2 years ago
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,044Updated last year
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆467Updated last year