Alternatives and similar repositories for skypilot

Users that are interested in skypilot are comparing it to the libraries listed below

• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,155Updated this week
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,666Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,238Updated last week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,304Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,943Updated last week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,685Updated 3 weeks ago
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆20,090Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,762Updated this week
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,493Updated last year
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,168Updated 3 weeks ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,898Updated 10 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,634Updated 8 months ago
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,727Updated 5 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,060Updated 8 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,470Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,591Updated this week
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,510Updated 2 weeks ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,446Updated 11 months ago
• qdrant / qdrant
  Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…
  ☆23,835Updated this week
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,737Updated last year
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,754Updated last week
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,416Updated last year
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆12,101Updated this week
• 567-labs / instructor
  structured outputs for llms
  ☆10,603Updated this week
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,411Updated 9 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,022Updated 2 weeks ago
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,111Updated 2 months ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆24,538Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆23,409Updated this week
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆15,547Updated 3 weeks ago