skypilot-org / skypilotLinks
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).
☆8,910Updated this week
Alternatives and similar repositories for skypilot
Users that are interested in skypilot are comparing it to the libraries listed below
Sorting:
- Large Language Model Text Generation Inference☆10,621Updated last month
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,532Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆19,718Updated this week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,817Updated 3 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,839Updated 11 months ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,905Updated this week
- Structured Outputs☆12,770Updated last week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,831Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆61,727Updated this week
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,102Updated last year
- Accessible large language models via k-bit quantization for PyTorch.☆7,716Updated this week
- Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.☆7,880Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,528Updated 5 months ago
- Python bindings for llama.cpp☆9,697Updated 2 months ago
- A language for constraint-guided and efficient LLM programming.☆4,076Updated 5 months ago
- Numbers every LLM developer should know☆4,261Updated last year
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆4,983Updated 6 months ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,525Updated 2 years ago
- Tensor library for machine learning☆13,361Updated last week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,082Updated 4 months ago
- Official inference library for Mistral models☆10,531Updated 7 months ago
- Go ahead and axolotl questions☆10,716Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,883Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,734Updated last year
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆12,008Updated last week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,354Updated 2 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,498Updated last year
- Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-s…☆2,661Updated this week
- An awesome & curated list of best LLMOps tools for developers☆5,393Updated 2 weeks ago
- Train transformer language models with reinforcement learning.☆16,106Updated this week