Alternatives and similar repositories for cog

Users that are interested in cog are comparing it to the libraries listed below

• skypilot-org / skypilot
  Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, o…
  ☆8,585Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,787Updated 11 months ago
• huggingface / diffusers
  🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
  ☆30,556Updated this week
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,425Updated 2 weeks ago
• facebookincubator / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆4,669Updated 2 weeks ago
• chroma-core / chroma
  Open-source search and retrieval database for AI applications.
  ☆22,798Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,111Updated last week
• nebuly-ai / optimate
  A collection of libraries to optimise AI model performances
  ☆8,368Updated last year
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,477Updated this week
• dstackai / dstack
  dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…
  ☆1,870Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,259Updated this week
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆8,034Updated this week
• dottxt-ai / outlines
  Structured Outputs
  ☆12,462Updated this week
• weaviate / weaviate
  Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…
  ☆14,447Updated this week
• facebookresearch / metaseq
  Repo for external large-scale work
  ☆6,542Updated last year
• deepset-ai / haystack
  AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file convert…
  ☆22,073Updated last week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,664Updated this week
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,811Updated last year
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,493Updated last week
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆15,741Updated this week
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆9,900Updated last week
• postgresml / postgresml
  Postgres with GPUs for ML/AI apps.
  ☆6,458Updated 2 months ago
• deep-floyd / IF
  ☆7,847Updated last year
• divamgupta / stable-diffusion-tensorflow
  Stable Diffusion in TensorFlow / Keras
  ☆1,607Updated 2 years ago
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆10,502Updated this week
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,803Updated last year
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆44,018Updated this week
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,362Updated 10 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,531Updated 3 weeks ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,041Updated 3 months ago