Alternatives and similar repositories for torch-submit

Users that are interested in torch-submit are comparing it to the libraries listed below

• charlesfrye / minimodal
  A miniature version of Modal
  ☆20Updated last year
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆190Updated 2 weeks ago
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆144Updated last year
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆98Updated 2 months ago
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆222Updated 6 months ago
• AnswerDotAI / fastkmeans
  ☆71Updated 2 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆149Updated 2 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆267Updated last month
• google-deepmind / asyncdiloco
  ☆46Updated last year
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• lianakoleva / no-libtorch-compile
  ☆21Updated 6 months ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 3 months ago
• xjdr-alt / muzero_sketch
  ☆39Updated last year
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆121Updated 2 weeks ago
• somewheresystems / llama2mlx
  Karpathy's llama2.c transpiled to MLX for Apple Silicon
  ☆15Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 8 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• abacaj / train-with-fsdp
  ☆94Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 5 months ago
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 4 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated last month
• xjdr-alt / llmri
  look how they massacred my boy
  ☆64Updated 11 months ago
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆207Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• character-ai / MuKoe
  ☆54Updated last year
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆216Updated 10 months ago
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆131Updated 6 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year