Alternatives and similar repositories for worker-sglang

Users that are interested in worker-sglang are comparing it to the libraries listed below

• nyunAI / PruneGPT
  ☆53Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆112Updated 4 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆90Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆37Updated last year
• Zyphra / Zyda_processing
  ☆34Updated 11 months ago
• arcee-ai / DAM
  ☆49Updated 6 months ago
• unslothai / unsloth-zoo
  Utils for Unsloth
  ☆90Updated this week
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week
• cognitivecomputations / grokadamw
  ☆130Updated 9 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆76Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆123Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 2 months ago
• cognitivecomputations / spectrum
  ☆121Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆92Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago