Alternatives and similar repositories for Cornstarch:

Users that are interested in Cornstarch are comparing it to the libraries listed below

• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆277Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆65Updated 2 weeks ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆139Updated 3 weeks ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆111Updated 9 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆87Updated 2 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆21Updated 2 months ago
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆127Updated this week
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆94Updated 3 months ago
• Just-Curieous / Curie
  ❓Curie: Automated and Rigorous Scientific Experimentation with AI Agents
  ☆54Updated this week
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆90Updated 3 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆169Updated last week
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 9 months ago
• huggingface / picotron_tutorial
  ☆158Updated last month
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆62Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆168Updated 2 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆82Updated 3 weeks ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆311Updated 3 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆37Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated this week
• nyunAI / Faster-LLM-Survey
  ☆41Updated 11 months ago
• PrimeIntellect-ai / genesys
  ☆107Updated last week
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated last month
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆21Updated last week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆139Updated 2 months ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 5 months ago
• apple / ml-hypercloning
  ☆46Updated 4 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆444Updated last week