Alternatives and similar repositories for Fast-LLM:

Users that are interested in Fast-LLM are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆254Updated 9 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated last week
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆211Updated 5 months ago
• cognitivecomputations / spectrum
  ☆113Updated 2 weeks ago
• AnswerDotAI / fastdata
  ☆151Updated 4 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆299Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆170Updated 3 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆284Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆86Updated last month
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆197Updated this week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 4 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆217Updated 2 weeks ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 10 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆266Updated this week
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆197Updated 9 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆100Updated 2 weeks ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated 2 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆334Updated 5 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆96Updated 3 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 10 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆180Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆168Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated last month
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆241Updated 2 months ago
• PrimeIntellect-ai / genesys
  ☆122Updated last month
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆272Updated 5 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆72Updated last month