Alternatives and similar repositories for Fast-LLM:

Users that are interested in Fast-LLM are comparing it to the libraries listed below

• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆167Updated last month
• cognitivecomputations / spectrum
  ☆113Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆193Updated this week
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆204Updated 4 months ago
• writer / writing-in-the-margins
  ☆110Updated 6 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆207Updated this week
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated 2 weeks ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆108Updated 9 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆114Updated 8 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 5 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆85Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 7 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆277Updated 2 weeks ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆53Updated 5 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆163Updated this week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆264Updated 4 months ago
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆76Updated 3 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 11 months ago
• apple / ml-superposition-prompting
  ☆142Updated 7 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆96Updated last month
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆145Updated last month
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆196Updated 7 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆176Updated 2 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆207Updated 3 weeks ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆102Updated 3 months ago