Alternatives and similar repositories for Fast-LLM:

Users that are interested in Fast-LLM are comparing it to the libraries listed below

• cognitivecomputations / spectrum
  ☆113Updated 4 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆252Updated 7 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 8 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆203Updated 3 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆191Updated this week
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated 2 weeks ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆114Updated 8 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆79Updated 11 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆158Updated this week
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆101Updated 2 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆104Updated 8 months ago
• SalesforceAIResearch / SFR-RAG
  ☆73Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆167Updated last month
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆64Updated 5 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆100Updated 5 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆272Updated last week
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆124Updated last month
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• ali-bahrainian / RAG_best_practices
  ☆78Updated last month
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated 9 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆88Updated 11 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆101Updated 2 months ago
• writer / writing-in-the-margins
  ☆109Updated 5 months ago
• apple / ml-superposition-prompting
  ☆141Updated 7 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆296Updated last year