ServiceNow / Fast-LLM

Related projects ⓘ

Alternatives and complementary repositories for Fast-LLM

• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆44Updated 2 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆51Updated this week
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆77Updated 3 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆49Updated last week
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 5 months ago
• srush / LLM-Talk
  ☆45Updated 9 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆28Updated 4 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆73Updated 3 weeks ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆21Updated 2 weeks ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆73Updated 9 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• Aleph-Alpha / trigrams
  ☆43Updated 2 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆53Updated 7 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 6 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆22Updated 8 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆34Updated 10 months ago
• Knowledgator / TurboT5
  Truly flash T5 realization!
  ☆53Updated 5 months ago
• codefuse-ai / D2LLM
  ☆22Updated 3 months ago
• RobertCsordas / moeut
  ☆61Updated 2 months ago
• arcee-ai / DAM
  ☆40Updated this week
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆33Updated last year
• du-nlp-lab / MLR-Copilot
  ☆57Updated last month
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆57Updated 2 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; arXiv preprint arXiv:2403.…
  ☆36Updated 4 months ago
• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• LLM360 / k2-train
  ☆36Updated 5 months ago