GreenBitAI / bitorch-engine

Related projects ⓘ

Alternatives and complementary repositories for bitorch-engine

• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆72Updated 3 weeks ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆46Updated 7 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆30Updated 2 months ago
• IST-DASLab / RoSA
  ☆34Updated 8 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆24Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆20Updated last week
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated 11 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆91Updated last month
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed
  ☆25Updated this week
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆26Updated 7 months ago
• tridao / flash-attention-wheels
  ☆41Updated 11 months ago
• BBuf / RWKV-World-HF-Tokenizer
  ☆33Updated 3 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆51Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆44Updated 2 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆45Updated 3 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆74Updated 5 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆34Updated 8 months ago
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆12Updated 4 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆43Updated 3 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆56Updated 6 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆28Updated 6 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆19Updated 5 months ago
• RobertCsordas / moeut
  ☆61Updated 2 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated this week
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆18Updated last month