hscspring / llama.np

Related projects: ⓘ

• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 3 months ago
• nyunAI / PruneGPT
  ☆50Updated 3 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆62Updated this week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆68Updated last month
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆154Updated 4 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆76Updated 4 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆69Updated 7 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆115Updated 5 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 5 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆77Updated 5 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆127Updated 2 weeks ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 4 months ago
• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆72Updated 8 months ago
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆114Updated 8 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆118Updated last week
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆177Updated 4 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆73Updated 8 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (Official Code)
  ☆118Updated 2 weeks ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆158Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆42Updated 3 weeks ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• nyunAI / nyuntam
  ☆59Updated last week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆41Updated 6 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆117Updated 8 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆36Updated 7 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆52Updated 4 months ago
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆11Updated 8 months ago