knotgrass / How-Transformers-Work

Related projects ⓘ

Alternatives and complementary repositories for How-Transformers-Work

• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆63Updated 5 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆83Updated 5 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆92Updated last month
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆340Updated 4 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆200Updated 5 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆251Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆209Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆116Updated 7 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆169Updated last week
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated 10 months ago
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆178Updated 3 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆227Updated 7 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆237Updated 3 months ago
• neuralmagic / AutoFP8
  ☆156Updated last month
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆86Updated 3 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆250Updated last year
• Psycoy / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆222Updated last week
• for-ai / parameter-efficient-moe
  ☆246Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆95Updated 3 weeks ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆175Updated 3 months ago
• gnovack / distributed-training-and-deepspeed
  ☆13Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆213Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆168Updated last month
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆89Updated last year
• apple / ml-recurrent-drafter
  ☆96Updated last month
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆435Updated 7 months ago
• neubig / minllama-assignment
  ☆63Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated 3 weeks ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆150Updated 2 months ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆251Updated this week