MDK8888 / GPTFastLinks
Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
☆686Updated last year
Alternatives and similar repositories for GPTFast
Users that are interested in GPTFast are comparing it to the libraries listed below
Sorting:
- ☆446Updated last year
- Training LLMs with QLoRA + FSDP☆1,536Updated last year
- ☆1,026Updated 11 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Updated last year
- llama3.np is a pure NumPy implementation for Llama 3 model.☆993Updated 8 months ago
- Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…☆1,313Updated 5 months ago
- Train Models Contrastively in Pytorch☆771Updated 9 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆733Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆723Updated 2 years ago
- Official inference library for pre-processing of Mistral models☆846Updated last week
- Automatically evaluate your LLMs in Google Colab☆679Updated last year
- Visualize the intermediate output of Mistral 7B☆381Updated 11 months ago
- The repository for the code of the UltraFastBERT paper☆519Updated last year
- ☆584Updated last year
- A bagel, with everything.☆325Updated last year
- Inference code for Persimmon-8B☆412Updated 2 years ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,406Updated last year
- batched loras☆348Updated 2 years ago
- Guide for fine-tuning Llama/Mistral/CodeLlama models and more☆644Updated 2 months ago
- ☆416Updated 2 years ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆233Updated last year
- Run Mixtral-8x7B models in Colab or consumer desktops☆2,329Updated last year
- ☆866Updated 2 years ago
- a small code base for training large models☆318Updated 8 months ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆905Updated 3 weeks ago
- Scale LLM Engine public repository☆820Updated this week
- Inference Llama 2 in one file of pure Python☆425Updated last month
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,088Updated 11 months ago
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆665Updated last year
- kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)☆595Updated 3 weeks ago