knotgrass / How-Transformers-Work
🧠 A study guide to learn about Transformers
☆10Updated last year
Alternatives and similar repositories for How-Transformers-Work:
Users that are interested in How-Transformers-Work are comparing it to the libraries listed below
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆92Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆69Updated last month
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆87Updated last year
- Tutorial for how to build BERT from scratch☆86Updated 7 months ago
- ☆76Updated 3 months ago
- [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia☆155Updated 5 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆198Updated 2 months ago
- Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation☆33Updated 10 months ago
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆56Updated last year
- Prune transformer layers☆67Updated 7 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆253Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆99Updated 3 months ago
- experiments with inference on llama☆104Updated 7 months ago
- Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training☆52Updated 3 weeks ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆66Updated 2 months ago
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- Efficient Attention for Long Sequence Processing☆91Updated last year
- Learn CUDA with PyTorch☆14Updated 2 months ago
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆185Updated last year
- SandLogic Lexicons☆16Updated 3 months ago
- ☆16Updated 2 weeks ago
- Training and Fine-tuning an llm in Python and PyTorch.☆41Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- Distributed training (multi-node) of a Transformer model☆49Updated 9 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated last month
- LLaMA 2 implemented from scratch in PyTorch☆280Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 7 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆138Updated 7 months ago
- A minimum example of aligning language models with RLHF similar to ChatGPT☆215Updated last year