Blaizzy / Coding-LLMs-from-scratch
☆29Updated 7 months ago
Alternatives and similar repositories for Coding-LLMs-from-scratch:
Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below
- a simplified version of Google's Gemma model to be used for learning☆24Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆38Updated 7 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆26Updated 11 months ago
- ☆122Updated 5 months ago
- Set of scripts to finetune LLMs☆36Updated 9 months ago
- ☆65Updated 7 months ago
- Video+code lecture on building nanoGPT from scratch☆65Updated 7 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆22Updated 6 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Cerule - A Tiny Mighty Vision Model☆67Updated 4 months ago
- LoRA and DoRA from Scratch Implementations☆194Updated 10 months ago
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆42Updated 5 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆166Updated 8 months ago
- minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever☆35Updated this week
- ☆74Updated last year
- ☆46Updated 2 months ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆141Updated 9 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆224Updated 2 months ago
- Very basic framework for parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture …☆36Updated last week
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆81Updated 3 weeks ago
- Testing LLM reasoning abilities with family relationship quizzes.☆55Updated this week
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- ☆96Updated 4 months ago
- Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow☆57Updated last year
- run ollama & gguf easily with a single command☆49Updated 8 months ago
- ☆87Updated 11 months ago
- Function Calling Benchmark & Testing☆78Updated 6 months ago
- Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed☆12Updated 7 months ago