angry-kratos / Simple_Llama3_from_scratch
☆28Updated 3 months ago
Related projects: ⓘ
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆45Updated 3 months ago
- Set of scripts to finetune LLMs☆36Updated 5 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆46Updated 5 months ago
- ☆59Updated last week
- From scratch implementation of a vision language model in pure PyTorch☆149Updated 4 months ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆77Updated 5 months ago
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆72Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆105Updated 3 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆77Updated 3 months ago
- Collection of autoregressive model implementation☆62Updated 2 weeks ago
- This repository contains a better implementation of Kolmogorov-Arnold networks☆59Updated 4 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆38Updated 3 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆82Updated 3 weeks ago
- Code related to training/fine-tuning Hindi/Hinglish models.☆47Updated 8 months ago
- Prune transformer layers☆60Updated 3 months ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆153Updated last week
- Distributed training (multi-node) of a Transformer model☆36Updated 5 months ago
- Video+code lecture on building nanoGPT from scratch☆64Updated 3 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆106Updated this week
- ☆109Updated last month
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆29Updated this week
- Variations of Kolmogorov-Arnold Networks☆112Updated 4 months ago
- Conference schedule, top papers, and analysis of the data for NeurIPS 2023!☆103Updated 9 months ago
- Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU☆30Updated 10 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆47Updated 5 months ago
- End-to-End LLM Guide☆91Updated 2 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆26Updated 8 months ago
- Evaluating the Mamba architecture on the Othello game☆41Updated 4 months ago
- ☆42Updated 3 weeks ago
- A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)☆81Updated this week