kyegomez / Python-Package-TemplateLinks
A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much much more
☆188Updated last week
Alternatives and similar repositories for Python-Package-Template
Users that are interested in Python-Package-Template are comparing it to the libraries listed below
Sorting:
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆59Updated last year
- LoRA and DoRA from Scratch Implementations☆212Updated last year
- open source alpha evolve☆67Updated 4 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆187Updated 2 weeks ago
- ☆196Updated 9 months ago
- PyTorch implementation of models from the Zamba2 series.☆185Updated 7 months ago
- An extension of the nanoGPT repository for training small MOE models.☆187Updated 6 months ago
- Collection of autoregressive model implementation☆86Updated 4 months ago
- ☆62Updated last year
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆161Updated 5 months ago
- Implementation of the Llama architecture with RLHF + Q-learning☆166Updated 7 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆286Updated 2 weeks ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆56Updated 3 months ago
- Implementation of Infini-Transformer in Pytorch☆111Updated 8 months ago
- Google TPU optimizations for transformers models☆120Updated 8 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆133Updated 2 weeks ago
- minimal GRPO implementation from scratch☆97Updated 6 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 months ago
- Data preparation code for Amber 7B LLM☆93Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆201Updated last year
- Code repository for Black Mamba☆255Updated last year
- Memory optimized Mixture of Experts☆65Updated last month
- Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels☆109Updated 2 years ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆105Updated 6 months ago
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆187Updated last week
- Set of scripts to finetune LLMs☆38Updated last year
- Load compute kernels from the Hub☆283Updated this week
- ☆196Updated 2 weeks ago
- ☆134Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆98Updated 11 months ago