yk / llmvmLinks
☆31Updated 2 years ago
Alternatives and similar repositories for llmvm
Users that are interested in llmvm are comparing it to the libraries listed below
Sorting:
- Learning Universal Predictors☆81Updated last year
- ☆53Updated 2 years ago
- ☆40Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- Jax like function transformation engine but micro, microjax☆34Updated last year
- ☆111Updated 6 months ago
- ☆27Updated last year
- ☆34Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Updated 6 months ago
- σ-GPT: A New Approach to Autoregressive Models☆70Updated last year
- ☆71Updated 2 years ago
- Simplex Random Feature attention, in PyTorch☆75Updated 2 years ago
- RWKV model implementation☆37Updated 2 years ago
- H-Net Dynamic Hierarchical Architecture☆81Updated 4 months ago
- Latent Large Language Models☆19Updated last year
- ☆77Updated last year
- ☆50Updated last year
- ☆22Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆183Updated 3 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Updated 2 months ago
- LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence☆61Updated 3 years ago
- An introduction to LLM Sampling☆79Updated last year
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆75Updated 7 months ago
- ☆63Updated 3 years ago
- ☆62Updated 2 years ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆60Updated 3 years ago
- ☆24Updated last year