subhashk01 / LLM-additionLinks
LLMs represent numbers on a helix and manipulate that helix to do addition.
☆27Updated 9 months ago
Alternatives and similar repositories for LLM-addition
Users that are interested in LLM-addition are comparing it to the libraries listed below
Sorting:
- Repository to create traveling waves integrate special information through time☆56Updated 3 months ago
- look how they massacred my boy☆63Updated last year
- ☆62Updated 8 months ago
- σ-GPT: A New Approach to Autoregressive Models☆69Updated last year
- Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization☆35Updated last month
- lossily compress representation vectors using product quantization☆59Updated 3 weeks ago
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"☆255Updated last week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆107Updated 8 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆147Updated last month
- A collection of lightweight interpretability scripts to understand how LLMs think☆66Updated this week
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆111Updated last month
- ☆143Updated 2 months ago
- ☆28Updated last year
- ☆40Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Updated 7 months ago
- Lego for GRPO☆30Updated 5 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆60Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Updated 6 months ago
- Fork of Flame repo for training of some new stuff in development☆19Updated this week
- Getting crystal-like representations with harmonic loss☆192Updated 7 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last month
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 2 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 7 months ago
- Alice in Wonderland code base for experiments and raw experiments data☆131Updated 2 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆59Updated last month
- implementation of https://arxiv.org/pdf/2312.09299☆21Updated last year
- ☆29Updated 2 weeks ago
- H-Net Dynamic Hierarchical Architecture☆80Updated 2 months ago
- Code for the Fractured Entangled Representation Hypothesis position paper!☆206Updated 2 weeks ago