hdmquan / torch_activationLinks
Torch-activation, a library of activation functions for PyTorch library
☆24Updated last month
Alternatives and similar repositories for torch_activation
Users that are interested in torch_activation are comparing it to the libraries listed below
Sorting:
- ☆49Updated last year
- Lego for GRPO☆28Updated last week
- entropix style sampling + GUI☆26Updated 7 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆49Updated 3 months ago
- ☆48Updated 4 months ago
- look how they massacred my boy☆63Updated 7 months ago
- ☆49Updated 7 months ago
- RWKV-7: Surpassing GPT☆88Updated 6 months ago
- ☆56Updated 2 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 3 months ago
- ☆20Updated 2 months ago
- ☆29Updated 6 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆100Updated 3 months ago
- ☆47Updated 9 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated last month
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆100Updated 5 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated last month
- ☆20Updated last year
- ☆95Updated 4 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆38Updated last month
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 4 months ago
- Latent Large Language Models☆18Updated 9 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated 11 months ago
- Esoteric Language Models☆34Updated this week
- ☆59Updated 3 weeks ago