sap-ient-ai / FFF
FastFeedForward Networks
☆18Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for FFF
- ☆49Updated 8 months ago
- Our solution for the arc challenge 2024☆32Updated last week
- ☆53Updated 10 months ago
- ☆27Updated 4 months ago
- ☆43Updated 2 months ago
- ☆76Updated 7 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- ☆34Updated last year
- ☆22Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Code repository for the c-BTM paper☆105Updated last year
- Evaluation of neuro-symbolic engines☆33Updated 3 months ago
- ☆24Updated 8 months ago
- ☆57Updated 11 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- RWKV-7: Surpassing GPT☆45Updated this week
- GoldFinch and other hybrid transformer components☆39Updated 4 months ago
- Collection of autoregressive model implementation☆67Updated this week
- Latent Large Language Models☆16Updated 2 months ago
- Jax like function transformation engine but micro, microjax☆26Updated 3 weeks ago
- Implementation of Spectral State Space Models☆17Updated 8 months ago
- Understanding how features learned by neural networks evolve throughout training☆31Updated 3 weeks ago
- Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)☆47Updated last year
- BitLinear implementation☆21Updated last month
- An introduction to LLM Sampling☆64Updated 2 weeks ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆37Updated last year
- Universal Neurons in GPT2 Language Models☆27Updated 5 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆111Updated last week
- ☆48Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated last month