joey00072 / Attention-as-graph
alternative way to calculating self attention
☆18Updated 10 months ago
Alternatives and similar repositories for Attention-as-graph:
Users that are interested in Attention-as-graph are comparing it to the libraries listed below
- BH hackathon☆14Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- ☆20Updated 5 months ago
- ☆38Updated 8 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 6 months ago
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆18Updated 2 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last week
- Apps that run on modal.com☆12Updated 10 months ago
- ☆17Updated this week
- Flexible, efficient, and context-aware generation from large unstructured knowledge sources.☆16Updated 11 months ago
- Latent Large Language Models☆17Updated 7 months ago
- look how they massacred my boy☆63Updated 5 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆25Updated 9 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated this week
- Lego for GRPO☆26Updated last week
- The Swarm Ecosystem☆20Updated 8 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Updated 4 months ago
- anything you want can be built with morph cloud☆8Updated this week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆93Updated last month
- Repository to create traveling waves integrate special information through time☆50Updated last month
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 10 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆24Updated last year
- ☆10Updated 5 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 7 months ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆68Updated 2 months ago
- Building large language foundational model☆9Updated last month
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 weeks ago
- OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space mod…☆14Updated last week