kabachuha / nanoGPKANTLinks
Testing KAN-based text generation GPT models
☆17Updated last year
Alternatives and similar repositories for nanoGPKANT
Users that are interested in nanoGPKANT are comparing it to the libraries listed below
Sorting:
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 7 months ago
- Implementation of the Mamba SSM with hf_integration.☆56Updated 9 months ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- Latent Large Language Models☆18Updated 10 months ago
- Official Repository for Task-Circuit Quantization☆20Updated 3 weeks ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- alternative way to calculating self attention☆18Updated last year
- ☆61Updated last year
- GoldFinch and other hybrid transformer components☆45Updated 11 months ago
- Efficiently computing & storing token n-grams from large corpora☆24Updated 8 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables☆20Updated last month
- Tools for formatting large language model prompts.☆13Updated last year
- a version of baby agi using dspy and typed predictors☆17Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆18Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Implementation of Stable Diffusion from scratch [WORK IN PROGRESS]☆22Updated 2 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Updated 11 months ago
- BH hackathon☆14Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆28Updated this week
- Experimental sampler to make LLMs more creative☆31Updated last year
- This repository implements DSPy programs to tasks in Indian Languages☆13Updated last year
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆101Updated 3 months ago
- ☆47Updated last year
- Tool to take your ML model from local to production with one-line of code.☆25Updated last year
- aesthetic tensor visualiser☆24Updated 2 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 months ago