chi2liu / mamba-gpt-3b
It is almost the best 3B model in the current open source industry, surpassing Dolly v2-3b, open lama-3b, and even outperforming the EleutherAI/pythia-12b model in terms of performance. Can refer to open_llm_leaderboard
☆13Updated last year
Alternatives and similar repositories for mamba-gpt-3b:
Users that are interested in mamba-gpt-3b are comparing it to the libraries listed below
- ☆38Updated last year
- ☆53Updated 10 months ago
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- ☆36Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Updated 4 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆28Updated 3 weeks ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- Simple Implementation of a Transformer in the new framework MLX by Apple☆20Updated 4 months ago
- RWKV-7: Surpassing GPT☆82Updated 4 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Simple GRPO scripts and configurations.☆59Updated last month
- The Next Generation Multi-Modality Superintelligence☆71Updated 7 months ago
- Low-Rank Adaptation of Large Language Models clean implementation☆8Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- fine tuning mistral 7B using Huggingface, Weights and Biases, Choline, and Vast AI☆37Updated last year
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆64Updated last year
- ☆54Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆54Updated last year
- An AI agent for interacting with a computer using the graphical user interface☆76Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- My fork os allen AI's OLMo for educational purposes.☆30Updated 3 months ago
- Eh, simple and works.☆27Updated last year
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆81Updated 3 weeks ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆20Updated 2 weeks ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- ☆73Updated last year