chi2liu / mamba-gpt-3b
It is almost the best 3B model in the current open source industry, surpassing Dolly v2-3b, open lama-3b, and even outperforming the EleutherAI/pythia-12b model in terms of performance. Can refer to open_llm_leaderboard
☆13Updated last year
Alternatives and similar repositories for mamba-gpt-3b:
Users that are interested in mamba-gpt-3b are comparing it to the libraries listed below
- ☆38Updated last year
- LLM reads a paper and produce a working prototype☆46Updated 3 weeks ago
- Github repo for Peifeng's internship project☆13Updated last year
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆16Updated last week
- ☆35Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- Low-Rank Adaptation of Large Language Models clean implementation☆9Updated last year
- ☆49Updated 10 months ago
- ☆60Updated last year
- Simple Implementation of a Transformer in the new framework MLX by Apple☆21Updated 2 months ago
- ☆52Updated 8 months ago
- ☆87Updated 11 months ago
- ☆46Updated 2 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated last month
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆36Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- Eh, simple and works.☆27Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated 2 months ago
- ☆74Updated last year
- An AI agent for interacting with a computer using the graphical user interface☆74Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆34Updated 8 months ago
- Very minimal (and stateless) agent framework☆41Updated last week
- OVALChat is a customizable Web app aimed at conducting user studies with chatbots☆28Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆43Updated 10 months ago
- fine tuning mistral 7B using Huggingface, Weights and Biases, Choline, and Vast AI☆38Updated last year
- Nexusflow function call, tool use, and agent benchmarks.☆18Updated last month
- A re-implementation of Meta-Prompt in LangChain for building self-improving agents.☆62Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year