mustafaaljadery / gemma-2B-10MLinks
Gemma 2B with 10M context length using Infini-attention.
☆940Updated last year
Alternatives and similar repositories for gemma-2B-10M
Users that are interested in gemma-2B-10M are comparing it to the libraries listed below
Sorting:
- OpenCodeInterpreter is a suite of open-source code generation systems aimed at bridging the gap between large language models and sophist…☆1,684Updated last year
- Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…☆1,301Updated 2 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆986Updated last year
- We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 …☆855Updated last year
- YaFSDP: Yet another Fully Sharded Data Parallel☆980Updated last month
- ☆1,007Updated 8 months ago
- The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user…☆1,308Updated 8 months ago
- Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.☆685Updated last year
- OmniFusion — a multimodal model to communicate using text and images☆233Updated last year
- Llama-3 agents that can browse the web by following instructions and talking to you☆1,408Updated 10 months ago
- ☆1,090Updated last year
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,300Updated last year
- ☆446Updated last year
- Automate the analysis of GitHub repositories for LLMs with RepoToTextForLLMs. Fetch READMEs, structure, and non-binary files efficiently.…☆770Updated last year
- Training LLMs with QLoRA + FSDP☆1,527Updated 11 months ago
- LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …☆841Updated 10 months ago
- Port of OpenAI's Whisper model in C/C++ with xtts and wav2lip☆834Updated 6 months ago
- The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling☆723Updated 11 months ago
- Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"☆711Updated last year
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆771Updated last year
- ☆937Updated last year
- multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at o…☆350Updated 9 months ago
- Generate and auto-execute Python scripts in the cli☆1,805Updated 2 months ago
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆663Updated 5 months ago
- 2D Positional Embeddings for Webpage Structural Understanding 🦙👀☆94Updated last year
- ☆353Updated 2 years ago
- Train Models Contrastively in Pytorch☆754Updated 7 months ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,771Updated last year
- ☆331Updated 3 weeks ago
- This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…☆596Updated last year