inference code for mixtral-8x7b-32kseqlen
☆105Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for mixtral-inference
Users that are interested in mixtral-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Eh, simple and works.☆27Dec 9, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆367Dec 9, 2023Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Jan 7, 2024Updated 2 years ago
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆770Dec 15, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆71Nov 9, 2025Updated 10 months ago
- ☆17Dec 5, 2023Updated 2 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- ☆13Sep 17, 2022Updated 4 years ago
- ☆13Dec 22, 2023Updated 2 years ago
- ☆24Oct 19, 2024Updated last year
- ☆13Mar 15, 2024Updated 2 years ago
- Make AES-GCM safe to use with random nonces, for any practical number of messages.☆19Sep 16, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- AltugCar on 0xMonaco☆10Aug 22, 2022Updated 4 years ago
- ☆20Dec 19, 2023Updated 2 years ago
- ☆10Sep 11, 2026Updated last week
- ☆867Dec 8, 2023Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 3 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated 2 years ago
- ☆133Nov 24, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆22Dec 14, 2023Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Aug 27, 2023Updated 3 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Sep 10, 2023Updated 3 years ago
- ☆16Mar 2, 2024Updated 2 years ago
- batched loras☆352Sep 6, 2023Updated 3 years ago
- ☆13Mar 25, 2024Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration …☆13Apr 17, 2023Updated 3 years ago
- This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]☆22Jul 21, 2024Updated 2 years ago
- React Frontend for stable diffusion☆28Sep 23, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Generate textbook-quality synthetic LLM pretraining data☆508Oct 19, 2023Updated 2 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 3 years ago
- Retro styled terminal shell☆26May 8, 2024Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- ☆1,593Mar 25, 2026Updated 5 months ago
- ☆67Dec 8, 2023Updated 2 years ago
- Mixtral on Your Local Computer☆35Dec 14, 2023Updated 2 years ago