inference code for mixtral-8x7b-32kseqlen
☆105Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for mixtral-inference
Users that are interested in mixtral-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Eh, simple and works.☆27Dec 9, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆367Dec 9, 2023Updated 2 years ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11May 8, 2024Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Jan 7, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆768Dec 15, 2023Updated 2 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆71Nov 9, 2025Updated 11 months ago
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Apr 7, 2024Updated 2 years ago
- ☆17Dec 5, 2023Updated 2 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- ☆13Sep 17, 2022Updated 4 years ago
- ☆13Dec 22, 2023Updated 2 years ago
- ☆24Oct 19, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Mar 15, 2024Updated 2 years ago
- Make AES-GCM safe to use with random nonces, for any practical number of messages.☆19Sep 16, 2025Updated last year
- AltugCar on 0xMonaco☆10Aug 22, 2022Updated 4 years ago
- ☆25Dec 21, 2023Updated 2 years ago
- ☆20Dec 19, 2023Updated 2 years ago
- ☆866Dec 8, 2023Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆157Aug 5, 2023Updated 3 years ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A component that allows you to annotate an image with points and boxes.☆21Dec 12, 2023Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated 2 years ago
- ☆133Nov 24, 2023Updated 2 years ago
- ☆22Dec 14, 2023Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Aug 27, 2023Updated 3 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 3 years ago
- ☆16Mar 2, 2024Updated 2 years ago
- A rewrite of Optimism's MIPS.sol thread context in Huff☆26Aug 6, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆24May 5, 2024Updated 2 years ago
- ☆27Aug 25, 2023Updated 3 years ago
- batched loras☆352Sep 6, 2023Updated 3 years ago
- ☆13Mar 25, 2024Updated 2 years ago
- This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]☆22Jul 21, 2024Updated 2 years ago
- React Frontend for stable diffusion☆28Sep 23, 2022Updated 4 years ago
- Generate textbook-quality synthetic LLM pretraining data☆507Oct 19, 2023Updated 2 years ago