inference code for mixtral-8x7b-32kseqlen
☆105Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for mixtral-inference
Users that are interested in mixtral-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Eh, simple and works.☆27Dec 9, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆367Dec 9, 2023Updated 2 years ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11May 8, 2024Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Jan 7, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆770Dec 15, 2023Updated 2 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆71Nov 9, 2025Updated 9 months ago
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Apr 7, 2024Updated 2 years ago
- ☆17Dec 5, 2023Updated 2 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- ☆13Dec 22, 2023Updated 2 years ago
- ☆24Oct 19, 2024Updated last year
- ☆13Mar 15, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Make AES-GCM safe to use with random nonces, for any practical number of messages.☆19Sep 16, 2025Updated 10 months ago
- Ongoing research training transformer models at scale☆37Jan 19, 2024Updated 2 years ago
- ☆20Dec 19, 2023Updated 2 years ago
- ☆10Jan 16, 2024Updated 2 years ago
- ☆867Dec 8, 2023Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated 10 months ago
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆133Nov 24, 2023Updated 2 years ago
- ☆23Dec 14, 2023Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Aug 27, 2023Updated 2 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 2 years ago
- Implementing the Vision Transformer paper from scratch for course project.☆12Apr 25, 2022Updated 4 years ago
- Spatial Spectral Machine Learning☆14Oct 15, 2025Updated 9 months ago
- A rewrite of Optimism's MIPS.sol thread context in Huff☆26Aug 6, 2023Updated 3 years ago
- ☆24May 5, 2024Updated 2 years ago
- ☆27Aug 25, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- batched loras☆351Sep 6, 2023Updated 2 years ago
- ☆13Mar 25, 2024Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration …☆13Apr 17, 2023Updated 3 years ago
- This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]☆22Jul 21, 2024Updated 2 years ago
- React Frontend for stable diffusion☆28Sep 23, 2022Updated 3 years ago
- Generate textbook-quality synthetic LLM pretraining data☆508Oct 19, 2023Updated 2 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 2 years ago