inference code for mixtral-8x7b-32kseqlen
☆105Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for mixtral-inference
Users that are interested in mixtral-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Eh, simple and works.☆27Dec 9, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆367Dec 9, 2023Updated 2 years ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11May 8, 2024Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Jan 7, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆770Dec 15, 2023Updated 2 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆71Nov 9, 2025Updated 9 months ago
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Apr 7, 2024Updated 2 years ago
- ☆17Dec 5, 2023Updated 2 years ago
- A benchmark framework for Tensorflow 2.X☆12Apr 20, 2024Updated 2 years ago
- ☆13Sep 17, 2022Updated 3 years ago
- ☆13Dec 22, 2023Updated 2 years ago
- ☆24Oct 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Mar 15, 2024Updated 2 years ago
- Make AES-GCM safe to use with random nonces, for any practical number of messages.☆19Sep 16, 2025Updated 11 months ago
- AltugCar on 0xMonaco☆10Aug 22, 2022Updated 4 years ago
- ☆25Dec 21, 2023Updated 2 years ago
- ☆10Jan 16, 2024Updated 2 years ago
- ☆867Dec 8, 2023Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆158Aug 5, 2023Updated 3 years ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- AIME API Server - Scalable AI Model Inference API Server☆15Sep 19, 2025Updated 11 months ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated 11 months ago
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated 2 years ago
- ☆133Nov 24, 2023Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Aug 27, 2023Updated 3 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 2 years ago
- ☆16Mar 2, 2024Updated 2 years ago
- A rewrite of Optimism's MIPS.sol thread context in Huff☆26Aug 6, 2023Updated 3 years ago
- ☆24May 5, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Aug 25, 2023Updated 3 years ago
- batched loras☆352Sep 6, 2023Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration …☆13Apr 17, 2023Updated 3 years ago
- This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]☆22Jul 21, 2024Updated 2 years ago
- Generate textbook-quality synthetic LLM pretraining data☆508Oct 19, 2023Updated 2 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 3 years ago
- The repo of "Improving Seq2Seq Grammatical Error Correction via Decoding Interventions"☆32Jan 22, 2024Updated 2 years ago