Alternatives and similar repositories for mixtral-8x7b-Inference

Users that are interested in mixtral-8x7b-Inference are comparing it to the libraries listed below

• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• teknium1 / ShareGPT-Builder
  ☆114Updated 6 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated 2 years ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mzbac / qlora-inference-multi-gpu
  ☆12Updated 2 years ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• AtakanTekparmak / tiny_fnc_engine
  tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.
  ☆38Updated 9 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆66Updated 9 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 10 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆29Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• AlexBodner / How_Much_VRAM
  ☆101Updated 9 months ago
• geronimi73 / phi2-finetune
  ☆87Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• character-ai / MuKoe
  ☆54Updated last year
• AK391 / dailypapersHN
  ☆86Updated 9 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 3 months ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated last year