Alternatives and similar repositories for mixtral-8x7b-Inference

Users that are interested in mixtral-8x7b-Inference are comparing it to the libraries listed below

• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆105Updated 2 years ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated 2 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated 2 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated last year
• character-ai / MuKoe
  ☆55Updated last year
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated 2 years ago
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆118Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆75Updated 2 years ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 9 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆44Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆39Updated 2 years ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 3 weeks ago
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• geronimi73 / qlora-minimal
  ☆88Updated 2 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 4 months ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆46Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated 2 years ago
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆93Updated last year
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated 2 years ago
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year