Alternatives and similar repositories for mixtral-vis-moe

Users that are interested in mixtral-vis-moe are comparing it to the libraries listed below

• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆65Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆127Updated 2 years ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆73Updated last year
• collinear-ai / spider
  Streamline on-policy/off-policy distillation workflows in a few lines of code
  ☆87Updated this week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• character-ai / pipelining-sft
  Simple and efficient DeepSeek V3 SFT using pipeline parallel and expert parallel, with both FP8 and BF16 trainings
  ☆112Updated 5 months ago
• mungg / FABLES
  ☆59Updated last year
• arcee-ai / DAM
  ☆55Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆155Updated 7 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆114Updated 8 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆118Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 6 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆157Updated 9 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• codelion / pts
  Pivotal Token Search
  ☆142Updated 3 weeks ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 8 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆104Updated 7 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆170Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• wdlctc / mini-s
  ☆53Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated 2 months ago
• guidance-ai / jsonschemabench
  ☆71Updated 7 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago