Alternatives and similar repositories for Cephalo-Phi-3-Vision-MoE

Users that are interested in Cephalo-Phi-3-Vision-MoE are comparing it to the libraries listed below

• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆44Updated 9 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 6 months ago
• samlhuillier / spider-sql-finetune
  ☆17Updated last year
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 6 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆156Updated last month
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆33Updated last month
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆56Updated last month
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 6 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated last week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 8 months ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆83Updated last year
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆93Updated 5 months ago
• LLM360 / k2-train
  ☆50Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• yynil / RWKVInside
  ☆34Updated last month
• LLM360 / k2-data-prep
  ☆20Updated last year
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆48Updated 10 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 10 months ago
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆27Updated 3 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 10 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 11 months ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆44Updated 2 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆44Updated this week
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 8 months ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• dinobby / MAgICoRE
  ☆24Updated 8 months ago