Alternatives and similar repositories for InternEvo

Users that are interested in InternEvo are comparing it to the libraries listed below

• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆325Updated this week
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆388Updated this week
• DeepLink-org / dlinfer
  ☆53Updated 2 weeks ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆259Updated last month
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆528Updated last month
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆459Updated 11 months ago
• THUDM / slime
  slime is a LLM post-training framework aiming for RL Scaling.
  ☆596Updated this week
• madsys-dev / deepseekv2-profile
  ☆145Updated 4 months ago
• InternLM / Agent-FLAN
  [ACL2024 Findings] Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models
  ☆350Updated last year
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆243Updated last year
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆657Updated last year
• alipay / PainlessInferenceAcceleration
  Accelerate inference without tears
  ☆319Updated 4 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆802Updated 2 weeks ago
• hahnyuan / LLM-Viewer
  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…
  ☆506Updated 10 months ago
• feifeibear / LLMSpeculativeSampling
  Fast inference from large lauguage models via speculative decoding
  ☆779Updated 10 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆475Updated 5 months ago
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 25'&24')
  ☆926Updated 6 months ago
• thunlp / InfLLM
  The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Mem…
  ☆370Updated last year
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆370Updated last week
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆67Updated 10 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆306Updated 2 months ago
• OpenPPL / ppl.llm.serving
  ☆128Updated 6 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆812Updated last month
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆341Updated 9 months ago
• microsoft / MInference
  [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…
  ☆1,067Updated 3 weeks ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆285Updated 2 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆36Updated 2 months ago
• step-law / steplaw
  ☆193Updated 3 months ago
• mindspore-lab / mindformers
  ☆169Updated this week
• open-compass / T-Eval
  [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step
  ☆280Updated last year