Alternatives and similar repositories for Titans

Users that are interested in Titans are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆188Updated 2 years ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆106Updated 2 years ago
• hpcaitech / ColossalAI-Pytorch-lightning
  ☆24Updated 2 years ago
• dropreg / efficient_alpaca
  The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca
  ☆98Updated 2 years ago
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆114Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆68Updated 2 years ago
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆339Updated 2 years ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆153Updated 2 years ago
• AI21Labs / Parallel-Context-Windows
  ☆105Updated 2 years ago
• Oneflow-Inc / one-glm
  A more efficient GLM implementation!
  ☆54Updated 2 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated 2 years ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆111Updated 7 months ago
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆75Updated 2 years ago
• MoFHeka / LLaMA-Megatron
  A LLaMA1/LLaMA12 Megatron implement.
  ☆28Updated last year
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆98Updated last year
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆76Updated last year
• Glaciohound / LM-Infinite
  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆149Updated 7 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆71Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆73Updated 2 years ago
• lxe / llama-tune
  LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
  ☆51Updated 2 years ago
• liyucheng09 / llm-compressive
  Longitudinal Evaluation of LLMs via Data Compression
  ☆33Updated last year
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆87Updated 2 years ago
• anyscale / llm-continuous-batching-benchmarks
  ☆121Updated last year
• TsinghuaAI / TDS
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆25Updated 4 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆125Updated last year