Alternatives and similar repositories for Titans:

Users that are interested in Titans are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 2 years ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆104Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆118Updated last year
• Agora-Lab-AI / Orca
  An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"
  ☆43Updated 6 months ago
• AI21Labs / Parallel-Context-Windows
  ☆106Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆77Updated last year
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆72Updated 2 years ago
• nyu-mll / ILF-for-code-generation
  ☆75Updated last month
• WENGSYX / LMTuner
  LMTuner: Make the LLM Better for Everyone
  ☆35Updated last year
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆150Updated 11 months ago
• MayDomine / Burst-Attention
  Distributed IO-aware Attention algorithm
  ☆20Updated 8 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆66Updated last month
• bigcode-project / bigcode-encoder
  ☆30Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆177Updated last year
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆103Updated last month
• Glaciohound / LM-Infinite
  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆142Updated last month
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆65Updated 5 months ago
• yegcjs / mixinglaws
  ☆98Updated 7 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• OpenBMB / DecT
  Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding
  ☆49Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 5 months ago
• shjwudp / c4-dataset-script
  Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…
  ☆124Updated last year
• dropreg / efficient_alpaca
  The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca
  ☆97Updated 2 years ago
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆29Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆82Updated last year
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆152Updated 2 years ago