Alternatives and similar repositories for Titans:

Users that are interested in Titans are comparing it to the libraries listed below

• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆63Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 2 years ago
• AI21Labs / Parallel-Context-Windows
  ☆104Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆104Updated 2 years ago
• Agora-Lab-AI / Orca
  An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"
  ☆43Updated 6 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆73Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• TsinghuaAI / TDS
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆26Updated 4 years ago
• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆28Updated last year
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• THUDM / ChatGLM-Math
  ☆81Updated last year
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated 3 weeks ago
• mrcabbage972 / simple-toolformer
  A Python implementation of Toolformer using Huggingface Transformers
  ☆15Updated 2 years ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆101Updated 3 weeks ago
• umass-ml4ed / mathGPT
  A GPT-based generative LM for combined text and math formulas, leveraging tree-based formula encoding.
  ☆35Updated last year
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆62Updated 6 months ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 7 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆45Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 6 months ago
• bigcode-project / bigcode-encoder
  ☆30Updated last year
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆74Updated 2 years ago
• Glaciohound / LM-Infinite
  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆142Updated last month
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated last week
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆152Updated 2 years ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆81Updated 10 months ago
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated last year
• RUCAIBox / BAMBOO
  ☆34Updated last year