hpcaitech / Titans

Related projects ⓘ

Alternatives and complementary repositories for Titans

• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆76Updated last month
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆192Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆100Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆34Updated 10 months ago
• TsinghuaAI / TDS
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆26Updated 3 years ago
• hpcaitech / ColossalAI-Pytorch-lightning
  ☆23Updated 2 years ago
• MoFHeka / LLaMA-Megatron
  A LLaMA1/LLaMA12 Megatron implement.
  ☆27Updated 11 months ago
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆56Updated last month
• THUDM / ChatGLM-Math
  ☆78Updated 7 months ago
• bigcode-project / bigcode-encoder
  ☆29Updated last year
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆21Updated last month
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆61Updated 11 months ago
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆69Updated 8 months ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆44Updated 10 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆58Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆74Updated 10 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆111Updated 8 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• Glaciohound / LM-Infinite
  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆128Updated last month
• AI21Labs / Parallel-Context-Windows
  ☆103Updated last year
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆195Updated 3 months ago
• THU-KEG / ChatLog
  ⏳ ChatLog: Recording and Analysing ChatGPT Across Time
  ☆94Updated 5 months ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• zphang / transformers
  Code and models for BERT on STILTs
  ☆53Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆118Updated last year
• DRSY / EasyKV
  Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)
  ☆58Updated 9 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆94Updated last month