IdoAmos / not-from-scratch

Related projects ⓘ

Alternatives and complementary repositories for not-from-scratch

• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆40Updated 3 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆61Updated 6 months ago
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• berlino / seq_icl
  ☆50Updated 6 months ago
• gregorbachmann / Next-Token-Failures
  ☆69Updated 8 months ago
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• weigq / openview_quicklook
  ☆28Updated 7 months ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• jihoontack / MAC
  Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)
  ☆53Updated 3 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆48Updated 7 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆39Updated 3 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆32Updated last month
• dtunai / Griffin-Jax
  Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆12Updated 6 months ago
• formll / resolving-scaling-law-discrepancies
  ☆15Updated 4 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆54Updated last month
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆63Updated 9 months ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 2 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆55Updated 5 months ago
• Asap7772 / understanding-rlhf
  ☆24Updated 7 months ago
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• srush / mamba-primer
  ☆35Updated 7 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆34Updated last week
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆49Updated 3 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆26Updated 2 weeks ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆46Updated 5 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆14Updated 5 months ago
• HKUNLP / DiffuLLaMA
  DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆57Updated 3 weeks ago
• HazyResearch / prefix-linear-attention
  ☆45Updated 4 months ago