keezen/ntk_alibi external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

keezen/ntk_alibi

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/keezen/ntk_alibi)

Close

keezen / ntk_alibiView on GitHubMore

• External links
• Readme badge

NTK scaled version of ALiBi position encoding in Transformer.

☆69Aug 16, 2023Updated 2 years ago

Alternatives and similar repositories for ntk_alibi

Users that are interested in ntk_alibi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi

  View on GitHub
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Aug 27, 2023Updated 2 years ago
• genggui001 / Megatron-DeepSpeed-Llama

  View on GitHub
  ☆84Sep 9, 2023Updated 2 years ago
• NormXU / Consistent-DynamicNTKRoPE

  View on GitHub
  An Experiment on Dynamic NTK Scaling RoPE
  ☆65Nov 26, 2023Updated 2 years ago
• OpenLMLab / scaling-rope

  View on GitHub
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Oct 16, 2023Updated 2 years ago
• ssbuild / aigc_evals

  View on GitHub
  aigc evals
  ☆10Dec 2, 2023Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• Prakhar-97 / Table-detection-and-Document-layout-analysis

  View on GitHub
  ☆10Jun 22, 2020Updated 5 years ago
• yangjianxin1 / LLMPruner

  View on GitHub
  ☆310Apr 6, 2023Updated 3 years ago
• LydiaXiaohongLi / Megatron-DeepSpeed

  View on GitHub
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Jul 20, 2023Updated 2 years ago
• bugensui / WenTianSearch

  View on GitHub
  “阿里灵杰”问天引擎电商搜索算法赛 13/2771
  ☆10Jul 31, 2022Updated 3 years ago
• jquesnelle / yarn

  View on GitHub
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,727Apr 17, 2024Updated 2 years ago
• nick7nlp / Counting-Stars

  View on GitHub
  Counting-Stars (★)
  ☆83Nov 24, 2025Updated 6 months ago
• MUGE-2021 / image-retrieval-baseline

  View on GitHub
  ☆60Nov 17, 2022Updated 3 years ago
• thunlp / WebCPM

  View on GitHub
  Official codes for ACL 2023 paper "WebCPM: Interactive Web Search for Chinese Long-form Question Answering"
  ☆911Nov 25, 2023Updated 2 years ago
• limenlp / safer-instruct

  View on GitHub
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Feb 22, 2024Updated 2 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• OpenLMLab / MOSS-RLHF

  View on GitHub
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,426Mar 3, 2024Updated 2 years ago
• OpenLMLab / LongWanjuan

  View on GitHub
  Towards Systematic Measurement for Long Text Quality
  ☆38Sep 5, 2024Updated last year
• Lauorie / DFT

  View on GitHub
  Reproduced the DFT method without using Verl. https://arxiv.org/abs/2508.05629
  ☆23Oct 14, 2025Updated 8 months ago
• wangguojim / LargeScale

  View on GitHub
  ☆19May 11, 2024Updated 2 years ago
• yegcjs / mixinglaws

  View on GitHub
  ☆112Jul 15, 2025Updated 11 months ago
• OpenCoder-llm / opc_data_filtering

  View on GitHub
  Heuristic filtering framework for RefineCode
  ☆86Mar 13, 2025Updated last year
• ictnlp / NMLA-NAT

  View on GitHub
  Code for NeurIPS 2022 Spotlight paper " Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation"
  ☆20Nov 16, 2022Updated 3 years ago
• LianjiaTech / BELLE

  View on GitHub
  BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
  ☆8,272Oct 16, 2024Updated last year
• ml-inory / melotts.axera

  View on GitHub
  MeloTTS demo on Axera
  ☆13Nov 18, 2025Updated 7 months ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• stack-heap-overflow / sohu2022-nlp-rank1

  View on GitHub
  2022搜狐校园算法大赛NLP赛道第一名开源方案（实验代码）
  ☆89Jul 31, 2022Updated 3 years ago
• Miraclemarvel55 / LLaMA-MOSS-RLHF-LoRA

  View on GitHub
  用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]
  ☆21May 16, 2023Updated 3 years ago
• alibaba / Megatron-LLaMA

  View on GitHub
  Best practice for training LLaMA models in Megatron-LM
  ☆665Jan 2, 2024Updated 2 years ago
• LouChao98 / nner_as_parsing

  View on GitHub
  ☆16Mar 22, 2023Updated 3 years ago
• lucasjinreal / LLaVA-Magvit2

  View on GitHub
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆38Jun 20, 2024Updated last year
• THUDM / LongAlign

  View on GitHub
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆261Dec 16, 2024Updated last year
• deepspeedai / Megatron-DeepSpeed

  View on GitHub
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,251Aug 14, 2025Updated 10 months ago
• CarnoZhao / GAIIC-Track1

  View on GitHub
  codes for GAIIC-Track1
  ☆15Jun 14, 2022Updated 4 years ago
• DAMO-NLP-SG / CLEX

  View on GitHub
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Mar 12, 2024Updated 2 years ago
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• fla-org / fla-zoo

  View on GitHub
  Flash-Linear-Attention models beyond language
  ☆22Aug 28, 2025Updated 9 months ago
• nursery42 / WenTianSearch

  View on GitHub
  A baseline for WenTianSearch
  ☆85Mar 24, 2022Updated 4 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed

  View on GitHub
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Jul 20, 2023Updated 2 years ago
• DachengLi1 / LongChat

  View on GitHub
  Official repository for LongChat and LongEval
  ☆534May 24, 2024Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed

  View on GitHub
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,444Mar 20, 2024Updated 2 years ago
• shshlzh / TextCNN-Adversarial-Training-in-NLP

  View on GitHub
  对抗训练在NLP中的应用
  ☆14Nov 22, 2021Updated 4 years ago
• yizhilll / CIF-Bench

  View on GitHub
  ☆18Feb 29, 2024Updated 2 years ago