epfl-dlab / transformers-CFG

Related projects ⓘ

Alternatives and complementary repositories for transformers-CFG

• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆99Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆138Updated this week
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆79Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆200Updated 5 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆87Updated last week
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆237Updated 3 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆119Updated 2 weeks ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆77Updated 3 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆110Updated 4 months ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆174Updated last month
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆194Updated last week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆128Updated this week
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• uiuc-focal-lab / syncode
  Efficient and general syntactical decoding for Large Language Models
  ☆196Updated this week
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆156Updated 3 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆106Updated 2 weeks ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆292Updated 10 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆100Updated 3 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆104Updated last month
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆175Updated 3 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆210Updated last month
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆137Updated this week
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆68Updated this week
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆216Updated 7 months ago
• shunzh / Code-AI-Tree-Search
  ☆105Updated 3 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆142Updated last week
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆142Updated this week
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆215Updated 5 months ago