Alternatives and similar repositories for transformers-CFG:

Users that are interested in transformers-CFG are comparing it to the libraries listed below

• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆189Updated last month
• structuredllm / syncode
  Efficient and general syntactical decoding for Large Language Models
  ☆253Updated last week
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 6 months ago
• epfl-dlab / GCD
  ☆33Updated last month
• berlino / grammar-prompting
  Grammar Prompting for Domain-Specific Language Generation with Large Language Models
  ☆65Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆180Updated 3 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆101Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆241Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆127Updated 3 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆103Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆107Updated 5 months ago
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆36Updated 11 months ago
• schen149 / sub-sentence-encoder
  The official code repo for "Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations".
  ☆81Updated last year
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆128Updated 8 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 10 months ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆199Updated 4 months ago
• nyu-mll / quality
  ☆132Updated 3 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆151Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆254Updated 9 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆114Updated last week
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆153Updated last month
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated 2 weeks ago
• benlipkin / decoding
  Composable inference algorithms with LLMs and programmable logic
  ☆68Updated 4 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆104Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆126Updated 4 months ago
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆136Updated 6 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆144Updated 6 months ago