Alternatives and similar repositories for batch-prompting:

Users that are interested in batch-prompting are comparing it to the libraries listed below

• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆53Updated last week
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated 10 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆77Updated 6 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆48Updated 4 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• locuslab / scaling_laws_data_filtering
  ☆64Updated 10 months ago
• allenai / bff
  ☆38Updated 10 months ago
• ScalingIntelligence / large_language_monkeys
  ☆82Updated 4 months ago
• liyucheng09 / Contamination_Detector
  Lightweight tool to identify Data Contamination in LLMs evaluation
  ☆46Updated 11 months ago
• hadasah / btm
  ☆72Updated 9 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 4 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆21Updated 5 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆59Updated 4 months ago
• anadim / the-little-retrieval-test
  ☆34Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆54Updated this week
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
  ☆100Updated 7 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆56Updated 4 months ago
• Zayne-sprague / MuSR
  ☆39Updated 6 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated 3 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆59Updated 3 months ago
• chijames / KERPLE
  ☆20Updated 2 years ago
• ScalerLab / JudgeBench
  ☆57Updated 3 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆62Updated last year