openai / simple-evals
☆1,517Updated last week
Related projects: ⓘ
- [ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?☆1,766Updated 2 weeks ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,451Updated last month
- Tools for merging pretrained large language models.☆4,501Updated this week
- Training LLMs with QLoRA + FSDP☆1,382Updated last week
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,378Updated 2 months ago
- A Native-PyTorch Library for LLM Fine-tuning☆3,942Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆2,817Updated 2 weeks ago
- A unified evaluation framework for large language models☆2,375Updated last week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,396Updated this week
- The official implementation of Self-Play Fine-Tuning (SPIN)☆958Updated 4 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆955Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆5,121Updated this week
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,309Updated 5 months ago
- ☆4,006Updated 3 months ago
- High-quality datasets, tools, and concepts for LLM fine-tuning.☆1,664Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,542Updated last week
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,436Updated this week
- A native PyTorch Library for large model training☆1,544Updated this week
- A framework for prompt tuning using Intent-based Prompt Calibration☆2,038Updated this week
- ☆2,652Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆2,739Updated last week
- LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …☆727Updated last month
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆871Updated this week
- DataComp for Language Models☆1,108Updated 2 weeks ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆1,935Updated last week
- To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x com…☆4,435Updated 3 weeks ago
- Robust recipes to align language models with human and AI preferences☆4,481Updated 3 weeks ago
- ReFT: Representation Finetuning for Language Models☆1,076Updated 2 weeks ago
- ☆1,161Updated 3 weeks ago
- [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct☆1,958Updated 4 months ago