Naman-ntc / FastCode
Utilities for efficient fine-tuning, inference and evaluation of code generation models
☆21Updated last year
Alternatives and similar repositories for FastCode:
Users that are interested in FastCode are comparing it to the libraries listed below
- Using FlexAttention to compute attention with different masking patterns☆40Updated 4 months ago
- NeurIPS 2024 tutorial on LLM Inference☆38Updated last month
- CodeUltraFeedback: aligning large language models to coding preferences☆66Updated 7 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆64Updated 5 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆40Updated 7 months ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆40Updated last year
- ☆74Updated last year
- ☆22Updated 2 months ago
- Experimental paper writing linter.☆34Updated 4 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated last month
- ☆20Updated 3 months ago
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆24Updated last year
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆21Updated 5 months ago
- Commit0: Library Generation from Scratch☆123Updated this week
- The repository contains code for Adaptive Data Optimization☆20Updated last month
- Codebase for Instruction Following without Instruction Tuning☆33Updated 4 months ago
- Efficient Scaling laws and collaborative pretraining.☆13Updated this week
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆42Updated 6 months ago
- Aioli: A unified optimization framework for language model data mixing☆19Updated last week
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- ☆18Updated 8 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- List of papers on Self-Correction of LLMs.☆70Updated last month
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation