for-ai / AI-Alignment-Cohort
☆21Updated 4 months ago
Alternatives and similar repositories for AI-Alignment-Cohort:
Users that are interested in AI-Alignment-Cohort are comparing it to the libraries listed below
- A set of scripts and notebooks on LLM finetunning and dataset creation☆102Updated 4 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆124Updated last year
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆25Updated this week
- ☆121Updated this week
- End-to-End LLM Guide☆101Updated 7 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆81Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 8 months ago
- ☆80Updated 4 months ago
- Prune transformer layers☆67Updated 8 months ago
- 🧠 Starter templates for doing interpretability research☆65Updated last year
- ☆61Updated 2 weeks ago
- Fast bare-bones BPE for modern tokenizer training☆145Updated 3 months ago
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆32Updated 8 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆209Updated last year
- ☆40Updated 9 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆121Updated 9 months ago
- ☆64Updated 4 months ago
- A puzzle to learn about prompting☆124Updated last year
- Website☆51Updated 2 years ago
- Mechanistic Interpretability Visualizations using React☆227Updated last month
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- ☆149Updated this week
- Learn CUDA with PyTorch☆16Updated 2 weeks ago
- RuLES: a benchmark for evaluating rule-following in language models☆217Updated this week
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- Coding an LLM and its building blocks from scratch.☆16Updated 2 weeks ago
- An introduction to LLM Sampling☆75Updated 2 months ago