VectorInstitute / vector-inference
Efficient LLM inference on Slurm clusters using vLLM.
☆53Updated this week
Alternatives and similar repositories for vector-inference:
Users that are interested in vector-inference are comparing it to the libraries listed below
- LLM finetuning in resource-constrained environments.☆47Updated 9 months ago
- nanoGPT-like codebase for LLM training☆91Updated last week
- PyTorch library for Active Fine-Tuning☆62Updated last month
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆48Updated 5 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 5 months ago
- Discovering Data-driven Hypotheses in the Wild☆65Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆59Updated last month
- ☆13Updated last year
- Language models scale reliably with over-training and on downstream tasks☆96Updated 11 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆165Updated last week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆103Updated 4 months ago
- ☆121Updated last year
- ☆173Updated last year
- ☆66Updated 4 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆91Updated last month
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆62Updated this week
- ☆78Updated last week
- ☆124Updated last week
- ☆82Updated 7 months ago
- ☆38Updated 11 months ago
- AI Logging for Interpretability and Explainability🔬☆108Updated 9 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 4 months ago
- Sparse Autoencoder Training Library☆47Updated 5 months ago
- ☆32Updated 4 months ago
- ☆37Updated 11 months ago
- ☆90Updated last month
- Understand and test language model architectures on synthetic tasks.☆185Updated 3 weeks ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆140Updated 8 months ago