VectorInstitute / vector-inference
Efficient LLM inference on Slurm clusters using vLLM.
☆47Updated this week
Alternatives and similar repositories for vector-inference:
Users that are interested in vector-inference are comparing it to the libraries listed below
- LLM finetuning in resource-constrained environments.☆46Updated 7 months ago
- nanoGPT-like codebase for LLM training☆89Updated this week
- Open source replication of Anthropic's Crosscoders for Model Diffing☆39Updated 3 months ago
- PyTorch library for Active Fine-Tuning☆56Updated this week
- AI Logging for Interpretability and Explainability🔬☆104Updated 8 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆70Updated 3 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆65Updated 6 months ago
- ☆122Updated last week
- Steering vectors for transformer language models in Pytorch / Huggingface☆88Updated this week
- A MAD laboratory to improve AI architecture designs 🧪☆103Updated 2 months ago
- ☆86Updated last week
- ☆27Updated 3 months ago
- ☆151Updated this week
- Language models scale reliably with over-training and on downstream tasks☆96Updated 10 months ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆133Updated 6 months ago
- A library for efficient patching and automatic circuit discovery.☆53Updated this week
- ☆36Updated last year
- ☆116Updated last year
- ☆72Updated 9 months ago
- ☆52Updated this week
- LLM-Merging: Building LLMs Efficiently through Merging☆190Updated 4 months ago
- Extract full next-token probabilities via language model APIs☆229Updated 11 months ago
- Discovering Data-driven Hypotheses in the Wild☆55Updated 3 months ago
- ☆51Updated 9 months ago
- ☆205Updated 4 months ago
- ☆18Updated 2 months ago
- ☆76Updated 6 months ago
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆31Updated 6 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆95Updated 3 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 8 months ago