okuvshynov / slowllama
Finetune llama2-70b and codellama on MacBook Air without quantization
☆448Updated last year
Alternatives and similar repositories for slowllama
Users that are interested in slowllama are comparing it to the libraries listed below
Sorting:
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago
- JS tokenizer for LLaMA 1 and 2☆351Updated 10 months ago
- Agents Capable of Self-Editing Their Prompts / Python Code☆765Updated last year
- Complex LLM Workflows from Simple JSON.☆299Updated last year
- LLM Analytics☆659Updated 6 months ago
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework☆339Updated 5 months ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,013Updated 2 months ago
- Enforce structured output from LLMs 100% of the time☆249Updated 9 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆855Updated last year
- llama3.np is a pure NumPy implementation for Llama 3 model.☆981Updated 2 weeks ago
- Visualize the intermediate output of Mistral 7B☆360Updated 3 months ago
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- C++ implementation for 💫StarCoder☆454Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆711Updated last year
- OpenAI-compatible Python client that can call any LLM☆372Updated last year
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆275Updated 2 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆755Updated 2 weeks ago
- An implementation of bucketMul LLM inference☆217Updated 10 months ago
- LLM plugin for running models using MLC☆186Updated last year
- Prompt engineering for developers☆686Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆608Updated last month
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆693Updated 2 months ago
- batched loras☆342Updated last year
- 💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages.☆246Updated last year
- Build robust LLM applications with true composability 🔗☆418Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆284Updated 2 weeks ago
- A bagel, with everything.☆320Updated last year
- A fast and minimal framework for building agentic systems☆427Updated 9 months ago
- Large language model evaluation and workflow framework from Phase AI.☆458Updated 3 months ago
- Inference code for Persimmon-8B☆415Updated last year