Alternatives and similar repositories for slowllama

Users that are interested in slowllama are comparing it to the libraries listed below

• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆363Updated 4 months ago
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆858Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆713Updated last year
• aymenfurter / microagents
  Agents Capable of Self-Editing Their Prompts / Python Code
  ☆768Updated last year
• labmlai / inspectus
  LLM Analytics
  ☆664Updated 7 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆767Updated last week
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• lxe / llavavision
  A simple "Be My Eyes" web app with a llama.cpp/llava backend
  ☆488Updated last year
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆285Updated this week
• approximatelabs / datadm
  DataDM is your private data assistant. Slide into your data's DMs
  ☆385Updated 8 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆301Updated last year
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆615Updated 2 months ago
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆1,013Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆189Updated 10 months ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆300Updated last month
• palico-ai / palico-ai
  Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework
  ☆339Updated 6 months ago
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆349Updated last year
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆682Updated 9 months ago
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆983Updated last month
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆352Updated 11 months ago
• stoyan-stoyanov / llmflows
  LLMFlows - Simple, Explicit and Transparent LLM Apps
  ☆695Updated 3 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆377Updated last year
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆567Updated last year
• npi-ai / npi
  Action library for AI Agent
  ☆214Updated 2 months ago
• KhoomeiK / LlamaGym
  Fine-tune LLM agents with online reinforcement learning
  ☆1,191Updated last year
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,043Updated last year
• bananaml / fructose
  ☆744Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 10 months ago
• simonw / llm-mlc
  LLM plugin for running models using MLC
  ☆186Updated last year