okuvshynov / slowllama

Related projects ⓘ

Alternatives and complementary repositories for slowllama

• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp
  ☆563Updated this week
• labmlai / inspectus
  LLM Analytics
  ☆615Updated last month
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆313Updated 9 months ago
• aymenfurter / microagents
  Agents Capable of Self-Editing Their Prompts / Python Code
  ☆745Updated 8 months ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆241Updated 4 months ago
• palico-ai / palico-ai
  Tech Stack for Building, Evaluating, and Deploying your LLM Application
  ☆328Updated this week
• npi-ai / npi
  Action library for AI Agent
  ☆191Updated 2 weeks ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆280Updated last year
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆984Updated 6 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆214Updated 4 months ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆342Updated 4 months ago
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆271Updated this week
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆702Updated last year
• KhoomeiK / LlamaGym
  Fine-tune LLM agents with online reinforcement learning
  ☆995Updated 8 months ago
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆289Updated 5 months ago
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆941Updated last month
• pchunduri6 / rag-demystified
  An LLM-powered advanced RAG pipeline built from scratch
  ☆798Updated 9 months ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year
• Tanuki / tanuki.py
  Prompt engineering for developers
  ☆674Updated 9 months ago
• Ads97 / WhatsApp-Llama
  Finetune a LLM to speak like you based on your WhatsApp Conversations
  ☆342Updated 6 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆149Updated 4 months ago
• stoyan-stoyanov / llmflows
  LLMFlows - Simple, Explicit and Transparent LLM Apps
  ☆668Updated 7 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆446Updated last year
• samvher / bert-for-laptops
  A BERT that you can train on a (gaming) laptop.
  ☆211Updated last year
• imelnyk / ArxivPapers
  Code behind Arxiv Papers
  ☆468Updated 7 months ago
• operand / agency
  A fast and minimal framework for building agent-integrated systems
  ☆416Updated 3 months ago
• wgryc / phasellm
  Large language model evaluation and workflow framework from Phase AI.
  ☆448Updated 4 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆210Updated last month
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆836Updated 10 months ago
• nestordemeure / question_extractor
  Generate question/answer training pairs out of raw text.
  ☆204Updated 11 months ago