Alternatives and similar repositories for effort:

Users that are interested in effort are comparing it to the libraries listed below

• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆123Updated 2 weeks ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆131Updated 9 months ago
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆349Updated 11 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆269Updated 3 months ago
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆360Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆186Updated 9 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆188Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• mlecauchois / micrograd-cuda
  ☆241Updated last year
• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated 11 months ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆247Updated 3 weeks ago
• lechmazur / elimination_game
  A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…
  ☆261Updated last week
• llmonpy / needle-in-a-needlestack
  ☆112Updated 3 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆237Updated 11 months ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆294Updated last week
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆96Updated 3 weeks ago
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆283Updated this week
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆232Updated 2 years ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆212Updated 2 months ago
• gavi / mlx-whatsapp
  An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning
  ☆166Updated last year
• recmo / cria
  Tiny inference-only implementation of LLaMA
  ☆93Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 9 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆185Updated 3 months ago
• a1k0n / a1gpt
  throwaway GPT inference
  ☆139Updated 11 months ago
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆607Updated last month
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆96Updated 7 months ago
• adamkarvonen / chess_llm_interpretability
  Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …
  ☆204Updated 5 months ago