Alternatives and similar repositories for predictive-spy

Users that are interested in predictive-spy are comparing it to the libraries listed below

• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆224Updated last year
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆97Updated last year
• rounak / MLXTinyGPT
  MLX Swift implementation of Andrej Karpathy's Let's build GPT video
  ☆63Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆175Updated 2 years ago
• grantslatton / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆45Updated 2 years ago
• jbarrow / mlx-playground
  mlx implementations of various transformers, speedups, training
  ☆33Updated 2 years ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆273Updated 2 years ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• Futrell / ziplm
  ☆255Updated 2 years ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆93Updated 2 weeks ago
• llmonpy / needle-in-a-needlestack
  ☆115Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆250Updated last year
• simonw / openai-to-sqlite
  Save OpenAI API results to a SQLite database
  ☆236Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆84Updated last year
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆240Updated 2 years ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆156Updated 2 years ago
• smpanaro / more-ane-transformers
  Run transformers (incl. LLMs) on the Apple Neural Engine.
  ☆64Updated 2 years ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆450Updated last year
• 1rgs / MeGPT
  Fine-tune a large language model on your own iMessages
  ☆119Updated 2 years ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆139Updated last year
• simonw / llm-mlc
  LLM plugin for running models using MLC
  ☆191Updated last year
• jeffchuber / chroma-demo
  ☆12Updated 2 years ago
• adamkarvonen / chess_llm_interpretability
  Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …
  ☆218Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated 2 years ago
• zachlatta / openai-whisper-speaker-identification
  Python notebook to run OpenAI's Whisper model with speaker identification
  ☆80Updated 3 years ago
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆288Updated 3 weeks ago
• TristanBilot / mlx-benchmark
  Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  ☆215Updated last month
• facebookresearch / personal-timeline
  A public release of TimelineBuilder for building personal digital data timelines.
  ☆370Updated last year
• antimatter15 / AlpacaChat
  A Swift library that runs Alpaca prediction locally to implement ChatGPT like app on Apple platform devices.
  ☆94Updated 2 years ago