Alternatives and similar repositories for predictive-spy

Users that are interested in predictive-spy are comparing it to the libraries listed below

• Explosion-Scratch / apple-intelligence-prompts
  System prompts from Apple's new Apple Intelligence on MacOS Sequoia
  ☆199Updated 10 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• rounak / MLXTinyGPT
  MLX Swift implementation of Andrej Karpathy's Let's build GPT video
  ☆61Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆89Updated last year
• llmonpy / needle-in-a-needlestack
  ☆116Updated 9 months ago
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆236Updated 2 years ago
• simonw / llm-mlc
  LLM plugin for running models using MLC
  ☆191Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆174Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆450Updated last year
• simonw / openai-to-sqlite
  Save OpenAI API results to a SQLite database
  ☆235Updated last year
• jbarrow / mlx-playground
  mlx implementations of various transformers, speedups, training
  ☆33Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆138Updated last year
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆273Updated 2 years ago
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆94Updated last year
• Futrell / ziplm
  ☆254Updated 2 years ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆83Updated 9 months ago
• grantslatton / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆45Updated 2 years ago
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆192Updated last year
• okuvshynov / cubestat
  Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
  ☆26Updated 2 months ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆248Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆360Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆153Updated 2 years ago
• jasonjmcghee / portable-hnsw
  What if an HNSW index was just a file, and you could serve it from a CDN, and search it directly in the browser?
  ☆107Updated 6 months ago
• adamkdean / gpt-unicorn
  Getting GPT-4 to draw a new unicorn every day
  ☆80Updated 2 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• smpanaro / more-ane-transformers
  Run transformers (incl. LLMs) on the Apple Neural Engine.
  ☆63Updated last year