Alternatives and similar repositories for faster-nougat:

Users that are interested in faster-nougat are comparing it to the libraries listed below

• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆46Updated 8 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆67Updated last month
• otriscon / llm-structured-output
  ☆68Updated 2 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture …
  ☆36Updated this week
• mzbac / flux.1.app
  ☆22Updated 3 months ago
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆81Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆152Updated 6 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆82Updated last week
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆38Updated last week
• Peter-obi / Video_summarization_mlx
  Transcribe and summarize videos using whisper and llms on apple mlx framework
  ☆73Updated 11 months ago
• teknium1 / ShareGPT-Builder
  ☆107Updated 3 weeks ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆58Updated 4 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆77Updated 5 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆98Updated 3 months ago
• cognitivecomputations / kraken
  ☆65Updated 7 months ago
• mustafaaljadery / mlxcli
  Run large models from the terminal using Apple MLX.
  ☆27Updated 10 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• AlexBodner / How_Much_VRAM
  ☆96Updated 4 months ago
• mzbac / mlx-lora
  ☆38Updated 10 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆90Updated 3 months ago
• rounak / MLXTinyGPT
  MLX Swift implementation of Andrej Karpathy's Let's build GPT video
  ☆56Updated 9 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆85Updated 10 months ago
• AtakanTekparmak / tiny_fnc_engine
  tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.
  ☆38Updated 4 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆36Updated 5 months ago
• jbarrow / mlx-playground
  mlx implementations of various transformers, speedups, training
  ☆34Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆70Updated last month
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆51Updated 2 months ago