trzy / llava-cpp-server

Related projects: ⓘ

• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆145Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆125Updated 2 weeks ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 weeks ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆46Updated 11 months ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆138Updated last week
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆117Updated 8 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 8 months ago
• sumo43 / loopvlm
  run paligemma in real time
  ☆122Updated 4 months ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.
  ☆187Updated this week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆176Updated 6 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆97Updated 4 months ago
• teknium1 / ShareGPT-Builder
  ☆101Updated 5 months ago
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆219Updated 2 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆86Updated 6 months ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆433Updated last month
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆245Updated 7 months ago
• j-csc / mlx_bark
  Port of Suno's Bark TTS transformer in Apple's MLX Framework
  ☆62Updated 7 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆79Updated 3 weeks ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆172Updated 4 months ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆87Updated 6 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆68Updated 7 months ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆170Updated 5 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆154Updated 8 months ago
• abacaj / openhermes-function-calling
  ☆133Updated 9 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated 4 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆64Updated 3 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆157Updated this week