trzy / llava-cpp-server

Related projects ⓘ

Alternatives and complementary repositories for llava-cpp-server

• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆46Updated last year
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆145Updated this week
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆147Updated last year
• herrera-luis / vision-core-ai
  Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.
  ☆45Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated 10 months ago
• sumo43 / loopvlm
  run paligemma in real time
  ☆122Updated 6 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆140Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆172Updated 6 months ago
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated 9 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆64Updated 5 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆232Updated 5 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆86Updated 8 months ago
• teknium1 / ShareGPT-Builder
  ☆104Updated 8 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 9 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆54Updated 7 months ago
• cognitivecomputations / OpenChatML
  ☆149Updated 4 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆122Updated 4 months ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• abacaj / openhermes-function-calling
  ☆136Updated 11 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated 11 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆159Updated 3 months ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆87Updated 9 months ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆459Updated 3 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆98Updated 11 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆149Updated 4 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• mzbac / mlx-lora
  ☆38Updated 8 months ago