ggml-org / ciLinks
CI for ggml and related projects
☆32Updated this week
Alternatives and similar repositories for ci
Users that are interested in ci are comparing it to the libraries listed below
Sorting:
- Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp☆158Updated 3 months ago
- LLM-based code completion engine☆194Updated 6 months ago
- AirLLM 70B inference with single 4GB GPU☆14Updated last month
- ☆157Updated last year
- ☆129Updated 2 years ago
- Utility library to work with character cards and roleplay AI in general☆35Updated 2 years ago
- ☆82Updated 11 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆31Updated 7 months ago
- ☆66Updated last year
- Granite 3.1 Language Models☆117Updated last month
- LLM powered development for IntelliJ☆81Updated last year
- An endpoint server for efficiently serving quantized open-source LLMs for code.☆56Updated last year
- Run GGML models with Kubernetes.☆173Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆164Updated this week
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- ☆116Updated 7 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Python bindings for ggml☆143Updated 11 months ago
- Transformer GPU VRAM estimator☆66Updated last year
- ☆141Updated last year
- Run language models on consumer hardware.☆28Updated last year
- Thin wrapper around GGML to make life easier☆40Updated last month
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆162Updated last year
- Drop in replacement for OpenAI, but with Open models.☆152Updated 2 years ago
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- run embeddings in MLX☆90Updated 10 months ago
- LLM inference in C/C++☆99Updated this week
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- Command line tool for Deep Infra cloud ML inference service☆32Updated last year
- ☆50Updated last year