rickardp / bitsandbytesLinks
8-bit CUDA functions for PyTorch
☆18Updated 9 months ago
Alternatives and similar repositories for bitsandbytes
Users that are interested in bitsandbytes are comparing it to the libraries listed below
Sorting:
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- Scripts to create your own moe models using mlx☆90Updated last year
- ☆38Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- Extend the original llama.cpp repo to support redpajama model.☆118Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- ☆53Updated 2 years ago
- GPT-2 small trained on phi-like data☆67Updated last year
- Experimental LLM Inference UX to aid in creative writing☆123Updated 10 months ago
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆122Updated 11 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- Distributed Inference for mlx LLm☆97Updated last year
- ☆73Updated 2 years ago
- Examples of apps built with Nendo, the AI Audio Tool Suite☆55Updated last year
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆42Updated 3 months ago
- Port of Suno's Bark TTS transformer in Apple's MLX Framework☆84Updated last year
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆76Updated 9 months ago
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆57Updated last year
- ☆35Updated 2 years ago
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- ☆31Updated last year
- Chat to Compose Video☆195Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆178Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆106Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- Local LLaMAs/Models in VSCode☆54Updated 2 years ago
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- Fast parallel LLM inference for MLX☆220Updated last year