AI-Commandos / LLaMa2langLinks
Convenience scripts to finetune (chat-)LLaMa3 and other models for any language
☆310Updated last year
Alternatives and similar repositories for LLaMa2lang
Users that are interested in LLaMa2lang are comparing it to the libraries listed below
Sorting:
- ☆205Updated last year
- A fast batching API to serve LLM models☆183Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆231Updated 7 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆186Updated 11 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- function calling-based LLM agents☆288Updated 9 months ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆327Updated last week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆573Updated 4 months ago
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆240Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated last year
- Web UI for ExLlamaV2☆502Updated 4 months ago
- A multimodal, function calling powered LLM webui.☆214Updated 9 months ago
- 🦖 X—LLM: Cutting Edge & Easy LLM Finetuning☆402Updated last year
- ☆167Updated 2 years ago
- Start a server from the MLX library.☆187Updated 11 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆154Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- A bagel, with everything.☆321Updated last year
- ☆157Updated 11 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆255Updated 3 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆162Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆714Updated last year
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…☆62Updated 11 months ago
- One click templates for inferencing Language Models☆190Updated last week
- Fast parallel LLM inference for MLX☆193Updated 11 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆382Updated last month
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- The repository for the code of the UltraFastBERT paper☆516Updated last year